FreshBSD

MFC r248830, r250027, r250409

Submitted by:        gibbs, andre, kib
Obtained from:        Netflix

MFC r250327

Add a sysctl vfs.read_min to complement the exiting vfs.read_max.  It
defaults to 1, meaning that it's off.

When read-ahead is enabled on a file, the vfs cluster code deliberately
breaks a read into 2 I/O transactions; one to satisfy the actual read,
and one to perform read-ahead.  This makes sense in low-latency
circumstances, but often produces unbalanced i/o transactions that
penalize disks.  By setting vfs.read_min, we can tell the algorithm to
fetch a larger transaction that what we asked for, achieving the same
effect as the read-ahead but without the doubled, unbalanced transaction
and the slightly lower latency.  This significantly helps our workloads
with video streaming.

Submitted by:   emax
Reviewed by:    kib
Obtained from:  Netflix

MFH revisions 242743 to 243202:

Make parameters to -c and -k options optional.  If no parameters are
supplied, print information for all keywords.

Improve output of -c option, in particular in conjunction with -k
option.

Complete man page.

Add comment on standards conformity.

Fix a copy-and-paste typo.

Regenerate with manual fixup for WITH_LDNS_UTILS inheriting WITHOUT_BIND_UTILS.

Properly spell sentinel (missed in 250891)
No functional changes.

Spotted by:  Navdeep Parhar and Alexey Dokuchaev
MFC after:   2 weeks

Fix NULL-dereference kernel panic in case of mps_attach() failure.

MFC after:        1 week

Implement beacon event debugging in athalq.

Add missing buffer releases (brelse) after bread calls that return
an error. One could argue that returning a buffer even when it is
not valid is incorrect, but bread has always returned a buffer
valid or not.

Reviewed by: kib
MFC after:   2 weeks

Add missing 28th element to softdep types name array.

Found by:    Coverity Scan, CID 1007621
Reviewed by: kib
MFC after:   2 weeks

Null a pointer after it is freed so that when it is returned
the return value is NULL. Based on the returned flags, the
return value should never be inspected in the case where NULL
is returned, but it is good coding practice not to return a
pointer to freed memory.

Found by:    Coverity Scan, CID 1006096
Reviewed by: kib
MFC after:   2 weeks

MFC r250374:

According to the documentation, on Linux, cancel_delayed_work() does not
do drain (flush_workqueue() in Linux terms) but instead returns true if
the work was removed before it is run, or false otherwise.

Simulate this by removing the taskqueue_drain() and return the value
derived from taskqueue_cancel()'s return value.

This would solve a witness warning caused by calling taskqueue_drain()
with a non-sleepable lock held, like:

taskqueue_drain with the following non-sleepable locks held:
exclusive rw lle (lle) r = 0 (0xfffffe001450b410) locked @
/usr/src/sys/netinet/in.c:1484
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff848d4f7690
kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff848d4f7740
witness_warn() at witness_warn+0x4a8/frame 0xffffff848d4f7800
taskqueue_drain() at taskqueue_drain+0x3a/frame 0xffffff848d4f7840
set_timeout() at set_timeout+0x4a/frame 0xffffff848d4f7860
netevent_callback() at netevent_callback+0x16/frame 0xffffff848d4f7870
arpintr() at arpintr+0x9b5/frame 0xffffff848d4f7930

This do not affect kernel without OFED compiled in.

    [2 lines not shown]

Remove a bogus check for a NULL buffer pointer.
Add a KASSERT that it is not NULL.

Found by:    Coverity Scan, CID 1009114
Reviewed by: kib
MFC after:   2 weeks

Properly spell sentinel (not sintenel or sentinal).
No functional changes.

Spotted by:  kib
MFC after:   2 weeks

passing fd over unix socket: fix a corner case where caller
wants to pass no descriptors.

Previously the kernel would leak memory and try to free a potentially
arbitrary pointer.

Reviewed by:        pjd

Add proper prerequisites for even two more headers.

Spotted by:   http://hacks.owlfolio.org/header-survey/

Update manpages for r250887.

Remove the lists of unneeded header files.

Requested by:        eadler

Allow certain headers to be included more easily.

Spotted by:        http://hacks.owlfolio.org/header-survey/

vm_object locking is not needed there as pages are already wired.

Sponsored by:        EMC / Isilon storage division
Submitted by:        alc

o Relax locking assertions for vm_page_find_least()
o Relax locking assertions for pmap_enter_object() and add them also
  to architectures that currently don't have any
o Introduce VM_OBJECT_LOCK_DOWNGRADE() which is basically a downgrade
  operation on the per-object rwlock
o Use all the mechanisms above to make vm_map_pmap_enter() to work
  mostl of the times only with readlocks.

Sponsored by:        EMC / Isilon storage division
Reviewed by:        alc

Add <uchar.h>.

The <uchar.h> header, part of C11, adds a small number of utility
functions for 16/32-bit "universal" characters, which may or may not be
UTF-16/32. As our wchar_t is already ISO 10646, simply add light-weight
wrappers around wcrtomb() and mbrtowc().

While there, also add (non-yet-standard) _l functions, similar to the
ones we already have for the other locale-dependent functions.

Reviewed by:        theraven

Avoid signed overflow in error handling code.

Reviewed by:        cperciva, bjk

Connect flex 2.5.37 to the build and bump __FreeBSD_version.

MFC 238450,250152-250153,250415:
- Add support for the XSAVEOPT instruction use.
- The check to ensure that xstate_bv always has XFEATURE_ENABLED_X87 and
  XFEATURE_ENABLED_SSE bits set is not needed.  CPU correctly handles
  any bitmask which is subset of the enabled bits in %XCR0.
- Partially saved extended state must be handled always, i.e. for both
  fpu-owned context, and for pcb-saved one.
- Correct the type for the literal used on the left side of the shift up
  to 63 bit positions.

  Do not fill the save area and do not set the saved bit in the xstate
  bit vector for the state which is not marked as enabled in xsave_mask.

Enable GNU m4 compatibility mode.

Allow YY_NO_UNPUT to disable unput() for backward compatibility.

Define yy_current_buffer for backward compatibility.

Do not use log10(3) to get rid of libm dependency.  It is really not useful.

Reduce compiler warnings.

Apply still relevant local changes.

r124183:        Work around a `label defined but not used' warning.
r179549:        De-register declarations.
r179657:        De-register declarations in non-dot-c files.
r181269:        Mark yy_fatal_error() as __dead2.
r228992:        Spelling fixes.
r240518:        Correct double "the the".

Add flex 2.5.37 from flex.sourceforge.net to contrib.

MFC r249687, r249704, r250511:

r249687, r249704:

Sync gcore(1) with the recent changes in kernel code aimed at adding
procstat notes to a process core file.

Suggested by:        jhb

r250511 (antoine):

Add some missing DPADD.

MFC r249668, r249669, r249671, r249673, r249675, r249678, r249680, r249683,
    r249685, r249686:

r249668:

Use procstat_getprocs(3) for retrieving thread information instead of
direct sysctl calls.

r249669:

Use more generic procstat_getvmmap(3) for retrieving VM layout of a process.

r249671:

Use procstat_getgroups(3) for retrieving groups information instead of
direct sysctl.

r249673:

Use procstat_getumask(3) for retrieving umaks information instead of
direct sysctl.

r249675:

Use procstat_getrlimit(3) for retrieving rlimit information instead of

    [43 lines not shown]

MFC r249666, r249667, r249670, r249672, r249674, r249676, r249677, r249679,
    r249681, r249684, r249688, r249711, r249731, r250146

r249666, r249682:

Make libprocstat(3) extract procstat notes from a process core file.

PR:                kern/173723
Suggested by:        jhb
Glanced by:        kib

r249667:

Add procstat_getvmmap function to get VM layout of a process.

r249670:

Add procstat_getgroups function to retrieve process groups.

r249672:

Add procstat_getumask function to retrieve a process umask.

r249674:


    [42 lines not shown]

Remove an extra semicolon from the DOT language output.

PR:                kern/178540
Submitted by:        Trond Endrestol
MFC after:        1 week

Mention the switch to bmake by default.

Reviewed by:        obrien

Implement a separate hardware queue threshold for aggregate and non-aggr
traffic.

When transmitting non-aggregate traffic, we need to keep the hardware
busy whilst transmitting or small bursts in txdone/tx latency will
kill us.

This restores non-aggregate iperf performance, especially when doing
TDMA.

Tested:

* AR5416<->AR5416, TDMA
* AR5416 STA <-> AR9280 AP

Enable the use of TDMA on an 802.11n channel (with aggregation disabled,
of course.)

There's a few things that needed to happen:

* In case someone decides to set the beacon transmission rate to be
  at an MCS rate, use the MCS-aware version of the duration calculation
  to figure out how long the received beacon frame was.

* If TxOP enforcing is available on the hardware and we're doing TDMA,
  enable it after a reset and set the TDMA guard interval to zero.
  This seems to behave fine.

TODO:

* Although I haven't yet seen packet loss, the PHY errors that would be
  triggered (specifically Transmit-Override-Receive) aren't enabled
  by the 11n HAL.  I'll have to do some work to enable these PHY errors
  for debugging.

What broke:

* My recent changes to the TX queue handling has resulted in the driver
  not keeping the hardware queue properly filled when doing non-aggregate
  traffic.  I have a patch to commit soon which fixes this situation

    [10 lines not shown]

Fix the PowerPC Book-E register definitions used by the remote GDB
protocol.

Obtained from:        Juniper Networks, Inc.

Add a makefle that recurses into the right architecture-specific
sub-directory. This to allow simpler logic outside of the csu
directory.

Obtained from:        Juniper Networks, Inc.

Don't look for headers outside of the source or object directories. In
particular, don't use DESTDIR. Such creates an unnecessary dependency
on the build machine.

Obtained from:  Juniper Networks, Inc.

Don't look for headers outside of the source or object directories. In
particular, don't use DESTDIR. Such creates an unnecessary dependency
on the build machine.

Obtained from:        Juniper Networks, Inc.

Restore the ability to build on systems with 32-bit compat when
the system compiler is not clang.  clang and gcc appear to differ
signficantly in their interpretation of -isystem and --sysroot.  Further
work is likely required to support an external gcc.

Reported by:        andreast, fidaj at ukr.net, sergey.dyatko at gmail.com

Fix build break - the SetCapability calls return HAL_BOOL,
not HAL_STATUS.

Regenerate.

Fix the wait6(2) on 32bit architectures and for the compat32, by using
the right type for the argument in syscalls.master.  Also fix the
posix_fallocate(2) and posix_fadvise(2) compat32 syscalls on the
architectures which require padding of the 64bit argument.

Noted and reviewed by:        jhb
Pointy hat to:        kib
MFC after:        1 week

Do not leak the NULLV_NOUNLOCK flag from the nullfs_unlink_lowervp(),
for the case when the nullfs vnode is not reclaimed.  Otherwise, later
reclamation would not unlock the lower vnode.

Reported by:        antoine
Tested by:        pho
Sponsored by:        The FreeBSD Foundation
MFC after:        1 week

Fix the hardware watchpoints on SMP amd64.  Load the updated %dr
registers also on other CPUs, besides the CPU which happens to execute
the ddb.  The debugging registers are stored in the pcpu area,
together with the command which is executed by the IPI stop handler
upon resume.

Reviewed by:        jhb
Sponsored by:        The FreeBSD Foundation
MFC after:        1 week

Add amd64-specific ddb command 'show phys2dmap', which calculates the
address in the direct map corresponding to the given physical address.

Reviewed by:        jhb
Sponsored by:        The FreeBSD Foundation
MFC after:        1 week

Add ddb command 'show pginfo' which provides useful information about
a vm page, denoted either by an address of the struct vm_page, or, if
the '/p' modifier is specified, by a physical address of the
corresponding frame.

Reviewed by:        jhb
Sponsored by:        The FreeBSD Foundation
MFC after:        1 week