FreshBSD

Update build glue for a build of clang plus the extra tools (enabled via
MK_CLANG_EXTRAS).

ping: fix unaligned access to ancillary data

Use CMSG_FIRSTHDR rather than assume that an array is correctly aligned.
Fixes warnings on sparc64 and powerpcspe.

Submitted by:   Ján Sučan <sucanjan at gmail.com>
MFH:           2 weeks
Sponsored by:   Google LLC (Google Summer of Code 2019)
Differential Revision:  https://reviews.freebsd.org/D21406

Update build glue for a build of clang plus default base tools (llvm-ar,
llvm-nm, llvm-objdump, llvm-symbolizer).

last(1): correction after r351413

Make that change no-op for C/POSIX locale just like for UTF-8
that it superset of US-ASCII.

MFC after:      2 weeks
X-MFC-With:     r351413

Add nvdimm(4) man page.

Reviewed by:    emaste
Discussed with: scottl, scottph
Sponsored by:   The FreeBSD Foundation
MFC after:      3 days
Differential revision:  https://reviews.freebsd.org/D21386

amd64: rework PCPU allocation

Move pcpu KVA out of .bss into dynamically allocated VA at
pmap_bootstrap().  This avoids demoting superpage mapping .data/.bss.
Also it makes possible to use pmap_qenter() for installation of
domain-local pcpu page on NUMA configs.

Refactor pcpu and IST initialization by moving it to helper functions.

Reviewed by:    markj
Tested by:      pho
Discussed with: jeff
Sponsored by:   The FreeBSD Foundation
Differential revision:  https://reviews.freebsd.org/D21320

Do not constrain allocations for doublefault, boot, and mce stacks.

All these stacks are used only once (doublefault, boot) or very rare
(mce).

Reviewed by:    markj
Tested by:      pho
Sponsored by:   The FreeBSD Foundation
Differential revision:  https://reviews.freebsd.org/D21320

Style.

Remove unecessary VM_ALLOC_ZERO from allocation of the domain-local
page for pcpu.

Reviewed by:    markj
Tested by:      pho
Sponsored by:   The FreeBSD Foundation
Differential revision:  https://reviews.freebsd.org/D21320

Make stack grow use the same gap as stack create.

Store stack_guard_page * PAGE_SIZE into the gap->next_read field at
the time of the stack creation.  This makes the used guard size
consistent between stack creation and stack grow time.

Suggested by:   alc
Reviewed by:    alc, markj
Sponsored by:   The FreeBSD Foundation
MFC after:      1 week
Differential revision:  https://reviews.freebsd.org/D21384

dtso: allwinner: Add an overlay for H3 thermal node

Reviewed by:    manu

MFC r351349:
Fix _pthread_cancel_enter() and _pthread_cancel_leave() jmptable entries.

PR:     240022

Fix failure test cases after r351423 due to ping6(8) options changed

Failure test cases:
    sys.netpfil.common.pass_block.pf_v6
    sys.netpfil.pf.pass_block.noalias
    sys.netpfil.pf.pass_block.v6

Sponsored by:   The FreeBSD Foundation

MFC 350551:
Don't reset memory attributes when mapping physical addresses for ACPI.

Previously, AcpiOsMemory was using pmap_mapbios which would always map
the requested address Write-Back (WB).  For several AMD Ryzen laptops,
the BIOS uses AcpiOsMemory to directly access the PCI MCFG region in
order to access PCI config registers.  This has the side effect of
remapping the MCFG region in the direct map as WB instead of UC
hanging the laptops during boot.

On the one laptop I examined in detail, the _PIC global method used to
switch from 8259A PICs to I/O APICs uses a pair of PCI config space
registers at offset 0x84 in the device at 0:0:0 to as a pair of
address/data registers to access an indirect register in the chipset
and clear a single bit to switch modes.

To fix, alter the semantics of pmap_mapbios() such that it does not
modify the attributes of any existing mappings and instead uses the
existing attributes.  If a new mapping is created, this new mapping
uses WB (the default memory attribute).

Special thanks to the gentleman whose name I don't have who brought
two affected laptops to the hacker lounge at BSDCan.  Direct access to
the affected systems permitted finding the root cause within an hour
or so.

    [2 lines not shown]

Remove the obsolete pcpu_zone_ptr zone.

It was only used by flowtable (removed in r321618).

Sponsored by:   The FreeBSD Foundation

It turns out the duplication is only mostly harmless.

While it worked with the kenrel, it wasn't working with the loader.
It failed to handle dependencies correctly. The reason for that is
that we never created a nvme module with the DRIVER_MODULE, but
instead a nvme_pci and nvme_ahci module. Create a real nvme module
that nvd can be dependent on so it can import the nvme symbols it
needs from there.

Arguably, nvd should just be a simple child of nvme, but transitioning
to that (and winning that argument given why it was done this way) is
beyond the scope of this change.

Reviewed by: jhb@
Differential Revision: https://reviews.freebsd.org/D21382

cxgbe/t4_tom: Any invalid scaling factor in the hardware's wsf field
implies that window scaling is not in use.

MFC after:      3 days
Sponsored by:   Chelsio Communications

whitespace nit.

cxgbe(4): Use the same buffer size for TOE rx queues as the NIC rx queues.

This is a minor simplification.

MFC after:      1 week
Sponsored by:   Chelsio Communications

Update build glue for a minimal build of the clang executable.

Regenerate config and version headers.

Change clang lib dir to 9.0.0.

ping: Fix alignment errors

This fixes -Wcast-align errors when compiled with WARNS=6.

Submitted by:   Ján Sučan <sucanjan at gmail.com>
MFC after:      2 weeks
Sponsored by:   Google LLC (Google Summer of Code 2019)
Differential Revision:  https://reviews.freebsd.org/D21327

MFC 339432: Do not flush cache for PCIe config window.

Apparently AMD machines cannot tolerate this. This was uncovered by
r339386, where cache flush started really flushing the requested range.

Introduce pmap_mapdev_pciecfg(), which simply does not flush cache
comparing with pmap_mapdev().  It assumes that the MCFG region was
never accessed through the cacheable mapping, which is most likely
true for machine to boot at all.

Note that i386 does not need the change, since the architecture
handles access per-page due to the KVA shortage, and page remapping
already does not flush the cache.

MFC note: 339386 has not been MFC'd to 11, but merging this change
should still be fine for 11 and reduces conflicts in MFCs of other
changes.

vfs: assert the lock held in MNT_REF/MNT_REL

Sponsored by:   The FreeBSD Foundation

Stop clearing page flags in vm_page_pqbatch_submit().

All existing callers guarantee that the page does not have a
pre-existing dequeue pending.  Thus, if the page is dequeued before
pqbatch_submit() acquires the page queue lock, we do not need to do
anything since vm_page_dequeue_complete() takes care of clearing all
page queue state flags for us.

With this change, vm_page_pqbatch_submit() has the nice property that it
does not directly modify any fields in the page structure.

Reviewed by:    alc, kib
Tested by:      pho (part of a larger change)
MFC after:      1 week
Sponsored by:   Netflix
Differential Revision:  https://reviews.freebsd.org/D21372

Make vm_pqbatch_submit_page() externally visible.

It will become useful for the page daemon to be able to directly create
a batch queue entry for a page, and without modifying the page
structure.  Rename vm_pqbatch_submit_page() to vm_page_pqbatch_submit()
to keep the namespace consistent.  No functional change intended.

Reviewed by:    alc, kib
MFC after:      1 week
Sponsored by:   Netflix
Differential Revision:  https://reviews.freebsd.org/D21369

De-commision the MNTK_NOINSMNTQ kernel mount flag.

After all the changes, its dynamic scope is same as for MNTK_UNMOUNT,
but to allow the syncer vnode to be re-installed on unmount failure.
But the case of syncer was already handled by using the VV_FORCEINSMQ
flag for quite some time.

Tested by:      pho
Sponsored by:   The FreeBSD Foundation
MFC after:      1 week

Fix universe to include arm LINT kernel configs.

Strip comments from the NOTES.armv[57] files as is done for other
NOTES files when building the corresponding LINT configs.  Without
this, the LINT configs contained the NO_UNIVERSE comment from the
NOTES.armv[57] files.

Reviewed by:    imp
MFC after:      1 week
Sponsored by:   Netflix
Differential Revision:  https://reviews.freebsd.org/D21264

MFC r331074 (cem): telnetd(8): Fix dereference of uninitialized value 'IF'

Reported by:    Coverity

MFC r351070: telnet: remove 3rd clause from Berkeley copyrights

Per the July 22, 1999 letter (in /COPYRIGHT) from
William Hoskins
Director, Office of Technology Licensing
University of California, Berkeley

MFC r351070: telnet: remove 3rd clause from Berkeley copyrights

Per the July 22, 1999 letter (in /COPYRIGHT) from
William Hoskins
Director, Office of Technology Licensing
University of California, Berkeley

Turn off -Werror for gcc 4.2.1 for userland

As discussed on arch@, gcc 4.2.1 is on its way out. Turn off Werror on gcc
versions < 5.0 permantly. This will allow older platforms to continue to compile
w/o new errors once we take them out of universe by default. This will also free
developers from chasing down obsolete warnings that produce no beneficial
changes to the source.

Discussed on: arch@
Reviewed by: jhb@, emaste@, pfg@
Differential Revision: https://reviews.freebsd.org/D21378

Turn off -Werror for gcc 4.2.1

As part of marching gcc 4.2.1 out of the tree, turn off -Werror on gcc 4.2.1
compiles by default. It generates too many false positives and breaks CI
for no benefit.

Discussed on: arch@
Reviewed by: jhb@, emaste@, pfg@
Differential Revision: https://reviews.freebsd.org/D21378

vtfontcvt: improve BDF and hex font parsing

MFC r348661: vtfontcvt: rework height/width setting

Introduce VFNT_MAXDIMENSION to replace bare 128, add set_height, and
consistently use set_height and set_width.

Submitted by:   Dmitry Wagin

MFC r348662: vtfontcvt: include width and height in verbose info

Submitted by:   Dmitry Wagin

MFC r348668: vtfontcvt: zero memory allocated by xmalloc

Submitted by:   Dmitry Wagin

MFC r348692: vtfontcvt: exit on error if the input font has too many glyphs

The kernel has a limit of 131072 glyphs in a font; add the same check to
vtfontcvt so that we won't create a font file that the kernel will not
load.

MFC r348796: vtfontcvt: allow out-of-order glyphs


    [46 lines not shown]

MFC r305815: vtfontcvt: remove superfluous newlines in errx messages

vtfontcvt: improve BDF and hex font parsing

MFC r348661: vtfontcvt: rework height/width setting

Introduce VFNT_MAXDIMENSION to replace bare 128, add set_height, and
consistently use set_height and set_width.

Submitted by:   Dmitry Wagin

MFC r348662: vtfontcvt: include width and height in verbose info

Submitted by:   Dmitry Wagin

MFC r348668: vtfontcvt: zero memory allocated by xmalloc

Submitted by:   Dmitry Wagin

MFC r348692: vtfontcvt: exit on error if the input font has too many glyphs

The kernel has a limit of 131072 glyphs in a font; add the same check to
vtfontcvt so that we won't create a font file that the kernel will not
load.

MFC r348796: vtfontcvt: allow out-of-order glyphs


    [46 lines not shown]

vtfontcvt: simplify rshift_row

We don't need to specify the buffer size in both bytes and bits.

MFC after:      1 week
Sponsored by:   The FreeBSD Foundation

ping: fix include guard symbol name to reflect the header file name

Submitted by:   Ján Sučan <sucanjan at gmail.com>
MFC after:      2 weeks
MFC-With:       351171
Sponsored by:   Google LLC (Google Summer of Code 2019)
Differential Revision:  https://reviews.freebsd.org/D21374

ping6: Rename options for better consistency with ping

Now equivalent options have the same flags, and nonequivalent options have
different flags.  This is a prelude to merging the two commands.

Submitted by:   Ján Sučan <sucanjan at gmail.com>
MFC:           Never
Sponsored by:   Google LLC (Google Summer of Code 2019)
Differential Revision:  https://reviews.freebsd.org/D21345

Report Clock Power Management support and status.

Since we already report ASPM, why not to go further.

MFC after:      2 weeks
Sponsored by:   iXsystems, Inc.

netpfil tests: Add forward test for the three firewalls

Submitted by:   Ahsan Barkati
Reviewed by:    kp
Sponsored by:   Google, Inc. (GSoC 2019)
Differential Revision:  https://reviews.freebsd.org/D21321

MFC r350974:
  Save ip_ttl value and restore it after checksum calculation.

  Since ipvoly is used for checksum calculation, part of original IP
  header is zeroed. This part includes ip_ttl field, that can be used
  later in IP_MINTTL socket option handling.

  PR:           239799

MFC r350974:
  Since ipvoly is used for checksum calculation, part of original IP
  header is zeroed. This part includes ip_ttl field, that can be used
  later in IP_MINTTL socket option handling.

  PR:          239799

Convert ng_deflate to use new zlib.

This removes the last consumer of the modified zlib originally
bundled with Paul's PPP implementation, which will be removed
in a follow up commit.

PR:                   229763
Differential Revision:  https://reviews.freebsd.org/D21186

INVARIANTS: treat LA_LOCKED as the same of LA_XLOCKED in mtx_assert.

The Linux lockdep API assumes LA_LOCKED semantic in lockdep_assert_held(),
meaning that either a shared lock or write lock is Ok.  On the other hand,
the timeout code uses lc_assert() with LA_XLOCKED, and we need both to
work.

For mutexes, because they can not be shared (this is unique among all lock
classes, and it is unlikely that we would add new lock class anytime soon),
it is easier to simply extend mtx_assert to handle LA_LOCKED there, despite
the change itself can be viewed as a slight abstraction violation.

Reviewed by:    mjg, cem, jhb
MFC after:      1 month
Differential Revision:  https://reviews.freebsd.org/D21362

lib.libc.gen.getmntinfo_test.getmntinfo_test is unstable since 8/20, skip it
in CI env temporarily for more offline diagnosis

PR:            240049
Sponsored by:   The FreeBSD Foundation

Properly update FSInfo block after generation.

After populating the filesystem, write a FSInfo block with
proper information.

Reviewed by:    emaste, cem
MFC after:      2 weeks
Differential Revision:  https://reviews.freebsd.org/D21363

Added a test scenario for "recovering from disk failures".

Sponsored by:   Dell EMC Isilon

last(1): unbreak for 8-bit locales

Ouput format of last(1) is broken for non UTF-8 locales
since it got libxo(3) support. It uses strftime(3) that produces
non UTF-8 strings passed to xo_emit(3) with wrong %s format -
it should be %hs in this case, so xo_emit(3) produces empty output.

This change is basically no-op when locale is of UTF-8 type,
f.e. en_GB.UTF-8 or ru_RU.UTF-8 or sr_RS.UTF-8 at latin.
It fixes output for other locales.

MFC after:      2 weeks