FreshBSD

Directly print the extra status instead of filling a buffer
then printing it.

This prepares the code to make it libxo friendly

Reviewed by:        manu, Nikita Kozlov (nikita elyzion.net)
MFC after:        2 weeks
Sponsored by:        Gandi.net

style fixes in bin/echo/tests

Submitted by:        shivansh
Reviewed by:        asomers
MFC after:        2 weeks
X-MFC-With:        319626
Sponsored by:        Google, Inc (GSoC 2017)
Differential Revision:        https://reviews.freebsd.org/D11318

ipfw: dummynet: Add 'G' and 'g' suffix for bandwidth configuration/display

MFC after:        2 weeks
Sponsored by:        Gandi.net

Do not use sprintf(3) when not needed, while here,
prefer snprintf(3) over sprintf(3)

jedec_ts: add support for devices manufactured by IDT

Full manufacturer name is Integrated Device Technology, Inc.
Supported devices include TSE2002B3C and TS3000B3A.

MFC after:        1 week

Fix caveat in new implementation of linprocfs_docpuinfo():
Prevent kernel panic in case that extended-cpuid isn't supported by CPU

Reviewed by:        kib, ngie, trasz
Approved by:        trasz
MFC after:        1 week
Differential Revision:        https://reviews.freebsd.org/D11294

Check the length of a COOKIE chunk before accessing fields in it.

Thanks to Felix Weinrank for reporting the issue he found by using
libFuzzer.

MFC after:        3 days

Use a longer buffer for messages in ERROR chunks.

This allows them to be sent in a non truncated way and addresses a warning
given by newver versions of gcc.
Thanks to Anselm Jonas Scholl for reporting it and providing a patch.

fix gcc-specific fallout from r320156, MFV of r318946, ZFS ABD

Reported by:        jhibbits
MFC after:        1 week
X-MFC with:        r320156

Honor the backlog field.

Improve compilation on platforms different from FreeBSD.

jedec_ts: read device id from the correct register

Due to my braino / typo the driver was reading the Vendor ID register
twice.

MFC after:        3 days

change GNU ld LINKER_TYPE from binutils to bfd

GNU binutils includes two linkers: ld.bfd and ld.gold.  For clarity use
LINKER_TYPE=bfd to refer to ld.bfd, the original binutils linker that
identifies itself as "GNU ld".

Discussed with:        bdrewery

Replace AF_INET6 ifdefs with USE_INET6 ifdefs. This is more consistent
and guaranteed to build everywhere in ipfilter.

Not all of this commit can be MFCed. Some is original code while others
are not.

Replace the leap-seconds file in r320242 from USNO -
ftp://tycho.usno.navy.mil/pub/ntp/leap-seconds.3701462400 - with a
leap-seconds file from NIST at ftp://time.nist.gov/pub/. The USNO
version of the file changes the last documented leap second update
time whereas the NIST version does not. The expiration of the USNO
version of the file is also one month short.

Requested by:        ian@
Obtained from:        ftp://time.nist.gov/pub/leap-seconds.3676924800
MFC after:        3 days

Clarify usage of aio(4) with kqueue(2)

Reviewed by:        jhb
MFC after:        3 weeks
Differential Revision:        https://reviews.freebsd.org/D11299

Fix, for the fourth or fifth time now, looking up where boot1.efi
is located.

MFC after:        5 days
X-MFC-Note:        maybe
X-MFC-With:        r320252, r320253
Sponsored by:        The FreeBSD Foundation

Remove two configuration entries used for debugging that snuck in.

MFC after:        5 days
X-MFC-Note:        maybe
X-MFC-With:        r320252
Sponsored by:        The FreeBSD Foundation

In release/release.sh:
- Rename chroot_arm_armv6_build_release() to chroot_arm_build_release()
  and make it hardware agnostic (such as armv6 -vs- armv7 -vs- arm64).

- Evaluate EMBEDDED_TARGET differently so release/tools/arm.subr can
  be used for arm/armv6 and arm64/aarch64.

- Update comments and copyright.

In release/tools/arm.subr:
- In arm_create_disk(), change the default alignment from 63 to 512k,
  fixing a boot issue on arm64 and EFI. [1]

- Update comments and copyright.

Add a RPI3 configuration file, pieces obtained from Crochet.

Obtained from:        Crochet [1]
MFC after:        5 days
X-MFC-Note:        maybe
Sponsored by:        The FreeBSD Foundation

Update stable/11 to BETA3 as part of the 11.1-RELEASE cycle.

Approved by:        re (implicit)
Sponsored by:        The FreeBSD Foundation

LINKER_VERSION: Support external binutils.

The ports binutils stores the version in the 5th word so just look for
a version using a pattern instead.

Reported by:        rpokala
MFC after:        2 weeks
Sponsored by:        Dell EMC Isilon

Pass along LINKER_* vars during installworld and show in test-system-compiler.

Sponsored by:        Dell EMC Isilon

Support cached linker values in environment.

This is similar to r289659 for bsd.compiler.mk.

MFC after:        2 weeks
Reviewed by:        emaste
Sponsored by:        Dell EMC Isilon
Differential Revision:        https://reviews.freebsd.org/D11310

Support XLD for setting X_LINKER_TYPE and X_LINKER_VERSION.

This is similar to r300350 for bsd.compiler.mk.

MFC after:        2 weeks
Reviewed by:        emaste
Sponsored by:        Dell EMC Isilon
Differential Revision:        https://reviews.freebsd.org/D11309

Add basic bsd.linker.mk auto included from bsd.compiler.mk.

This will provide LINKER_TYPE and LINKER_VERSION.

MFC after:        2 weeks
Reviewed by:        emaste
Sponsored by:        Dell EMC Isilon
Differential Revision:        https://reviews.freebsd.org/D11308

Fix spelling error.

Reported by:        arc
Sponsored by:        Dell EMC Isilon

Update leap-seconds to leap-seconds.3701462400.

As per https://datacenter.iers.org/eop/-/somos/5Rgv/latest/16:

     INTERNATIONAL EARTH ROTATION AND REFERENCE SYSTEMS SERVICE (IERS)

SERVICE INTERNATIONAL DE LA ROTATION TERRESTRE ET DES SYSTEMES DE REFERENCE

SERVICE DE LA ROTATION TERRESTRE
OBSERVATOIRE DE PARIS
61, Av. de l'Observatoire 75014 PARIS (France)
Tel.      : 33 (0) 1 40 51 23 35
FAX       : 33 (0) 1 40 51 22 91
Internet  : services.iers at obspm.fr

                                             Paris, 9 January 2017

                                             Bulletin C 53

                                             To authorities responsible
                                             for the measurement and
                                             distribution of time

                          INFORMATION ON UTC - TAI


    [18 lines not shown]

Disable CFI for unbound

unbound(8) needs CFI disabled completely
unbound-checkconf(8) works with only disabling icall

(cherry picked from commit 51206a425be8a64aff89c15f84226d37cd5b4320)
Signed-off-by: Shawn Webb <shawn.webb at hardenedbsd.org>

retire arm64 kernel module linker workaround

Relocatable linking in aarch64 ld from binutils 2.25.1 does not work.
The linker corrupts the references to the external symbols which are
defined by other object in the linking set and should therefore lose
the GOT entry.

The problem is fixed in later versions of GNU ld and does not exist in
the in-tree lld linker that we now use by default for arm64, so the
workaround can be removed.

Reviewed by:        kib
MFC after:        3 weeks
Sponsored by:        The FreeBSD Foundation
Differential Revision:        https://reviews.freebsd.org/D11302

Make structure padding explicit in EFI_MEMORY_DESCRIPTOR

The EFI memory descriptor 64-bit aligns PhysicalStart on both 32- and
64-bit platforms.  Make the padding explicit for i386 EFI.

Submitted by:        Siva Mahadevan <smahadevan at freebsdfoundation.org>
MFC after:        3 weeks
Sponsored by:        The FreeBSD Foundation
Differential Revision:        https://reviews.freebsd.org/D11301

Document r320218, primes(6) updated to new limit of 2^64-1.
Document r320164, qlnxe(4) firmware and hardware support updates.

Approved by:        re (implicit)
Sponsored by:        The FreeBSD Foundation

MFC r319975:
Some minor improvements to vnode_pager_generic_putpages().

Approved by:        re (marius)

Revert r320228 as well

See r320229 for the other related revert commit.

Revert r320222,r320223,r320224

The committed changes (reverted after this commit) break POLA on
a stable branch.

Requested by:        jhb

    MFC r318545:
    
    Install {cron.d,newsyslog.conf.d,syslog.d} via `make distribution`, not `make install`
    
    I incorrectly started this pattern in r277541 with the opensm newsyslog.conf.d file,
    and continued using it in r318441 and r318443.
    
    This will fix the files being handled improperly via installworld, preventing tools 
like
    etcupdate, mergemaster, etc from functioning properly when comparing the installed
    contents on a system vs the contents in a source tree when doing merges.
    
    PR:                219404
    MFC with:        r277541, r318441, r318443

MFC r309194,r309216:

r309194 (by bapt):

initialize *nextp which could be left uninitialized in case the configuration
file cannot be open/read

CID:                1365665

r309216 (by bapt):

Properly initialize nextp

MFC r308158:
r308158 (by bapt):

Allow symlinks to be followed in cron.d directories and fix detection of
regular files on NFS

MFC r308139,r308157,r308160,r316818,r318250,r318443:

r308139 (by bapt):

cron(8): add support for /etc/cron.d and /usr/local/etc/cron.d

For automation tools it is way easier to maintain files in directories rather
than modifying /etc/crontab.

The files in those directories are in the same format as /etc/crontab

Relnotes:        yes

r308157 (by bapt):

Fix typo in cron(8) date

r308160 (by bapt):

syslogd(8): add an 'include' keyword

All the '.conf' files not beginning with a '.' contained int he directory
following the keyword will be included.

This keyword can only be used in the first level configuration files.

    [50 lines not shown]

makefs: add copies of NetBSD makefs msdos source files

We do not treat makefs as contrib code.  Import copies of makefs msdos
files from NetBSD so that we can track our changes to these files.

These are copied from NetBSD, with only a change to use __FBSDID and
$FreeBSD$ instead of __KERNEL_RCSID and $NetBSD$.  A copy of the
original $NetBSD$ tag remains in each source file.

Submitted by:        Siva Mahadevan
Sponsored by:        The FreeBSD Foundation

ext2fs: add dir_nlink feature support.

ext4 on linux has always supported more than 32000 directories through
the dir_nlink feature, but FreeBSD was unable to catch up on this feature.
As part of the 64 bit inode changes nlink_t has been extended and this
feature is now possible.

Submitted by:        Fedor Uporov
Differential Revision:        https://reviews.freebsd.org/D11210

join(1): Fix field ordering for -v output

Per POSIX, join(1) (in modes other than -o) is a concatenation of selected
character fields.  The joined field is first, followed by fields in the
order they occurred in the input files.

Our join(1) utility previously handled this correctly for lines with a match
in the other file.  But it failed to order output fields correctly for
unmatched lines, printed in -a and -v modes.

A simple test case is:

$ touch a
$ echo "2 1" > b
$ join -v2 -2 2 a b
1 2

PR:                217711
Reported by:        alt.j2-4o4s2yon at yopmail.com
Sponsored by:        Dell EMC Isilon

Revert "Assert that the protection of a new map entry is a subset of the max"

This reverts commit 1892b8956115bef5ef6b4c0bb6f93d3fd16edc04. This does
not play well with PaX NOEXEC due to relocation entries. PaX NOEXEC
takes care of the rational behind this commit, anyways.

Signed-off-by:        Shawn Webb <shawn.webb at hardenedbsd.org>

HBSD: Resolve merge conflict

Signed-off-by:        Shawn Webb <shawn.webb at hardenedbsd.org>
Sponsored-by:        SoldierX

HBSD: Resolve merge conflict

Signed-off-by:        Shawn Webb <shawn.webb at hardenedbsd.org>
Sponsored-by:        SoldierX

HBSD: Return with proc unlocked

Signed-off-by:        Shawn Webb <shawn.webb at hardenedbsd.org>
Sponsored-by:        SoldierX
github-issue:        #265
MFC-to:                10-STABLE
MFC-to:                11-STABLE

    HBSD: Do not allow non-stack mappings between bottom-most limit of stack and the top 
of the stack
    
    The space between the bottom-most limit of the stack and the top of the
    stack should not be able to be mapped via mmap(2). This should fully
    mitigate Stack Clash in conjunction with the hardened stack guard.
    
    Signed-off-by:        Shawn Webb <shawn.webb at hardenedbsd.org>
    Sponsored-by:        SoldierX
    github-issue:        #265
    MFC-to:                10-STABLE
    MFC-to:                11-STABLE

MFC 313186, 319702: Account for overhead of page structures when sizing page array.

313186:

Over the years, the code and comments in vm_page_startup() have diverged in
one respect.  When determining how many page structures to allocate,
contrary to what the comments say, the code does not account for the
overhead of a page structure per page of physical memory.  This revision
changes the code to match the comments.

319702:

Fix an off-by-one error in the VM page array on some systems.

r313186 changed how the size of the VM page array was calculated to be
less wasteful.  For most systems, the amount of memory is divided by
the overhead required by each page (a page of data plus a struct vm_page)
to determine the maximum number of available pages.  However, if the
remainder for the first non-available page was at least a page of data
(so that the only memory missing was a struct vm_page), this last page
was left in phys_avail[] but was not allocated an entry in the VM page
array.  Handle this case by explicitly excluding the page from
phys_avail[].

Requested by:        alc

    HBSD: after the upstream fix (45e900925ca) to #266 back out the backported KPI 
breaking patches
    
        Revert "HBSD MFC: Remove unneeded Giant locking around kthreads creation."
    
        This reverts commit cee5caf9e1f6ce69e92e8e6c020c3a58b7e544fe.
    
        Revert "HBSD MFC: Removal of Giant droping wrappers for GEOM classes."
    
        This reverts commit 46670cb82b99d4e65c99304ce37d2c1f913a9757.
    
        Revert "HBSD MFC: Remove asserts that Giant is not held on entrance into geom KPI"
    
        This reverts commit f1a3816944beb846506d6a322f1dbf4e321504f9.
    
    github-issue: #266
    svn-ref: r320168 (45e900925ca)
    Signed-off-by: Oliver Pinter <oliver.pinter at hardenedbsd.org>

add -znotext to kernel module link invocation

ARM kernel modules require .text relocations (DT_TEXTREL) in shared
object ouptut, which is not allowed by default by lld.  Add the -znotext
option to enable this.  For simplicity add it unconditionally: it is
already default and thus either redundant (GNU BFD ld and gold from
ports) or ignored as an unknown option (GNU BFD ld 2.17.50 in the base
system).

Reviewed by:        kib
MFC after:        3 weeks
Sponsored by:        The FreeBSD Foundation
Differential Revision:        https://reviews.freebsd.org/D11250

Add some device IDs for Intel Denverton SoCs.