HardenedBSD/hardenedbsd a906febsys/vm vm_unix.c

HBSD: Resolve merge conflict

Signed-off-by:  Shawn Webb <shawn.webb at hardenedbsd.org>
DeltaFile
+0-5sys/vm/vm_unix.c
+0-51 files

HardenedBSD/hardenedbsd 887d9e4lib/libcasper/services/cap_sysctl cap_sysctl.c cap_sysctl.3, lib/libcasper/services/cap_sysctl/tests sysctl_test.c

Merge remote-tracking branch 'origin/freebsd/current/master' into hardened/current/master

Conflicts:
        sys/vm/vm_unix.c (unresolved)

PC-BSD/trueos 37c86c8libexec/rc/etc.init.d ldapd

- Remove ldapd is a leftover from the old trueos-master

OpenZFS on OS X/zfs d6e954dmodule/zfs zio.c

Enable raw writes to perform dedup with verification

Reviewed by: Dan Kimmel <dan.kimmel at delphix.com>
Reviewed by: Brian Behlendorf <behlendorf1 at llnl.gov>
Reviewed by: David Quigley <david.quigley at intel.com>
Signed-off-by: Tom Caputi <tcaputi at datto.com>
Issue #5078
DeltaFile
+46-24module/zfs/zio.c
+46-241 files

NetBSD/pkgsrc XvLuFKYnet/djbdnscurve6 Makefile distinfo, net/djbdnscurve6/patches patch-src_Makefile

   Switch from NaCl to libsodium for portability. Ride previous bump.

OpenZFS on OS X/zfs 2be5466module/zfs zio.c

Enable raw writes to perform dedup with verification

Reviewed by: Dan Kimmel <dan.kimmel at delphix.com>
Reviewed by: Brian Behlendorf <behlendorf1 at llnl.gov>
Reviewed by: David Quigley <david.quigley at intel.com>
Signed-off-by: Tom Caputi <tcaputi at datto.com>
Issue #5078
DeltaFile
+47-7module/zfs/zio.c
+47-71 files

FreeBSD/ports 504608head/multimedia/musikcube distinfo Makefile

multimedia/musikcube: Update 0.65.0 -> 0.65.1

LLVM/llvm 363905compiler-rt/trunk/lib/fuzzer/dataflow DataFlow.cpp, compiler-rt/trunk/test/fuzzer only-some-bytes.test OnlySomeBytesTest.cpp

[libFuzzer] ensure that DFT and autofocus works for C++ (mangled) functions

NetBSD/pkgsrc EXh1f6Fdoc CHANGES-2019

   doc: Updated net/djbdnscurve6 to 35
VersionDeltaFile
1.2611+2-1doc/CHANGES-2019
+2-11 files

NetBSD/pkgsrc RIkOxwnnet/djbdnscurve6 distinfo Makefile

   Update to 35. From the changelog:

   - fixed bug in tinydns-data with false translation of IPv6|v4 addresses
     for MX records.
   - fixed bug in dnsip abending while evaluating IPv6 addresses.
   - fixed alignment bug in dd.c for dd6 (tx vise).
   - fixed bug in dns_nd.c for IPv6; dnsfilter is working now for IPv4 and IPv6
     (tx vise).
   - dns_ip, dns_mx, dns_txt, and dns_name return now number of answers given
     (fehQlibs-12).
   - libsodium compatibility checked and verified.

FreeBSD/src 349222stable 11, stable/11/sys/vm uma_core.c

MFC r348764: Allow UMA hash tables to expand faster then 2x in 20 seconds.

ZFS ABD allocates tons of 4KB chunks via UMA, requiring huge hash tables.
With initial hash table size of only 32 elements it takes ~20 expansions
or ~400 seconds to adapt to handling 220GB ZFS ARC.  During that time not
only the hash table is highly inefficient, but also each of those expan-
sions takes significant time with the lock held, blocking operation.

On my test system with 256GB of RAM and ZFS pool of 28 HDDs this change
reduces time needed to first time read 240GB from ~300-400s, during which
system is quite busy and unresponsive, to only ~150s with light CPU load
and just 5 sub-second CPU spikes to expand the hash table.

FreeBSD/src 349221stable 12, stable/12/sys/vm uma_core.c

MFC r348764: Allow UMA hash tables to expand faster then 2x in 20 seconds.

ZFS ABD allocates tons of 4KB chunks via UMA, requiring huge hash tables.
With initial hash table size of only 32 elements it takes ~20 expansions
or ~400 seconds to adapt to handling 220GB ZFS ARC.  During that time not
only the hash table is highly inefficient, but also each of those expan-
sions takes significant time with the lock held, blocking operation.

On my test system with 256GB of RAM and ZFS pool of 28 HDDs this change
reduces time needed to first time read 240GB from ~300-400s, during which
system is quite busy and unresponsive, to only ~150s with light CPU load
and just 5 sub-second CPU spikes to expand the hash table.

FreeBSD/src 349220head/share/man/man9 sleep.9 sleepqueue.9, head/sys/kern subr_sleepqueue.c kern_synch.c

Add wakeup_any(), cheaper wakeup_one() for taskqueue(9).

wakeup_one() and underlying sleepq_signal() spend additional time trying
to be fair, waking thread with highest priority, sleeping longest time.
But in case of taskqueue there are many absolutely identical threads, and
any fairness between them is quite pointless.  It makes even worse, since
round-robin wakeups not only make previous CPU affinity in scheduler quite
useless, but also hide from user chance to see CPU bottlenecks, when
sequential workload with one request at a time looks evenly distributed
between multiple threads.

This change adds new SLEEPQ_UNFAIR flag to sleepq_signal(), making it wakeup
thread that went to sleep last, but no longer in context switch (to avoid
immediate spinning on the thread lock).  On top of that new wakeup_any()
function is added, equivalent to wakeup_one(), but setting the flag.
On top of that taskqueue(9) is switchied to wakeup_any() to wakeup its
threads.

As result, on 72-core Xeon v4 machine sequential ZFS write to 12 ZVOLs
with 16KB block size spend 34% less time in wakeup_any() and descendants
then it was spending in wakeup_one(), and total write throughput increased
by ~10% with the same as before CPU usage.

Reviewed by:    markj, mmacy
MFC after:      2 weeks

    [2 lines not shown]

NetBSD/pkgsrc Y5byAladoc CHANGES-2019

   doc: Updated net/ucspi-ssl to 0.999.10.10
VersionDeltaFile
1.2610+2-1doc/CHANGES-2019
+2-11 files

NetBSD/pkgsrc LLjcP10net/ucspi-ssl distinfo Makefile

   Update to 0.10.10. From the changelog:

   - Added DSA/DSS (+ECC) signature verification additionally to RSA.
   - Added compatibility with fehQlibs-12.
VersionDeltaFile
1.15+5-5net/ucspi-ssl/distinfo
1.31+2-2net/ucspi-ssl/Makefile
+7-72 files

NetBSD/pkgsrc ojQnpH3doc CHANGES-2019

   doc: Updated net/ucspi-tcp6 to 1.10.6
VersionDeltaFile
1.2609+2-1doc/CHANGES-2019
+2-11 files

NetBSD/pkgsrc qEvkqTGnet/ucspi-tcp6 distinfo Makefile

   Update to 1.10.6. From the changelog:

   - Added fehQlibs-12 compatibility.
VersionDeltaFile
1.12+5-5net/ucspi-tcp6/distinfo
1.12+2-2net/ucspi-tcp6/Makefile
+7-72 files

NetBSD/pkgsrc wcccjQHdoc CHANGES-2019

   doc: Updated net/fehqlibs to 0.9.12
VersionDeltaFile
1.2608+2-1doc/CHANGES-2019
+2-11 files

NetBSD/pkgsrc Pv4KttWnet/fehqlibs distinfo Makefile

   Update to 0.9.12. From the changelog:

   - dns_ip, dns_cname, dns_txt, dns_name and dns_mx
     return now the number of DNS answers received
     unlike the number of bytes for the given output.
   - Added convenience routines for forthcoming s/qmail.
   - Added ia4_fmt, ia6_fmt and dns_cname (for *qmail).
   - Changed dns_transmit lookup time constants.
VersionDeltaFile
1.3+5-5net/fehqlibs/distinfo
1.4+3-3net/fehqlibs/Makefile
+8-82 files

NetBSD/pkgsrc Hs1jEILdoc CHANGES-2019

   doc: Updated devel/skalibs to 2.8.1.0
VersionDeltaFile
1.2607+2-1doc/CHANGES-2019
+2-11 files

NetBSD/pkgsrc 9fpnruedevel/skalibs Makefile distinfo

   Update to 2.8.1.0. From the changelog:

   - Added skalibs_regcomp(), accepting empty regexes on BSDs.
   - Bugfixes.
   - Better reporting in utc_from_tai() and localtm_from_*()
   - avltreeb removed. (It used VLAs inside of structures, which is
     GNU C, not C99.) The AVLTREEN_DECLARE_AND_INIT() macro should be
     used instead.
   - New functions: env_dump(), mk?temp(), autosurf(), autosurf_name()
   - mkdir_unique() removed. (Duplicate functionality with mkdtemp.)
   - ancilautoclose and nbwaitall sysdeps removed.
   - New header: skalibs/posixishard.h
   - Static libraries are now PIC by default.

NetBSD/src gIkGCv6sys/ufs/ufs ufs_readwrite.c

   unifdef -ULFS_READWRITE ufs_readwrite.c
VersionDeltaFile
1.124+2-75sys/ufs/ufs/ufs_readwrite.c
+2-751 files

LLVM/llvm 363904llvm/trunk/lib/Target/AMDGPU SIInstrInfo.cpp, llvm/trunk/test/CodeGen/AMDGPU mubuf-legalize-operands.mir

AMDGPU: Don't clobber VCC in MUBUF addr64 emulation

Introducing VCC defs during SIFixSGPRCopies is generally
problematic. Avoid it by starting with the VOP3 form with the general
condition register. This is the easiest to fix instance, but doesn't
solve any specific problems I'm looking at.

NetBSD/src 5USl6afsys/ufs/lfs ulfs_readwrite.c lfs_vnops.c

   unifdef -DLFS_READWRITE ulfs_readwrite.c
VersionDeltaFile
1.25+2-57sys/ufs/lfs/ulfs_readwrite.c
1.324+2-4sys/ufs/lfs/lfs_vnops.c
+4-612 files

Illumos/gate e3a966fusr/src/uts/common/fs/smbclnt/netsmb smb_usr.c

11262 Memory leak in SMB client
Reviewed by: Roman Strashkin <roman.strashkin at nexenta.com>
Reviewed by: Yuri Pankov <yuri.pankov at nexenta.com>
Reviewed by: Garrett D'Amore <garrett at damore.org>
Approved by: Garrett D'Amore <garrett at damore.org>

NetBSD/src yLSzKX1usr.bin/msgc msg_sys.def msgdb.c

   Introduce _fmt_ flavors of the menu functions that take a formatting string
   so we can use fmtcheck(3) to check the formats of the messages strings.
VersionDeltaFile
1.45+81-28usr.bin/msgc/msg_sys.def
1.24+39-13usr.bin/msgc/msgdb.c
+120-412 files

NetBSD/src DdnTOLiusr.sbin/sysinst util.c, usr.sbin/sysinst/arch/i386 md.c

   Use _fmt_ msg_ methods when formats are needed.

OpenBSD/src uWI1PtQusr.bin/su su.c

   auth_approval() returns 0 on failure, so don't test for <= 0
   (error has no effect. just striving for an accurate following of contract)
   ok millert
VersionDeltaFile
1.75+2-2usr.bin/su/su.c
+2-21 files

Linux/linux 241e390. MAINTAINERS

nfsd: replace Jeff by Chuck as nfsd co-maintainer

Jeff's picking up more responsibilities elsewhere, and Chuck's agreed to
take over.

For now, as before, nothing's changing day-to-day, but I want to have a
co-maintainer if only for bus factor.

Acked-by: Jeff Layton <jlayton at redhat.com>
Signed-off-by: J. Bruce Fields <bfields at redhat.com>
Signed-off-by: Linus Torvalds <torvalds at linux-foundation.org>
DeltaFile
+1-1MAINTAINERS
+1-11 files

LLVM/llvm 363903llvm/trunk/include/llvm/Object ELFObjectFile.h, llvm/trunk/lib/Target/ARM/Disassembler ARMDisassembler.cpp

[llvm-objdump] Switch between ARM/Thumb based on mapping symbols.

The ARMDisassembler changes allow changing between ARM and Thumb mode
based on the MCSubtargetInfo, rather than the Target, which simplifies
the other changes a bit.

I'm not really happy with adding more target-specific logic to
tools/llvm-objdump/, but there isn't any easy way around it: the logic
in question specifically applies to disassembling an object file, and
that code simply isn't located in lib/Target, at least at the moment.

Differential Revision: https://reviews.llvm.org/D60927

FreeBSD/ports 504607head/comms/fldigi distinfo Makefile, head/comms/fldigi/files patch-src_soundcard_sound.cxx

Update to 4.1.04
Simplify local patch

2019-06-07  Davide Gerhard IV3CVE  <w1hkj at bellsouth.net>

        51590b10b: MacOS high-DPI
        33505fec3: timeops

2019-06-07  David Freese  <w1hkj at bellsouth.net>

        c2dbea65b: log server
        337aa4d2a: xmlrpc <vector>
        2086bd1fe: LoTW delivery
        2e0ba6d11: Apple kill button
        6d9c80e3a: main dialog title
        2ec197373: Warnings
        f63f8bc36: Contestia/Olivia
        ea39851b6: Log reports
        f7c376723: Documentation update
        8d25f53d9: 7qp multi
        867ded47b: n3fjp
        ebab17a2b: wfonly controls
        ef2d55e22: Read log debugging
        2928a9b97: New Modem Macro
        90b021222: DE QSO Party

FreeBSD/src 349219stable 12, stable/12/share/man/man3 Makefile

MFC r349148:
Add some missing MLINKs for tree(3).

LLVM/llvm 363902llvm/trunk/lib/Target/AMDGPU AMDGPUSubtarget.h SIISelLowering.cpp

AMDGPU: Consolidate some getGeneration checks

This is incomplete, and ideally these would all be removed, but it's
better to localize them to the subtarget first with comments about
what they're for.

FreeBSD/ports 504606head/biology/mothur distinfo Makefile

biology/mothur: Update 1.42.1-3 -> 1.42.2

FreeBSD/ports 504605head/emulators/rpcs3 distinfo Makefile

emulators/rpcs3: update to 0.0.6.8266

Changes:        https://github.com/RPCS3/rpcs3/compare/d52953fca...5753b3222

LLVM/llvm 363901llvm/trunk/docs/CommandGuide FileCheck.rst, llvm/trunk/include/llvm/Support FileCheck.h

[FileCheck] Stop qualifying expressions as numeric

Summary:
Stop referring to "numeric expression", using simply the term
"expression" instead. Likewise for numeric operation since operations
are only used in numeric expressions.

Reviewers: jhenderson, jdenny, probinson, arichardson

Subscribers: hiraditya, llvm-commits

Tags: #llvm

Differential Revision: https://reviews.llvm.org/D63500

LLVM/llvm 363900llvm/trunk/include/llvm/Support FileCheck.h, llvm/trunk/lib/Support FileCheck.cpp

FileCheck: Return parse error w/ Error & Expected

Summary:
Make use of Error and Expected to bubble up diagnostics and force
checking of errors in the callers.

Reviewers: jhenderson, jdenny, probinson, arichardson

Subscribers: hiraditya, llvm-commits

Tags: #llvm

Differential Revision: https://reviews.llvm.org/D63125

LLVM/llvm 363899llvm/trunk/lib/Target/AMDGPU AMDGPUISelDAGToDAG.cpp SIInstrInfo.td, llvm/trunk/test/CodeGen/AMDGPU shrink-add-sub-constant.ll sminmax.v2i16.ll

AMDGPU: Undo sub x, c canonicalization for v2i16

Should avoid regression from D62341

SmartOS/live e735268overlay/generic/etc name_to_major

OS-7026 Add DDI support for Upgradable Firmware Modules
Reviewed by: Robert Mustacchi <robert.mustacchi at joyent.com>
Approved by: Jerry Jelinek <jerry.jelinek at joyent.com>

NetBSD/src FxRIoYptools/compat configure nbtool_config.h.in

   regen tools/compat

XigmaNAS/svn 6767branches/11.2.0.4/build/ports/tftp-hpa Makefile, branches/11.2.0.4/build/ports/tftp-hpa/files tftpd.in

set proper pid name

FreeBSD/ports 504604head/www/p5-Dancer2 distinfo Makefile

- Update to 0.208000

LLVM/llvm 363898cfe/trunk/test/Analysis/exploded-graph-rewriter environment_diff.dot store_diff.dot, cfe/trunk/utils/analyzer exploded-graph-rewriter.py

[analyzer] exploded-graph-rewriter: Implement a --diff mode.

In this mode the tool would avoid duplicating the contents of the
program state on every node, replacing them with a diff-like dump
of changes that happened on that node.

This is useful because most of the time we only interested in whether
the effect of the statement was modeled correctly. A diffed graph would
also be much faster to load and navigate, being much smaller than
the original graph.

The diffs are computed "semantically" as opposed to plain text diffs.
I.e., the diff algorithm is hand-crafted separately for every state trait,
taking the underlying data structures into account. This is especially nice
for Environment because textual diffs would have been terrible.
On the other hand, it requires some boilerplate to implement.

Differential Revision: https://reviews.llvm.org/D62761

LLVM/llvm 363897cfe/trunk/lib/StaticAnalyzer/Core RegionStore.cpp, cfe/trunk/test/Analysis/exploded-graph-rewriter escapes.c lit.local.cfg

[analyzer] exploded-graph-rewriter: Fix escaping StringRegions.

Quotes around StringRegions are now escaped and unescaped correctly,
producing valid JSON.

Additionally, add a forgotten escape for Store values.

Differential Revision: https://reviews.llvm.org/D63519

LLVM/llvm 363896cfe/trunk/lib/StaticAnalyzer/Core RegionStore.cpp, cfe/trunk/test/Analysis dump_egraph.cpp expr-inspection.c

[analyzer] Fix JSON dumps for store clusters.

Include a unique pointer so that it was possible to figure out if it's
the same cluster in different program states. This allows comparing
dumps of different states against each other.

Differential Revision: https://reviews.llvm.org/D63362

LLVM/llvm 363895cfe/trunk/lib/Analysis AnalysisDeclContext.cpp, cfe/trunk/lib/StaticAnalyzer/Core Environment.cpp ExprEngine.cpp

[analyzer] Fix JSON dumps for location contexts.

Location context ID is a property of the location context, not of an item
within it. It's useful to know the id even when there are no items
in the context, eg. for the purposes of figuring out how did contents
of the Environment for the same location context changed across states.

Differential Revision: https://reviews.llvm.org/D62754

LLVM/llvm 363894cfe/trunk/lib/StaticAnalyzer/Core DynamicTypeMap.cpp, cfe/trunk/test/Analysis dump_egraph.cpp

[analyzer] Fix JSON dumps for dynamic type information.

They're now valid JSON.

Differential Revision: https://reviews.llvm.org/D62716

LLVM/llvm 363893cfe/trunk/lib/StaticAnalyzer/Checkers ChrootChecker.cpp BuiltinFunctionChecker.cpp, cfe/trunk/lib/StaticAnalyzer/Checkers/RetainCountChecker RetainCountChecker.cpp

[analyzer] NFC: Change evalCall() to provide a CallEvent.

This changes the checker callback signature to use the modern, easy to
use interface. Additionally, this unblocks future work on allowing
checkers to implement evalCall() for calls that don't correspond to any
call-expression or require additional information that's only available
as part of the CallEvent, such as C++ constructors and destructors.

Differential Revision: https://reviews.llvm.org/D62440

LLVM/llvm 363892cfe/trunk/lib/StaticAnalyzer/Checkers DeadStoresChecker.cpp, cfe/trunk/test/Analysis deadstores-driverkit.cpp os_object_base.h

[analyzer] DeadStores: Add a crude suppression files generated by DriverKit IIG.

IIG is a replacement for MIG in DriverKit: IIG is autogenerating C++ code.
Suppress dead store warnings on such code, as the tool seems to be producing
them regularly, and the users of IIG are not in position to address these
warnings, as they don't control the autogenerated code. IIG-generated code
is identified by looking at the comments at the top of the file.

Differential Revision: https://reviews.llvm.org/D63118

LLVM/llvm 363891cfe/trunk/lib/Analysis RetainSummaryManager.cpp, cfe/trunk/test/Analysis osobject-retain-release.cpp os_object_base.h

[analyzer] RetainCount: Add support for OSRequiredCast().

It's a new API for custom RTTI in Apple IOKit/DriverKit framework that is
similar to OSDynamicCast() that's already supported, but crashes instead of
returning null (and therefore causing UB when the cast fails unexpectedly).
Kind of like cast_or_null<> as opposed to dyn_cast_or_null<> in LLVM's RTTI.

Historically, RetainCountChecker was responsible for modeling OSDynamicCast.
This is simply an extension of the same functionality.

Differential Revision: https://reviews.llvm.org/D63117