Re: FreeBSD CI Weekly Report 2020-08-30

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Re: FreeBSD CI Weekly Report 2020-08-30

Alan Somers-2
On Thu, Sep 3, 2020 at 4:06 AM Li-Wen Hsu <[hidden email]> wrote:

> (Please send the followup to freebsd-testing@ and note Reply-To is set.)
>
> FreeBSD CI Weekly Report 2020-08-30
> ===================================
>
> Here is a summary of the FreeBSD Continuous Integration results for the
> period
> from 2020-08-24 to 2020-08-30.
>
> During this period, we have:
>
> * 2429 builds (88.3% (+0.4) passed, 11.7% (-0.4) failed) of buildworld and
>   buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6,
>   armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64,
>   sparc64 architectures for head, stable/12, stable/11 branches.
> * 274 test runs (45.3% (-8.1) passed, 27.7% (-8.0) unstable, 27.0% (+16.1)
>   exception) were executed on amd64, i386, riscv64 architectures for head,
>   stable/12, stable/11 branches.
> * 24 doc and www builds (100% (0) passed)
>
> Test case status (on 2020-08-30 23:59):
> | Branch/Architecture | Total     | Pass       | Fail  | Skipped  |
> | ------------------- | --------- | ---------- | ----- | -------- |
> | head/amd64          | 7876 (+1) | 7785 (+1)  | 1 (0) | 90 (0)   |
> | head/i386           | 7873 (0)  | 7773 (-3)  | 0 (0) | 100 (+3) |
> | 12-STABLE/amd64     | 7626 (0)  | 7569 (0)   | 0 (0) | 57 (0)   |
> | 12-STABLE/i386      | 7624 (0)  | 7559 (+3)  | 0 (0) | 65 (-3)  |
> | 11-STABLE/amd64     | 6912 (0)  | 6861 (-30) | 0 (0) | 51 (+30) |
> | 11-STABLE/i386      | 6910 (0)  | 6854 (-3)  | 0 (0) | 56 (+3)  |
>
> (The statistics from experimental jobs are omitted)
>
> If any of the issues found by CI are in your area of interest or expertise
> please investigate the PRs listed below.
>
> The latest web version of this report is available at
> https://hackmd.io/@FreeBSD-CI/report-20200830 and archive is available at
> https://hackmd.io/@FreeBSD-CI/ , any help is welcomed.
>
> ## News
>
> * Numbers of FreeBSD-head-amd64-test_zfs are changed after OpenZFS
> importing,
>   we encouage everyone check and fix the failing and skipped test cases.
>
> ## Failing jobs
>
> * https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/
>   There are still mutiple errors when building with gcc6, error log
> available at
>
> https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/lastCompletedBuild/console
>   See also:
>
> https://lists.freebsd.org/pipermail/svn-src-all/2020-September/202307.html
>
> ## Failing test cases
>
> * sys.kern.kern_copyin.kern_copyin
>   Fails after somewhere in (r364509, r364542]
>   https://bugs.freebsd.org/248933
>
> * lib.libbe.be_create.* and sbin.bectl.bectl_test.*
>   https://bugs.freebsd.org/249055
>
> ## Regressions
>
> * lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on
> amd64 after r360915
>   https://bugs.freebsd.org/246537
>
> * lib.msun.ctrig_test.test_inf_inputs starts failing after llvm10 import
>   https://bugs.freebsd.org/244732
>   Needs to check if llvm11 import fixes this.
>
> * Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on
> i386
>   https://bugs.freebsd.org/244163
>   Discovered by newly endabled sys.net.* tests. ([r357857](
> https://svnweb.freebsd.org/changeset/base/357857))
>
> * sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel
>   https://bugs.freebsd.org/244168
>   Discovered by newly endabled sys.net.* tests. ([r357857](
> https://svnweb.freebsd.org/changeset/base/357857))
>   Fix committed as https://svnweb.freebsd.org/changeset/base/364220 ,
> needs more verification.
>
> * sys.kern.kern_copyin.kern_copyin
>   https://bugs.freebsd.org/248933
>
> ## Failing and Flaky tests (from experimental jobs)
>
> * https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/
>     * cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d
>         * https://bugs.freebsd.org/237641
>
> * https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
>     * Total 681 tests, 525 success, 46 failures, 110 skipped, see
>
> https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
> for more details
>


That's 35 more failures than we used to have.  What changed?  Was this
using the openzfs kmod?  It looks like test run 7392 was when the change
happened.
https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/7392/changes


>
> * https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/
>     * Total 3749 tests, 2292 success, 644 failures, 813 skipped
>
> ## Disabled Tests
>
> * sys.fs.tmpfs.mount_test.large
>   https://bugs.freebsd.org/212862
> * sys.fs.tmpfs.link_test.kqueue
>   https://bugs.freebsd.org/213662
> * sys.kqueue.libkqueue.kqueue_test.main
>   https://bugs.freebsd.org/233586
> * sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop
>   https://bugs.freebsd.org/220841
> * lib.libc.regex.exhaust_test.regcomp_too_big (i386 only)
>   https://bugs.freebsd.org/237450
> * sys.netinet.socket_afinet.socket_afinet_bind_zero
>   https://bugs.freebsd.org/238781
> * sys.netpfil.pf.names.names
> * sys.netpfil.pf.synproxy.synproxy
>   https://bugs.freebsd.org/238870
> *
> sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger
>   https://bugs.freebsd.org/239292
> *
> sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger
>
>   https://bugs.freebsd.org/239397
> * sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
>   https://bugs.freebsd.org/239399
> *
> sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
>   https://bugs.freebsd.org/239425
> * sys.sys.qmath_test.qdivq_s64q
>   https://bugs.freebsd.org/240219
> * sys.kern.ptrace_test.ptrace__getppid
>   https://bugs.freebsd.org/240510
> * lib.libc.sys.stat_test.stat_socket
>   https://bugs.freebsd.org/240621
> * lib.libarchive.functional_test.test_write_filter_zstd
>   https://bugs.freebsd.org/240683
> * lib.libcasper.services.cap_dns.dns_test.main
>   lib.libcasper.services.cap_net.net_test.*
>   https://bugs.freebsd.org/241435
> * local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386
>   https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/
> * sys.kern.ptrace_test.ptrace__procdesc_reparent_wait_child
>   https://bugs.freebsd.org/243605
> * sys.kern.ptrace_test.ptrace__parent_wait_after_attach
>   https://bugs.freebsd.org/244055
> * sys.kern.ptrace_test.ptrace__parent_exits_before_child
>   https://bugs.freebsd.org/244056
> * sys.net.if_lagg_test.witness (i386)
>   https://bugs.freebsd.org/244163
> * PipePdfork.WildcardWait in sys.capsicum.capsicum-test.main
>   https://bugs.freebsd.org/244165
> * sys.net.if_lagg_test.lacp_linkstate_destroy_stress (i386)
>   https://bugs.freebsd.org/244168
> * sys.netinet6.frag6.frag6_07.frag6_07
>   https://bugs.freebsd.org/244170
> * sys.netinet.fibs_test.udp_dontroute6
>   https://bugs.freebsd.org/244172
> * sys.netpfil.pf.nat.exhaust
>   https://bugs.freebsd.org/244703
> * sys.geom.class.gate.ggate_test.ggated (i386)
>   https://bugs.freebsd.org/244737
> * sys.kern.sysv_test.msg
>   https://bugs.freebsd.org/233649
>
> ## Issues
>
> ### Cause build fails
> * https://bugs.freebsd.org/233769
>   Possible build race: ld: error: unable to find library -lgcc_s
>
> ### Cause kernel panics
> * https://bugs.freebsd.org/238870
>   sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause
> panic
>
> ### Open
> * https://bugs.freebsd.org/237641
>   Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d
> * https://bugs.freebsd.org/237656
>   "Freed UMA keg (rtentry) was not empty (18 items). Lost 1 pages of
> memory." seen when running sys/netipsec tests
> * https://bugs.freebsd.org/238781
>   sys.netinet.socket_afinet.socket_afinet_bind_zero does not work when
> mac_portacl(4) loaded
> * https://bugs.freebsd.org/239292
>   Flakey test case:
> sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger
> * https://bugs.freebsd.org/239397
>   Flakey test case:
> sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger
> * https://bugs.freebsd.org/239399
>   Flakey test case:
> sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger
> * https://bugs.freebsd.org/239425
>   Flakey test case:
> sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger
> * https://bugs.freebsd.org/241662
>   Flakey test case: lib.libarchive.functional_test.test_fuzz_iso9660
> * https://bugs.freebsd.org/246443
>   sys.net.if_clone_test.epair_stress sometimes exceeds timeout limit but
> not caught by kyua
> * https://bugs.freebsd.org/247510
>   sys.net.if_lagg_test.status_stress panics kernel on i386
>
> ### Others
>
> * [Tickets related to testing@](https://preview.tinyurl.com/y9maauwg)
> _______________________________________________
> [hidden email] mailing list
> https://lists.freebsd.org/mailman/listinfo/freebsd-testing
> To unsubscribe, send any mail to "[hidden email]"
>
_______________________________________________
[hidden email] mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "[hidden email]"
Reply | Threaded
Open this post in threaded view
|

Re: FreeBSD CI Weekly Report 2020-08-30

Li-Wen Hsu-3
On Thu, Sep 3, 2020 at 8:57 PM Alan Somers <[hidden email]> wrote:

>
> On Thu, Sep 3, 2020 at 4:06 AM Li-Wen Hsu <[hidden email]> wrote:
>
> >
> > FreeBSD CI Weekly Report 2020-08-30
> > ===================================
> > * https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/
> >     * Total 681 tests, 525 success, 46 failures, 110 skipped, see
> >
> > https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/
> > for more details
> >
> That's 35 more failures than we used to have.  What changed?  Was this
> using the openzfs kmod?  It looks like test run 7392 was when the change
> happened.
> https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/7392/changes

Yes as described in the news section, the statistics are from the
build after openzfs importing.

Best,
Li-Wen
_______________________________________________
[hidden email] mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "[hidden email]"