Re: Strange test failures

[Andreas Gustafsson <gson%gson.org@localhost>]

Jukka Ruohonen wrote:
> On Sun, Apr 17, 2011 at 07:47:45PM +0000, David Holland wrote:
> > I am seeing that too. Furthermore, since so many tests are timing out
> > and many of them have long timeouts, I'm only getting through 96 tests
> > before anita's overall timeout fires.
> 
> Is it still possible to "single-step" the commits to find the faulty one,
> like was done with the previous regression?

No, because the faulty commit was made during an interval when for
most of the time, the system didn't even build, and when it did, the
tests paniced the kernel before getting to the tests that are now
failing.

I'm currently seeing 19 test failures on i386.  Looking at the first
failing test, "get_nfs_be_1_both", I see that it it succeeded up to
and including 2011.04.12.08.39.26, and has failed from
2011.04.13.12.40.54 onwards:

  2011.04.12.08.39.26    get_nfs_be_1_both: Passed.
  2011.04.13.12.40.54    get_nfs_be_1_both: Failed: Test case timed out after 
60 seconds

Therefore, it must have been broken by one of the following commits:

  2011.04.12.08.40.34 jruoho src/lib/libc/time/strptime.3 1.29
  2011.04.12.08.42.12 mrg src/sys/ddb/db_lwp.c 1.7
  2011.04.12.08.42.12 mrg src/sys/ddb/db_print.c 1.28
  2011.04.12.13.46.38 jruoho src/lib/libc/time/ctime.3 1.40
  2011.04.12.13.48.29 jruoho src/share/man/man3/tm.3 1.3
  2011.04.12.14.07.35 tsutsui src/sys/arch/x68k/stand/boot/Makefile 1.20
  2011.04.12.14.07.35 tsutsui src/sys/arch/x68k/stand/boot/srt0.S 1.2
  2011.04.12.14.07.35 tsutsui src/sys/arch/x68k/stand/libsa/consio.c 1.8
  2011.04.12.14.07.35 tsutsui src/sys/arch/x68k/stand/libsa/Makefile.inc 1.1
  2011.04.12.14.07.35 tsutsui src/sys/arch/x68k/stand/libsa/Makefile 1.26
  2011.04.12.16.19.44 matt src/common/lib/libc/gen/rb.c 1.10
  2011.04.12.16.40.04 matt src/libexec/ld.elf_so/arch/arm/mdreloc.c 1.36
  2011.04.12.17.07.52 matt src/etc/mtree/NetBSD.dist.tests 1.38
  2011.04.12.17.10.51 matt src/distrib/sets/lists/tests/mi 1.309
  2011.04.12.17.46.38 nakayama src/sys/ddb/db_proc.c 1.5
  2011.04.12.18.07.57 matt src/sys/arch/vax/vax/intvec.S 1.20
  2011.04.12.18.09.11 ahoka src/sys/arch/evbarm/conf/BEAGLEBOARD 1.19
  2011.04.12.18.10.15 ahoka src/sys/arch/arm/omap/omapfb.c 1.2
  2011.04.12.18.24.28 matt src/sys/arch/vax/include/mcontext.h 1.6
  2011.04.12.18.39.38 matt src/sys/arch/mips/mips/pmap_tlb.c 1.5
  2011.04.12.18.53.23 matt src/sys/arch/mips/mips/pmap_tlb.c 1.6
  2011.04.12.19.49.48 christos src/lib/librumphijack/hijack.c 1.87
  2011.04.12.19.52.04 christos src/lib/libpthread/pthread_cancelstub.c 1.32
  2011.04.12.20.37.25 rmind src/sys/kern/uipc_sem.c 1.31
  2011.04.12.22.50.33 matt src/sys/arch/mips/mips/locore_mips3.S 1.99
  2011.04.12.22.54.31 matt src/sys/arch/mips/include/locore.h 1.87
  2011.04.13.03.22.49 mrg src/sys/arch/sparc64/include/db_machdep.h 1.29
  2011.04.13.03.24.28 mrg src/distrib/sets/lists/comp/md.sparc64 1.91
  2011.04.13.03.24.28 mrg src/sys/arch/sparc64/include/intr.h 1.30
  2011.04.13.03.24.28 mrg src/sys/arch/sparc64/include/Makefile 1.26
  2011.04.13.03.25.35 mrg src/sys/arch/sparc64/sparc64/db_disasm.c 1.16
  2011.04.13.03.29.03 mrg src/sys/arch/sparc64/sparc64/db_interface.c 1.127
  2011.04.13.03.29.03 mrg src/sys/arch/sparc64/sparc64/db_trace.c 1.45
  2011.04.13.03.32.28 mrg src/sys/arch/sparc64/sparc64/db_trace.c 1.46
  2011.04.13.03.34.37 mrg src/sys/arch/sparc64/sparc64/db_interface.c 1.128
  2011.04.13.03.35.19 mrg src/sys/arch/sparc64/include/cpu.h 1.95
  2011.04.13.03.40.00 mrg src/sys/arch/sparc64/include/cpu.h 1.96
  2011.04.13.04.57.10 jruoho src/lib/libm/man/copysign.3 1.1
  2011.04.13.04.57.10 jruoho src/lib/libm/man/ieee.3 1.24
  2011.04.13.04.57.10 jruoho src/lib/libm/man/remainder.3 1.1
  2011.04.13.04.57.11 jruoho src/lib/libm/Makefile 1.106
  2011.04.13.06.29.30 mrg src/sys/arch/x86/include/cpu.h 1.32
  2011.04.13.06.35.48 jruoho src/lib/libc/stdlib/Attic/imaxabs.3 1.3
  2011.04.13.06.41.11 jruoho src/lib/libc/stdlib/Attic/imaxabs.3 1.4
  2011.04.13.06.56.50 jruoho src/lib/libc/stdlib/abs.3 1.14
  2011.04.13.06.56.50 jruoho src/lib/libc/stdlib/Attic/imaxabs.3 1.5
  2011.04.13.06.56.50 jruoho src/lib/libc/stdlib/Attic/labs.3 1.12
  2011.04.13.06.56.50 jruoho src/lib/libc/stdlib/Attic/llabs.3 1.8
  2011.04.13.06.56.50 jruoho src/lib/libc/stdlib/Makefile.inc 1.76
  2011.04.13.07.12.52 jruoho src/lib/libc/stdlib/Attic/imaxdiv.3 1.2
  2011.04.13.07.12.52 jruoho src/lib/libc/stdlib/Attic/ldiv.3 1.14
  2011.04.13.07.12.52 jruoho src/lib/libc/stdlib/Attic/lldiv.3 1.8
  2011.04.13.07.12.52 jruoho src/lib/libc/stdlib/div.3 1.13
  2011.04.13.07.12.52 jruoho src/lib/libc/stdlib/Makefile.inc 1.77
  2011.04.13.08.45.00 mrg src/sys/sys/proc.h 1.303
  2011.04.13.09.46.38 he src/tests/lib/libcurses/slave/Makefile 1.2
  2011.04.13.11.10.49 he src/sys/arch/x68k/stand/loadbsd/Makefile 1.13
  2011.04.13.12.40.54 he src/lib/librumphijack/hijack.c 1.88

-- 
Andreas Gustafsson, gson%gson.org@localhost