expected result of running tests with anita

To: current-users%netbsd.org@localhost
Subject: expected result of running tests with anita
From: Greg Troxel <gdt%lexort.com@localhost>
Date: Tue, 17 Sep 2024 18:02:40 -0400
Before I apply the FreeBDS fix to remquo, I want to get a valid atf run
so I can check for regressions.   I see at

  https://releng.netbsd.org/b5reports/amd64/

that I can expect

  build: OK with 734050 lines of log, install: OK, tests: 10615 passed, 625 skipped, 71 expected_failure, 6 failed, ATF output: raw, xml, html

I have built current (that does try to use less memory for zfs, but is
pretty minimally different), and run a qemu/nvmm test

  anita --vmm-args="-accel nvmm" test /usr/obj/gdt-current/releasedir/amd64/

and there are 63 failures.    It seems  that perhaps anita's defauls
aren't what releng is using, but looking at releng's test I see

usr/pkg/bin/anita \
    --workdir=/bracket/work/amd64/test/2024.09.17.15.25.39/anita \
    --structured-log-file=/bracket/work/amd64/test/2024.09.17.15.25.39/test.slog \
    '--vmm-args=-accel nvmm' \
    --disk-size 1536M \
    --memory-size 192M \
    test \
    file:///bracket/work/amd64/release/2024.09.17.15.25.39/release/amd64/

and mine doesn't call with 192M but anita calls qemu that way.

qemu-system-x86_64 \
    -m 192 \
    -drive file=work-file----usr-obj-gdt-current-releasedir-amd64-+a4c19/wd0.img,format=raw,media=disk,snapshot=off \
    -nographic \
    -drive file=work-file----usr-obj-gdt-current-releasedir-amd64-+a4c19/download/amd64/installation/cdrom/boot-com.iso,format=raw,media=cdrom,readonly=on \
    -boot d \
    -drive file=work-file----usr-obj-gdt-current-releasedir-amd64-+a4c19/install_tmp.iso,format=raw,media=cdrom,readonly=on \
    -accel nvmm

My failures:

    kevent: [52.717879s] Failed: /n0/gdt/NetBSD-current/src/tests/lib/libc/gen/t_sleep.c:182: kevent: KEVNT_TIMEOUT did not cause EVFILT_TIMER event
    signal_errno: [0.075224s] Failed: atf-check failed; see the output of the test for details
    signal_errno_pic: [0.109022s] Failed: atf-check failed; see the output of the test for details
    signal_errno_pie: [0.081807s] Failed: atf-check failed; see the output of the test for details
    set_base: [3.926221s] Failed: atf-check failed; see the output of the test for details
    set_misc: [0.350088s] Failed: atf-check failed; see the output of the test for details
    set_rescue: [7.123780s] Failed: atf-check failed; see the output of the test for details
    signal_errno: [0.098782s] Failed: atf-check failed; see the output of the test for details
    signal_errno_pic: [0.147350s] Failed: atf-check failed; see the output of the test for details
    signal_errno_pie: [0.103282s] Failed: atf-check failed; see the output of the test for details
    zfs_hardlink_otheruser: [0.094741s] Failed: open: Cannot allocate memory
    zfs_hardlink_otheruser_sysctl: [0.070573s] Failed: open: Cannot allocate memory
    zfs_hardlink_rootuser: [0.070609s] Failed: open: Cannot allocate memory
    zfs_hardlink_rootuser_sysctl: [0.067915s] Failed: open: Cannot allocate memory
    zfs_hardlink_sameuser: [0.069150s] Failed: open: Cannot allocate memory
    zfs_hardlink_sameuser_sysctl: [0.070716s] Failed: open: Cannot allocate memory
    zfs_extendfile: [0.073224s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_io.c:87: fd = rump_sys_open("testfile", 0x00000200 | 0x00000002 | (seekcnt ? 0x00000008 : 0), 0600): Cannot allocate memory
    zfs_extendfile_append: [0.071783s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_io.c:87: fd = rump_sys_open("testfile", 0x00000200 | 0x00000002 | (seekcnt ? 0x00000008 : 0), 0600): Cannot allocate memory
    zfs_holywrite: [0.072020s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_io.c:57: fd = rump_sys_open("file", 0x00000002|0x00000200|0x00000400, 0666): Cannot allocate memory
    zfs_overwrite512: [0.074187s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_io.c:125: fd = rump_sys_open("testi", 0x00000200 | 0x00000002, 0666): Cannot allocate memory
    zfs_overwrite64k: [0.101737s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_io.c:125: fd = rump_sys_open("testi", 0x00000200 | 0x00000002, 0666): Cannot allocate memory
    zfs_overwrite_trunc: [0.082443s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_io.c:125: fd = rump_sys_open("testi", 0x00000200 | 0x00000002, 0666): Cannot allocate memory
    zfs_read_after_unlink: [0.086987s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_io.c:181: fd = rump_sys_open("file", 0x00000002|0x00000200, 0666): Cannot allocate memory
    zfs_read_fault: [0.074594s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_io.c:232: fd = rump_sys_open("file", 0x00000200 | 0x00000002, 0777): Cannot allocate memory
    zfs_shrinkfile: [0.074076s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_io.c:164: fd = rump_sys_open("file", 0x00000002|0x00000200|0x00000400, 0666): Cannot allocate memory
    zfs_wrrd_after_unlink: [0.072208s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_io.c:208: fd = rump_sys_open("file", 0x00000002|0x00000200, 0666): Cannot allocate memory
    zfs_renamerace: [0.096986s] Failed: create: Cannot allocate memory
    zfs_renamerace_cycle: [12.815443s] Failed: 225362 checks failed; see output for more details
    zfs_renamerace_dirs: [0.114362s] Failed: mkdir: Cannot allocate memory
    zfs_layer_read_unlinked: [0.069035s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_rwtoro.c:107: file_fd = rump_sys_open(file_path, 0x00000200 | 0x00000002, 0777): Cannot allocate memory
    zfs_layer_readopen: [0.070017s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_rwtoro.c:97: file_fd = rump_sys_open(file_path, 0x00000200 | 0x00000002, 0777): Cannot allocate memory
    zfs_layer_writeopen: [0.071598s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_rwtoro.c:118: file_fd = rump_sys_open(file_path, 0x00000200 | 0x00000002, 0777): Cannot allocate memory
    zfs_read_unlinked: [0.067959s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_rwtoro.c:107: file_fd = rump_sys_open(file_path, 0x00000200 | 0x00000002, 0777): Cannot allocate memory
    zfs_readopen: [0.070298s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_rwtoro.c:97: file_fd = rump_sys_open(file_path, 0x00000200 | 0x00000002, 0777): Cannot allocate memory
    zfs_writeopen: [0.069783s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_rwtoro.c:118: file_fd = rump_sys_open(file_path, 0x00000200 | 0x00000002, 0777): Cannot allocate memory
    zfs_dirperms: [0.066689s] Failed: mkdir: Cannot allocate memory
    zfs_flags: [0.067650s] Failed: open: Cannot allocate memory
    zfs_times: [0.066666s] Failed: open: Cannot allocate memory
    zfs_otrunc_mtime_update: [4.060513s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_mtime_otrunc.c:76: iteration 1: lock time did not increase, old time 0, new time 0
    zfs_mtime_update_on_write: [4.033291s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_mtime_write.c:77: iteration 1: lock time did not increase, old time 0, new time 0
    zfs_tfhremove: [0.067956s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_vfsops.c:133: fd = rump_sys_open("a_file", 0x00000002 | 0x00000200, 0777): Cannot allocate memory
    zfs_tfilehandle: [0.069869s] Failed: open: Cannot allocate memory
    zfs_access_simple: [0.088503s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_vnops.c:1002: fd = rump_sys_open("tfile", 0x00000200 | 0x00000002, 0777): Cannot allocate memory
    zfs_attrs: [0.072829s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_vnops.c:746: fd = rump_sys_open("afile", 0x00000002 | 0x00000200, 0755): Cannot allocate memory
    zfs_create_exist: [0.070852s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_vnops.c:615: fd = rump_sys_open(name, 0x00000002|0x00000200|0x00000800, 0666): Cannot allocate memory
    zfs_create_many: [0.073252s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_vnops.c:514: rump_sys_mkdir("subdir", 0777): Cannot allocate memory
    zfs_dir_2slash: [0.071449s] Failed: mkdir: Cannot allocate memory
    zfs_dir_3slash: [0.070249s] Failed: mkdir: Cannot allocate memory
    zfs_dir_notempty: [0.070105s] Failed: mkdir: Cannot allocate memory
    zfs_dir_rmdirdotdot: [0.073032s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_vnops.c:255: rump_sys_mkdir("test", 0777): Cannot allocate memory
    zfs_dir_simple: [0.073967s] Failed: mkdir: Cannot allocate memory
    zfs_dir_slash: [0.072172s] Failed: mkdir: Cannot allocate memory
    zfs_fcntl_getlock_pids: [0.073103s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_vnops.c:934: fd[i] = rump_sys_open("afile", oflags, omode): Cannot allocate memory
    zfs_fcntl_lock: [0.071559s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_vnops.c:804: fd = rump_sys_open("afile", 0x00000002 | 0x00000200, 0755): Cannot allocate memory
    zfs_lookup_complex: [0.071734s] Failed: mkdir: Cannot allocate memory
    zfs_lstat_symlink: [0.069308s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_vnops.c:1055: res != -1 not met
    zfs_rename_dir: [0.069835s] Failed: mkdir 1: Cannot allocate memory
    zfs_rename_dotdot: [0.069752s] Failed: mkdir 1: Cannot allocate memory
    zfs_rename_nametoolong: [0.070167s] Failed: open: Cannot allocate memory
    zfs_rename_reg_nodir: [0.078370s] Failed: create file: Cannot allocate memory
    zfs_symlink_long: [0.071038s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_vnops.c:696: Expected errno 63, got 12, in r
    zfs_symlink_root: [0.071188s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_vnops.c:734: rump_sys_symlink("/", "foo"): Cannot allocate memory
    zfs_symlink_zerolen: [0.075147s] Failed: /n0/gdt/NetBSD-current/src/tests/fs/vfs/t_vnops.c:696: Expected errno 63, got 12, in r

ignoring all zfs

    kevent: [52.717879s] Failed: /n0/gdt/NetBSD-current/src/tests/lib/libc/gen/t_sleep.c:182: kevent: KEVNT_TIMEOUT did not cause EVFILT_TIMER event
    signal_errno: [0.075224s] Failed: atf-check failed; see the output of the test for details
    signal_errno_pic: [0.109022s] Failed: atf-check failed; see the output of the test for details
    signal_errno_pie: [0.081807s] Failed: atf-check failed; see the output of the test for details
    set_base: [3.926221s] Failed: atf-check failed; see the output of the test for details
    set_misc: [0.350088s] Failed: atf-check failed; see the output of the test for details
    set_rescue: [7.123780s] Failed: atf-check failed; see the output of the test for details
    signal_errno: [0.098782s] Failed: atf-check failed; see the output of the test for details
    signal_errno_pic: [0.147350s] Failed: atf-check failed; see the output of the test for details
    signal_errno_pie: [0.103282s] Failed: atf-check failed; see the output of the test for details

which is still 10, not 6.  I think kevent and set_* are new in mine.

Is this ok and I should ignore it?  Should I have done something
different?  (If so, should it be default?)
Prev by Date: daily CVS update output
Next by Date: daily CVS update output
Previous by Thread: openssl version
Next by Thread: macos: "configure: error: gmp library too old"
Indexes:
Home | Main Index | Thread Index | Old Index