Re: misc/59155 (bin/sh/t_input:nul_elimination, possibly other sh tests, require root for silly reasons)

To: gnats-bugs%netbsd.org@localhost
Subject: Re: misc/59155 (bin/sh/t_input:nul_elimination, possibly other sh tests, require root for silly reasons)
From: Jason Thorpe <thorpej%me.com@localhost>
Date: Sun, 9 Mar 2025 15:06:57 -0700

> On Mar 9, 2025, at 2:20 PM, Robert Elz via gnats <gnats-admin%NetBSD.org@localhost> wrote:
> 
> Jason, can you demonstrate how you ran the test, along with
> permissions, owners, etc, on any directories you consider
> relevant.

I did a baseline run of the full test suite on a fresh NetBSD 10.1 install on an AlphaStation 200.  I ran it by logging in as user “thorpej” and doing:

$ cd /usr/tests
$ atf-run | atf-report

…and then I let it run for like 2 days (because that’s how long it took).  And at the end I had a the following list of failures:

Failed test cases:
   bin/sh/t_input:nul_elimination, bin/sh/t_patterns:filename_expansion,
   bin/sh/t_syntax:g_variable_syntax, lib/libc/db/t_db:bsize_ffactor,
   lib/libc/db/t_db:btree_weird_page_split,
   lib/libc/gen/t_fpclassify:fpclassify_double,
   lib/libc/gen/t_fpclassify:fpclassify_float,
   lib/libc/gen/t_fpclassify:fpclassify_long_double,
   lib/libc/gen/t_fpsetround:fpsetround_basic,
   lib/libc/gen/t_fpsetround:fpsetround_noftz,
   lib/libc/gen/t_siginfo:sigchild_dump, lib/libc/sys/t_fork:raise6,
   lib/libc/sys/t_ptrace_wait:core_dump_procinfo,
   lib/libc/sys/t_ptrace_wait:traceme_sendsignal_simple10,
   lib/libc/sys/t_ptrace_wait:traceme_sendsignal_simple3,
   lib/libc/sys/t_ptrace_wait:traceme_sendsignal_simple6,
   lib/libc/sys/t_ptrace_wait:traceme_sendsignal_simple7,
   lib/libc/sys/t_ptrace_wait:traceme_sendsignal_simple8,
   lib/libc/sys/t_ptrace_wait:traceme_sendsignal_simple9,
   lib/libc/sys/t_ptrace_wait:traceme_vfork_crash_bus,
   lib/libc/sys/t_ptrace_wait:traceme_vfork_crash_fpe,
   lib/libc/sys/t_ptrace_wait:traceme_vfork_crash_segv,
   lib/libc/sys/t_ptrace_wait:traceme_vfork_crash_trap,
   lib/libc/sys/t_ptrace_wait:traceme_vfork_raise10,
   lib/libc/sys/t_ptrace_wait:traceme_vfork_raise11,
   lib/libc/sys/t_ptrace_wait:traceme_vfork_raise12,
   lib/libc/sys/t_ptrace_wait:traceme_vfork_raise13,
   lib/libc/sys/t_ptrace_wait:traceme_vfork_raise6,
   lib/libc/sys/t_ptrace_wait:traceme_vfork_raise9,
   lib/libc/sys/t_ptrace_wait:traceme_vfork_signalignored_crash_bus,
   lib/libc/sys/t_ptrace_wait:traceme_vfork_signalignored_crash_fpe,
   lib/libc/sys/t_ptrace_wait:traceme_vfork_signalignored_crash_segv,
   lib/libc/sys/t_ptrace_wait:traceme_vfork_signalignored_crash_trap,
   lib/libc/sys/t_ptrace_wait:traceme_vfork_signalmasked_crash_bus,
   lib/libc/sys/t_ptrace_wait:traceme_vfork_signalmasked_crash_fpe,
   lib/libc/sys/t_ptrace_wait:traceme_vfork_signalmasked_crash_segv,
   lib/libc/sys/t_ptrace_wait:traceme_vfork_signalmasked_crash_trap,
   lib/libc/sys/t_ptrace_wait3:core_dump_procinfo,
   lib/libc/sys/t_ptrace_wait3:traceme_sendsignal_simple10,
   lib/libc/sys/t_ptrace_wait3:traceme_sendsignal_simple3,
   lib/libc/sys/t_ptrace_wait3:traceme_sendsignal_simple6,
   lib/libc/sys/t_ptrace_wait3:traceme_sendsignal_simple7,
   lib/libc/sys/t_ptrace_wait3:traceme_sendsignal_simple8,
   lib/libc/sys/t_ptrace_wait3:traceme_sendsignal_simple9,
   lib/libc/sys/t_ptrace_wait3:traceme_vfork_crash_bus,
   lib/libc/sys/t_ptrace_wait3:traceme_vfork_crash_fpe,
   lib/libc/sys/t_ptrace_wait3:traceme_vfork_crash_segv,
   lib/libc/sys/t_ptrace_wait3:traceme_vfork_crash_trap,
   lib/libc/sys/t_ptrace_wait3:traceme_vfork_raise10,
   lib/libc/sys/t_ptrace_wait3:traceme_vfork_raise11,
   lib/libc/sys/t_ptrace_wait3:traceme_vfork_raise12,
   lib/libc/sys/t_ptrace_wait3:traceme_vfork_raise13,
   lib/libc/sys/t_ptrace_wait3:traceme_vfork_raise6,
   lib/libc/sys/t_ptrace_wait3:traceme_vfork_raise9,
   lib/libc/sys/t_ptrace_wait3:traceme_vfork_signalignored_crash_bus,
   lib/libc/sys/t_ptrace_wait3:traceme_vfork_signalignored_crash_fpe,
   lib/libc/sys/t_ptrace_wait3:traceme_vfork_signalignored_crash_segv,
   lib/libc/sys/t_ptrace_wait3:traceme_vfork_signalignored_crash_trap,
   lib/libc/sys/t_ptrace_wait3:traceme_vfork_signalmasked_crash_bus,
   lib/libc/sys/t_ptrace_wait3:traceme_vfork_signalmasked_crash_fpe,
   lib/libc/sys/t_ptrace_wait3:traceme_vfork_signalmasked_crash_segv,
   lib/libc/sys/t_ptrace_wait3:traceme_vfork_signalmasked_crash_trap,
   lib/libc/sys/t_ptrace_wait4:core_dump_procinfo,
   lib/libc/sys/t_ptrace_wait4:traceme_sendsignal_simple10,
   lib/libc/sys/t_ptrace_wait4:traceme_sendsignal_simple3,
   lib/libc/sys/t_ptrace_wait4:traceme_sendsignal_simple6,
   lib/libc/sys/t_ptrace_wait4:traceme_sendsignal_simple7,
   lib/libc/sys/t_ptrace_wait4:traceme_sendsignal_simple8,
   lib/libc/sys/t_ptrace_wait4:traceme_sendsignal_simple9,
   lib/libc/sys/t_ptrace_wait4:traceme_vfork_crash_bus,
   lib/libc/sys/t_ptrace_wait4:traceme_vfork_crash_fpe,
   lib/libc/sys/t_ptrace_wait4:traceme_vfork_crash_segv,
   lib/libc/sys/t_ptrace_wait4:traceme_vfork_crash_trap,
   lib/libc/sys/t_ptrace_wait4:traceme_vfork_raise10,
   lib/libc/sys/t_ptrace_wait4:traceme_vfork_raise11,
   lib/libc/sys/t_ptrace_wait4:traceme_vfork_raise12,
   lib/libc/sys/t_ptrace_wait4:traceme_vfork_raise13,
   lib/libc/sys/t_ptrace_wait4:traceme_vfork_raise6,
   lib/libc/sys/t_ptrace_wait4:traceme_vfork_raise9,
   lib/libc/sys/t_ptrace_wait4:traceme_vfork_signalignored_crash_bus,
   lib/libc/sys/t_ptrace_wait4:traceme_vfork_signalignored_crash_fpe,
   lib/libc/sys/t_ptrace_wait4:traceme_vfork_signalignored_crash_segv,
   lib/libc/sys/t_ptrace_wait4:traceme_vfork_signalignored_crash_trap,
   lib/libc/sys/t_ptrace_wait4:traceme_vfork_signalmasked_crash_bus,
   lib/libc/sys/t_ptrace_wait4:traceme_vfork_signalmasked_crash_fpe,
   lib/libc/sys/t_ptrace_wait4:traceme_vfork_signalmasked_crash_segv,
   lib/libc/sys/t_ptrace_wait4:traceme_vfork_signalmasked_crash_trap,
   lib/libc/sys/t_ptrace_wait6:core_dump_procinfo,
   lib/libc/sys/t_ptrace_wait6:traceme_sendsignal_simple10,
   lib/libc/sys/t_ptrace_wait6:traceme_sendsignal_simple3,
   lib/libc/sys/t_ptrace_wait6:traceme_sendsignal_simple6,
   lib/libc/sys/t_ptrace_wait6:traceme_sendsignal_simple7,
   lib/libc/sys/t_ptrace_wait6:traceme_sendsignal_simple8,
   lib/libc/sys/t_ptrace_wait6:traceme_sendsignal_simple9,
   lib/libc/sys/t_ptrace_wait6:traceme_vfork_crash_bus,
   lib/libc/sys/t_ptrace_wait6:traceme_vfork_crash_fpe,
   lib/libc/sys/t_ptrace_wait6:traceme_vfork_crash_segv,
   lib/libc/sys/t_ptrace_wait6:traceme_vfork_crash_trap,
   lib/libc/sys/t_ptrace_wait6:traceme_vfork_raise10,
   lib/libc/sys/t_ptrace_wait6:traceme_vfork_raise11,
   lib/libc/sys/t_ptrace_wait6:traceme_vfork_raise12,
   lib/libc/sys/t_ptrace_wait6:traceme_vfork_raise13,
   lib/libc/sys/t_ptrace_wait6:traceme_vfork_raise6,
   lib/libc/sys/t_ptrace_wait6:traceme_vfork_raise9,
   lib/libc/sys/t_ptrace_wait6:traceme_vfork_signalignored_crash_bus,
   lib/libc/sys/t_ptrace_wait6:traceme_vfork_signalignored_crash_fpe,
   lib/libc/sys/t_ptrace_wait6:traceme_vfork_signalignored_crash_segv,
   lib/libc/sys/t_ptrace_wait6:traceme_vfork_signalignored_crash_trap,
   lib/libc/sys/t_ptrace_wait6:traceme_vfork_signalmasked_crash_bus,
   lib/libc/sys/t_ptrace_wait6:traceme_vfork_signalmasked_crash_fpe,
   lib/libc/sys/t_ptrace_wait6:traceme_vfork_signalmasked_crash_segv,
   lib/libc/sys/t_ptrace_wait6:traceme_vfork_signalmasked_crash_trap,
   lib/libc/sys/t_ptrace_waitid:core_dump_procinfo,
   lib/libc/sys/t_ptrace_waitpid:core_dump_procinfo,
   lib/libc/sys/t_ptrace_waitpid:traceme_sendsignal_simple10,
   lib/libc/sys/t_ptrace_waitpid:traceme_sendsignal_simple3,
   lib/libc/sys/t_ptrace_waitpid:traceme_sendsignal_simple6,
   lib/libc/sys/t_ptrace_waitpid:traceme_sendsignal_simple7,
   lib/libc/sys/t_ptrace_waitpid:traceme_sendsignal_simple8,
   lib/libc/sys/t_ptrace_waitpid:traceme_sendsignal_simple9,
   lib/libc/sys/t_ptrace_waitpid:traceme_vfork_crash_bus,
   lib/libc/sys/t_ptrace_waitpid:traceme_vfork_crash_fpe,
   lib/libc/sys/t_ptrace_waitpid:traceme_vfork_crash_segv,
   lib/libc/sys/t_ptrace_waitpid:traceme_vfork_crash_trap,
   lib/libc/sys/t_ptrace_waitpid:traceme_vfork_raise10,
   lib/libc/sys/t_ptrace_waitpid:traceme_vfork_raise11,
   lib/libc/sys/t_ptrace_waitpid:traceme_vfork_raise12,
   lib/libc/sys/t_ptrace_waitpid:traceme_vfork_raise13,
   lib/libc/sys/t_ptrace_waitpid:traceme_vfork_raise6,
   lib/libc/sys/t_ptrace_waitpid:traceme_vfork_raise9,
   lib/libc/sys/t_ptrace_waitpid:traceme_vfork_signalignored_crash_bus,
   lib/libc/sys/t_ptrace_waitpid:traceme_vfork_signalignored_crash_fpe,
   lib/libc/sys/t_ptrace_waitpid:traceme_vfork_signalignored_crash_segv,
   lib/libc/sys/t_ptrace_waitpid:traceme_vfork_signalignored_crash_trap,
   lib/libc/sys/t_ptrace_waitpid:traceme_vfork_signalmasked_crash_bus,
   lib/libc/sys/t_ptrace_waitpid:traceme_vfork_signalmasked_crash_fpe,
   lib/libc/sys/t_ptrace_waitpid:traceme_vfork_signalmasked_crash_segv,
   lib/libc/sys/t_ptrace_waitpid:traceme_vfork_signalmasked_crash_trap,
   lib/libc/sys/t_vfork:raise6, lib/libcurses/t_curses:mutt_test,
   lib/libcurses/t_curses:mvgetstr, lib/libm/t_acos:acos_is_nan,
   lib/libm/t_asin:asin_inf_neg, lib/libm/t_asin:asin_range,
   lib/libm/t_asin:asinf_inf_neg, lib/libm/t_asin:asinf_range,
   lib/libm/t_cbrt:cbrtf_inf_neg, lib/libm/t_cbrt:cbrtf_inf_pos,
   lib/libm/t_cbrt:cbrtf_nan, lib/libm/t_errhandling:log,
   lib/libm/t_exp:expf_nan, lib/libm/t_exp:expm1f_nan,
   lib/libm/t_fe_round:fe_nearbyint, lib/libm/t_fe_round:fe_round,
   lib/libm/t_ldexp:ldexp_denormal_large, lib/libm/t_ldexp:ldexpf_inf_neg,
   lib/libm/t_ldexp:ldexpf_inf_pos, lib/libm/t_ldexp:ldexpf_nan,
   lib/libm/t_log:log10f_inf_pos, lib/libm/t_log:log1pf_inf_pos,
   lib/libm/t_log:log2f_inf_pos, lib/libm/t_log:logf_inf_pos,
   lib/libm/t_next:nextf_nan, lib/libm/t_next:nextf_near_0,
   lib/libm/t_next:nextf_near_infinity,
   lib/libm/t_next:nextf_near_sub_normal, lib/libm/t_pow:pow_one_neg_x,
   lib/libm/t_pow:pow_zero_x, lib/libm/t_scalbn:scalbnf_inf_neg,
   lib/libm/t_scalbn:scalbnf_inf_pos, lib/libm/t_scalbn:scalbnf_nan,
   lib/libm/t_sincos:sincos_inf_neg, lib/libm/t_sincos:sincos_inf_pos,
   lib/libm/t_sincos:sincos_nan, lib/libm/t_sincos:sincosf_inf_neg,
   lib/libm/t_sincos:sincosf_inf_pos, lib/libm/t_sincos:sincosf_nan,
   lib/libm/t_sqrt:sqrtf_inf_pos, lib/libm/t_sqrt:sqrtf_nan,
   net/net/t_ipv6address:linklocal, net/net/t_ipv6_lifetime:basic,
   net/arp/t_arp:arp_cache_creation,
   net/arp/t_arp:arp_cache_creation_nodad,
   net/icmp/t_icmp_redirect:icmp_redirect,
   net/icmp/t_icmp_redirect:icmp_redirect_timeout,
   net/if_bridge/t_rtable:bridge_rtable_manyaddrs,
   net/if_ipsec/t_ipsec_natt:ipsecif_natt_transport_null,
   net/if_ipsec/t_ipsec_natt:ipsecif_natt_transport_rijndaelcbc,
   net/if_l2tp/t_l2tp:l2tp_basic_ipv4overipv4,
   net/if_l2tp/t_l2tp:l2tp_basic_ipv4overipv6,
   net/if_l2tp/t_l2tp:l2tp_basic_ipv6overipv4,
   net/if_l2tp/t_l2tp:l2tp_basic_ipv6overipv6,
   net/if_pppoe/t_pppoe:pppoe_params,
   net/if_wg/t_basic:wg_basic_ipv6_over_ipv4,
   net/if_wg/t_basic:wg_payload_sizes_ipv4_over_ipv4,
   net/if_wg/t_basic:wg_payload_sizes_ipv4_over_ipv6,
   net/if_wg/t_basic:wg_payload_sizes_ipv6_over_ipv4,
   net/if_wg/t_basic:wg_payload_sizes_ipv6_over_ipv6,
   net/if_wg/t_misc:wg_cookie, net/if_wg/t_misc:wg_rekey,
   net/if_wg/t_tunnel:wg_tunnel_ipv6_over_ipv6,
   net/ipsec/t_ipsec_l2tp:ipsec_l2tp_ipv6_tunnel_esp_rijndaelcbc,
   net/ipsec/t_ipsec_misc:ipsec_lifetime_ipv4_ah_hmacsha512,
   net/ipsec/t_ipsec_misc:ipsec_lifetime_ipv4_ah_null,
   net/ipsec/t_ipsec_misc:ipsec_lifetime_ipv6_ah_hmacsha512,
   net/ipsec/t_ipsec_misc:ipsec_lifetime_ipv6_ah_null,
   net/ipsec/t_ipsec_misc:ipsec_lifetime_ipv6_esp_null,
   net/ipsec/t_ipsec_misc:ipsec_lifetime_ipv6_esp_rijndaelcbc,
   net/ndp/t_ndp:ndp_cache_expiration,
   net/tcp/t_tcp_connect_port:basic_ipv4,
   net/tcp/t_tcp_connect_port:basic_ipv6,
   sbin/fsck_ffs/t_check_quotas:expand2_list_be_1,
   sbin/fsck_ffs/t_check_quotas:expand2_list_be_2,
   sbin/fsck_ffs/t_check_quotas:expand2_list_le_1,
   sbin/fsck_ffs/t_check_quotas:expand2_list_le_2,
   sbin/resize_ffs/t_grow:grow_16M_v0_8192,
   sbin/resize_ffs/t_grow:grow_16M_v1_16384,
   sbin/resize_ffs/t_grow:grow_16M_v2_32768,
   sbin/resize_ffs/t_shrink:shrink_24M_16M_v0_32768,
   sbin/resize_ffs/t_shrink:shrink_24M_16M_v1_65536,
   sbin/resize_ffs/t_shrink:shrink_24M_16M_v2_4096,
   sbin/resize_ffs/t_grow_swapped:grow_16M_v0_65536,
   sbin/resize_ffs/t_grow_swapped:grow_16M_v1_4096,
   sbin/resize_ffs/t_grow_swapped:grow_16M_v2_8192,
   sbin/resize_ffs/t_shrink_swapped:shrink_24M_16M_v0_4096,
   sbin/resize_ffs/t_shrink_swapped:shrink_24M_16M_v1_8192,
   sbin/resize_ffs/t_shrink_swapped:shrink_24M_16M_v2_16384,
   sbin/sysctl/t_perm:sysctl_net, usr.bin/cpio/t_cpio:cpio,
   usr.bin/tar/t_tar:tar, usr.bin/xlint/lint1/t_integration:msg_142,
   usr.bin/c++/t_call_once:call_once_pie,
   usr.bin/c++/t_call_once2:call_once2_pie,
   usr.bin/c++/t_hello:hello_pic_profile,
   usr.bin/c++/t_pthread_once:pthread_once_pic_profile,
   fs/ffs/t_quota2_1:quota_1000_O1_be, fs/ffs/t_quota2_1:quota_1000_O1_le,
   fs/ffs/t_quota2_1:quota_1000_O2_be, fs/ffs/t_quota2_1:quota_1000_O2_le,
   fs/ffs/t_clearquota:clear_be_1_both_log,
   fs/ffs/t_miscquota:default_deny_user_big, fs/tmpfs/t_mkdir:many,
   fs/vfs/t_full:v7fs_fillfs, fs/vfs/t_io:v7fs_wrrd_after_unlink,
   fs/vfs/t_vnops:ext2fs_create_many, fs/vfs/t_vnops:ffs_create_many,
   fs/vfs/t_vnops:nfs_create_many, fs/vfs/t_vnops:p2k_ffs_create_many,
   fs/vfs/t_vnops:v7fs_create_many, crypto/libcrypto/t_pubkey:dsa,
   atf/tools/atf-config_test:override_env

-- thorpej
References:
- Re: misc/59155 (bin/sh/t_input:nul_elimination, possibly other sh tests, require root for silly reasons)
  - From: Robert Elz via gnats
Prev by Date: Re: misc/59155 (bin/sh/t_input:nul_elimination, possibly other sh tests, require root for silly reasons)
Next by Date: kern/59165: vio9p(4): expose tag through sysctl or device properties
Previous by Thread: Re: misc/59155 (bin/sh/t_input:nul_elimination, possibly other sh tests, require root for silly reasons)
Next by Thread: Re: misc/59155 (bin/sh/t_input:nul_elimination, possibly other sh tests, require root for silly reasons)
Indexes:
Home | Main Index | Thread Index | Old Index