misc/57507: Automated test case slimit_le_1_user fails intermittently on some architectures

[jspath55%gmail.com@localhost]

>Number:         57507
>Category:       misc
>Synopsis:       Automated test case slimit_le_1_user fails intermittently on some architectures
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    misc-bug-people
>State:          open
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Thu Jul 06 20:00:01 +0000 2023
>Originator:     Jim Spath
>Release:        10.0_BETA
>Organization:
>Environment:
NetBSD etc.etc 10.0_BETA NetBSD 10.0_BETA (GENERIC) #0: Sun Feb 12 12:39:37 UTC 2023  mkrepro%mkrepro.NetBSD.org@localhost:/usr/src/sys/arch/amd64/compile/GENERIC amd64 x86_64 AMD 686-class NetBSD

>Description:
This test case fails intermittently on some architectures I tested but not all.
Several tests were chosen from the full test suite after observing inconsistent pass/fail results over many runs.
Tests were run periodically from cron, timed to avoid overlapping runs while completing as many attempts as feasible based on the system speed.

The set being reported in July 2023 includes failure rates in the one-percent ranges, to be followed by other tests that fail more frequently.

The results for systems used:

System Passes Fails

amd64 3998 8
Pi3 267 5
Pi4 791 0
Pi0W 595 2
Pi02W 888 2
i386 (Intel Atom) 707 3


Example failure message:

tps-count: 1
tp-start: 1685596261.645414, fs/ffs/t_quotalimit, 1
tc-start: 1685596261.645555, slimit_le_1_user
tc-so:Executing command [ newfs -q user -B le -O 1 -s 4000 -F fsimage ]
tc-so:Executing command [ /usr/tests/fs/ffs/h_ffs_server -b fsimage unix://test ]
tc-so:Executing command [ env LD_PRELOAD=/usr/lib/librumphijack.so RUMPHIJACK=vfs=getvfsstat,blanket=/mnt edquota -u -s2k/4 -h3k/6 -t 1s/1d 1 ]
tc-so:Executing command [ rump.halt ]
tc-so:Executing command [ /usr/tests/fs/ffs/h_quota2_tests -b 1 fsimage unix://test ]
tc-so:Executing command [ env LD_PRELOAD=/usr/lib/librumphijack.so RUMPHIJACK=vfs=getvfsstat,blanket=/mnt quota -u -h 1 ]
tc-so:Executing command [ env LD_PRELOAD=/usr/lib/librumphijack.so RUMPHIJACK=vfs=getvfsstat,blanket=/mnt repquota -u /mnt ]
tc-so:Executing command [ env RUMP_SERVER=unix://test rump.halt ]
tc-so:Executing command [ fsck_ffs -nf -F fsimage ]
tc-end: 1685596622.716306, slimit_le_1_user, failed, Test case timed out after 360 seconds
tp-end: 1685596622.742382, fs/ffs/t_quotalimit
info: time.end, Thu Jun 1 05:17:02 UTC 2023


Example 2 failure:

tps-count: 18
tp-start: 1685840405.888079, fs/ffs/t_quotalimit, 1
tc-start: 1685840405.888403, slimit_le_1_user
tc-so:Executing command [ newfs -q user -B le -O 1 -s 4000 -F fsimage ]
tc-so:Executing command [ /usr/tests/fs/ffs/h_ffs_server -b fsimage unix://test ]
tc-so:Executing command [ env LD_PRELOAD=/usr/lib/librumphijack.so RUMPHIJACK=vfs=getvfsstat,blanket=/mnt edquota -u -s2k/4 -h3k/6 -t 1s/1d 1 ]
tc-so:Executing command [ rump.halt ]
tc-so:Executing command [ /usr/tests/fs/ffs/h_quota2_tests -b 1 fsimage unix://test ]
tc-se:Fail: regexp test 1: write beyond the soft limit after grace time returned 69: Disc quota exceeded not in stderr
tc-end: 1685840410.766193, slimit_le_1_user, failed, atf-check failed; see the output of the test for details
tp-end: 1685840410.783617, fs/ffs/t_quotalimit


Example pass message:

tps-count: 1
tp-start: 1685599861.881615, fs/ffs/t_quotalimit, 1
tc-start: 1685599861.881763, slimit_le_1_user
tc-so:Executing command [ newfs -q user -B le -O 1 -s 4000 -F fsimage ]
tc-so:Executing command [ /usr/tests/fs/ffs/h_ffs_server -b fsimage unix://test ]
tc-so:Executing command [ env LD_PRELOAD=/usr/lib/librumphijack.so RUMPHIJACK=vfs=getvfsstat,blanket=/mnt edquota -u -s2k/4 -h3k/6 -t 1s/1d 1 ]
tc-so:Executing command [ rump.halt ]
tc-so:Executing command [ /usr/tests/fs/ffs/h_quota2_tests -b 1 fsimage unix://test ]
tc-so:Executing command [ env LD_PRELOAD=/usr/lib/librumphijack.so RUMPHIJACK=vfs=getvfsstat,blanket=/mnt quota -u -h 1 ]
tc-so:Executing command [ env LD_PRELOAD=/usr/lib/librumphijack.so RUMPHIJACK=vfs=getvfsstat,blanket=/mnt repquota -u /mnt ]
tc-so:Executing command [ env RUMP_SERVER=unix://test rump.halt ]
tc-so:Executing command [ fsck_ffs -nf -F fsimage ]
tc-end: 1685599865.543896, slimit_le_1_user, passed
tp-end: 1685599865.561248, fs/ffs/t_quotalimit
info: time.end, Thu Jun 1 06:11:05 UTC 2023



>How-To-Repeat:
$ atf-run fs/ffs/t_quotalimit:slimit_le_1_user

>Fix:
Unknown.