port-sparc64/57350: Panic during shutdown on sun fire v445 system

[palle%lyckegaard.dk@localhost]

>Number:         57350
>Category:       port-sparc64
>Synopsis:       Panic during shutdown on sun fire v445 system
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    port-sparc64-maintainer
>State:          open
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Thu Apr 13 15:40:00 +0000 2023
>Originator:     Palle Lyckegaard
>Release:        NetBSD 10.99.2 (GENERIC.DEBUG) #5: Wed Apr 12 16:27:00 UTC 2023
>Organization:
NetBSD
>Environment:
NetBSD 10.99.2 (GENERIC.DEBUG) #5: Wed Apr 12 16:27:00 UTC 2023
>Description:
During shutdown of 4-cpu v445 system, the following panic occurs:


...

v445# 
v445# halt
Apr 12 18:51:42 v445 halt: halted by root
Apr 12 18:51:42 v445 syslogd[846]: Exiting on signal 15
[ 116.6049802] syncing disks... done
[ 116.6849767] unmounting 0x1095f3000 /var/shm (tmpfs)...
[ 116.7549736] unmounting 0x108abd000 /proc (procfs)...
[ 116.8149715] unmounting 0x108a5f000 /dev/pts (ptyfs)...
[ 116.8749683] unmounting 0x1095f2000 /kern (kernfs)...
[ 116.9349658] unmounting 0x108a5e000 /tmp (tmpfs)...
[ 116.9849636] unmounting 0x108956000 / (/dev/sd1a)...
[ 117.7449313] unmounting 0x108956000 / (/dev/sd1a)...
[ 117.8049279] uhub4: detached
[ 117.8349265] cd0: detached
[ 117.8753897] atapibus0: detached
[ 117.9049235] uhub3: detached
[ 117.9449217] uhub2: detached
[ 117.9749205] uhub1: detached
[ 118.0049191] uhub0: detached
[ 118.0449174] pci14: detached
[ 118.0749161] atabus1: detached
[ 118.1149143] atabus0: detached
[ 118.1449132] usb3: detached
[ 118.1749117] usb2: detached
[ 118.2149100] usb1: detached
[ 118.2449086] usb0: detached
[ 118.2749073] pci4: detached
[ 118.3049060] sd4: detached
[ 118.3349047] dk3 at sd3 (61794d71-0f8b-2764-dfe4-8bc137a269b1) deleted
[ 118.4149014] dk2 at sd3 (3f5c5123-7966-3346-b2bf-d1774016c2bc) deleted
[ 118.4972738] sd3: detached
[ 118.5285251] dk1 at sd2 (4113af4f-dcd1-7760-f006-c2821bb8a1d8) deleted
[ 118.6056071] dk0 at sd2 (zfs) deleted
[ 118.6448915] sd2: detached
[ 118.6748901] sd0: detached
[ 118.7048887] ppb12: detached
[ 118.7548865] brgphy3: detached
[ 118.7948894] bge3: detached
[ 118.8348885] brgphy2: detached
[ 118.8748815] bge2: detached
[ 118.9048802] Skipping crash dump on recursive panic
[ 118.9048802] panic: mutex_vector_enter,511: uninitialized lock (lock=0x108643018, from=01645508)
[ 118.9048802] cpu0: Begin traceback...
[ 118.9048802] cpu0: End traceback...
[ 119.1579070] Mutex error: mutex_vector_enter,511: assertion failed: !cpu_intr_p()

[ 119.1579070] lock address : netbsd:xc_high_pri
[ 119.1579070] type         : sleep/adaptive
[ 119.1579070] initialized  : netbsd:xc_init_cpu+0xf4
[ 119.1579070] shared holds :                  0 exclusive:                  0
[ 119.1579070] shares wanted:                  0 exclusive:                  0
[ 119.1579070] relevant cpu :                  0 last held:                  2
[ 119.1579070] relevant lwp : 0x0000000106ea5140 last held: 000000000000000000
[ 119.1579070] last locked  : netbsd:xc_wait+0x9c
[ 119.1579070] unlocked*    : netbsd:cv_enter+0x13c
[ 119.1579070] owner field  : 000000000000000000 wait/spin:                0/0
[ 119.1579070] Turnstile: no active turnstile for this lock.

[ 119.9980289] Skipping crash dump on recursive panic
[ 120.0574031] panic: LOCKDEBUG: Mutex error: mutex_vector_enter,511: assertion failed: !cpu_intr_p()
[ 120.1646952] cpu0: Begin traceback...
[ 120.2074041] cpu0: End traceback...
[ 130.2043880] cpu0[6 softser/0]: hogging kernel lock
[ 130.2597738] cpu0[6 softser/0]: hogging kernel lock
[ 130.2597738] cpu0[6 softser/0]: hogging kernel lock
[ 130.3743583] cpu0[6 softser/0]: hogging kernel lock
[ 130.3743583] cpu0[6 softser/0]: hogging kernel lock
[ 130.3743583] cpu0[6 softser/0]: hogging kernel lock
[ 130.5462354] cpu0[6 softser/0]: hogging kernel lock
[ 130.6035291] cpu0[6 softser/0]: hogging kernel lock
[ 130.6608210] cpu0[6 softser/0]: hogging kernel lock
[ 130.6608210] cpu0[6 softser/0]: hogging kernel lock
[ 130.6608210] cpu0[6 softser/0]: hogging kernel lock
[ 130.8326987] cpu0[6 softser/0]: hogging kernel lock
[ 130.8326987] cpu0[6 softser/0]: hogging kernel lock
[ 130.9472843] cpu0[6 softser/0]: hogging kernel lock
[ 131.0045776] cpu0[6 softser/0]: hogging kernel lock
[ 131.0618701] cpu0[6 softser/0]: hogging kernel lock
[ 131.1191624] cpu0[6 softser/0]: hogging kernel lock
[ 131.1191624] cpu0[6 softser/0]: hogging kernel lock
[ 131.2337479] cpu0[6 softser/0]: hogging kernel lock
[ 131.2910415] cpu0[6 softser/0]: hogging kernel lock
[ 131.2910415] cpu0[6 softser/0]: hogging kernel lock
[ 131.4056265] cpu0[6 softser/0]: hogging kernel lock
[ 131.4056265] cpu0[6 softser/0]: hogging kernel lock
[ 131.5202120] cpu0[6 softser/0]: hogging kernel lock
[ 131.5775045] cpu0[6 softser/0]: hogging kernel lock
[ 131.5775045] cpu0[6 softser/0]: hogging kernel lock
[ 131.6920900] cpu0[6 softser/0]: hogging kernel lock
[ 
>How-To-Repeat:
Problem seems to be present in NetBSD-9 as well.

Using recent sources the issue happends during each shutdown of the system, causing the root fs to be fsck'ed during the next reboot.
>Fix:
N/A