NetBSD-Bugs archive
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]
kern/54908: kernel semi-lock-up
>Number: 54908
>Category: kern
>Synopsis: kernel semi-lock-up
>Confidential: no
>Severity: critical
>Priority: high
>Responsible: kern-bug-people
>State: open
>Class: sw-bug
>Submitter-Id: net
>Arrival-Date: Wed Jan 29 13:50:00 +0000 2020
>Originator: Martin Husemann
>Release: NetBSD 9.99.44
>Organization:
The NetBSD Foundation, Inc.
>Environment:
System: NetBSD space-truckin.duskware.de 9.99.44 NetBSD 9.99.44 (GENERIC) #48: Wed Jan 29 11:21:23 CET 2020 martin%seven-days-to-the-wolves.aprisoft.de@localhost:/work/src/sys/arch/evbarm/compile/GENERIC evbarm
Architecture: earmv7hfeb
Machine: evbarm
>Description:
Since a few days it is impossible to complete an atf test run on this machine.
The test grinds to an halt, kernel and a few processes still work but once
you try doing anything, things lock up. Userland watchdog process still
works fine (for example).
I disabled watchdog (upfront) and got into ddb:
db{0}> show uvm
Current UVM status:
pagesize=4096 (0x1000), pagemask=0xfff, pageshift=12, ncolors=1
510689 VM pages: 39560 active, 19408 inactive, 3093 wired, 403039 free
pages 6102 anon, 52233 file, 3802 exec
freemin=512, free-target=682, wired-max=170229
resv-pg=1, resv-kernel=10, zeropages=0
bootpages=9975, poolpages=37100
faults=10469917, traps=10665839, intrs=1666219, ctxswitch=2298098
softint=765066, syscalls=101480210
fault counts:
noram=0, noanon=0, pgwait=0, pgrele=0
ok relocks(total)=7730(7730), anget(retrys)=3362376(0), amapcopy=1698609
neighbor anon/obj pg=2257848/18406717, gets(lock/unlock)=4013220/7925
cases: anon=2132847, anoncow=1229529, obj=3548423, prcopy=464602, przero=212
6407
daemon and swap counts:
woke=1, revs=4, scans=0, obscans=0, anscans=0
busy=0, freed=0, reactivate=0, deactivate=19408
pageouts=0, pending=0, nswget=0
nswapdev=1, swpgavail=524533
swpages=524533, swpginuse=0, swpgonly=0, paging=0
db{0}> ps
PID LID S CPU FLAGS STRUCT LWP * NAME WAIT
6219 1 3 1 80 9934f200 h_execthr kqueue
3139 1 3 0 80 993419c0 atf-check wait
1955 151 2 0 0 99b47040 rump_server
1955 150 2 0 0 99b3c500 rump_server
1955 147 2 0 0 99b3ba40 rump_server
1955 143 2 0 0 99b38cc0 rump_server
1955 141 5 1 0 99b38740 rump_server
1955 140 2 0 0 99b38480 rump_server
1955 138 2 0 0 99b37c80 rump_server
1955 132 2 0 0 99b35980 rump_server
1955 131 2 0 0 99b356c0 rump_server
1955 130 3 1 80 99b35400 rump_server parked
1955 129 3 1 80 99b35140 rump_server parked
1955 127 3 1 80 99b33940 rump_server parked
1955 126 3 1 80 99b33680 rump_server parked
1955 125 3 1 80 99b333c0 rump_server parked
1955 124 3 1 80 99b33100 rump_server parked
1955 123 2 0 0 99b31bc0 rump_server
1955 122 3 1 80 99b31900 rump_server parked
1955 121 2 0 0 99b31640 rump_server
1955 119 3 1 80 99b310c0 rump_server parked
1955 118 2 0 0 99b30b80 rump_server
1955 117 2 0 0 99b308c0 rump_server
1955 115 2 0 0 99b30340 rump_server
1955 113 2 0 0 99b2db40 rump_server
1955 112 3 1 80 99b2d880 rump_server parked
1955 110 3 1 80 99b2d300 rump_server parked
1955 109 3 1 80 99b2d040 rump_server parked
1955 108 2 0 0 99b2bd40 rump_server
1955 107 2 0 0 99b2ba80 rump_server
1955 106 2 0 0 99b2b7c0 rump_server
1955 105 2 0 0 99b2b500 rump_server
1955 103 2 0 0 99b28d00 rump_server
1955 102 3 1 80 99b28a40 rump_server parked
1955 99 2 0 0 99b28200 rump_server
1955 94 3 1 80 99b271c0 rump_server parked
1955 92 2 0 0 99b249c0 rump_server
1955 90 2 0 0 99b24440 rump_server
1955 80 2 0 0 99b213c0 rump_server
1955 76 2 0 0 99b1f640 rump_server
1955 68 2 0 0 99b1cb40 rump_server
1955 66 2 0 0 99b1c5c0 rump_server
1955 65 3 1 80 99b1c300 rump_server parked
1955 61 2 0 0 99b18200 rump_server
1955 57 2 0 0 99b126c0 rump_server
1955 56 2 0 0 99b12140 rump_server
1955 54 2 0 0 99b11100 rump_server
1955 52 2 0 0 99b06600 rump_server
1955 48 2 0 0 99b079c0 rump_server
1955 43 3 1 80 998f0cc0 rump_server parked
1955 35 3 1 80 993be400 rump_server parked
1955 25 3 1 80 94408340 rump_server parked
1955 23 3 1 80 993aabc0 rump_server poll
1955 22 3 1 80 998fe600 vmem_rehash parked
1955 21 3 1 80 998f0a00 aiodoned parked
1955 20 2 0 0 9935f7c0 ioflush
1955 19 2 0 0 99902300 cachegc
1955 18 3 1 80 993be140 vdrain parked
1955 17 3 1 80 99910640 pdaemon parked
1955 16 3 1 80 998ec180 xcall/1 parked
1955 15 3 1 80 94421640 sipbnc parked
1955 14 2 0 0 99341440 rumpclk1
1955 13 3 1 80 9939c340 xcall/0 parked
1955 12 3 1 80 944210c0 rsi1/0 parked
1955 11 3 1 80 993aa0c0 rsi0/0 parked
1955 10 3 1 80 999100c0 rsi1/3 parked
1955 9 3 0 80 99901d40 rsi0/3 parked
1955 8 3 1 80 99911100 rsi1/2 parked
1955 7 3 0 80 998f0480 rsi0/2 parked
1955 6 3 0 80 99341180 sipbnc parked
1955 5 2 0 0 998fe080 rumpclk0
1955 4 3 1 80 99341700 rsi1/1 parked
1955 3 3 0 80 998ff780 rsi0/1 parked
1955 1 3 0 80 941744c0 rump_server psem
29097 1 3 1 80 993bac00 sh wait
2652 1 3 0 80 94174d00 tail kqueue
1305 1 3 0 80 943e4300 tcsh pause
1493 1 3 0 80 943e4880 rxvt select
1556 1 3 1 80 943e45c0 tcsh pause
1544 1 3 1 80 930b4c00 sshd select
951 1 3 0 80 94174780 sshd poll
50 1 3 0 80 94174200 tee pipe_rd
702 1 3 1 80 9396bcc0 atf-report pipe_rd
554 1 3 1 80 9396ba00 tee pipe_rd
595 1 2 0 1000000 930b4940 atf-run
580 1 3 0 80 930b4100 sh wait
134 1 3 1 80 93115400 sh wait
397 1 3 1 80 92e71a00 getty ttyraw
517 1 3 1 80 9396b480 cron nanoslp
410 1 3 1 80 931f9440 inetd kqueue
440 1 3 0 80 931f9700 sshd select
367 1 3 1 80 9396b1c0 ntpd pause
209 1 3 1 80 931f9180 rpcbind poll
268 1 3 1 80 93115140 syslogd kqueue
223 1 2 0 0 93115c40 dhcpcd
1 1 3 0 80 92fe7b80 init wait
0 74 5 0 200 931f9c80 (zombie)
0 71 3 1 200 92e91780 physiod physiod
0 70 3 1 200 92ff7900 aiodoned aiodoned
0 69 3 1 200 92ff7640 pooldrain xclocv
0 68 3 1 200 92e711c0 ioflush syncer
0 > 67 7 0 20000200 92e914c0 pgdaemon
0 63 3 1 200 92e71cc0 usb2 usbevt
0 62 3 1 200 92e71740 usb3 usbevt
0 61 3 1 200 92e71480 usb1 usbevt
0 60 3 1 200 92ff7380 usb0 usbevt
0 59 2 0 200 92ff70c0 npfgc-0
0 58 3 1 200 92fe78c0 rt_free rt_free
0 57 3 1 200 92fe7600 unpgc unpgc
0 56 3 1 200 92e91200 key_timehandler key_timehandler
0 55 3 1 200 92fe7340 icmp6_wqinput/1 icmp6_wqinput
0 54 2 0 200 92fe7080 icmp6_wqinput/0
0 53 3 1 200 92fdeb40 nd6_timer nd6_timer
0 52 3 1 200 92fde880 carp6_wqinput/1 carp6_wqinput
0 51 3 0 200 92fde5c0 carp6_wqinput/0 carp6_wqinput
0 50 3 1 200 92fde300 carp_wqinput/1 carp_wqinput
0 49 3 0 200 92fde040 carp_wqinput/0 carp_wqinput
0 48 3 1 200 92e96d40 icmp_wqinput/1 icmp_wqinput
0 47 3 0 200 92e96a80 icmp_wqinput/0 icmp_wqinput
0 46 3 1 200 92e967c0 rt_timer rt_timer
0 44 3 1 200 92e91a40 vmem_rehash vmem_rehash
0 43 3 0 200 92e96500 sdmmc1 mmctaskq
0 42 3 1 200 92e96240 sdmmc0 mmctaskq
0 41 3 1 200 92e91d00 axp20x0 axp20x0
0 31 3 1 200 92e1ac80 iic2 iicintr
0 30 3 1 200 92e1a9c0 iic1 iicintr
0 29 3 1 200 92e1a700 atabus0 atath
0 28 3 0 200 92e1a440 usbtask-dr usbtsk
0 27 3 0 200 92e1a180 usbtask-hc usbtsk
0 26 2 0 200 92a0cc40 iic0
0 25 3 1 200 92a0c980 xcall/1 xcall
0 24 1 1 200 92a0c6c0 softser/1
0 23 1 1 200 92a0c400 softclk/1
0 22 1 1 200 92a0c140 softbio/1
0 21 1 1 200 929f7c00 softnet/1
0 > 20 7 1 20000201 929f7940 idle/1
0 19 3 0 200 929f7680 lnxpwrwq lnxpwrwq
0 18 3 0 200 929f73c0 lnxlngwq lnxlngwq
0 17 3 0 200 929f7100 lnxsyswq lnxsyswq
0 16 3 0 200 929f2bc0 lnxrcugc lnxrcugc
0 15 3 0 200 929f2900 sysmon smtaskq
0 14 3 0 200 929f2640 pmfsuspend pmfsuspend
0 13 3 0 200 929f2380 pmfevent pmfevent
0 12 3 0 200 929f20c0 sopendfree sopendfr
0 11 3 0 200 928dab80 nfssilly nfssilly
0 10 3 1 200 928da8c0 cachegc cachegc
0 9 3 0 200 928da600 vdrain vdrain
0 8 3 0 200 928da340 modunload mod_unld
0 7 2 0 200 928da080 xcall/0
0 6 1 0 200 928d8b40 softser/0
0 > 5 7 0 20000200 928d8880 softclk/0
0 4 1 0 200 928d85c0 softbio/0
0 3 2 0 200 928d8300 softnet/0
0 2 1 0 201 928d8040 idle/0
0 1 3 1 200 807ec5c0 swapper uvm
db{0}> bt/a 92e914c0
trace: pid 0 lid 67 at 0x9bdcae54
0x9bdcae54: netbsd:dosoftints+0xc
0x9bdcaed4: netbsd:irq_entry+0x88
0x9bdcafac: netbsd:uvm_pageout+0x178
db{0}> bt/a 929f7940
trace: pid 0 lid 20 at 0x80b16f3c
0x80b16f3c: netbsd:cpu_idle+0x48
0x80b16f54: netbsd:sched_curcpu_runnable_p+0x24
0x80b16f94: netbsd:idle_loop+0x144
--- tf 0x80b16fb0 ---
db{0}> bt/a 928d8880
trace: pid 0 lid 5 at 0x9ba5beac
0x9ba5beac: 92e72050
Bad frame pointer: 0x92b8f948
>How-To-Repeat:
cd /usr/tests && atf-run|atf-report
>Fix:
n/a
Home |
Main Index |
Thread Index |
Old Index