NetBSD-Bugs archive
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]
kern/53639: -current amd64 20180927 lockup
>Number: 53639
>Category: kern
>Synopsis: -current amd64 20180927 lockup
>Confidential: no
>Severity: serious
>Priority: high
>Responsible: kern-bug-people
>State: open
>Class: sw-bug
>Submitter-Id: net
>Arrival-Date: Fri Sep 28 20:05:00 +0000 2018
>Originator: Frank Kardel
>Release: NetBSD 8.99.25 -current 20180927
>Organization:
>Environment:
System: NetBSD pip 8.99.25 NetBSD 8.99.25 (PIPGEN) #0: Thu Sep 27 20:14:43 CEST 2018 kardel@pip:/src/NetBSD/act/src/obj.amd64/sys/arch/amd64/compile/PIPGEN amd64
Architecture: x86_64
Machine: amd64
>Description:
On a Ryzen 7 1800X (8-core/16 threads) system I see a release build -j 16 often get locked up (1-2 time in 3 runs) (no progress, no network).
One thing is noteworthy: /src/NetBSD is a null mount from from a file system backed by a raid device. The stacks show many pmap_update calls and often
involve layerfs in the back-trace.
A ddb dumped kernel is available. The stacks at the time of the lockup look like this:
Crash version 8.99.25, image version 8.99.25.
System panicked: dump forced via kernel debugger
Backtrace from time of crash is available.
lwp_t ffff9179486b58a0
cc1: pid 7819 proc ffff9179329dd000 vmspace/map ffff917959594a18 flags 4000
> lwp 1 ffff9179486b58a0 pcb ffff970499f9f000
stat 7 flags 8060000 cpu 12 pri 25
trace: pid 7819 lid 1 at 0xffffffff80985c6c
?() at ffff970499fa2a88
lwp_t ffff9179486ef720
nbmake: pid 7525 proc ffff9178ca3256a8 vmspace/map ffff9178c91c45c8 flags 4000
> lwp 1 ffff9179486ef720 pcb ffff9704976b8000
stat 7 flags 8020000 cpu 13 pri 25
trace: pid 7525 lid 1 at 0xffff9704976bbaa0
pmap_update() at pmap_update+0x26
uvm_km_kmem_free() at uvm_km_kmem_free+0x46
ufs_readdir() at ufs_readdir+0x2c0
layer_bypass() at layer_bypass+0xe8
VOP_READDIR() at VOP_READDIR+0x5c
getcwd_scandir() at getcwd_scandir+0x1be
getcwd_common() at getcwd_common+0x209
sys___getcwd() at sys___getcwd+0xa1
syscall() at syscall+0x24d
--- syscall (number 296) ---
7c75624a64da:
lwp_t ffff91793a80f500
nbmake: pid 6627 proc ffff917937042100 vmspace/map ffff9178b6f9bd20 flags 4000
> lwp 1 ffff91793a80f500 pcb ffff970497188000
stat 7 flags 8020000 cpu 6 pri 25
trace: pid 6627 lid 1 at 0xffff97049718baa0
pmap_update() at pmap_update+0x26
uvm_km_kmem_free() at uvm_km_kmem_free+0x46
ufs_readdir() at ufs_readdir+0x2c0
layer_bypass() at layer_bypass+0xe8
VOP_READDIR() at VOP_READDIR+0x5c
getcwd_scandir() at getcwd_scandir+0x1be
getcwd_common() at getcwd_common+0x209
sys___getcwd() at sys___getcwd+0xa1
syscall() at syscall+0x24d
--- syscall (number 296) ---
73bcea8a64da:
lwp_t ffff9178b18202a0
nbmake: pid 191 proc ffff9179352ba620 vmspace/map ffff9178c7aadd20 flags 4000
> lwp 1 ffff9178b18202a0 pcb ffff97049ab02000
stat 7 flags 8020000 cpu 1 pri 25
trace: pid 191 lid 1 at 0xffff97049ab05aa0
pmap_update() at pmap_update+0x26
uvm_km_kmem_free() at uvm_km_kmem_free+0x46
ufs_readdir() at ufs_readdir+0x2c0
layer_bypass() at layer_bypass+0xe8
VOP_READDIR() at VOP_READDIR+0x5c
getcwd_scandir() at getcwd_scandir+0x1be
getcwd_common() at getcwd_common+0x209
sys___getcwd() at sys___getcwd+0xa1
syscall() at syscall+0x24d
--- syscall (number 296) ---
75717eea64da:
lwp_t ffff91792d37f6a0
nbmake: pid 3233 proc ffff917930e5e3e0 vmspace/map ffff9179330c3e78 flags 4000
> lwp 1 ffff91792d37f6a0 pcb ffff970499b10000
stat 7 flags 8020000 cpu 3 pri 25
trace: pid 3233 lid 1 at 0xffff970499b13aa0
pmap_update() at pmap_update+0x26
uvm_km_kmem_free() at uvm_km_kmem_free+0x46
ufs_readdir() at ufs_readdir+0x2c0
layer_bypass() at layer_bypass+0xe8
VOP_READDIR() at VOP_READDIR+0x5c
getcwd_scandir() at getcwd_scandir+0x1be
getcwd_common() at getcwd_common+0x209
sys___getcwd() at sys___getcwd+0xa1
syscall() at syscall+0x24d
--- syscall (number 296) ---
7e0c4d2a64da:
lwp_t ffff9178f9857320
postgres: pid 2494 proc ffff9178fd7fa958 vmspace/map ffff9178fd9ef5e0 flags 4004
> lwp 1 ffff9178f9857320 pcb ffff9704981d0000
stat 7 flags 8060000 cpu 5 pri 25
trace: pid 2494 lid 1 at 0xffffffff80985c6c
?() at ffff9704981d3b58
lwp_t ffff917948c95880
ntpd: pid 2266 proc ffff91795978bc08 vmspace/map ffff917959203740 flags 0
> lwp 1 ffff917948c95880 pcb ffff970497650000
stat 7 flags 9020000 cpu 0 pri 191
trace: pid 2266 lid 1 at 0xffff970497653c00
ubc_alloc() at ubc_alloc+0x7b
ubc_uiomove() at ubc_uiomove+0xec
ffs_write() at ffs_write+0x276
layer_bypass() at layer_bypass+0xe8
VOP_WRITE() at VOP_WRITE+0x50
vn_write() at vn_write+0xec
dofilewrite() at dofilewrite+0xb0
sys_write() at sys_write+0x5f
syscall() at syscall+0x24d
--- syscall (number 4) ---
76f45be3dcda:
lwp_t ffff91794e9171e0
syslogd: pid 307 proc ffff91794e9045f0 vmspace/map ffff917951b0f178 flags 100
> lwp 1 ffff91794e9171e0 pcb ffff970496fb9000
stat 7 flags 8020000 cpu 4 pri 25
trace: pid 307 lid 1 at 0x0
_KERNEL_OPT_WSDISPLAY_SCROLLBACK_LINES+0x1c:
lwp_t ffff9179527ca080
system: pid 0 proc ffffffff81659700 vmspace/map ffffffff81783c60 flags 20002
> lwp 196 [aiodoned] ffff9179527ca080 pcb ffff97049586f000
stat 7 flags 200 cpu 8 pri 125
lwp 195 [ioflush] ffff9179527ca4a0 pcb ffff97049586a000
stat 3 flags 200 cpu 14 pri 124
wmesg genput wchan ffff970062dc9000
lwp 194 [pgdaemon] ffff9179527ca8c0 pcb ffff970495865000
stat 3 flags 200 cpu 1 pri 126
wmesg pgdaemon wchan ffffffff8171cf54
lwp 193 [ttm_swap] ffff916a641da060 pcb ffff970495860000
stat 3 flags 200 cpu 2 pri 43
wmesg ttm_swap wchan ffff9179527bdf90
lwp 186 [atapibus0] ffff916a641da8a0 pcb ffff9704950ff000
stat 3 flags 200 cpu 15 pri 96
wmesg sccomp wchan ffff970082958890
lwp 183 [usb2] ffff916a63fd4a40 pcb ffff9704955f2000
stat 3 flags 200 cpu 9 pri 96
wmesg usbevt wchan ffff916a63e014a8
lwp 182 [usb3] ffff916a63fc5600 pcb ffff9704955ed000
stat 2 flags 200 cpu 8 pri 96
lwp 181 [usb1] ffff916a63fc5a20 pcb ffff97049510e000
stat 3 flags 200 cpu 4 pri 96
wmesg usbevt wchan ffff916a63b01948
lwp 180 [usb0] ffff916a63ec41c0 pcb ffff9704950eb000
stat 2 flags 200 cpu 1 pri 96
lwp 179 [npfgc-0] ffff916a64126040 pcb ffff9704955e8000
stat 3 flags 200 cpu 12 pri 96
wmesg xchicv wchan ffffffff8169b048
lwp 178 [rt_free] ffff916a64126880 pcb ffff9704955d1000
stat 3 flags 200 cpu 15 pri 222
wmesg rt_free wchan ffff916a659b3488
lwp 177 [unpgc] ffff916a64177020 pcb ffff9704955cc000
stat 3 flags 200 cpu 15 pri 96
wmesg unpgc wchan ffffffff817911a0
lwp 176 [key_timehandler] ffff916a64177440 pcb ffff9704955c7000
stat 3 flags 200 cpu 10 pri 222
wmesg key_timehandler wchan ffff916a659b3848
lwp 175 [icmp6_wqinput/1] ffff916a64177860 pcb ffff9704955c2000
stat 3 flags 200 cpu 15 pri 222
wmesg icmp6_wqinput wchan ffff916a640f9808
lwp 174 [icmp6_wqinput/1] ffff916a64168000 pcb ffff9704955bd000
stat 3 flags 200 cpu 14 pri 222
wmesg icmp6_wqinput wchan ffff916a640f9788
lwp 173 [icmp6_wqinput/1] ffff916a64168420 pcb ffff9704955b8000
stat 3 flags 200 cpu 13 pri 222
wmesg icmp6_wqinput wchan ffff916a640f9708
lwp 172 [icmp6_wqinput/1] ffff916a64168840 pcb ffff9704955b3000
stat 3 flags 200 cpu 12 pri 222
wmesg icmp6_wqinput wchan ffff916a640f9688
lwp 171 [icmp6_wqinput/1] ffff916a64139360 pcb ffff9704955ae000
stat 3 flags 200 cpu 11 pri 222
wmesg icmp6_wqinput wchan ffff916a640f9608
lwp 170 [icmp6_wqinput/1] ffff916a64139780 pcb ffff9704955a9000
stat 3 flags 200 cpu 10 pri 222
wmesg icmp6_wqinput wchan ffff916a640f9588
lwp 169 [icmp6_wqinput/9] ffff916a64139ba0 pcb ffff9704955a4000
stat 3 flags 200 cpu 9 pri 222
wmesg icmp6_wqinput wchan ffff916a640f9508
lwp 168 [icmp6_wqinput/8] ffff916a6410a340 pcb ffff97049559f000
stat 3 flags 200 cpu 8 pri 222
wmesg icmp6_wqinput wchan ffff916a640f9488
lwp 167 [icmp6_wqinput/7] ffff916a6410a760 pcb ffff97049559a000
stat 3 flags 200 cpu 7 pri 222
wmesg icmp6_wqinput wchan ffff916a640f9408
lwp 166 [icmp6_wqinput/6] ffff916a6410ab80 pcb ffff970495595000
stat 3 flags 200 cpu 6 pri 222
wmesg icmp6_wqinput wchan ffff916a640f9388
lwp 165 [icmp6_wqinput/5] ffff916a6412b320 pcb ffff970495590000
stat 3 flags 200 cpu 5 pri 222
wmesg icmp6_wqinput wchan ffff916a640f9308
lwp 164 [icmp6_wqinput/4] ffff916a6412b740 pcb ffff97049558b000
stat 3 flags 200 cpu 4 pri 222
wmesg icmp6_wqinput wchan ffff916a640f9288
lwp 163 [icmp6_wqinput/3] ffff916a6412bb60 pcb ffff970495586000
stat 3 flags 200 cpu 3 pri 222
wmesg icmp6_wqinput wchan ffff916a640f9208
lwp 162 [icmp6_wqinput/2] ffff916a640dc300 pcb ffff970495581000
stat 3 flags 200 cpu 2 pri 222
wmesg icmp6_wqinput wchan ffff916a640f9188
lwp 161 [icmp6_wqinput/1] ffff916a640dc720 pcb ffff97049557c000
stat 3 flags 200 cpu 1 pri 222
wmesg icmp6_wqinput wchan ffff916a640f9108
lwp 160 [icmp6_wqinput/0] ffff916a640dcb40 pcb ffff970495577000
stat 3 flags 200 cpu 0 pri 222
wmesg icmp6_wqinput wchan ffff916a640f9088
lwp 159 [ip6flow] ffff916a640ad2e0 pcb ffff970495572000
stat 3 flags 200 cpu 15 pri 222
wmesg ip6flow wchan ffff916a6405a188
lwp 158 [nd6_timer] ffff916a640ad700 pcb ffff97049556d000
stat 3 flags 200 cpu 2 pri 222
wmesg nd6_timer wchan ffff916a6405a408
lwp 157 [icmp_wqinput/15] ffff916a640adb20 pcb ffff970495568000
stat 3 flags 200 cpu 15 pri 222
wmesg icmp_wqinput wchan ffff916a650ae808
lwp 156 [icmp_wqinput/14] ffff916a650fe2c0 pcb ffff970495563000
stat 3 flags 200 cpu 14 pri 222
wmesg icmp_wqinput wchan ffff916a650ae788
lwp 155 [icmp_wqinput/13] ffff916a650fe6e0 pcb ffff97049555e000
stat 3 flags 200 cpu 13 pri 222
wmesg icmp_wqinput wchan ffff916a650ae708
lwp 154 [icmp_wqinput/12] ffff916a650feb00 pcb ffff970495559000
stat 3 flags 200 cpu 12 pri 222
wmesg icmp_wqinput wchan ffff916a650ae688
lwp 153 [icmp_wqinput/11] ffff916a640bf2a0 pcb ffff970495554000
stat 3 flags 200 cpu 11 pri 222
wmesg icmp_wqinput wchan ffff916a650ae608
lwp 152 [icmp_wqinput/10] ffff916a640bf6c0 pcb ffff97049554f000
stat 3 flags 200 cpu 10 pri 222
wmesg icmp_wqinput wchan ffff916a650ae588
lwp 151 [icmp_wqinput/9] ffff916a640bfae0 pcb ffff97049554a000
stat 3 flags 200 cpu 9 pri 222
wmesg icmp_wqinput wchan ffff916a650ae508
lwp 150 [icmp_wqinput/8] ffff916a640c0280 pcb ffff970495545000
stat 3 flags 200 cpu 8 pri 222
wmesg icmp_wqinput wchan ffff916a650ae488
lwp 149 [icmp_wqinput/7] ffff916a640c06a0 pcb ffff970495540000
stat 3 flags 200 cpu 7 pri 222
wmesg icmp_wqinput wchan ffff916a650ae408
lwp 148 [icmp_wqinput/6] ffff916a640c0ac0 pcb ffff97049553b000
stat 3 flags 200 cpu 6 pri 222
wmesg icmp_wqinput wchan ffff916a650ae388
lwp 147 [icmp_wqinput/5] ffff916a64071260 pcb ffff970495536000
stat 3 flags 200 cpu 5 pri 222
wmesg icmp_wqinput wchan ffff916a650ae308
lwp 146 [icmp_wqinput/4] ffff916a64071680 pcb ffff970495531000
stat 3 flags 200 cpu 4 pri 222
wmesg icmp_wqinput wchan ffff916a650ae288
lwp 145 [icmp_wqinput/3] ffff916a64071aa0 pcb ffff97049552c000
stat 3 flags 200 cpu 3 pri 222
wmesg icmp_wqinput wchan ffff916a650ae208
lwp 144 [icmp_wqinput/2] ffff916a64d72240 pcb ffff970495527000
stat 3 flags 200 cpu 2 pri 222
wmesg icmp_wqinput wchan ffff916a650ae188
lwp 143 [icmp_wqinput/1] ffff916a64d72660 pcb ffff970495522000
stat 3 flags 200 cpu 1 pri 222
wmesg icmp_wqinput wchan ffff916a650ae108
lwp 142 [icmp_wqinput/0] ffff916a64d72a80 pcb ffff97049551d000
stat 3 flags 200 cpu 0 pri 222
wmesg icmp_wqinput wchan ffff916a650ae088
lwp 141 [rt_timer] ffff916a63fe3220 pcb ffff970495104000
stat 3 flags 200 cpu 11 pri 222
wmesg rt_timer wchan ffff916a64026c88
lwp 140 [ipflow_slowtimo] ffff916a63fd4620 pcb ffff970495518000
stat 2 flags 200 cpu 10 pri 222
lwp 139 [vmem_rehash] ffff916a63fe3a60 pcb ffff970495109000
stat 3 flags 200 cpu 9 pri 125
wmesg vmem_rehash wchan ffff916a63fb2348
lwp 138 [amdzentemp0] ffff916a63fe3640 pcb ffff970495113000
stat 3 flags 200 cpu 9 pri 43
wmesg amdzentemp0 wchan ffff916a63fb20c8
lwp 129 [audiomix] ffff916a63ec45e0 pcb ffff9704948e4000
stat 3 flags 280 cpu 8 pri 223
wmesg play wchan ffff916a63e8c948
lwp 128 [audiorec] ffff916a63ec4a00 pcb ffff9704948df000
stat 3 flags 280 cpu 9 pri 223
wmesg record wchan ffff916a63e8c968
lwp 127 [atabus8] ffff916a63de81a0 pcb ffff97049488e000
stat 3 flags 200 cpu 15 pri 96
wmesg atath wchan ffff9700829643b8
lwp 125 [scsibus1] ffff916a63de89e0 pcb ffff970494773000
stat 3 flags 200 cpu 0 pri 96
wmesg sccomp wchan ffff916a63cf19a0
lwp 124 [mpii0_evt] ffff916a63d71180 pcb ffff970493f40000
stat 3 flags 200 cpu 0 pri 43
wmesg mpii0_evt wchan ffff916a63dcf5c8
lwp 123 [mpii0_tmo] ffff916a63d715a0 pcb ffff970493f3b000
stat 3 flags 200 cpu 0 pri 43
wmesg mpii0_tmo wchan ffff916a63dcf848
lwp 121 [scsibus0] ffff916a63bc9160 pcb ffff970493e27000
stat 3 flags 200 cpu 0 pri 96
wmesg sccomp wchan ffff9700746fe118
lwp 120 [atabus7] ffff916a63bc9580 pcb ffff970493c8d000
stat 3 flags 200 cpu 15 pri 96
wmesg atath wchan ffff97008295a808
lwp 119 [atabus6] ffff916a63bc99a0 pcb ffff970493c84000
stat 3 flags 200 cpu 14 pri 96
wmesg atath wchan ffff97008295a2d8
lwp 118 [atabus5] ffff916a63b9e140 pcb ffff970493c7b000
stat 3 flags 200 cpu 6 pri 96
wmesg atath wchan ffff970082959da8
lwp 117 [atabus4] ffff916a63b9e560 pcb ffff970493c72000
stat 3 flags 200 cpu 0 pri 96
wmesg atath wchan ffff970082959878
lwp 116 [atabus3] ffff916a63b9e980 pcb ffff970493c69000
stat 3 flags 200 cpu 6 pri 96
wmesg atath wchan ffff970082959348
lwp 115 [atabus2] ffff916a63b43120 pcb ffff970493c60000
stat 3 flags 200 cpu 0 pri 96
wmesg atath wchan ffff970082958e18
lwp 114 [atabus1] ffff916a63b43540 pcb ffff970493c57000
stat 3 flags 200 cpu 0 pri 96
wmesg atath wchan ffff9700829588e8
lwp 113 [atabus0] ffff916a63b43960 pcb ffff970493c4e000
stat 3 flags 200 cpu 1 pri 96
wmesg atath wchan ffff9700829583b8
lwp 112 [usbtask-dr] ffff916a634bc100 pcb ffff970493c22000
stat 3 flags 200 cpu 1 pri 96
wmesg usbtsk wchan ffffffff816e6f00
lwp 111 [usbtask-hc] ffff916a634bc520 pcb ffff970493c1d000
stat 3 flags 200 cpu 0 pri 96
wmesg usbtsk wchan ffffffff816e6eb8
lwp 110 [xcall/15] ffff916a634bc940 pcb ffff970493a67000
stat 3 flags 200 cpu 15 pri 127
wmesg xcall wchan ffff970493a45098
lwp 109 [softser/15] ffff916a634ad0e0 pcb ffff970493a62000
stat 1 flags 200 cpu 15 pri 223
lwp 108 [softclk/15] ffff916a634ad500 pcb ffff970493a5d000
stat 1 flags 200 cpu 15 pri 220
lwp 107 [softbio/15] ffff916a634ad920 pcb ffff970493a58000
stat 1 flags 200 cpu 15 pri 221
lwp 106 [softnet/15] ffff916a634830c0 pcb ffff970493a53000
stat 1 flags 200 cpu 15 pri 222
lwp 105 [idle/15] ffff916a634834e0 pcb ffff970493a46000
stat 1 flags 201 cpu 15 pri 0
lwp 104 [xcall/14] ffff916a63483900 pcb ffff970493a3e000
stat 3 flags 200 cpu 14 pri 127
wmesg xcall wchan ffff970493a1c098
lwp 103 [softser/14] ffff916a634540a0 pcb ffff970493a39000
stat 1 flags 200 cpu 14 pri 223
lwp 102 [softclk/14] ffff916a634544c0 pcb ffff970493a34000
stat 1 flags 200 cpu 14 pri 220
lwp 101 [softbio/14] ffff916a634548e0 pcb ffff970493a2f000
stat 1 flags 200 cpu 14 pri 221
lwp 100 [softnet/14] ffff916a6343a080 pcb ffff970493a2a000
stat 1 flags 200 cpu 14 pri 222
lwp 99 [idle/14] ffff916a6343a4a0 pcb ffff970493a1d000
stat 1 flags 201 cpu 14 pri 0
lwp 98 [xcall/13] ffff916a6343a8c0 pcb ffff970493a15000
stat 3 flags 200 cpu 13 pri 127
wmesg xcall wchan ffff9704939f3098
lwp 97 [softser/13] ffff916a633eb060 pcb ffff970493a10000
stat 1 flags 200 cpu 13 pri 223
lwp 96 [softclk/13] ffff916a633eb480 pcb ffff970493a0b000
stat 1 flags 200 cpu 13 pri 220
lwp 95 [softbio/13] ffff916a633eb8a0 pcb ffff970493a06000
stat 1 flags 200 cpu 13 pri 221
lwp 94 [softnet/13] ffff916a633d1040 pcb ffff970493a01000
stat 1 flags 200 cpu 13 pri 222
lwp 93 [idle/13] ffff916a633d1460 pcb ffff9704939f4000
stat 1 flags 201 cpu 13 pri 0
lwp 92 [xcall/12] ffff916a633d1880 pcb ffff9704939ec000
stat 3 flags 200 cpu 12 pri 127
wmesg xcall wchan ffff9704939ca098
lwp 91 [softser/12] ffff916a633a2020 pcb ffff9704939e7000
stat 1 flags 200 cpu 12 pri 223
lwp 90 [softclk/12] ffff916a633a2440 pcb ffff9704939e2000
stat 1 flags 200 cpu 12 pri 220
lwp 89 [softbio/12] ffff916a633a2860 pcb ffff9704939dd000
stat 1 flags 200 cpu 12 pri 221
lwp 88 [softnet/12] ffff916a63378000 pcb ffff9704939d8000
stat 1 flags 200 cpu 12 pri 222
lwp 87 [idle/12] ffff916a63378420 pcb ffff9704939cb000
stat 1 flags 201 cpu 12 pri 0
lwp 86 [xcall/11] ffff916a63378840 pcb ffff9704939c3000
stat 3 flags 200 cpu 11 pri 127
wmesg xcall wchan ffff9704939a1098
lwp 85 [softser/11] ffff916a63349360 pcb ffff9704939be000
stat 1 flags 200 cpu 11 pri 223
lwp 84 [softclk/11] ffff916a63349780 pcb ffff9704939b9000
stat 1 flags 200 cpu 11 pri 220
lwp 83 [softbio/11] ffff916a63349ba0 pcb ffff9704939b4000
stat 1 flags 200 cpu 11 pri 221
lwp 82 [softnet/11] ffff916a632ef340 pcb ffff9704939af000
stat 1 flags 200 cpu 11 pri 222
> lwp 81 [idle/11] ffff916a632ef760 pcb ffff9704939a2000
stat 7 flags 201 cpu 11 pri 0
lwp 80 [xcall/10] ffff916a632efb80 pcb ffff97049399a000
stat 3 flags 200 cpu 10 pri 127
wmesg xcall wchan ffff970493978098
lwp 79 [softser/10] ffff916a63300320 pcb ffff970493995000
stat 1 flags 200 cpu 10 pri 223
lwp 78 [softclk/10] ffff916a63300740 pcb ffff970493990000
stat 1 flags 200 cpu 10 pri 220
lwp 77 [softbio/10] ffff916a63300b60 pcb ffff97049398b000
stat 1 flags 200 cpu 10 pri 221
lwp 76 [softnet/10] ffff916a632c6300 pcb ffff970493986000
stat 1 flags 200 cpu 10 pri 222
> lwp 75 [idle/10] ffff916a632c6720 pcb ffff970493979000
stat 7 flags 201 cpu 10 pri 0
lwp 74 [xcall/9] ffff916a632c6b40 pcb ffff970493971000
stat 3 flags 200 cpu 9 pri 127
wmesg xcall wchan ffff97049394f098
lwp 73 [softser/9] ffff916a632b72e0 pcb ffff97049396c000
stat 1 flags 200 cpu 9 pri 223
lwp 72 [softclk/9] ffff916a632b7700 pcb ffff970493967000
stat 1 flags 200 cpu 9 pri 220
lwp 71 [softbio/9] ffff916a632b7b20 pcb ffff970493962000
stat 1 flags 200 cpu 9 pri 221
lwp 70 [softnet/9] ffff916a6328d2c0 pcb ffff97049395d000
stat 1 flags 200 cpu 9 pri 222
lwp 69 [idle/9] ffff916a6328d6e0 pcb ffff970493950000
stat 1 flags 201 cpu 9 pri 0
lwp 68 [xcall/8] ffff916a6328db00 pcb ffff970493948000
stat 3 flags 200 cpu 8 pri 127
wmesg xcall wchan ffff970493926098
lwp 67 [softser/8] ffff916a6326e2a0 pcb ffff970493943000
stat 1 flags 200 cpu 8 pri 223
lwp 66 [softclk/8] ffff916a6326e6c0 pcb ffff97049393e000
stat 1 flags 200 cpu 8 pri 220
lwp 65 [softbio/8] ffff916a6326eae0 pcb ffff970493939000
stat 1 flags 200 cpu 8 pri 221
lwp 64 [softnet/8] ffff916a63224280 pcb ffff970493934000
stat 1 flags 200 cpu 8 pri 222
lwp 63 [idle/8] ffff916a632246a0 pcb ffff970493927000
stat 1 flags 201 cpu 8 pri 0
lwp 62 [xcall/7] ffff916a63224ac0 pcb ffff97049391f000
stat 3 flags 200 cpu 7 pri 127
wmesg xcall wchan ffff9704938fd098
lwp 61 [softser/7] ffff916a63205260 pcb ffff97049391a000
stat 1 flags 200 cpu 7 pri 223
lwp 60 [softclk/7] ffff916a63205680 pcb ffff970493915000
stat 1 flags 200 cpu 7 pri 220
lwp 59 [softbio/7] ffff916a63205aa0 pcb ffff970493910000
stat 1 flags 200 cpu 7 pri 221
lwp 58 [softnet/7] ffff916a631cb240 pcb ffff97049390b000
stat 1 flags 200 cpu 7 pri 222
lwp 57 [idle/7] ffff916a631cb660 pcb ffff9704938fe000
stat 1 flags 201 cpu 7 pri 0
lwp 56 [xcall/6] ffff916a631cba80 pcb ffff9704938f6000
stat 3 flags 200 cpu 6 pri 127
wmesg xcall wchan ffff9704938d4098
lwp 55 [softser/6] ffff916a631bc220 pcb ffff9704938f1000
stat 1 flags 200 cpu 6 pri 223
lwp 54 [softclk/6] ffff916a631bc640 pcb ffff9704938ec000
stat 1 flags 200 cpu 6 pri 220
lwp 53 [softbio/6] ffff916a631bca60 pcb ffff9704938e7000
stat 1 flags 200 cpu 6 pri 221
lwp 52 [softnet/6] ffff916a63172200 pcb ffff9704938e2000
stat 1 flags 200 cpu 6 pri 222
lwp 51 [idle/6] ffff916a63172620 pcb ffff9704938d5000
stat 1 flags 201 cpu 6 pri 0
lwp 50 [xcall/5] ffff916a63172a40 pcb ffff9704938cd000
stat 3 flags 200 cpu 5 pri 127
wmesg xcall wchan ffff9704938ab098
lwp 49 [softser/5] ffff916a631831e0 pcb ffff9704938c8000
stat 1 flags 200 cpu 5 pri 223
lwp 48 [softclk/5] ffff916a63183600 pcb ffff9704938c3000
stat 1 flags 200 cpu 5 pri 220
lwp 47 [softbio/5] ffff916a63183a20 pcb ffff9704938be000
stat 1 flags 200 cpu 5 pri 221
lwp 46 [softnet/5] ffff916a631291c0 pcb ffff9704938b9000
stat 1 flags 200 cpu 5 pri 222
lwp 45 [idle/5] ffff916a631295e0 pcb ffff9704938ac000
stat 1 flags 201 cpu 5 pri 0
lwp 44 [xcall/4] ffff916a63129a00 pcb ffff9704938a4000
stat 3 flags 200 cpu 4 pri 127
wmesg xcall wchan ffff970493882098
lwp 43 [softser/4] ffff916a6310a1a0 pcb ffff97049389f000
stat 1 flags 200 cpu 4 pri 223
lwp 42 [softclk/4] ffff916a6310a5c0 pcb ffff97049389a000
stat 1 flags 200 cpu 4 pri 220
lwp 41 [softbio/4] ffff916a6310a9e0 pcb ffff970493895000
stat 1 flags 200 cpu 4 pri 221
lwp 40 [softnet/4] ffff916a630e0180 pcb ffff970493890000
stat 1 flags 200 cpu 4 pri 222
lwp 39 [idle/4] ffff916a630e05a0 pcb ffff970493883000
stat 1 flags 201 cpu 4 pri 0
lwp 38 [xcall/3] ffff916a630e09c0 pcb ffff97049387b000
stat 3 flags 200 cpu 3 pri 127
wmesg xcall wchan ffff970493859098
lwp 37 [softser/3] ffff916a630d1160 pcb ffff970493876000
stat 1 flags 200 cpu 3 pri 223
lwp 36 [softclk/3] ffff916a630d1580 pcb ffff970493871000
stat 1 flags 200 cpu 3 pri 220
lwp 35 [softbio/3] ffff916a630d19a0 pcb ffff97049386c000
stat 1 flags 200 cpu 3 pri 221
lwp 34 [softnet/3] ffff916a63097140 pcb ffff970493867000
stat 1 flags 200 cpu 3 pri 222
lwp 33 [idle/3] ffff916a63097560 pcb ffff97049385a000
stat 1 flags 201 cpu 3 pri 0
lwp 32 [xcall/2] ffff916a63097980 pcb ffff970493852000
stat 3 flags 200 cpu 2 pri 127
wmesg xcall wchan ffff970493830098
lwp 31 [softser/2] ffff916a63088120 pcb ffff97049384d000
stat 1 flags 200 cpu 2 pri 223
lwp 30 [softclk/2] ffff916a63088540 pcb ffff970493848000
stat 1 flags 200 cpu 2 pri 220
lwp 29 [softbio/2] ffff916a63088960 pcb ffff970493843000
stat 1 flags 200 cpu 2 pri 221
lwp 28 [softnet/2] ffff916a6301f100 pcb ffff97049383e000
stat 1 flags 200 cpu 2 pri 222
lwp 27 [idle/2] ffff916a6301f520 pcb ffff970493831000
stat 1 flags 201 cpu 2 pri 0
lwp 26 [xcall/1] ffff916a6301f940 pcb ffff97049382a000
stat 3 flags 200 cpu 1 pri 127
wmesg xcall wchan ffff9704935dc098
lwp 25 [softser/1] ffff916a6302d0e0 pcb ffff970493825000
stat 1 flags 200 cpu 1 pri 223
lwp 24 [softclk/1] ffff916a6302d500 pcb ffff970493820000
stat 1 flags 200 cpu 1 pri 220
lwp 23 [softbio/1] ffff916a6302d920 pcb ffff9704937f8000
stat 1 flags 200 cpu 1 pri 221
lwp 22 [softnet/1] ffff917952d800c0 pcb ffff9704937f3000
stat 1 flags 200 cpu 1 pri 222
lwp 21 [idle/1] ffff917952d804e0 pcb ffff9704935dd000
stat 1 flags 201 cpu 1 pri 0
lwp 20 [lnxpwrwq] ffff917952d80900 pcb ffff9704937cd000
stat 3 flags 200 cpu 14 pri 43
wmesg lnxpwrwq wchan ffff917952d97e90
lwp 19 [lnxlngwq] ffff917952d990a0 pcb ffff9704937c8000
stat 3 flags 200 cpu 0 pri 43
wmesg lnxlngwq wchan ffff917952d97f10
lwp 18 [lnxsyswq] ffff917952d994c0 pcb ffff9704937c3000
stat 3 flags 200 cpu 14 pri 43
wmesg lnxsyswq wchan ffff917952d97f90
lwp 17 [lnxrcugc] ffff917952d998e0 pcb ffff9704937be000
stat 3 flags 200 cpu 15 pri 43
wmesg lnxrcugc wchan ffffffff8169bbc8
lwp 16 [sysmon] ffff917952da4080 pcb ffff9704937b9000
stat 3 flags 200 cpu 0 pri 96
wmesg smtaskq wchan ffffffff816fd640
lwp 15 [pmfsuspend] ffff917952da44a0 pcb ffff9704937b4000
stat 3 flags 200 cpu 0 pri 43
wmesg pmfsuspend wchan ffff91795cddf0c8
lwp 14 [pmfevent] ffff917952da48c0 pcb ffff9704937af000
stat 3 flags 200 cpu 0 pri 43
wmesg pmfevent wchan ffff91795cddf348
lwp 13 [sopendfree] ffff917954dcf060 pcb ffff9704937aa000
stat 3 flags 200 cpu 0 pri 96
wmesg sopendfr wchan ffffffff81791110
lwp 12 [nfssilly] ffff917954dcf480 pcb ffff9704937a5000
stat 3 flags 200 cpu 0 pri 43
wmesg nfssilly wchan ffff91795cddf848
lwp 11 [autofstmo] ffff917954dcf8a0 pcb ffff9704937a0000
stat 3 flags 200 cpu 0 pri 43
wmesg autofstmo wchan ffff91795cddfac8
lwp 10 [cachegc] ffff91795ede2040 pcb ffff97049379b000
stat 3 flags 200 cpu 2 pri 125
wmesg cachegc wchan ffff91795ede2040
lwp 9 [vdrain] ffff91795ede2460 pcb ffff970493796000
stat 3 flags 200 cpu 5 pri 125
wmesg vdrain wchan ffffffff8169b680
lwp 8 [modunload] ffff91795ede2880 pcb ffff970493791000
stat 3 flags 200 cpu 3 pri 125
wmesg mod_unld wchan ffffffff81782c80
lwp 7 [xcall/0] ffff91795ee05020 pcb ffff97049378c000
stat 3 flags 200 cpu 0 pri 127
wmesg xcall wchan ffffffff81600698
lwp 6 [softser/0] ffff91795ee05440 pcb ffff970493787000
stat 1 flags 200 cpu 0 pri 223
> lwp 5 [softclk/0] ffff91795ee05860 pcb ffff970493782000
stat 7 flags 200 cpu 0 pri 220
lwp 4 [softbio/0] ffff91795ee21000 pcb ffff97049377d000
stat 1 flags 200 cpu 0 pri 221
lwp 3 [softnet/0] ffff91795ee21420 pcb ffff970493778000
stat 1 flags 200 cpu 0 pri 222
lwp 2 [idle/0] ffff91795ee21840 pcb ffff970493728000
stat 1 flags 201 cpu 0 pri 0
lwp 1 [swapper] ffffffff81658fa0 pcb ffffffff81b09000
stat 2 flags 200 cpu 13 pri 125
trace: pid 0 lid 196 at 0xffff970495872ef0
pmap_update() at pmap_update+0x26
uvm_pagermapout() at uvm_pagermapout+0x29
uvm_aio_aiodone() at uvm_aio_aiodone+0x83
workqueue_worker() at workqueue_worker+0xe9
trace: pid 0 lid 81 at 0xffff9704939a5f90
idle_loop() at idle_loop+0x1a5
cpu_hatch() at cpu_hatch+0x186
trace: pid 0 lid 75 at 0xffff97049397cf90
idle_loop() at idle_loop+0x1a5
cpu_hatch() at cpu_hatch+0x186
trace: pid 0 lid 5 at 0xffff9704937700c0
softint_dispatch() at softint_dispatch+0x157
>How-To-Repeat:
run a "build.sh -U -N 1 -j 16 release" on an 8 core amd64 system on a null mounted file system.
>Fix:
reducing parallelism helps in side stepping the lock-up but is no solution.
>Unformatted:
Home |
Main Index |
Thread Index |
Old Index