Port-xen archive

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]

Fwd: Re: Odd problem with many vcpus




D'oh, thunderbird on the laptop didn't do list reply automatically,

On 09/19/18 11:01, Cherry G.Mathew wrote:
Staffan Thomén <duck%shangtai.net@localhost> writes:

Do you have any messages from dom0 (xl dmesg, /var/log/xen/... ) that
could help please ?

First, thanks for helping, nothing really stood out in the logs for me but I've pasted them below anyway.


The (build domU) system also feels slightly slower than netbsd-7, but
I could well be imagning that.

So what's going on here?


Hard to tell without more data. All you've given us is a process fork
related domU hang which isn't much to go on.

Would you be able to break into ddb, for eg: and give us a dmesg, ps and
other info ?

I built a kernel with DEBUG and LOCKDEBUG and breaking into ddb works. I'll keep the machine in ddb if you have a more specific suggestion.


/var/log/xen/xl-power.log
-------------------------
Waiting for domain power (domid 23) to die [pid 5443]


domU console building firefox62, I press ^T at ^T.
-------------------------------
[...]
Creating config.status
Reticulating splines...
0:03.14 File already read. Skipping: /usr/build/pkgwork/www/firefox/work/firefox-62.0/gfx/angle/targets/angle_common/moz.build
^T
load: 1.00 cmd: python2.7 19923 [0x7f7ff6c08762/17 parked] 368.17u 0.19s 99% 21332k
make: Working in: /usr/build/pkgsrc/www/firefox
make[1]: Working in: /usr/build/pkgsrc/www/firefox


dom0 dmesg changes since VM start
---------------------------------
xbd backend: attach device vm-power (size 209715200) for domain 23
xvif23i0: Ethernet address 00:16:3e:01:07:03
xbd backend domain 23 handle 0x300 (768) using event channel 71, protocol x86_64-abi

xen dmesg change since VM start
-------------------------------
(XEN) d23 attempted to change d23v1's CR4 flags 00002660 -> 00000620
(XEN) d23 attempted to change d23v2's CR4 flags 00002660 -> 00000620
(XEN) d23 attempted to change d23v3's CR4 flags 00002660 -> 00000620
(XEN) d23 attempted to change d23v4's CR4 flags 00002660 -> 00000620
(XEN) d(23 attempted to change d23v5's CR4 flags 00002660 -> 00000620
(XEN) d23 attempted to change d23v6's CR4 flags 00002660 -> 00000620
(XEN) d23 attempted to change d23v7's CR4 flags 00002660 -> 00000620
(XEN) d23 attempted to change d23v8's CR4 flags 00002660 -> 00000620
(XEN) d23 attempted to change d23v9's CR4 flags 00002660 -> 00000620
(XEN) d23 attempted to change d23v10's CR4 flags 00002660 -> 00000620


domU ddb
--------
fatal breakpoint trap in supervisor mode
trap type 1 code 0 rip 0xffffffff80205a95 cs 0xe030 rflags 0x202 cr2 0x7f7ff3418038 ilevel 0x8 rsp 0xffffa008d04edc10
curlwp 0xffffa0005ae79840 pid 0.2 lowest kstack 0xffffa008d04ea2c0
Stopped in pid 0.2 (system) at  netbsd:breakpoint+0x5:  leave
breakpoint() at netbsd:breakpoint+0x5
xencons_tty_input() at netbsd:xencons_tty_input+0xb2
xencons_handler() at netbsd:xencons_handler+0x6a
intr_biglock_wrapper() at netbsd:intr_biglock_wrapper+0x1d
evtchn_do_event() at netbsd:evtchn_do_event+0x24b
do_hypervisor_callback() at netbsd:do_hypervisor_callback+0x140
hypervisor_callback() at netbsd:hypervisor_callback+0xa1
idle_loop() at netbsd:idle_loop+0x10e
ds          9840
es          1990
fs          dc00
gs          1990
rdi         ffffa00066fa9588
rsi         ffffffff86d1c09a
rbp         ffffa008d04edc10
rbx         ffffffff86d1c09a
rdx         2b
rcx         2b
rax         1
r8          ffffffff8021147a    intr_biglock_wrapper+0x16
r9          0
r10         0
r11         246
r12         ffffa000690db008
r13         ffffa00066fa9588
r14         ffffffff86d1c09b
r15         1
rip         ffffffff80205a95    breakpoint+0x5
cs          e030
rflags      202
rsp         ffffa008d04edc10
ss          e02b
netbsd:breakpoint+0x5:  leave
db{0}> ps
PID    LID S CPU     FLAGS       STRUCT LWP *               NAME WAIT
18620    1 3   0         0   ffffa0006bfa8120             dhcpcd tstile
17554    1 3   0        80   ffffa00083f575c0               sshd netio
20448    1 3   0         0   ffffa00083f45160               sshd psrlz
20898    1 3   5        80   ffffa00083bc8a80          python2.7 psem
20758    1 3   1        80   ffffa00083cb56e0          python2.7 psem
19691    1 3  18        80   ffffa0006bf90940          python2.7 psem
10949    1 3  10        80   ffffa0006c224760          python2.7 psem
19647    1 3   9        80   ffffa00083e050a0          python2.7 psem
6625     1 3  18        80   ffffa00083e9c520          python2.7 psem
13913    1 3   8        80   ffffa00083e334e0          python2.7 psem
18247    1 3   1        80   ffffa00083fb3a20          python2.7 psem
23196    1 3  18        80   ffffa00083e9c100          python2.7 psem
22979    1 3   9        80   ffffa00084f76600          python2.7 psem
22798    1 3   8        80   ffffa0006c0eea80          python2.7 psem
19064    1 3   7        80   ffffa0006c0a9200          python2.7 psem
21609    1 3  18        80   ffffa00069707940          python2.7 psem
23150    1 3  11        80   ffffa0006b0748c0          python2.7 psem
20535    1 3   8        80   ffffa00069e3a2a0          python2.7 psem
19540    1 3  11        80   ffffa000851c3b80          python2.7 psem
22153    1 3   4        80   ffffa00083e058e0          python2.7 psem
18685    1 3  16        80   ffffa00085420840          python2.7 psem
23014    1 3   6        80   ffffa00083ce8300          python2.7 pipe_rd
19923>   2 7  17     40000   ffffa000841d8300          python2.7
19923    1 3   0        80   ffffa00083ed5960          python2.7 parked
2340     4 3  19        80   ffffa00084a40900          python2.7 parked
2340     3 3  18        80   ffffa00083b981c0          python2.7 pipe_rd
2340     2 3   0        80   ffffa00083b78180          python2.7 parked
2340     1 3   3        80   ffffa000841b8700          python2.7 parked
5997     1 3   5        80   ffffa0006be21920          python2.7 wait
13475    1 3  13        80   ffffa0006c1f9740                 sh wait
2266     1 3   0        80   ffffa00069907620               make wait
1745     1 3  18        80   ffffa0006bfd3160                 sh wait
424      1 3  18        80   ffffa0006b074080               make wait
498      1 3   0        80   ffffa0006b32f4c0                ksh pause
1630     1 3  19   1000000   ffffa0006afa9420             script tstile
1348     1 3   0         0   ffffa00069e512c0             script tstile
266      1 3   0        80   ffffa000698079a0                ksh ttyraw
1047     1 3   0         0   ffffa0006b32f8e0               sshd tstile
267      1 3   7        80   ffffa0006af5fba0               sshd select
492      1 3   0        80   ffffa0006987c9c0                ksh pause
950      1 3   0        80   ffffa0006afa9840              login wait
1146     1 3   1        80   ffffa0006af5f360               cron nanoslp
525      1 3   0        80   ffffa0006a11eb40              inetd kqueue
628      1 3  14        80   ffffa00069e19280               qmgr kqueue
981      1 3  14        80   ffffa000698dfa00             pickup kqueue
975      1 3   0        80   ffffa0006a5ec340             master kqueue
625      1 3   0        80   ffffa00069e51b00               sshd select
435      1 3   0        80   ffffa00069e516e0             powerd kqueue
408      1 3   0        80   ffffa00069e3aae0               ntpd pause
347      5 3  11        80   ffffa00069e196a0              slave nfsd
347      4 3  11        80   ffffa00069e19ac0              slave nfsd
347      3 3  12        80   ffffa00069dfd260              slave nfsd
347      2 3  13        80   ffffa00069dfd680              slave nfsd
347      1 3  13        80   ffffa0006987c180             master select
349      1 3   3        80   ffffa00069dfdaa0             mountd select
351      1 3  16        80   ffffa0006988f5c0            rpcbind select
249  >   1 7   4         0   ffffa0006988f1a0            syslogd
229      1 3   0        80   ffffa000697e0140             dhcpcd wait
1        1 3   0        80   ffffa000695644a0               init wait
0      193 3   0       200   ffffa000690ed1e0            physiod physiod
0      192 3   0       200   ffffa000690e31c0           aiodoned aiodoned
0      191 3  14       200   ffffa000690eda20            ioflush syncer
0      190 3   0       200   ffffa000690ed600           pgdaemon pgdaemon
0      187 3  12       200   ffffa00069564080            pfpurge pftm
0      186 3  19       200   ffffa000695648c0            rt_free rt_free
0      185 3  19       200   ffffa0006955e060              unpgc unpgc
0 184 3 16 200 ffffa0006955e480 key_timehandler key_timehandler

0 183 3 19 200 ffffa0006955e8a0 icmp6_wqinput/1 icmp6_wqinput 0 182 3 18 200 ffffa0006955d040 icmp6_wqinput/1 icmp6_wqinput 0 181 3 17 200 ffffa0006955d460 icmp6_wqinput/1 icmp6_wqinput 0 180 3 16 200 ffffa0006955d880 icmp6_wqinput/1 icmp6_wqinput 0 179 3 15 200 ffffa0006955c020 icmp6_wqinput/1 icmp6_wqinput 0 178 3 14 200 ffffa0006955c440 icmp6_wqinput/1 icmp6_wqinput 0 177 3 13 200 ffffa0006955c860 icmp6_wqinput/1 icmp6_wqinput 0 176 3 12 200 ffffa0006955a000 icmp6_wqinput/1 icmp6_wqinput 0 175 3 11 200 ffffa0006955a420 icmp6_wqinput/1 icmp6_wqinput 0 174 3 10 200 ffffa0006955a840 icmp6_wqinput/1 icmp6_wqinput 0 173 3 9 200 ffffa00069477360 icmp6_wqinput/9 icmp6_wqinput 0 172 3 8 200 ffffa00069477780 icmp6_wqinput/8 icmp6_wqinput 0 171 3 7 200 ffffa00069477ba0 icmp6_wqinput/7 icmp6_wqinput 0 170 3 6 200 ffffa00069476340 icmp6_wqinput/6 icmp6_wqinput 0 169 3 5 200 ffffa00069476760 icmp6_wqinput/5 icmp6_wqinput 0 168 3 4 200 ffffa00069476b80 icmp6_wqinput/4 icmp6_wqinput 0 167 3 3 200 ffffa00069475320 icmp6_wqinput/3 icmp6_wqinput 0 166 3 2 200 ffffa00069475740 icmp6_wqinput/2 icmp6_wqinput 0 165 3 1 200 ffffa00069475b60 icmp6_wqinput/1 icmp6_wqinput 0 164 3 0 200 ffffa00069454300 icmp6_wqinput/0 icmp6_wqinput
0      163 3  12       200   ffffa000690ee620          nd6_timer nd6_timer
0 162 3 19 200 ffffa00069454720 icmp_wqinput/19 icmp_wqinput 0 161 3 18 200 ffffa00069454b40 icmp_wqinput/18 icmp_wqinput 0 160 3 17 200 ffffa000694532e0 icmp_wqinput/17 icmp_wqinput 0 159 3 16 200 ffffa00069453700 icmp_wqinput/16 icmp_wqinput 0 158 3 15 200 ffffa00069453b20 icmp_wqinput/15 icmp_wqinput 0 157 3 14 200 ffffa000694522c0 icmp_wqinput/14 icmp_wqinput 0 156 3 13 200 ffffa000694526e0 icmp_wqinput/13 icmp_wqinput 0 155 3 12 200 ffffa00069452b00 icmp_wqinput/12 icmp_wqinput 0 154 3 11 200 ffffa000694512a0 icmp_wqinput/11 icmp_wqinput 0 153 3 10 200 ffffa000694516c0 icmp_wqinput/10 icmp_wqinput 0 152 3 9 200 ffffa00069451ae0 icmp_wqinput/9 icmp_wqinput 0 151 3 8 200 ffffa00069450280 icmp_wqinput/8 icmp_wqinput 0 150 3 7 200 ffffa000694506a0 icmp_wqinput/7 icmp_wqinput 0 149 3 6 200 ffffa00069450ac0 icmp_wqinput/6 icmp_wqinput 0 148 3 5 200 ffffa0006944f260 icmp_wqinput/5 icmp_wqinput 0 147 3 4 200 ffffa0006944f680 icmp_wqinput/4 icmp_wqinput 0 146 3 3 200 ffffa0006944faa0 icmp_wqinput/3 icmp_wqinput 0 145 3 2 200 ffffa0006944e240 icmp_wqinput/2 icmp_wqinput 0 144 3 1 200 ffffa0006944e660 icmp_wqinput/1 icmp_wqinput 0 143 3 0 200 ffffa0006944ea80 icmp_wqinput/0 icmp_wqinput
0      142 3   4       200   ffffa000690e35e0           rt_timer rt_timer
0      141 3   0       200   ffffa000690ee200        xen_balloon xen_balloon
0      140 3   1       200   ffffa000690efa60        vmem_rehash vmem_rehash
0      139 3  18       200   ffffa000690ef220             xenbus rdst
0      138 3   0       200   ffffa000690ef640           xenwatch evtsq
0      128 3  19       200   ffffa000690e3a00           xcall/19 xcall
0      127 1  19       200   ffffa000690e21a0         softser/19
0      126 1  19       200   ffffa000690e25c0         softclk/19
0      125 1  19       200   ffffa000690e29e0         softbio/19
0      124 1  19       200   ffffa000690df180         softnet/19
0    > 123 7  19       201   ffffa000690df5a0            idle/19
0      122 3  18       200   ffffa000690df9c0           xcall/18 xcall
0      121 1  18       200   ffffa000690de160         softser/18
0      120 1  18       200   ffffa000690de580         softclk/18
0      119 1  18       200   ffffa000690de9a0         softbio/18
0      118 1  18       200   ffffa000690d9140         softnet/18
0    > 117 7  18       201   ffffa000690d9560            idle/18
0      116 3  17       200   ffffa000690d9980           xcall/17 xcall
0      115 1  17       200   ffffa000690d8120         softser/17
0      114 1  17       200   ffffa000690d8540         softclk/17
0      113 1  17       200   ffffa000690d8960         softbio/17
0      112 1  17       200   ffffa000690d4100         softnet/17
0      111 1  17       201   ffffa000690d4520            idle/17
0      110 3  16       200   ffffa000690d4940           xcall/16 xcall
0      109 1  16       200   ffffa000690d30e0         softser/16
0      108 1  16       200   ffffa000690d3500         softclk/16
0      107 1  16       200   ffffa000690d3920         softbio/16
0      106 1  16       200   ffffa000690d00c0         softnet/16
0    > 105 7  16       201   ffffa000690d04e0            idle/16
0      104 3  15       200   ffffa000690d0900           xcall/15 xcall
0      103 1  15       200   ffffa000690cf0a0         softser/15
0      102 1  15       200   ffffa000690cf4c0         softclk/15
0      101 1  15       200   ffffa000690cf8e0         softbio/15
0      100 1  15       200   ffffa000690cb080         softnet/15
0    >  99 7  15       201   ffffa000690cb4a0            idle/15
0       98 3  14       200   ffffa000690cb8c0           xcall/14 xcall
0       97 1  14       200   ffffa000690ca060         softser/14
0       96 1  14       200   ffffa000690ca480         softclk/14
0       95 1  14       200   ffffa000690ca8a0         softbio/14
0       94 1  14       200   ffffa000690c7040         softnet/14
0    >  93 7  14       201   ffffa000690c7460            idle/14
0       92 3  13       200   ffffa000690c7880           xcall/13 xcall
0       91 1  13       200   ffffa000690c6020         softser/13
0       90 1  13       200   ffffa000690c6440         softclk/13
0       89 1  13       200   ffffa000690c6860         softbio/13
0       88 1  13       200   ffffa000690c0000         softnet/13
0    >  87 7  13       201   ffffa000690c0420            idle/13
0       86 3  12       200   ffffa000690c0840           xcall/12 xcall
0       85 1  12       200   ffffa000690bf360         softser/12
0       84 1  12       200   ffffa000690bf780         softclk/12
0       83 1  12       200   ffffa000690bfba0         softbio/12
0       82 1  12       200   ffffa000690bc340         softnet/12
0    >  81 7  12       201   ffffa000690bc760            idle/12
0       80 3  11       200   ffffa000690bcb80           xcall/11 xcall
0       79 1  11       200   ffffa000690bb320         softser/11
0       78 1  11       200   ffffa000690bb740         softclk/11
0       77 1  11       200   ffffa000690bbb60         softbio/11
0       76 1  11       200   ffffa000690b8300         softnet/11
0    >  75 7  11       201   ffffa000690b8720            idle/11
0       74 3  10       200   ffffa000690b8b40           xcall/10 xcall
0       73 1  10       200   ffffa000690b72e0         softser/10
0       72 1  10       200   ffffa000690b7700         softclk/10
0       71 1  10       200   ffffa000690b7b20         softbio/10
0       70 1  10       200   ffffa000690b42c0         softnet/10
0    >  69 7  10       201   ffffa000690b46e0            idle/10
0       68 3   9       200   ffffa000690b4b00            xcall/9 xcall
0       67 1   9       200   ffffa000690b32a0          softser/9
0       66 1   9       200   ffffa000690b36c0          softclk/9
0       65 1   9       200   ffffa000690b3ae0          softbio/9
0       64 1   9       200   ffffa000690b0280          softnet/9
0    >  63 7   9       201   ffffa000690b06a0             idle/9
0       62 3   8       200   ffffa000690b0ac0            xcall/8 xcall
0       61 1   8       200   ffffa00066fdd260          softser/8
0       60 1   8       200   ffffa00066fdd680          softclk/8
0       59 1   8       200   ffffa00066fddaa0          softbio/8
0       58 1   8       200   ffffa00066fd9240          softnet/8
0    >  57 7   8       201   ffffa00066fd9660             idle/8
0       56 3   7       200   ffffa00066fd9a80            xcall/7 xcall
0       55 1   7       200   ffffa00066fd8220          softser/7
0       54 1   7       200   ffffa00066fd8640          softclk/7
0       53 1   7       200   ffffa00066fd8a60          softbio/7
0       52 1   7       200   ffffa00066fd5200          softnet/7
0    >  51 7   7       201   ffffa00066fd5620             idle/7
0       50 3   6       200   ffffa00066fd5a40            xcall/6 xcall
0       49 1   6       200   ffffa00066fd41e0          softser/6
0       48 1   6       200   ffffa00066fd4600          softclk/6
0       47 1   6       200   ffffa00066fd4a20          softbio/6
0       46 1   6       200   ffffa00066fcf1c0          softnet/6
0    >  45 7   6       201   ffffa00066fcf5e0             idle/6
0       44 3   5       200   ffffa00066fcfa00            xcall/5 xcall
0       43 1   5       200   ffffa00066fce1a0          softser/5
0       42 1   5       200   ffffa00066fce5c0          softclk/5
0       41 1   5       200   ffffa00066fce9e0          softbio/5
0       40 1   5       200   ffffa00066fcb180          softnet/5
0    >  39 7   5       201   ffffa00066fcb5a0             idle/5
0       38 3   4       200   ffffa00066fcb9c0            xcall/4 xcall
0       37 1   4       200   ffffa00066fca160          softser/4
0       36 1   4       200   ffffa00066fca580          softclk/4
0       35 1   4       200   ffffa00066fca9a0          softbio/4
0       34 1   4       200   ffffa00066fc7140          softnet/4
0       33 1   4       201   ffffa00066fc7560             idle/4
0       32 3   3       200   ffffa00066fc7980            xcall/3 xcall
0       31 1   3       200   ffffa00066fc6120          softser/3
0       30 1   3       200   ffffa00066fc6540          softclk/3
0       29 1   3       200   ffffa00066fc6960          softbio/3
0       28 1   3       200   ffffa00066fc2100          softnet/3
0    >  27 7   3       201   ffffa00066fc2520             idle/3
0       26 3   2       200   ffffa00066fc2940            xcall/2 xcall
0       25 1   2       200   ffffa00066fc10e0          softser/2
0       24 1   2       200   ffffa00066fc1500          softclk/2
0       23 1   2       200   ffffa00066fc1920          softbio/2
0       22 1   2       200   ffffa00066fbe0c0          softnet/2
0    >  21 7   2       201   ffffa00066fbe4e0             idle/2
0       20 3   1       200   ffffa00066fbe900            xcall/1 xcall
0       19 1   1       200   ffffa00066fbd0a0          softser/1
0       18 1   1       200   ffffa00066fbd4c0          softclk/1
0       17 1   1       200   ffffa00066fbd8e0          softbio/1
0       16 1   1       200   ffffa00066fa5080          softnet/1
0    >  15 7   1       201   ffffa00066fa54a0             idle/1
0       14 3   0       200   ffffa00066fa58c0         pmfsuspend pmfsuspend
0       13 3   0       200   ffffa00066f9e060           pmfevent pmfevent
0       12 3   0       200   ffffa00066f9e480         sopendfree sopendfr
0       11 3   0       200   ffffa00066f9e8a0           nfssilly nfssilly
0       10 3  10       200   ffffa0005ae86040            cachegc cachegc
0        9 3   0       200   ffffa0005ae86460             vdrain vdrain
0        8 3   0       200   ffffa0005ae86880          modunload mod_unld
0        7 3   0       200   ffffa0005ae7d020            xcall/0 xcall
0        6 1   0       200   ffffa0005ae7d440          softser/0
0        5 1   0       200   ffffa0005ae7d860          softclk/0
0        4 1   0       200   ffffa0005ae79000          softbio/0
0        3 1   0       200   ffffa0005ae79420          softnet/0
0    >   2 7   0       201   ffffa0005ae79840             idle/0
0        1 3  11       200   ffffffff806b5fe0            swapper uvm

db{0}> show locks
[Locks tracked through LWPs]
Locks held by an LWP (dhcpcd):
Lock 0 (initialized at do_posix_spawn)
lock address : 0xffffa00083ce19f8 type     :     sleep/adaptive
initialized  : 0xffffffff8047bf21
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  0
current cpu  :                  0 last held:                  0
current lwp  : 0xffffa0005ae79840 last held: 0xffffa0006bfa8120
last locked* : 0xffffffff8047b6fa unlocked : 000000000000000000
owner/count  : 0xffffa0006bfa8120 flags    : 0x0000000000000004

Turnstile chain at 0xffffffff806befb0.
=> No active turnstile for this lock.

Locks held by an LWP (sshd):
Lock 0 (initialized at fstrans_init)
lock address : 0xffffffff80867418 type     :     sleep/adaptive
initialized  : 0xffffffff8050782d
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  0
current cpu  :                  0 last held:                  0
current lwp  : 0xffffa0005ae79840 last held: 0xffffa00083f45160
last locked* : 0xffffffff80508ca9 unlocked : 0xffffffff8050a6e3
owner field  : 0xffffa00083f45160 wait/spin:                0/0
Turnstile chain at 0xffffffff806bebf0.
=> No active turnstile for this lock.
Lock 1 (initialized at fstrans_init)
lock address : 0xffffffff80867410 type     :     sleep/adaptive
initialized  : 0xffffffff80507840
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  4
current cpu  :                  0 last held:                  0
current lwp  : 0xffffa0005ae79840 last held: 0xffffa00083f45160
last locked* : 0xffffffff80508656 unlocked : 0xffffffff80507cdf
owner field  : 0xffffa00083f45160 wait/spin:                1/0

Turnstile chain at 0xffffffff806bebe0.
=> Turnstile at 0xffffa0006afaef00 (wrq=0xffffa0006afaef20, rdq=0xffffa0006afaef
30).
=> 0 waiting readers:
=> 4 waiting writers: 0xffffa0006afa9420 0xffffa0006bfa8120 0xffffa0006b32f8e0 0
xffffa00069e512c0

Locks held by an LWP (syslogd):
Lock 0 (initialized at filedesc_ctor)
lock address : 0xffffa00069715900 type     :     sleep/adaptive
initialized  : 0xffffffff804746aa
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  0
current cpu  :                  0 last held:                  4
current lwp  : 0xffffa0005ae79840 last held: 0xffffa0006988f1a0
last locked* : 0xffffffff804787f7 unlocked : 0xffffffff804788ad
owner field  : 0xffffa0006988f1a0 wait/spin:                0/0

Turnstile chain at 0xffffffff806bedc0.
=> No active turnstile for this lock.

[Locks tracked through CPUs]
Locks held on CPU 0:
Lock 0 (initialized at event_set_handler)
lock address : 0xffffffff807cee30 type     :               spin
initialized  : 0xffffffff80211ad5
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  0
current cpu  :                  0 last held:                  0
current lwp  : 0xffffa0005ae79840 last held: 0xffffa0005ae79840
last locked* : 0xffffffff80211f22 unlocked : 0xffffffff80211f6b
owner field  : 0x0000000000010800 wait/spin:                0/1

Lock 1 (initialized at main)
lock address : 0xffffffff806bd640 type     :               spin
initialized  : 0xffffffff805953f1
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  1
current cpu  :                  0 last held:                  0
current lwp  : 0xffffa0005ae79840 last held: 0xffffa0005ae79840
last locked* : 0xffffffff8021147a unlocked : 0xffffffff8049e085
curcpu holds :                  1 wanted by: 000000000000000000

Locks held on CPU 1:
Lock 0 (initialized at event_set_handler)
lock address : 0xffffffff807cee50 type     :               spin
initialized  : 0xffffffff80211ad5
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  0
current cpu  :                  0 last held:                  1
current lwp  : 0xffffa0005ae79840 last held: 0xffffa00066fa54a0
last locked* : 0xffffffff80211f22 unlocked : 0xffffffff80211f6b
owner field  : 0x0000000000010800 wait/spin:                0/1

Locks held on CPU 2:
Lock 0 (initialized at event_set_handler)
lock address : 0xffffffff807cee60 type     :               spin
initialized  : 0xffffffff80211ad5
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  0
current cpu  :                  0 last held:                  2
current lwp  : 0xffffa0005ae79840 last held: 0xffffa00066fbe4e0
last locked* : 0xffffffff80211f22 unlocked : 0xffffffff80211f6b
owner field  : 0x0000000000010800 wait/spin:                0/1

Locks held on CPU 3:
Lock 0 (initialized at event_set_handler)
lock address : 0xffffffff807cee70 type     :               spin
initialized  : 0xffffffff80211ad5
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  0
current cpu  :                  0 last held:                  3
current lwp  : 0xffffa0005ae79840 last held: 0xffffa00066fc2520
last locked* : 0xffffffff80211f22 unlocked : 0xffffffff80211f6b
owner field  : 0x0000000000010800 wait/spin:                0/1

Locks held on CPU 4:
Lock 0 (initialized at event_set_handler)
lock address : 0xffffffff807cee80 type     :               spin
initialized  : 0xffffffff80211ad5
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  0
current cpu  :                  0 last held:                  4
current lwp  : 0xffffa0005ae79840 last held: 0xffffa0006988f1a0
last locked* : 0xffffffff80211f22 unlocked : 0xffffffff80211f6b
owner field  : 0x0000000000010800 wait/spin:                0/1

Locks held on CPU 5:
Lock 0 (initialized at event_set_handler)
lock address : 0xffffffff807cee90 type     :               spin
initialized  : 0xffffffff80211ad5
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  0
current cpu  :                  0 last held:                  5
current lwp  : 0xffffa0005ae79840 last held: 0xffffa00066fcb5a0
last locked* : 0xffffffff80211f22 unlocked : 0xffffffff80211f6b
owner field  : 0x0000000000010800 wait/spin:                0/1

Locks held on CPU 6:
Lock 0 (initialized at event_set_handler)
lock address : 0xffffffff807ceea0 type     :               spin
initialized  : 0xffffffff80211ad5
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  0
current cpu  :                  0 last held:                  6
current lwp  : 0xffffa0005ae79840 last held: 0xffffa00066fcf5e0
last locked* : 0xffffffff80211f22 unlocked : 0xffffffff80211f6b
owner field  : 0x0000000000010800 wait/spin:                0/1

Locks held on CPU 7:
Lock 0 (initialized at event_set_handler)
lock address : 0xffffffff807ceeb0 type     :               spin
initialized  : 0xffffffff80211ad5
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  0
current cpu  :                  0 last held:                  7
current lwp  : 0xffffa0005ae79840 last held: 0xffffa00066fd5620
last locked* : 0xffffffff80211f22 unlocked : 0xffffffff80211f6b
owner field  : 0x0000000000010800 wait/spin:                0/1

Locks held on CPU 8:
Lock 0 (initialized at event_set_handler)
lock address : 0xffffffff807ceec0 type     :               spin
initialized  : 0xffffffff80211ad5
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  0
current cpu  :                  0 last held:                  8
current lwp  : 0xffffa0005ae79840 last held: 0xffffa00066fd9660
last locked* : 0xffffffff80211f22 unlocked : 0xffffffff80211f6b
owner field  : 0x0000000000010800 wait/spin:                0/1

Locks held on CPU 9:
Lock 0 (initialized at event_set_handler)
lock address : 0xffffffff807ceed0 type     :               spin
initialized  : 0xffffffff80211ad5
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  0
current cpu  :                  0 last held:                  9
current lwp  : 0xffffa0005ae79840 last held: 0xffffa000690b06a0
last locked* : 0xffffffff80211f22 unlocked : 0xffffffff80211f6b
owner field  : 0x0000000000010800 wait/spin:                0/1

Locks held on CPU 10:
Lock 0 (initialized at event_set_handler)
lock address : 0xffffffff807ceee0 type     :               spin
initialized  : 0xffffffff80211ad5
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  0
current cpu  :                  0 last held:                 10
current lwp  : 0xffffa0005ae79840 last held: 0xffffa000690b46e0
last locked* : 0xffffffff80211f22 unlocked : 0xffffffff80211f6b
owner field  : 0x0000000000010800 wait/spin:                0/1

Locks held on CPU 11:
Lock 0 (initialized at event_set_handler)
lock address : 0xffffffff807ceef0 type     :               spin
initialized  : 0xffffffff80211ad5
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  0
current cpu  :                  0 last held:                 11
current lwp  : 0xffffa0005ae79840 last held: 0xffffa000690b8720
last locked* : 0xffffffff80211f22 unlocked : 0xffffffff80211f6b
owner field  : 0x0000000000010800 wait/spin:                0/1

Locks held on CPU 12:
Lock 0 (initialized at event_set_handler)
lock address : 0xffffffff807cef00 type     :               spin
initialized  : 0xffffffff80211ad5
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  0
current cpu  :                  0 last held:                 12
shares wanted:                  0 exclusive:                  0
current cpu  :                  0 last held:                 12
current lwp  : 0xffffa0005ae79840 last held: 0xffffa000690bc760
last locked* : 0xffffffff80211f22 unlocked : 0xffffffff80211f6b
owner field  : 0x0000000000010800 wait/spin:                0/1

Locks held on CPU 13:
Lock 0 (initialized at event_set_handler)
lock address : 0xffffffff807cef10 type     :               spin
initialized  : 0xffffffff80211ad5
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  0
current cpu  :                  0 last held:                 13
current lwp  : 0xffffa0005ae79840 last held: 0xffffa000690c0420
last locked* : 0xffffffff80211f22 unlocked : 0xffffffff80211f6b
owner field  : 0x0000000000010800 wait/spin:                0/1

Locks held on CPU 14:
Lock 0 (initialized at event_set_handler)
lock address : 0xffffffff807cef20 type     :               spin
initialized  : 0xffffffff80211ad5
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  0
current cpu  :                  0 last held:                 14
current lwp  : 0xffffa0005ae79840 last held: 0xffffa000690c7460
last locked* : 0xffffffff80211f22 unlocked : 0xffffffff80211f6b
owner field  : 0x0000000000010800 wait/spin:                0/1

Locks held on CPU 15:
Lock 0 (initialized at event_set_handler)
lock address : 0xffffffff807cef30 type     :               spin
initialized  : 0xffffffff80211ad5
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  0
current cpu  :                  0 last held:                 15
current lwp  : 0xffffa0005ae79840 last held: 0xffffa000690cb4a0
last locked* : 0xffffffff80211f22 unlocked : 0xffffffff80211f6b
owner field  : 0x0000000000010800 wait/spin:                0/1

Locks held on CPU 16:
Lock 0 (initialized at event_set_handler)
lock address : 0xffffffff807cef40 type     :               spin
initialized  : 0xffffffff80211ad5
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  0
current cpu  :                  0 last held:                 16
current lwp  : 0xffffa0005ae79840 last held: 0xffffa000690d04e0
last locked* : 0xffffffff80211f22 unlocked : 0xffffffff80211f6b
owner field  : 0x0000000000010800 wait/spin:                0/1

Locks held on CPU 16:
Lock 0 (initialized at event_set_handler)
lock address : 0xffffffff807cef40 type     :               spin
initialized  : 0xffffffff80211ad5
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  0
current cpu  :                  0 last held:                 16
current lwp  : 0xffffa0005ae79840 last held: 0xffffa000690d04e0
last locked* : 0xffffffff80211f22 unlocked : 0xffffffff80211f6b
owner field  : 0x0000000000010800 wait/spin:                0/1

Locks held on CPU 17:
Lock 0 (initialized at event_set_handler)
lock address : 0xffffffff807cef50 type     :               spin
initialized  : 0xffffffff80211ad5
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  0
current cpu  :                  0 last held:                 17
current lwp  : 0xffffa0005ae79840 last held: 0xffffa000841d8300
last locked* : 0xffffffff80211f22 unlocked : 0xffffffff80211f6b
owner field  : 0x0000000000010800 wait/spin:                0/1

Locks held on CPU 18:
Lock 0 (initialized at event_set_handler)
lock address : 0xffffffff807cef60 type     :               spin
initialized  : 0xffffffff80211ad5
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  0
current cpu  :                  0 last held:                 18
current lwp  : 0xffffa0005ae79840 last held: 0xffffa000690d9560
last locked* : 0xffffffff80211f22 unlocked : 0xffffffff80211f6b
owner field  : 0x0000000000010800 wait/spin:                0/1

Locks held on CPU 19:
Lock 0 (initialized at event_set_handler)
lock address : 0xffffffff807cef70 type     :               spin
initialized  : 0xffffffff80211ad5
shared holds :                  0 exclusive:                  1
shares wanted:                  0 exclusive:                  0
current cpu  :                  0 last held:                 19
current lwp  : 0xffffa0005ae79840 last held: 0xffffa000690df5a0
last locked* : 0xffffffff80211f22 unlocked : 0xffffffff80211f6b
owner field  : 0x0000000000010800 wait/spin:                0/1

db{0}> dmesg
Copyright (c) 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005,
    2006, 2007, 2008, 2009, 2010, 2011, 2012, 2013, 2014, 2015, 2016, 2017,
    2018 The NetBSD Foundation, Inc.  All rights reserved.
Copyright (c) 1982, 1986, 1989, 1991, 1993
    The Regents of the University of California.  All rights reserved.

NetBSD 8.0_STABLE (BLUEGLEAM_XEN3_DOMU-LOCKDEBUG) #0: Mon Sep 17 21:29:03 EEST 2
018

duck%power.shangtai.net@localhost:/usr/build/src/sys/arch/amd64/compile/obj/BLUEGL
EAM_XEN3_DOMU-LOCKDEBUG
total memory = 51200 MB
avail memory = 49565 MB
timecounter: Timecounters tick every 10.000 msec
Kernelized RAIDframe activated
running cgd selftest aes-xts-256 aes-xts-512 done
mainbus0 (root)
hypervisor0 at mainbus0: Xen version 4.11.0nb0
hypervisor0: features: mmu_pt_update_preserve_ad highmem_assist gnttab_map_avai
l_bits
VIRQ_DEBUG interrupt using event channel 3
vcpu0 at hypervisor0
vcpu0: Intel(R) Xeon(R) CPU           X5650  @ 2.67GHz, id 0x206c2
vcpu0: package 1, core 8, smt 1
vcpu1 at hypervisor0
vcpu1: Intel(R) Xeon(R) CPU           X5650  @ 2.67GHz, id 0x206c2
vcpu1: package 1, core 0, smt 0
vcpu2 at hypervisor0
vcpu2: Intel(R) Xeon(R) CPU           X5650  @ 2.67GHz, id 0x206c2
vcpu2: package 1, core 0, smt 1
vcpu3 at hypervisor0
vcpu3: Intel(R) Xeon(R) CPU           X5650  @ 2.67GHz, id 0x206c2
vcpu3: package 1, core 1, smt 0
vcpu4 at hypervisor0
vcpu4: Intel(R) Xeon(R) CPU           X5650  @ 2.67GHz, id 0x206c2
vcpu4: package 1, core 1, smt 1
vcpu5 at hypervisor0
vcpu5: Intel(R) Xeon(R) CPU           X5650  @ 2.67GHz, id 0x206c2
vcpu5: package 1, core 2, smt 0
vcpu6 at hypervisor0
vcpu6: Intel(R) Xeon(R) CPU           X5650  @ 2.67GHz, id 0x206c2
vcpu6: package 1, core 2, smt 1
vcpu7 at hypervisor0
vcpu7: Intel(R) Xeon(R) CPU           X5650  @ 2.67GHz, id 0x206c2
vcpu7: package 1, core 8, smt 0
vcpu8 at hypervisor0
vcpu8: Intel(R) Xeon(R) CPU           X5650  @ 2.67GHz, id 0x206c2
vcpu8: package 1, core 10, smt 1
vcpu9 at hypervisor0
vcpu9: Intel(R) Xeon(R) CPU           X5650  @ 2.67GHz, id 0x206c2
vcpu9: package 1, core 9, smt 0
vcpu10 at hypervisor0
vcpu10: Intel(R) Xeon(R) CPU           X5650  @ 2.67GHz, id 0x206c2
vcpu10: package 1, core 9, smt 1
vcpu11 at hypervisor0
vcpu11: Intel(R) Xeon(R) CPU           X5650  @ 2.67GHz, id 0x206c2
vcpu11: package 1, core 10, smt 0
vcpu12 at hypervisor0
vcpu12: Intel(R) Xeon(R) CPU           X5650  @ 2.67GHz, id 0x206c2
vcpu12: package 0, core 9, smt 1
vcpu13 at hypervisor0
vcpu13: Intel(R) Xeon(R) CPU           X5650  @ 2.67GHz, id 0x206c2
vcpu13: package 0, core 10, smt 0
vcpu14 at hypervisor0
vcpu14: Intel(R) Xeon(R) CPU           X5650  @ 2.67GHz, id 0x206c2
vcpu14: package 0, core 10, smt 1
vcpu15 at hypervisor0
vcpu15: Intel(R) Xeon(R) CPU           X5650  @ 2.67GHz, id 0x206c2
vcpu15: package 1, core 0, smt 0
vcpu16 at hypervisor0
vcpu16: Intel(R) Xeon(R) CPU           X5650  @ 2.67GHz, id 0x206c2
vcpu16: package 1, core 0, smt 1
vcpu17 at hypervisor0
vcpu17: Intel(R) Xeon(R) CPU           X5650  @ 2.67GHz, id 0x206c2
vcpu17: package 1, core 8, smt 1
vcpu18 at hypervisor0
vcpu18: Intel(R) Xeon(R) CPU           X5650  @ 2.67GHz, id 0x206c2
vcpu18: package 0, core 0, smt 0
vcpu19 at hypervisor0
vcpu19: Intel(R) Xeon(R) CPU           X5650  @ 2.67GHz, id 0x206c2
vcpu19: package 0, core 0, smt 1
xenbus0 at hypervisor0: Xen Virtual Bus Interface
xencons0 at hypervisor0: Xen Virtual Console Driver
xencons0: console major 143, unit 0
xencons0: using event channel 2
timecounter: Timecounter "clockinterrupt" frequency 100 Hz quality 0
timecounter: Timecounter "xen_system_time" frequency 1000000000 Hz quality 10000

Xen clock: using event channel 5
Xen clock: using event channel 7
Xen clock: using event channel 9
Xen clock: using event channel 11
Xen clock: using event channel 13
Xen clock: using event channel 15
Xen clock: using event channel 17
Xen clock: using event channel 19
Xen clock: using event channel 21
Xen clock: using event channel 23
Xen clock: using event channel 25
Xen clock: using event channel 27
Xen clock: using event channel 29
Xen clock: using event channel 31
Xen clock: using event channel 33
Xen clock: using event channel 35
Xen clock: using event channel 37
Xen clock: using event channel 39
Xen clock: using event channel 41
Xen clock: using event channel 43
xenbus0: using event channel 1
xenbus: can't get state for device/suspend/event-channel (2)
xbd0 at xenbus0 id 768: Xen Virtual Block Device Interface
xbd0: using event channel 44
xennet0 at xenbus0 id 0: Xen Virtual Network Interface
xennet0: MAC address 00:16:3e:00:07:03
xennet0: using event channel 45
balloon0 at xenbus0 id 0: Xen Balloon driver
balloon0: current reservation: 52428800 KiB
xbd0: 100 GB, 512 bytes/sect x 209715200 sectors
xennet0: using RX copy mode
xenbus: can't get state for device/suspend/event-channel (2)
balloon0: current reservation: 13107200 pages => target: 13107200 pages
ignore shutdown request:
xenbus: can't get state for device/suspend/event-channel (2)
IPsec: Initialized Security Association Processing.
boot device: xbd0
root on xbd0a dumps on xbd0b
dump_misc_init: max_paddr = 0x0
Your machine does not initialize mem_clusters; sparse_dumps disabled
mountroot: trying lfs...
mountroot: trying ext2fs...
mountroot: trying ffs...
root file system type: ffs
kern.module.path=/stand/amd64/8.0/modules
fatal breakpoint trap in supervisor mode
trap type 1 code 0 rip 0xffffffff80205a95 cs 0xe030 rflags 0x202 cr2 0x7f7ff3418
038 ilevel 0x8 rsp 0xffffa008d04edc10
curlwp 0xffffa0005ae79840 pid 0.2 lowest kstack 0xffffa008d04ea2c0





Home | Main Index | Thread Index | Old Index