NetBSD-Bugs archive

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]

Re: port-amd64/53155: OS wedges after <12h uptime when >2 bnx network interfaces in use



The following reply was made to PR port-amd64/53155; it has been noted by GNATS.

From: Havard Eidnes <he%NetBSD.org@localhost>
To: gnats-bugs%NetBSD.org@localhost
Cc: port-amd64-maintainer%netbsd.org@localhost
Subject: Re: port-amd64/53155: OS wedges after <12h uptime when >2 bnx
 network interfaces in use
Date: Sun, 27 May 2018 23:22:16 +0200 (CEST)

 Hi,
 
 another wedge.  This time with "show all locks/t".
 
 This time I did not assign an IP address to the bnx3 interface
 which I took up right before it wedged.
 
 I have the matching kernel core dump.
 
 Regards,
 
 - Havard
 
 ------------------------------
 
 
 db{0}> show all locks/t
 [Locks tracked through LWPs]
 Locks held by an LWP (npfgc-0):
 Lock 0 (initialized at npf_config_init)
 lock address : 0xfffffe822d7e54c8 type     :     sleep/adaptive
 initialized  : 0xffffffff8196d8cf
 shared holds :                  0 exclusive:                  1
 shares wanted:                  0 exclusive:                  0
 current cpu  :                  0 last held:                  5
 current lwp  : 0xfffffe822f5eb440 last held: 0xfffffe822cf3d1c0
 last locked* : 0xffffffff81972df3 unlocked : 0xffffffff81972e03
 owner field  : 0xfffffe822cf3d1c0 wait/spin:                0/0
 
 Turnstile chain at 0xffffffff814c5050.
 => No active turnstile for this lock.
 trace: pid 0 lid 123 at 0xffff8000bcec6eb0
 sleepq_block() at netbsd:sleepq_block+0x97
 cv_wait() at netbsd:cv_wait+0x127
 xc_wait() at netbsd:xc_wait+0x7c
 pserialize_perform() at netbsd:pserialize_perform+0x102
 npf_conn_gc() at npf:npf_conn_gc+0x1b5
 npf_worker() at npf:npf_worker+0x4b
 
 Locks held by an LWP (ioflush):
 Lock 0 (initialized at wapbl_start)
 lock address : 0xfffffe810f4fd480 type     :     sleep/adaptive
 initialized  : 0xffffffff80a4a13c
 shared holds :                  0 exclusive:                  1
 shares wanted:                  0 exclusive:                  0
 current cpu  :                  0 last held:                  2
 current lwp  : 0xfffffe822f5eb440 last held: 0xfffffe822dc08940
 last locked* : 0xffffffff80a480ce unlocked : 0xffffffff8091396b
 owner/count  : 0xfffffe822dc08940 flags    : 0x0000000000000004
 
 Turnstile chain at 0xffffffff814c4fc0.
 => No active turnstile for this lock.
 trace: pid 0 lid 119 at 0xffff8000bcceecf0
 sleepq_block() at netbsd:sleepq_block+0x97
 cv_wait() at netbsd:cv_wait+0x127
 biowait() at netbsd:biowait+0x61
 wapbl_buffered_flush() at netbsd:wapbl_buffered_flush+0xc6
 wapbl_buffered_write() at netbsd:wapbl_buffered_write+0x69
 wapbl_circ_write() at netbsd:wapbl_circ_write+0xa7
 wapbl_flush() at netbsd:wapbl_flush+0x386
 ffs_sync() at netbsd:ffs_sync+0x220
 VFS_SYNC() at netbsd:VFS_SYNC+0x35
 sched_sync() at netbsd:sched_sync+0x91
 
            
 [Locks tracked through CPUs]
 Locks held on CPU 0:
 Lock 0 (initialized at com_attach_subr)
 lock address : 0xfffffe810f2731e0 type     :               spin
 initialized  : 0xffffffff805f4964
 shared holds :                  0 exclusive:                  1
 shares wanted:                  0 exclusive:                  0
 current cpu  :                  0 last held:                  0
 current lwp  : 0xfffffe822f5eb440 last held: 0xfffffe822f5eb440
 last locked* : 0xffffffff805f3ec4 unlocked : 0xffffffff805f40a3
 owner field  : 0x0000000000010800 wait/spin:                0/1
 trace: pid 0 lid 6 at 0xffff8000ae69ad18
 breakpoint() at netbsd:breakpoint+0x5
 comintr() at netbsd:comintr+0x562
 Xhandle_ioapic_edge13() at netbsd:Xhandle_ioapic_edge13+0x66
 --- interrupt ---
 splraise() at netbsd:splraise
 _kernel_lock() at netbsd:_kernel_lock+0x129
 intr_biglock_wrapper() at netbsd:intr_biglock_wrapper+0x16
 Xhandle_ioapic_level5() at netbsd:Xhandle_ioapic_level5+0x6a
 --- interrupt ---
 Xspllower() at netbsd:Xspllower+0xe
 DDB lost frame for netbsd:Xsoftintr+0x4f, trying 0xffff8000ae69b0f0
 Xsoftintr() at netbsd:Xsoftintr+0x4f
 --- interrupt ---
 0:
 
 
 db{0}>
 
 db{0}> ps
 PID    LID S CPU     FLAGS       STRUCT LWP *               NAME WAIT
 28127    1 3   0        80   fffffe821b45c660               sshd select
 3765     1 3   0        80   fffffe821c860980               sshd select
 10510    1 3   0        80   fffffe820c1a95a0               sshd select
 12095    1 3   0        80   fffffe8201ea4880               sshd select
 24917    1 3   2        80   fffffe82143e10c0               sshd select
 14706    1 3   2        80   fffffe81f95ab000               sshd select
 24718    1 3   4        80   fffffe822d981420               tcsh ttyraw
 14768    1 3   6        80   fffffe8127c869c0             pickup kqueue
 17173    1 3   7        80   fffffe821b7d1300               tcsh ttyraw
 22683    1 3   0        80   fffffe821e368720               tcsh pause
 6496     1 3   2        80   fffffe81fdf25980              xterm select
 8713     1 3   4        80   fffffe8223f352e0               tcsh pause
 18715    1 3   1        80   fffffe8203885760               sshd select
 27311    1 3   0        80   fffffe821f2322c0               sshd select
 12100    1 3   1        80   fffffe82208de4a0               tcsh ttyraw
 19259    1 3   7        80   fffffe820b1e85c0              xterm select
 27176    1 3   1        80   fffffe81bf43b260               tcsh pause
 17081    1 3   0        80   fffffe82261ef260               sshd select
 20646    1 3   0        80   fffffe821e413100               sshd select
 12410    1 3   0        80   fffffe821c761640               tcsh ttyraw
 17135    1 3   7        80   fffffe821e413520              xterm select
 5138     1 3   1        80   fffffe810f791ba0               tcsh pause
 4590     1 3   5        80   fffffe82261efaa0               sshd select
 14049    1 3   7        80   fffffe81f72641a0               sshd select
 13260    1 3   2        80   fffffe8218a44280                ssh select
 12084    1 3   5        80   fffffe8126a67a60               tcsh pause
 20039    1 3   0        80   fffffe8214096100              xterm select
 12456    1 3   5        80   fffffe820b1e81a0               tcsh pause
 16421    1 3   3        80   fffffe81afe42600               sshd select
 2132     1 3   5        80   fffffe8200185120               sshd select
 28308    1 3   6        80   fffffe81fdf25140                ssh select
 153      1 3   6        80   fffffe81cfc24240                 sh wait
 29602    1 3   6        80   fffffe81f77cd640                ssh select
 26803    1 3   6        80   fffffe820c1a99c0                 sh wait
 25619    1 3   5        80   fffffe822d908120                ssh select
 24644    1 3   6        80   fffffe821acfb480                 sh wait
 28650    1 3   6        80   fffffe82208de8c0                ssh select
 28765    1 3   6        80   fffffe822d7f8140                 sh wait
 26866    1 3   0        80   fffffe8218a446a0                ssh select
 28190    1 3   6        80   fffffe821a21e600                 sh wait
 23270    1 3   0        80   fffffe820f1bc640                ssh select
 29000    1 3   0        80   fffffe820bb76b60                 sh wait
 556      1 3   0        80   fffffe822478cb00                ssh select
 27618    1 3   0        80   fffffe81ffea40e0                 sh wait
 25866    1 3   0        80   fffffe821c341260                ssh select
 29240    1 3   0        80   fffffe82222d0a00                 sh wait
 27689    1 3   0        80   fffffe82206a4340                ssh select
 2714     1 3   0        80   fffffe81f95db780                 sh wait
 1755     1 3   5        80   fffffe821d1b00e0                ssh select
 27303    1 3   6        80   fffffe821fb47060                 sh wait
 25810    1 3   6        80   fffffe821f3a70c0                ssh select
 28383    1 3   6        80   fffffe81f77cd220                 sh wait
 21350    1 3   6        80   fffffe8219cd4740                ssh select
 24176    1 3   6        80   fffffe8201ea4040                 sh wait
 25377    1 3   0        80   fffffe82251f3280                ssh select
 28753    1 3   6        80   fffffe8208905280                 sh wait
 28152    1 3   0        80   fffffe820ad5b080                ssh select
 22480    1 3   6        80   fffffe820bb76320                 sh wait
 397      1 3   6        80   fffffe8208905ac0                ssh select
 27414    1 3   6        80   fffffe82134910a0                 sh wait
 25934    1 3   1        80   fffffe82102b8500                ssh select
 1603     1 3   0        80   fffffe81ad7c26a0                 sh wait
 28109    1 3   0        80   fffffe822d981000                ssh select
 29687    1 3   0        80   fffffe8214096940                 sh wait
 22723    1 3   7        80   fffffe821630a060                ssh select
 936      1 3   7        80   fffffe81f9e538a0                 sh wait
 28299    1 3   7        80   fffffe822c2c2860                ssh select
 25799    1 3   7        80   fffffe821a3b8b20                 sh wait
 25713    1 3   6        80   fffffe81be3c16c0                ssh select
 28263    1 3   6        80   fffffe82207b6ba0                 sh wait
 28024    1 3   6        80   fffffe821a21e1e0                ssh select
 27324    1 3   6        80   fffffe81f95dbba0                 sh wait
 23843    1 3   6        80   fffffe821e368b40                ssh select
 25187    1 3   6        80   fffffe8220b67760                 sh wait
 26257    1 3   6        80   fffffe822d60d9c0                ssh select
 28946    1 3   6        80   fffffe822d887580                 sh wait
 29668    1 3   6        80   fffffe821e33b860                ssh select
 28070    1 3   6        80   fffffe821f2326e0                 sh wait
 8919     1 3   5        80   fffffe821a852020               tcsh ttyraw
 792      1 3   0        80   fffffe8218a44ac0               tcsh pause
 1018     1 3   0        80   fffffe82174cb680               tcsh pause
 1284     1 3   0        80   fffffe82174cbaa0                ssh select
 1017     1 3   5        80   fffffe821b45c240                 sh wait
 1143     1 3   4        80   fffffe821b45ca80              xterm select
 563      1 3   5        80   fffffe8219b27220               tcsh pause
 1076     1 3   1        80   fffffe8219b27640               sshd select
 626      1 3   5        80   fffffe8219b27a60               sshd select
 272      1 3   0        80   fffffe8218a621e0              xterm select
 1086     1 3   6        80   fffffe821af99b80               tcsh pause
 893      1 3   3        80   fffffe82184f89a0               sshd select
 639      1 3   0        80   fffffe821c0181a0               sshd select
 884      1 3   4        80   fffffe8218bb2a00                ssh select
 371      1 3   4        80   fffffe8218bb25e0                 sh wait
 878      1 3   1        80   fffffe821d22e280                ssh select
 877      1 3   1        80   fffffe821a2e9200                 sh wait
 1260     1 3   7        80   fffffe821a2e9620                ssh select
 747      1 3   2        80   fffffe821d7af100                 sh wait
 354      1 3   3        80   fffffe8218ff04c0                ssh select
 481      1 3   0        80   fffffe821a2e9a40                 sh wait
 1118     1 3   1        80   fffffe8218a62600                ssh select
 989      1 3   4        80   fffffe8218a62a20          conserver select
 988      1 3   1        80   fffffe8218bb21c0                 sh wait
 601      1 3   3        80   fffffe821c0185c0                ssh select
 984      1 3   0        80   fffffe82196e11a0                ssh select
 855      1 3   3        80   fffffe82196e15c0                 sh wait
 598      1 3   6        80   fffffe82196e19e0                 sh wait
 597      1 3   7        80   fffffe821af99340                ssh select
 1236     1 3   3        80   fffffe821a3a7180                ssh select
 467      1 3   5        80   fffffe821a3a75a0                 sh wait
 338      1 3   7        80   fffffe821a3a79c0                ssh select
 1233     1 3   1        80   fffffe82184f8160                 sh wait
 336      1 3   4        80   fffffe82184f8580                 sh wait
 1230     1 3   6        80   fffffe821be405e0                ssh select
 844      1 3   5        80   fffffe821c064140                 sh wait
 459      1 3   4        80   fffffe821c064560                ssh select
 458      1 3   2        80   fffffe821c064980                 sh wait
 457      1 3   3        80   fffffe8219be1120                ssh select
 456      1 3   7        80   fffffe8219be1540                ssh select
 1222     1 3   6        80   fffffe8219be1960                 sh wait
 1220     1 3   0        80   fffffe821d7af940                 sh wait
 321      1 3   0        80   fffffe821af99760                ssh select
 320      1 3   0        80   fffffe821d7af520                 sh wait
 957      1 3   4        80   fffffe821a0110e0          conserver select
 954      1 3   0        80   fffffe821c8b5320                ssh select
 953      1 3   0        80   fffffe821a011500                 sh wait
 952      1 3   5        80   fffffe821a011920                ssh select
 566      1 3   7        80   fffffe821a1424e0                ssh select
 949      1 3   5        80   fffffe821a142900                 sh wait
 1204     1 3   7        80   fffffe8218ff00a0                 sh wait
 306      1 3   4        80   fffffe8218ff08e0                ssh select
 1201     1 3   4        80   fffffe821ab0b080                 sh wait
 304      1 3   6        80   fffffe821ab0b4a0                ssh select
 943      1 3   1        80   fffffe821a9b8b00                ssh select
 1198     1 3   6        80   fffffe821ab0b8c0                 sh wait
 1197     1 3   1        80   fffffe821acfb060                 sh wait
 1182     1 3   4        80   fffffe821b9b9360          conserver select
 797      1 3   5        80   fffffe821b7d1b40                ssh select
 540      1 3   0        80   fffffe821b9b9780                 sh wait
 539      1 3   0        80   fffffe821b9b9ba0          conserver select
 918      1 3   0        80   fffffe821d22e6a0                ssh select
 917      1 3   0        80   fffffe821c341aa0                 sh wait
 1044     1 3   4        80   fffffe821c341680          conserver select
 1041     1 3   0        80   fffffe821c761220                ssh select
 400      1 3   0        80   fffffe821d107a80                 sh wait
 911      1 3   4        80   fffffe821c8b1200                ssh select
 1038     1 3   0        80   fffffe821c8b5740                 sh wait
 781      1 3   4        80   fffffe821c8b5b60          conserver select
 267      1 3   4        80   fffffe821b7d1720                ssh select
 264      1 3   4        80   fffffe821cc7e2e0                 sh wait
 265      1 3   6        80   fffffe821cc7e700                ssh select
 1415     1 3   6        80   fffffe821cc7eb20                 sh wait
 774      1 3   7        80   fffffe821a9b82c0                ssh select
 901      1 3   0        80   fffffe821a9b86e0                 sh wait
 386      1 3   2        80   fffffe821bd2a6c0                ssh select
 385      1 3   2        80   fffffe821bd2aae0                 sh wait
 630      1 3   4        80   fffffe821d107240                ssh select
 757      1 3   4        80   fffffe821d107660                 sh wait
 1009     1 3   6        80   fffffe821c761a60                ssh select
 559      1 3   6        80   fffffe821c8b1620                ssh select
 814      1 3   0        80   fffffe821c8b1a40                 sh wait
 813      1 3   6        80   fffffe821ce4b1e0                 sh wait
 876      1 3   7        80   fffffe821ce4b600                ssh select
 363      1 3   7        80   fffffe821ce4ba20                 sh wait
 362      1 3   2        80   fffffe821be401c0          conserver select
 296      1 3   0        80   fffffe821be40a00                ssh select
 613      1 3   1        80   fffffe821c0189e0                ssh select
 995      1 3   0        80   fffffe821d462180                 sh wait
 290      1 3   0        80   fffffe821d4625a0                ssh select
 161      1 3   1        80   fffffe821d4629c0                 sh wait
 160      1 3   4        80   fffffe82251f3ac0                 sh wait
 671      1 3   0        80   fffffe821e38c160                ssh select
 990      1 3   6        80   fffffe821e38c580                ssh select
 669      1 3   2        80   fffffe821e38c9a0                 sh wait
 604      1 3   6        80   fffffe821c860140                 sh wait
 603      1 3   0        80   fffffe821c860560                ssh select
 537      1 3   3        80   fffffe821dba9120                 sh wait
 137      1 3   3        80   fffffe821f3a74e0          conserver select
 136      1 3   0        80   fffffe82209a0320                ssh select
 1031     1 3   7        80   fffffe822cf3da00                 sh wait
 838      1 3   2        80   fffffe821f3a7900                ssh select
 517      1 3   4        80   fffffe821ed310a0                ssh select
 900      1 3   2        80   fffffe822d887160                 sh wait
 899      1 3   4        80   fffffe82285b7640                 sh wait
 194      1 3   6        80   fffffe8224659ae0                ssh select
 193      1 3   3        80   fffffe821ed314c0                 sh wait
 192      1 3   5        80   fffffe821ed318e0                ssh select
 473      1 3   0        80   fffffe821e330080                 sh wait
 73       1 3   1        80   fffffe822d908540                ssh select
 569      1 3   7        80   fffffe821e3304a0                 sh wait
 75       1 3   3        80   fffffe822d7f8980                ssh select
 232      1 3   6        80   fffffe821fb47480                 sh wait
 749      1 3   5        80   fffffe822dc08100          conserver select
 170      1 3   6        80   fffffe82285b7a60          conserver select
 171      1 3   0        80   fffffe822dc01920              getty ttyraw
 169      1 3   4        80   fffffe822d908960          conserver select
 646      1 3   7        80   fffffe82207b6780          conserver select
 766      1 3   0        80   fffffe82209a0740               cron nanoslp
 716      1 3   1        80   fffffe82234a5b40              inetd kqueue
 97       1 3   4        80   fffffe822cff7200              nginx kqueue
 96       1 3   4        80   fffffe8223f35700              nginx pause
 589      1 3   4        80   fffffe822478c6e0               qmgr kqueue
 756      1 3   6        80   fffffe82246592a0             master kqueue
 408      1 3   0        80   fffffe822d34d5c0               sshd select
 469      1 3   0        80   fffffe822705ea80           tac_plus select
 438      1 3   0        80   fffffe82285b7220             powerd kqueue
 421      1 3   3        80   fffffe822d60d5a0               ntpd pause
 380      4 3   4        80   fffffe822cfce600              dhcpd parked
 380      3 3   0        80   fffffe822d34d9e0              dhcpd kqueue
 380      2 3   7        80   fffffe822d7f8560              dhcpd parked
 380      1 3   4        80   fffffe822cff7620              dhcpd parked
 83       1 2   6         0   fffffe822cfce1e0            syslogd
 1        1 3   7        80   fffffe810f56a900               init wait
 0      124 5   0       200   fffffe81ffea4920           (zombie)
 0      123 3   5       200   fffffe822cf3d1c0            npfgc-0 xchicv
 0      122 3   7       200   fffffe822cfcea20              ipmi0 ipmi0
 0      121 3   3       200   fffffe822dc01500            physiod physiod
 0      120 3   0       200   fffffe822dc08520           aiodoned aiodoned
 0      119 3   2       200   fffffe822dc08940            ioflush biowait
 0      118 3   0       200   fffffe822dc010e0           pgdaemon pgdaemon
 0      115 3   0       280   fffffe810f56a0c0              spkr1 bellcv
 0      114 3   5       280   fffffe810f56a4e0           audiomix play
 0      113 3   5       280   fffffe810edc32a0           audiorec record
 0      112 3   0       200   fffffe810f33a300          atapibus0 sccomp
 0      110 3   1       200   fffffe810f3332e0               usb2 usbevt
 0      109 3   3       200   fffffe810f333b20               usb5 usbevt
 0      108 3   3       200   fffffe810f333700               usb0 usbevt
 0      107 3   1       200   fffffe810f33ab40               usb3 usbevt
 0      106 3   1       200   fffffe810f2352c0               usb1 usbevt
 0      105 3   3       200   fffffe810f311b60               usb4 usbevt
 0      104 3   0       200   fffffe810f99b0a0            rt_free rt_free
 0      103 3   0       200   fffffe810f99b4c0              unpgc unpgc
 0      102 3   0       200   fffffe810f99b8e0    key_timehandler key_timehandler
 
 0      101 3   7       200   fffffe810f484080    icmp6_wqinput/7 icmp6_wqinput
 0      100 3   6       200   fffffe810f4844a0    icmp6_wqinput/6 icmp6_wqinput
 0       99 3   5       200   fffffe810f4848c0    icmp6_wqinput/5 icmp6_wqinput
 0       98 3   4       200   fffffe810f495060    icmp6_wqinput/4 icmp6_wqinput
 0       97 3   3       200   fffffe810f495480    icmp6_wqinput/3 icmp6_wqinput
 0       96 3   2       200   fffffe810f4958a0    icmp6_wqinput/2 icmp6_wqinput
 0       95 3   1       200   fffffe810f3be040    icmp6_wqinput/1 icmp6_wqinput
 0       94 3   0       200   fffffe810f3be460    icmp6_wqinput/0 icmp6_wqinput
 0       93 3   0       200   fffffe810f3be880          nd6_timer nd6_timer
 0       92 3   7       200   fffffe810f387020     icmp_wqinput/7 icmp_wqinput
 0       91 3   6       200   fffffe810f387440     icmp_wqinput/6 icmp_wqinput
 0       90 3   5       200   fffffe810f387860     icmp_wqinput/5 icmp_wqinput
 0       89 3   4       200   fffffe810f3a8000     icmp_wqinput/4 icmp_wqinput
 0       88 3   3       200   fffffe810f3a8420     icmp_wqinput/3 icmp_wqinput
 0       87 3   2       200   fffffe810f3a8840     icmp_wqinput/2 icmp_wqinput
 0       86 3   1       200   fffffe810f36e360     icmp_wqinput/1 icmp_wqinput
 0       85 3   0       200   fffffe810f36e780     icmp_wqinput/0 icmp_wqinput
 0       84 3   0       200   fffffe810f36eba0           rt_timer rt_timer
 0       83 3   0       200   fffffe810f33a720        vmem_rehash vmem_rehash
 0       82 3   7       200   fffffe810f318340          coretemp3 coretemp3
 0       81 3   7       200   fffffe810f318760          coretemp2 coretemp2
 0       80 3   5       200   fffffe810f318b80          coretemp1 coretemp1
 0       79 3   1       200   fffffe810f311320          coretemp0 coretemp0
 0       78 3   1       200   fffffe810f311740               mfi0 mfi0
 0       69 3   5       200   fffffe810f2356e0            atabus1 atath
 0       68 3   5       200   fffffe810f235b00            atabus0 atath
 0       66 3   0       200   fffffe810edc36c0           scsibus0 sccomp
 0       65 3   3       200   fffffe810edc3ae0         usbtask-dr usbtsk
 0       64 3   0       200   fffffe810ed02280         usbtask-hc usbtsk
 0       63 3   1       200   fffffe810ed026a0               bnx3 bnx3
 0       62 3   7       200   fffffe810ed02ac0               bnx2 bnx2
 0       61 3   2       200   fffffe810eb79260               bnx1 bnx1
 0       60 3   7       200   fffffe810eb79680               bnx0 bnx0
 0       59 3   5       200   fffffe810eb79aa0               ipmi ipmipoll
 0       58 3   7       200   fffffe810eaca240            xcall/7 xcall
 0       57 1   7       200   fffffe810eaca660          softser/7
 0       56 1   7       200   fffffe810eacaa80          softclk/7
 0       55 1   7       200   fffffe810eac3220          softbio/7
 0       54 1   7       200   fffffe810eac3640          softnet/7
 0    >  53 7   7       201   fffffe810eac3a60             idle/7
 0       52 3   6       200   fffffe810ea72200            xcall/6 xcall
 0       51 1   6       200   fffffe810ea72620          softser/6
 0       50 1   6       200   fffffe810ea72a40          softclk/6
 0       49 1   6       200   fffffe810ea6b1e0          softbio/6
 0       48 1   6       200   fffffe810ea6b600          softnet/6
 0    >  47 7   6       201   fffffe810ea6ba20             idle/6
 0       46 3   5       200   fffffe810ea221c0            xcall/5 xcall
 0       45 1   5       200   fffffe810ea225e0          softser/5
 0       44 1   5       200   fffffe810ea22a00          softclk/5
 0       43 1   5       200   fffffe810ea0b1a0          softbio/5
 0       42 1   5       200   fffffe810ea0b5c0          softnet/5
 0    >  41 7   5       201   fffffe810ea0b9e0             idle/5
 0       40 3   4       200   fffffe810e9ca180            xcall/4 xcall
 0       39 1   4       200   fffffe810e9ca5a0          softser/4
 0       38 1   4       200   fffffe810e9ca9c0          softclk/4
 0       37 1   4       200   fffffe810e9b3160          softbio/4
 0       36 1   4       200   fffffe810e9b3580          softnet/4
 0    >  35 7   4       201   fffffe810e9b39a0             idle/4
 0       34 3   3       200   fffffe810e972140            xcall/3 xcall
 0       33 1   3       200   fffffe810e972560          softser/3
 0       32 1   3       200   fffffe810e972980          softclk/3
 0       31 1   3       200   fffffe810e95b120          softbio/3
 0       30 1   3       200   fffffe810e95b540          softnet/3
 0    >  29 7   3       201   fffffe810e95b960             idle/3
 0       28 3   2       200   fffffe810e922100            xcall/2 xcall
 0       27 1   2       200   fffffe810e922520          softser/2
 0       26 1   2       200   fffffe810e922940          softclk/2
 0       25 1   2       200   fffffe810e9030e0          softbio/2
 0       24 1   2       200   fffffe810e903500          softnet/2
 0    >  23 7   2       201   fffffe810e903920             idle/2
 0       22 3   1       200   fffffe810e8ca0c0            xcall/1 xcall
 0       21 1   1       200   fffffe810e8ca4e0          softser/1
 0       20 1   1       200   fffffe810e8ca900          softclk/1
 0       19 1   1       200   fffffe810e8a30a0          softbio/1
 0       18 1   1       200   fffffe810e8a34c0          softnet/1
 0    >  17 7   1       201   fffffe810e8a38e0             idle/1
 0       16 3   0       200   fffffe822dd92080           lnxsyswq lnxsyswq
 0       15 3   2       200   fffffe822dd924a0             sysmon smtaskq
 0       14 3   6       200   fffffe822dd928c0         pmfsuspend pmfsuspend
 0       13 3   5       200   fffffe822e1b1060           pmfevent pmfevent
 0       12 3   0       200   fffffe822e1b1480         sopendfree sopendfr
 0       11 3   7       200   fffffe822e1b18a0           nfssilly nfssilly
 0       10 3   0       200   fffffe822f5d0040            cachegc cachegc
 0        9 3   0       200   fffffe822f5d0460             vdrain vdrain
 0        8 3   0       200   fffffe822f5d0880          modunload mod_unld
 0        7 3   0       200   fffffe822f5eb020            xcall/0 xcall
 0    >   6 7   0       200   fffffe822f5eb440          softser/0
 0    >   5 7   0       200   fffffe822f5eb860          softclk/0
 0        4 1   0       200   fffffe822f607000          softbio/0
 0    >   3 7   0       200   fffffe822f607420          softnet/0
 0    >   2 7   0       201   fffffe822f607840             idle/0
 0        1 3   0       200   ffffffff81481b80            swapper uvm
 db{0}>
 
 db{0}> trace/a fffffe822f607420
 trace: pid 0 lid 3 at 0xffff8000ae6960e0
 Xsoftintr() at netbsd:Xsoftintr+0x4f
 --- interrupt ---
 0:
 db{0}> trace/a fffffe822f5eb860
 trace: pid 0 lid 5 at 0xffff8000ae63df50
 Xsoftintr() at netbsd:Xsoftintr+0x4f
 --- interrupt ---
 ?() at 0
 db{0}> trace/a fffffe822f5eb440
 trace: pid 0 lid 6 at 0xffff8000ae69ad18
 breakpoint() at netbsd:breakpoint+0x5
 comintr() at netbsd:comintr+0x562
 Xhandle_ioapic_edge13() at netbsd:Xhandle_ioapic_edge13+0x66
 --- interrupt ---
 splraise() at netbsd:splraise
 _kernel_lock() at netbsd:_kernel_lock+0x129
 intr_biglock_wrapper() at netbsd:intr_biglock_wrapper+0x16
 Xhandle_ioapic_level5() at netbsd:Xhandle_ioapic_level5+0x6a
 --- interrupt ---
 Xspllower() at netbsd:Xspllower+0xe
 DDB lost frame for netbsd:Xsoftintr+0x4f, trying 0xffff8000ae69b0f0
 Xsoftintr() at netbsd:Xsoftintr+0x4f
 --- interrupt ---
 0:
 db{0}>
 
 db{0}> show all callout
 hardclock_ticks now: 86821384
     ticks  wheel               arg  func
      -863 -1/-256                0  pffasttimo
      -861 -1/-256                0  pfslowtimo
      -861 -1/-256                0  tcp_slowtimo
      -851 -1/-256                0  sched_balance
      -849 -1/-256 fffffe812d614ad0  tcp_delack
      -848 -1/-256 fffffe810f382e10  uhci_poll_hub
      -833 -1/-256                0  key_timehandler
      -828 -1/-256 ffffffff81481b80  sleepq_timeout
      -822 -1/-256                0  nd6_timer
      -819 -1/-256                0  rt_timer_timer
      -811 -1/-256 ffff80000e836000  bnx_tick
      -811 -1/-256 ffff80000e830008  if_slowtimo
      -811 -1/-256 ffff80000e833008  if_slowtimo
      -811 -1/-256 ffff80000e836008  if_slowtimo
      -811 -1/-256 ffff80000e839008  if_slowtimo
      -811 -1/-256 ffff80000e830000  bnx_tick
      -798 -1/-256 ffff80000e839000  bnx_tick
      -784 -1/-256 fffffe822f5d0040  sleepq_timeout
      -561 -1/-256                0  vmem_rehash_all_kick
      -430 -1/-256 fffffe81f8e8f5d8  tcp_timer_rexmt
        13  0/107  fffffe810f372e10  uhci_poll_hub
        14  0/129  fffffe810f330e10  uhci_poll_hub
        43  0/163  fffffe810eb79aa0  sleepq_timeout
        13  0/182  fffffe810f351e10  uhci_poll_hub
        50  0/220  fffffe822c048e70  realtimerexpire
     30475  1/321  fffffe822c048d68  realtimerexpire
     36544  1/344  fffffe8222de5218  realtimerexpire
     58821  1/431  fffffe8222de5950  realtimerexpire
       511  1/460  fffffe822705ea80  sleepq_timeout
       606  1/460  fffffe821f08ba00  tcp_timer_rexmt
       608  1/460  fffffe812d614790  tcp_timer_rexmt
       969  1/462  fffffe822478c6e0  sleepq_timeout
       975  1/462  fffffe82246592a0  sleepq_timeout
      1713  1/464  fffffe810ed76188  sme_events_check
      1713  1/464  fffffe810f24e708  sme_events_check
      1713  1/464  fffffe810f2afec8  sme_events_check
      1713  1/464  fffffe810f2af748  sme_events_check
      1713  1/464  fffffe810f2f2dc8  sme_events_check
      1773  1/465  fffffe810f5711c8  sme_events_check
      1821  1/465  fffffe821f3a74e0  sleepq_timeout
      1943  1/466  fffffe821be401c0  sleepq_timeout
      1976  1/466  fffffe821c341680  sleepq_timeout
      2134  1/466  fffffe822cfce1e0  sleepq_timeout
      2407  1/467  fffffe82209a0740  sleepq_timeout
      2891  1/469  fffffe82285b7a60  sleepq_timeout
      3302  1/470  fffffe821b565120  tcp_timer_rexmt
      3075  1/470  fffffe8218a62a20  sleepq_timeout
      2982  1/470  fffffe821b9b9360  sleepq_timeout
      3251  1/471  fffffe822d908960  sleepq_timeout
      3409  1/471  fffffe822dc08100  sleepq_timeout
      3553  1/472  fffffe821c8b5b60  sleepq_timeout
      3685  1/472  fffffe821a0110e0  sleepq_timeout
      4352  1/475  fffffe821b9b9ba0  sleepq_timeout
      4269  1/475  fffffe822c048c60  realtimerexpire
      4641  1/476  fffffe810f2352c0  sleepq_timeout
      4652  1/476  fffffe810f333700  sleepq_timeout
      4685  1/476  fffffe810f333b20  sleepq_timeout
      4906  1/477  fffffe821b466498  tcp_timer_rexmt
      4852  1/477  fffffe810f3332e0  sleepq_timeout
      4974  1/477  fffffe810f33ab40  sleepq_timeout
      4718  1/477  fffffe810f311b60  sleepq_timeout
      5146  1/478  fffffe81c2dc3b10  tcp_timer_rexmt
      5434  1/479  fffffe8222de5008  realtimerexpire
      6033  1/482  fffffe82068d5b60  tcp_timer_rexmt
      6368  1/483  fffffe821f08b380  tcp_timer_rexmt
      7175  1/486  fffffe8127c869c0  sleepq_timeout
     34620  2/557  fffffe821a7580d0  tcp_timer_keep
     34639  2/557  fffffe8210a5d1f0  tcp_timer_keep
     34665  2/557  fffffe81c2dc37d0  tcp_timer_keep
     34686  2/557  fffffe82068d54e0  tcp_timer_keep
     18442  2/557  fffffe81de573330  arptimer
     30184  2/557  fffffe822cdcc990  arptimer
     73369  2/557  fffffe81de573220  arptimer
     34607  2/557  fffffe81d8010030  tcp_timer_keep
     34626  2/557  fffffe821b96a778  tcp_timer_keep
     39854  2/557  fffffe821ada5480  tcp_timer_keep
     41498  2/557  fffffe821cb3a3c8  tcp_timer_keep
     63262  2/557  fffffe82173407f0  tcp_timer_keep
     83173  2/558  fffffe81dbf21228  arptimer
     99760  2/558  fffffe822cdcc110  arptimer
    102304  2/558  fffffe822cdcc880  arptimer
    110475  2/558  fffffe822cdccee0  arptimer
    113194  2/558  fffffe822cdcc550  arptimer
    119123  2/558  fffffe822cdcc440  arptimer
     83485  2/558  fffffe822cfce600  sleepq_timeout
    170902  2/559  fffffe821ed4a6c8  tcp_timer_keep
    178082  2/559  fffffe8210a5d530  tcp_timer_keep
    178095  2/559  fffffe821b4667d8  tcp_timer_keep
    178100  2/559  fffffe820cd5cb98  tcp_timer_keep
    178167  2/559  fffffe821f039038  tcp_timer_keep
    180463  2/559  fffffe821b937760  tcp_timer_keep
    180673  2/559  fffffe8217340b30  tcp_timer_keep
    178141  2/559  fffffe81f4ad9208  tcp_timer_keep
    178182  2/559  fffffe82068d51a0  tcp_timer_keep
    178181  2/559  fffffe821f08b040  tcp_timer_keep
    183651  2/559  fffffe820cd5c1d8  tcp_timer_keep
    185007  2/559  fffffe82173404b0  tcp_timer_keep
    186205  2/559  fffffe81f4ad9888  tcp_timer_keep
    186244  2/559  fffffe81f4ad9bc8  tcp_timer_keep
    180493  2/559  fffffe81f8e8f918  tcp_timer_keep
    180504  2/559  fffffe82173384a8  tcp_timer_keep
    180556  2/559  fffffe81f8e8fc58  tcp_timer_keep
    186851  2/559  fffffe8210a5dbb0  tcp_timer_keep
    188512  2/559  fffffe821c046428  tcp_timer_keep
    188800  2/559  fffffe8219e307a8  tcp_timer_keep
    189621  2/559  fffffe821b565460  tcp_timer_keep
    189932  2/559  fffffe821ada5b00  tcp_timer_keep
    190283  2/559  fffffe81f30d3578  tcp_timer_keep
    190659  2/559  fffffe821ae20430  tcp_timer_keep
    266181  2/560  fffffe821ed4aa08  tcp_timer_keep
    266494  2/560  fffffe821ed4a048  tcp_timer_keep
    267094  2/560  fffffe821b4d2a68  tcp_timer_keep
    267288  2/560  fffffe821ae20770  tcp_timer_keep
    267310  2/560  fffffe821ae200f0  tcp_timer_keep
    267318  2/560  fffffe821b96a438  tcp_timer_keep
    267334  2/560  fffffe821ab59ac0  tcp_timer_keep
    267334  2/560  fffffe821ab59100  tcp_timer_keep
    267406  2/560  fffffe8210a5d870  tcp_timer_keep
    275093  2/560  fffffe8219e30468  tcp_timer_keep
    267330  2/560  fffffe821cc7d798  tcp_timer_keep
    267349  2/560  fffffe8219e30ae8  tcp_timer_keep
    267064  2/560  fffffe821a758750  tcp_timer_keep
    267068  2/560  fffffe821ba920a0  tcp_timer_keep
    267070  2/560  fffffe821c0c2740  tcp_timer_keep
    267070  2/560  fffffe821c0c2400  tcp_timer_keep
    267068  2/560  fffffe821b9c20c8  tcp_timer_keep
    267071  2/560  fffffe821b9c2748  tcp_timer_keep
    267071  2/560  fffffe821c4f9418  tcp_timer_keep
    267072  2/560  fffffe821c4f9a98  tcp_timer_keep
    267124  2/560  fffffe821b937420  tcp_timer_keep
    267263  2/560  fffffe821c0460e8  tcp_timer_keep
    268769  2/560  fffffe821ebc26d0  tcp_timer_keep
    266964  2/560  fffffe821b9c2408  tcp_timer_keep
    267662  2/560  fffffe81f30d3bf8  tcp_timer_keep
    268000  2/560  fffffe81f8e8f298  tcp_timer_keep
    268341  2/560  fffffe8219a92b20  tcp_timer_keep
    266820  2/560  fffffe821caaa090  tcp_timer_keep
    267068  2/560  fffffe821b339a78  tcp_timer_keep
    267068  2/560  fffffe821ba92a60  tcp_timer_keep
    267068  2/560  fffffe821b3393f8  tcp_timer_keep
    267070  2/560  fffffe821ba923e0  tcp_timer_keep
    277109  2/561  fffffe8219e30128  tcp_timer_keep
    278611  2/561  fffffe820cd5c858  tcp_timer_keep
    278987  2/561  fffffe821b2023f0  tcp_timer_keep
    280166  2/561  fffffe821b339738  tcp_timer_keep
    280644  2/561  fffffe821b9c2a88  tcp_timer_keep
    281529  2/561  fffffe821cb3a088  tcp_timer_keep
    281820  2/561  fffffe821b0c8130  tcp_timer_keep
    284392  2/561  fffffe821b0c8af0  tcp_timer_keep
    298629  2/561                 0  nd6_slowtimo
    278048  2/561  fffffe821b565ae0  tcp_timer_keep
    278713  2/561  fffffe821ebc2390  tcp_timer_keep
    281860  2/561  fffffe821cb3a708  tcp_timer_keep
    282331  2/561  fffffe821ab59440  tcp_timer_keep
    283391  2/561  fffffe821cc7dad8  tcp_timer_keep
    278133  2/561  fffffe821b4d2728  tcp_timer_keep
    279419  2/561  fffffe821e59a058  tcp_timer_keep
    279801  2/561  fffffe821aa0d148  tcp_timer_keep
    281290  2/561  fffffe821cce2080  tcp_timer_keep
    276329  2/561  fffffe821ada57c0  tcp_timer_keep
    277660  2/561  fffffe821ebc2a10  tcp_timer_keep
    279103  2/561  fffffe8217920150  tcp_timer_keep
    279484  2/561  fffffe821b466158  tcp_timer_keep
    308870  2/561  fffffe821c0c20c0  tcp_timer_keep
    277014  2/561  fffffe821cc7d458  tcp_timer_keep
    278388  2/561  fffffe821ada5140  tcp_timer_keep
    279047  2/561  fffffe821e59a398  tcp_timer_keep
    279340  2/561  fffffe821b202730  tcp_timer_keep
    279751  2/561  fffffe821c192098  tcp_timer_keep
    282696  2/561  fffffe821b466b18  tcp_timer_keep
    276424  2/561  fffffe821cce23c0  tcp_timer_keep
    277575  2/561  fffffe821b5657a0  tcp_timer_keep
    278335  2/561  fffffe821e59aa18  tcp_timer_keep
    281000  2/561  fffffe821b96aab8  tcp_timer_keep
    281394  2/561  fffffe821b0c87b0  tcp_timer_keep
    281520  2/561  fffffe8217920490  tcp_timer_keep
    276779  2/561  fffffe821c1923d8  tcp_timer_keep
    277337  2/561  fffffe821c192718  tcp_timer_keep
    277983  2/561  fffffe821e59a6d8  tcp_timer_keep
    278977  2/561  fffffe821b202a70  tcp_timer_keep
    279866  2/561  fffffe81f4ad9548  tcp_timer_keep
    280139  2/561  fffffe821cce2700  tcp_timer_keep
    280193  2/561  fffffe821aa0d488  tcp_timer_keep
    280586  2/561  fffffe81f30d38b8  tcp_timer_keep
    280886  2/561  fffffe821caaaa50  tcp_timer_keep
    280948  2/561  fffffe821c0c2a80  tcp_timer_keep
    276057  2/561  fffffe821c192a58  tcp_timer_keep
    278567  2/561  fffffe821b4d20a8  tcp_timer_keep
    279767  2/561  fffffe821e51aa20  tcp_timer_keep
    280560  2/561  fffffe821cc7d118  tcp_timer_keep
    281960  2/561  fffffe82179207d0  tcp_timer_keep
    282179  2/561  fffffe8219a927e0  tcp_timer_keep
    282625  2/561  fffffe821cb3aa48  tcp_timer_keep
    283796  2/561  fffffe821aa0d7c8  tcp_timer_keep
    352289  2/562  fffffe821c046768  tcp_timer_keep
    345110  2/562  fffffe81f30d3238  tcp_timer_keep
    717815  2/563  fffffe8222cba9d0  tcp_timer_keep
    717812  2/563  fffffe8222cba690  tcp_timer_keep
    714678  2/563  fffffe8222cba350  tcp_timer_keep
    717813  2/563  fffffe8222cba010  tcp_timer_keep
    717814  2/563  fffffe821e1189d8  tcp_timer_keep
    714584  2/563  fffffe821e118358  tcp_timer_keep
    714678  2/563  fffffe821e118018  tcp_timer_keep
    714678  2/563  fffffe821f87c9e0  tcp_timer_keep
    717813  2/563  fffffe821f87c6a0  tcp_timer_keep
    719074  2/563  fffffe821f87c360  tcp_timer_keep
    714966  2/563  fffffe821f87c020  tcp_timer_keep
    714678  2/563  fffffe821f8549e8  tcp_timer_keep
    714967  2/563  fffffe821f8546a8  tcp_timer_keep
    714678  2/563  fffffe821f854368  tcp_timer_keep
    714678  2/563  fffffe821f854028  tcp_timer_keep
    714967  2/563  fffffe821fc8e9f0  tcp_timer_keep
    714678  2/563  fffffe821fc8e6b0  tcp_timer_keep
    714147  2/563  fffffe821fc8e370  tcp_timer_keep
    717812  2/563  fffffe821f0399f8  tcp_timer_keep
    717815  2/563  fffffe821f039378  tcp_timer_keep
    714678  2/563  fffffe821ebc2050  tcp_timer_keep
    717812  2/563  fffffe821e51a3a0  tcp_timer_keep
    714966  2/563  fffffe821e51a060  tcp_timer_keep
    714966  2/563  fffffe821d280a28  tcp_timer_keep
    714147  2/563  fffffe821d2806e8  tcp_timer_keep
    714678  2/563  fffffe821d280068  tcp_timer_keep
    714678  2/563  fffffe821cce2a40  tcp_timer_keep
    717791  2/563  fffffe821f0396b8  tcp_timer_keep
    714654  2/563  fffffe821ed4a388  tcp_timer_keep
    717789  2/563  fffffe821e51a6e0  tcp_timer_keep
    714943  2/563  fffffe821caaa710  tcp_timer_keep
    717791  2/563  fffffe82255b6008  tcp_timer_keep
    474660  2/564  fffffe821c046aa8  tcp_timer_keep
    719129  2/565  fffffe812d614790  tcp_timer_keep
    716178  2/565  fffffe821b0c8470  tcp_timer_keep
    575467  2/565  fffffe81ba3c3918  tcp_timer_keep
    716183  2/565  fffffe821c4f9758  tcp_timer_keep
    716203  2/565  fffffe821aa0db08  tcp_timer_keep
    716203  2/565  fffffe82173387e8  tcp_timer_keep
    716180  2/565  fffffe8219a924a0  tcp_timer_keep
    719131  2/565  fffffe821f08ba00  tcp_timer_keep
    575487  2/565  fffffe81966cb070  tcp_timer_keep
    582001  2/565  fffffe821ba92720  tcp_timer_keep
    719107  2/565  fffffe812d614ad0  tcp_timer_keep
    716173  2/565  fffffe821b937aa0  tcp_timer_keep
    575462  2/565  fffffe81ba3c3c58  tcp_timer_keep
    597175  2/565  fffffe8222de5e78  realtimerexpire
    620866  2/566  fffffe821b466498  tcp_timer_keep
    657207  2/566  fffffe82068d5b60  tcp_timer_keep
    666161  2/566  fffffe820cd5c518  tcp_timer_keep
    697102  2/567  fffffe821b565120  tcp_timer_keep
    718814  2/567  fffffe81f8e8f5d8  tcp_timer_keep
    680446  2/567  fffffe81c2dc3b10  tcp_timer_keep
    710518  2/567  fffffe821f08b380  tcp_timer_keep
    696427  2/567  fffffe81966cb6f0  tcp_timer_keep
    938912  2/571  fffffe81de573770  nd6_llinfo_timer
   3549262  2/610  fffffe81de573dd0  nd6_llinfo_timer
   8163629  2/681                 0  in6_tmpaddrtimer
   8269307  2/682  fffffe81de573000  nd6_llinfo_timer
   8271207  2/682  fffffe81de573aa0  nd6_llinfo_timer
   8271207  2/682  fffffe81de573110  nd6_llinfo_timer
 db{0}>
 
 db{0}> trace/a fffffe822f607840
 trace: pid 0 lid 2 at 0xffff8000ae63df90
 acpicpu_cstate_idle_enter() at netbsd:acpicpu_cstate_idle_enter+0xdb
 acpicpu_cstate_idle() at netbsd:acpicpu_cstate_idle+0xb6
 idle_loop() at netbsd:idle_loop+0x1b5
 db{0}>
 db{0}> trace/a fffffe810e8a38e0
 trace: pid 0 lid 17 at 0xffff8000ae4f1f30
 acpicpu_cstate_idle_enter() at netbsd:acpicpu_cstate_idle_enter+0xdb
 acpicpu_cstate_idle() at netbsd:acpicpu_cstate_idle+0xb6
 idle_loop() at netbsd:idle_loop+0x1b5
 cpu_hatch() at netbsd:cpu_hatch+0x17a
 md_root_setconf() at netbsd:md_root_setconf
 db{0}>
 



Home | Main Index | Thread Index | Old Index