NetBSD-Bugs archive
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]
port-amd64/53155: OS wedges after <12h uptime when >2 bnx network interfaces in use
>Number: 53155
>Category: port-amd64
>Synopsis: Wedge after <12h uptime when >2 bnx network interfaces in use
>Confidential: no
>Severity: serious
>Priority: high
>Responsible: port-amd64-maintainer
>State: open
>Class: sw-bug
>Submitter-Id: net
>Arrival-Date: Wed Apr 04 13:40:00 +0000 2018
>Originator: Havard Eidnes
>Release: NetBSD 8.0_BETA
>Organization:
I try...
>Environment:
System: NetBSD xx.xx.xxx 8.0_BETA NetBSD 8.0_BETA (GENERIC.201803261630Z) amd64
Architecture: x86_64
Machine: amd64
>Description:
This particular system appears to wedge at unpredictable times
with less than 12 hours uptime when more than two network
interfaces are configured and in use. We have tried with both
bnx and wm interfaces, and the mix doesn't appear to make any
difference.
The symptoms when it wedges are that the console (VGA with USB
keyboard, or physical serial port) is unresponsive, and the
host no longer responds to network traffic on any of its
network interfaces.
I should perhaps mention that this host has been tuned to
allow up to 1MB socket buffers, both for ipv4 and ipv6, and is
using the "cubic" congestion control algorithm, via the
following /etc/sysctl.conf entries:
kern.sbmax=1048576
net.inet6.tcp6.sendbuf_max=1048576
net.inet6.tcp6.recvbuf_max=1048576
net.inet.tcp.sendbuf_max=1048576
net.inet.tcp.recvbuf_max=1048576
net.inet.tcp.congctl.selected=cubic
and in normal use it has at least ~170 active TCP sessions,
most if not all all related to running conserver, so normally
carries very little traffic. The amount of memory allocated
to mbuf cluseters is (defaulted to):
kern.mbuf.nmbclusters = 261730
On the host I've rigged it to run "vmstat -m" every 100
seconds or so, but the last it logged didn't look strange, it
ended in
In use 92189K, total allocated 96140K; utilization 95.9%
and the mbpl and mclpl usage isn't anywhere near their
high-water marks if I read this correctly:
Memory resource pool statistics
Name Size Requests Fail Releases Pgreq Pgrel Npage Hiwat Minpg Maxpg Idle
...
mbpl 512 2176 0 0 274 0 274 274 2 inf 2
mclpl 2048 1953 0 0 981 0 981 981 4 130865 4
...
After I got rigged up a serial console, I managed to break
into DDB, and below you'll find an edited part of the DDB
session. What I observe is:
- Only one of the 8 CPUs is doing anything (running expect in
user-mode), but is apparently busy doing interrupt
processing. However, DDB apparently isn't able to decipher
the stack through the interrupt frames (any hints for
fixing that?)
- There is plenty of free memory available
- A number of processes have status "tstile", possibly
indicating a locking problem or contention of some sort,
but my ability to debug that sort of stuff isn't there, and
we're not good at documenting what info to collect (hint,
hint), and "tstile" doesn't really point towards the lock
which is contested, only indicates "some lock somewhere is
contested".
- My gut says this may be an interrupt storm, but none of the
event counters seems to back that up
I beleive this problem is the same one which was reported
against NetBSD/amd64 6.0 in PR#47229, in fact it probably is
the exact same host system.
Here's the edited DDB session (with "greater-than" replaced
with ":" in order to not confuse gnats):
:DDB break sequence:
fatal breakpoint trap in supervisor mode
trap type 1 code 0 rip 0xffffffff8021dbb5 cs 0x8 rflags 0x202 cr2 0xffff80009db2
3000 ilevel 0x8 rsp 0xffff80008f69bcf8
curlwp 0xfffffe822f6fd440 pid 0.6 lowest kstack 0xffff80008f6972c0
Stopped in pid 0.6 (system) at netbsd:breakpoint+0x5: leave
db{0}: trace
breakpoint() at netbsd:breakpoint+0x5
comintr() at netbsd:comintr+0x562
Xhandle_ioapic_edge13() at netbsd:Xhandle_ioapic_edge13+0x66
--- interrupt ---
DDB lost frame for netbsd:Xdoreti, trying 0xffff80008f69bd70
Xdoreti() at netbsd:Xdoreti
--- interrupt ---
Bad frame pointer: 0xffff800000000000
206:
db{0}: show uvmexp
Current UVM status:
pagesize=4096 (0x1000), pagemask=0xfff, pageshift=12, ncolors=8
2028595 VM pages: 1037330 active, 0 inactive, 1805 wired, 923564 free
pages 54144 anon, 979303 file, 5688 exec
freemin=2048, free-target=2730, wired-max=676198
resv-pg=1, resv-kernel=40, zeropages=820585
cpu0:
faults=5107500, traps=2516760, intrs=5678897, ctxswitch=3206198
softint=6171203, syscalls=10897655
cpu1:
faults=601410, traps=562379, intrs=0, ctxswitch=407170
softint=64702, syscalls=2203289
cpu2:
faults=607483, traps=592645, intrs=0, ctxswitch=357226
softint=127481, syscalls=1962203
cpu3:
faults=585411, traps=548343, intrs=0, ctxswitch=348991
softint=88312, syscalls=2002413
cpu4:
faults=843615, traps=531147, intrs=0, ctxswitch=538383
softint=104299, syscalls=1896227
cpu5:
faults=909578, traps=884707, intrs=0, ctxswitch=2440981
softint=103484, syscalls=8171151
cpu6:
faults=700436, traps=693435, intrs=0, ctxswitch=1017896
softint=139013, syscalls=4260226
cpu7:
faults=804685, traps=791518, intrs=0, ctxswitch=877603
softint=156355, syscalls=3733242
fault counts:
noram=0, noanon=0, pgwait=0, pgrele=0
ok relocks(total)=21248(21250), anget(retrys)=4091394(0), amapcopy=457812
neighbor anon/obj pg=406830/8542654, gets(lock/unlock)=3654322/21250
cases: anon=3893186, anoncow=198224, obj=2917328, prcopy=737081, przero=1448638
daemon and swap counts:
woke=0, revs=0, scans=0, obscans=0, anscans=0
busy=0, freed=0, reactivate=0, deactivate=0
pageouts=0, pending=0, nswget=0
nswapdev=1, swpgavail=32767
swpages=32767, swpginuse=0, swpgonly=0, paging=0
db{0}: machine cpu 0
using CPU 0
db{0}: trace
breakpoint() at netbsd:breakpoint+0x5
comintr() at netbsd:comintr+0x562
Xhandle_ioapic_edge13() at netbsd:Xhandle_ioapic_edge13+0x66
--- interrupt ---
DDB lost frame for netbsd:Xdoreti, trying 0xffff80008f69bd70
Xdoreti() at netbsd:Xdoreti
--- interrupt ---
Bad frame pointer: 0xffff800000000000
206:
db{0}: machine cpu 1
using CPU 1
db{0}: trace
x86_stihlt() at netbsd:x86_stihlt+0x6
acpicpu_cstate_idle_enter() at netbsd:acpicpu_cstate_idle_enter+0xdb
acpicpu_cstate_idle() at netbsd:acpicpu_cstate_idle+0xb6
idle_loop() at netbsd:idle_loop+0x18c
cpu_hatch() at netbsd:cpu_hatch+0x17d
md_root_setconf() at netbsd:md_root_setconf
db{0}: machine cpu 2
using CPU 2
db{0}: trace
x86_stihlt() at netbsd:x86_stihlt+0x6
acpicpu_cstate_idle_enter() at netbsd:acpicpu_cstate_idle_enter+0xdb
acpicpu_cstate_idle() at netbsd:acpicpu_cstate_idle+0xb6
idle_loop() at netbsd:idle_loop+0x18c
cpu_hatch() at netbsd:cpu_hatch+0x17d
md_root_setconf() at netbsd:md_root_setconf
db{0}: machine cpu 3
using CPU 3
db{0}: trace
x86_stihlt() at netbsd:x86_stihlt+0x6
acpicpu_cstate_idle_enter() at netbsd:acpicpu_cstate_idle_enter+0xdb
acpicpu_cstate_idle() at netbsd:acpicpu_cstate_idle+0xb6
idle_loop() at netbsd:idle_loop+0x18c
cpu_hatch() at netbsd:cpu_hatch+0x17d
md_root_setconf() at netbsd:md_root_setconf
db{0}: machine cpu 4
using CPU 4
db{0}: trace
x86_stihlt() at netbsd:x86_stihlt+0x6
acpicpu_cstate_idle_enter() at netbsd:acpicpu_cstate_idle_enter+0xdb
acpicpu_cstate_idle() at netbsd:acpicpu_cstate_idle+0xb6
idle_loop() at netbsd:idle_loop+0x18c
cpu_hatch() at netbsd:cpu_hatch+0x17d
md_root_setconf() at netbsd:md_root_setconf
db{0}: machine cpu 5
using CPU 5
db{0}: trace
x86_stihlt() at netbsd:x86_stihlt+0x6
acpicpu_cstate_idle_enter() at netbsd:acpicpu_cstate_idle_enter+0xdb
acpicpu_cstate_idle() at netbsd:acpicpu_cstate_idle+0xb6
idle_loop() at netbsd:idle_loop+0x18c
cpu_hatch() at netbsd:cpu_hatch+0x17d
md_root_setconf() at netbsd:md_root_setconf
db{0}: machine cpu 6
using CPU 6
db{0}: trace
x86_stihlt() at netbsd:x86_stihlt+0x6
acpicpu_cstate_idle_enter() at netbsd:acpicpu_cstate_idle_enter+0xdb
acpicpu_cstate_idle() at netbsd:acpicpu_cstate_idle+0xb6
idle_loop() at netbsd:idle_loop+0x18c
cpu_hatch() at netbsd:cpu_hatch+0x17d
md_root_setconf() at netbsd:md_root_setconf
db{0}: machine cpu 7
using CPU 7
db{0}: trace
x86_stihlt() at netbsd:x86_stihlt+0x6
acpicpu_cstate_idle_enter() at netbsd:acpicpu_cstate_idle_enter+0xdb
acpicpu_cstate_idle() at netbsd:acpicpu_cstate_idle+0xb6
idle_loop() at netbsd:idle_loop+0x18c
cpu_hatch() at netbsd:cpu_hatch+0x17d
md_root_setconf() at netbsd:md_root_setconf
db{0}: help show
db{0}: show event
evcnt type 0: bus_dma bounces = 8814235
evcnt type 0: bus_dma loads = 9314511
evcnt type 0: bus_dma nbouncebufs = 3211
evcnt type 0: vmcmd kills = 12944
evcnt type 0: vmcmd extends = 12219
evcnt type 0: vmcmd calls = 138643
evcnt type 0: vmem static_bt_inuse = 200
evcnt type 0: vmem static_bt_count = 200
evcnt type 0: rndpseudo open soft = 4559
evcnt type 1: TLB shootdown = 2192282
evcnt type 0: pserialize exclusive access = 18952
evcnt type 0: cpu0 runqueue pull = 34799
evcnt type 0: cpu0 runqueue push = 1042
evcnt type 0: cpu0 runqueue stay = 1725421
evcnt type 0: cpu0 runqueue localize = 8211
evcnt type 0: softint net/0 = 5191013
evcnt type 0: softint net block/0 = 1497
evcnt type 0: softint bio/0 = 487407
evcnt type 0: softint bio block/0 = 2270
evcnt type 0: softint clk/0 = 427502
evcnt type 0: softint clk block/0 = 12
evcnt type 0: softint ser/0 = 65281
evcnt type 0: callout late/0 = 13
evcnt type 0: callout wait/0 = 1
evcnt type 0: crosscall unicast = 1560
evcnt type 0: crosscall broadcast = 17
evcnt type 0: namecache entries collected = 10484
evcnt type 0: namecache under scan target = 12858
evcnt type 1: cpu0 timer = 1285733
evcnt type 0: cpu0 generic IPI = 437
evcnt type 0: cpu0 FPU synch IPI = 364
evcnt type 0: cpu0 xcall IPI = 26520
evcnt type 0: cpu0 kpreempt IPI = 61
evcnt type 0: cpu1 runqueue pull = 4176
evcnt type 0: cpu1 runqueue push = 1154
evcnt type 0: cpu1 runqueue stay = 217239
evcnt type 0: cpu1 runqueue localize = 188
evcnt type 0: softint net/1 = 2
evcnt type 0: softint net block/1 = 1
evcnt type 0: softint clk/1 = 27146
evcnt type 0: softint ser/1 = 37554
evcnt type 0: softint ser block/1 = 1
evcnt type 0: cpu1 timer = 1285906
evcnt type 0: cpu1 FPU synch IPI = 325
evcnt type 0: cpu1 xcall IPI = 34579
evcnt type 0: cpu2 runqueue pull = 3811
evcnt type 0: cpu2 runqueue push = 968
evcnt type 0: cpu2 runqueue stay = 193225
evcnt type 0: cpu2 runqueue localize = 300
evcnt type 0: softint clk/2 = 90104
evcnt type 0: softint ser/2 = 37377
evcnt type 0: cpu2 timer = 1285894
evcnt type 0: cpu2 FPU synch IPI = 291
evcnt type 0: cpu2 xcall IPI = 33748
evcnt type 0: cpu3 runqueue pull = 4132
evcnt type 0: cpu3 runqueue push = 1000
evcnt type 0: cpu3 runqueue stay = 188850
evcnt type 0: cpu3 runqueue localize = 487
evcnt type 0: softint net/3 = 1
evcnt type 0: softint clk/3 = 50860
evcnt type 0: softint ser/3 = 37451
evcnt type 0: cpu3 timer = 1285909
evcnt type 0: cpu3 FPU synch IPI = 276
evcnt type 0: cpu3 xcall IPI = 34139
evcnt type 0: cpu4 runqueue pull = 22245
evcnt type 0: cpu4 runqueue push = 1481
evcnt type 0: cpu4 runqueue stay = 281034
evcnt type 0: cpu4 runqueue localize = 298
evcnt type 0: softint clk/4 = 66905
evcnt type 0: softint ser/4 = 37394
evcnt type 0: cpu4 timer = 1285902
evcnt type 0: cpu4 FPU synch IPI = 290
evcnt type 0: cpu4 xcall IPI = 34811
evcnt type 0: cpu4 kpreempt IPI = 1
evcnt type 0: cpu5 runqueue pull = 7977
evcnt type 0: cpu5 runqueue push = 1309
evcnt type 0: cpu5 runqueue stay = 1249669
evcnt type 0: cpu5 runqueue localize = 1286
evcnt type 0: softint net/5 = 1
evcnt type 0: softint clk/5 = 65774
evcnt type 0: softint clk block/5 = 1
evcnt type 0: softint ser/5 = 37709
evcnt type 0: softint ser block/5 = 1
evcnt type 0: cpu5 timer = 1285895
evcnt type 0: cpu5 FPU synch IPI = 485
evcnt type 0: cpu5 xcall IPI = 31308
evcnt type 0: cpu6 runqueue pull = 5535
evcnt type 0: cpu6 runqueue push = 1795
evcnt type 0: cpu6 runqueue stay = 536359
evcnt type 0: cpu6 runqueue localize = 575
evcnt type 0: softint clk/6 = 101534
evcnt type 0: softint ser/6 = 37479
evcnt type 0: cpu6 timer = 1285900
evcnt type 0: cpu6 FPU synch IPI = 357
evcnt type 0: cpu6 xcall IPI = 34247
evcnt type 0: cpu7 runqueue pull = 7441
evcnt type 0: cpu7 runqueue push = 3442
evcnt type 0: cpu7 runqueue stay = 469377
evcnt type 0: cpu7 runqueue localize = 727
evcnt type 0: softint clk/7 = 118815
evcnt type 0: softint clk block/7 = 3
evcnt type 0: softint ser/7 = 37540
evcnt type 0: callout late/7 = 2
evcnt type 0: cpu7 timer = 1285900
evcnt type 0: cpu7 FPU synch IPI = 436
evcnt type 0: cpu7 xcall IPI = 31790
evcnt type 1: ioapic1 pin 4 = 5153711
evcnt type 1: ioapic1 pin 0 = 29577
evcnt type 1: ioapic1 pin 10 = 7447
evcnt type 1: ioapic0 pin 17 = 20
evcnt type 1: ioapic0 pin 19 = 21
evcnt type 1: ioapic0 pin 16 = 487731
evcnt type 1: ioapic0 pin 21 = 29
evcnt type 1: ioapic0 pin 23 = 12
evcnt type 1: ioapic0 pin 4 = 349
evcnt type 0: acpicpu0 C1 (HALT) = 6993829
evcnt type 0: acpicpu1 C1 (HALT) = 3158420
evcnt type 0: acpicpu2 C1 (HALT) = 3155060
evcnt type 0: acpicpu3 C1 (HALT) = 3049008
evcnt type 0: acpicpu4 C1 (HALT) = 3255477
evcnt type 0: acpicpu5 C1 (HALT) = 3851591
evcnt type 0: acpicpu6 C1 (HALT) = 3459820
evcnt type 0: acpicpu7 C1 (HALT) = 3405818
evcnt type 0: kpreempt defer: critical section = 48
evcnt type 0: kpreempt defer: kernel_lock = 60
evcnt type 0: kpreempt immediate = 3524
db{0}: ps
PID LID S CPU FLAGS STRUCT LWP * NAME WAIT
20105 1 3 1 0 fffffe8224d7d780 cron tstile
26131 1 3 1 0 fffffe822281d620 cron wait
23319 1 3 1 0 fffffe8224850b60 cron tstile
25811 1 3 7 0 fffffe82036d0740 cron tstile
22533 1 3 7 0 fffffe820a1115c0 cron wait
24189 1 3 1 0 fffffe8221441880 cron wait
26325 1 3 5 0 fffffe8226e1e900 cron tstile
18295 1 3 1 0 fffffe8229822360 cron tstile
24699 1 3 6 0 fffffe822571b100 cron tstile
20160 1 3 7 0 fffffe821430ea20 cron tstile
24819 1 3 5 0 fffffe821e31f2a0 cron wait
18159 1 3 6 0 fffffe81fdf214a0 cron wait
20826 1 3 7 0 fffffe8215beeaa0 cron wait
19785 1 3 1 0 fffffe822a5968c0 cron wait
19192 1 3 1 0 fffffe822da91540 cron tstile
24053 1 3 7 0 fffffe822d9c9140 cron tstile
22204 1 3 7 0 fffffe8224bf4000 cron wait
19906 1 3 1 0 fffffe82260d4760 cron wait
25501 1 3 4 0 fffffe821e715260 bash tstile
16391 1 3 1 0 fffffe822b3fb8a0 cron tstile
22719 1 3 1 0 fffffe8215236740 cron wait
27003 1 3 2 80 fffffe820a90e6e0 pickup kqueue
25066 1 3 5 0 fffffe8212edf620 ssh xchicv
21812 2 3 5 80 fffffe822a960740 expect select
21812 1 3 4 80 fffffe8226255060 expect wait
22983 1 3 5 80 fffffe8211b16780 sh wait
24598 1 3 5 80 fffffe821ed7e200 perl wait
23813 1 3 5 80 fffffe8209d819a0 sh wait
20606 1 3 0 80 fffffe821430e600 ssh select
14822 1 3 6 80 fffffe821f1f05c0 sh wait
29431 1 3 0 80 fffffe815c71a4c0 ssh select
25005 1 3 4 80 fffffe82140376c0 sh wait
23260 1 3 3 0 fffffe8212bd1520 ssh tstile
22933 1 3 4 80 fffffe82142275a0 sh wait
23169 1 3 0 80 fffffe821431d120 ssh select
20146 2 3 6 0 fffffe820f2f5b20 expect tstile
20146 1 3 6 0 fffffe822b7e3ae0 expect fdclose
27429 1 3 7 80 fffffe82200e3860 sh wait
23732 1 3 7 80 fffffe82257e8120 perl pipe_rd
19502 1 3 7 80 fffffe82107e9020 sh wait
23886 1 3 5 80 fffffe820f982220 ssh select
20022 2 3 4 0 fffffe821e467a00 expect tstile
20022 1 3 5 0 fffffe8210e401e0 expect fdclose
20799 1 3 0 80 fffffe82114f39c0 sh wait
21173 1 3 5 80 fffffe82036d0b60 perl wait
21675 1 3 6 80 fffffe82284e8260 sh wait
18171 1 3 0 80 fffffe8209d81160 ssh select
19295 2 3 4 80 fffffe82107e9860 expect select
19295: 1 7 0 0 fffffe82288daa80 expect
21354 1 3 5 80 fffffe8206f1a260 sh wait
26421 1 3 5 80 fffffe820e5634c0 perl pipe_rd
24533 1 3 5 80 fffffe82273078e0 sh wait
22388 1 3 0 80 fffffe8225d0d760 ssh select
20900 2 3 7 0 fffffe822a596080 expect tstile
20900 1 3 7 0 fffffe8212a4d080 expect fdclose
20540 1 3 0 80 fffffe822a3a9500 sh wait
22103 1 3 7 80 fffffe822571b940 perl pipe_rd
24457 1 3 5 80 fffffe8222326aa0 sh wait
23314 1 3 0 80 fffffe8215f8d840 ssh select
23095 1 3 0 80 fffffe82200e3020 sh wait
18806 1 3 0 80 fffffe821f97e980 ssh select
17372 1 3 4 80 fffffe820e5638e0 sh wait
23989 1 3 0 80 fffffe82201ad520 ssh select
23534 1 3 3 80 fffffe820d6e9440 sh wait
19407 1 3 2 80 fffffe821eb7e0e0 ssh select
25841 1 3 6 80 fffffe8222107a80 sh wait
26243 1 3 0 80 fffffe820fe60720 ssh select
17183 1 3 6 80 fffffe820acaa0e0 sh wait
24185 1 3 5 80 fffffe822a3a90e0 ssh select
19244 1 3 4 80 fffffe821dc670c0 sh wait
18735 1 3 0 80 fffffe822acb2460 ssh select
21395 1 3 6 80 fffffe8210521340 sh wait
26341 1 3 0 80 fffffe822604b700 ssh select
20515 1 3 0 80 fffffe822a5964a0 sh wait
24911 1 3 0 80 fffffe820de6a240 ssh select
19983 1 3 1 80 fffffe822da9c580 sh wait
18877 1 3 0 80 fffffe822281d200 ssh select
23537 1 3 7 80 fffffe82273074c0 sh wait
21663 1 3 0 80 fffffe821fad9420 ssh select
25421 1 3 1 80 fffffe82218a3ac0 sh wait
24440 1 3 0 80 fffffe8215f8d420 ssh select
26449 1 3 0 80 fffffe82253a8b40 sh wait
22382 1 3 0 80 fffffe820b0600c0 ssh select
21078 1 3 1 80 fffffe8166096900 sh wait
23069 1 3 5 80 fffffe821c068100 ssh select
20686 1 3 5 80 fffffe8220479080 sh wait
19346 1 3 0 80 fffffe820f2f5700 ssh select
21254 1 3 6 80 fffffe8212a4d8c0 sh wait
23663 1 3 0 80 fffffe81fdf21080 ssh select
22711 1 3 1 80 fffffe816482f960 sh wait
22549 1 3 0 80 fffffe821eb7e500 ssh select
12635 1 3 7 80 fffffe821de42120 sh wait
22248 1 3 0 80 fffffe822a3a9920 ssh select
16468 1 3 4 80 fffffe8228cb76e0 sh wait
17532 1 3 0 80 fffffe82111a0280 ssh select
24374 1 3 0 80 fffffe821f05d240 sh wait
23230 1 3 0 80 fffffe822b7e36c0 ssh select
18702 1 3 0 80 fffffe820a19ba80 sh wait
23591 1 3 0 80 fffffe822b6b6200 ssh select
24665 1 3 7 80 fffffe820de6a660 sh wait
20189 1 3 0 80 fffffe822a025a60 ssh select
20252 1 3 0 80 fffffe822d9c9980 ssh select
23080 1 3 0 80 fffffe82172c4b80 sh wait
20740 1 3 7 80 fffffe820a19b660 sh wait
24958 1 3 0 80 fffffe8210e40600 ssh select
22951 1 3 5 80 fffffe82204794a0 sh wait
21698 1 3 0 80 fffffe82143bbba0 ssh select
17032 1 3 2 80 fffffe821fad9840 sh wait
24314 1 3 0 80 fffffe821eb7e920 ssh select
20886 1 3 7 80 fffffe820e5630a0 sh wait
22406 1 3 0 80 fffffe821d814140 ssh select
23192 1 3 2 80 fffffe8215475420 sh wait
17303 1 3 0 80 fffffe822a960320 ssh select
24518 1 3 7 80 fffffe820e350b40 sh wait
21932 1 3 0 80 fffffe821227e040 ssh select
22174 1 3 6 80 fffffe822b7e32a0 sh wait
20504 1 3 0 80 fffffe821d855720 ssh select
19436 1 3 7 80 fffffe820ef105e0 sh wait
23481 1 3 0 80 fffffe820d6e9860 ssh select
22354 1 3 0 80 fffffe821f05d660 ssh select
21891 1 3 3 80 fffffe8159f125a0 sh wait
17000 1 3 6 80 fffffe8229822780 sh wait
21472 1 3 0 80 fffffe8221af7ac0 ssh select
24341 1 3 7 80 fffffe8212536220 sh wait
24131 1 3 0 80 fffffe821ed7e620 ssh select
22981 1 3 0 80 fffffe816482f540 ssh select
15043 1 3 4 80 fffffe820f982640 sh wait
21177 1 3 0 80 fffffe815dcc1160 sh wait
21503 1 3 0 80 fffffe820c092060 ssh select
25824 1 3 1 80 fffffe821e40d880 sh wait
17304 1 3 0 80 fffffe8225b3a540 ssh select
19360 1 3 6 80 fffffe820f2f52e0 sh wait
16456 1 3 5 80 fffffe821548d2e0 par pause
16577 1 3 0 80 fffffe8166b46500 sh wait
21790 1 3 0 80 fffffe82200e3440 sh wait
18068 1 3 1 80 fffffe821431d540 sh wait
22385 1 3 1 80 fffffe821d855300 sh wait
17963 1 3 1 80 fffffe81660964e0 cron pipe_rd
5078 1 3 0 80 fffffe820c092480 ssh select
7768 1 3 3 80 fffffe8164637140 sh wait
7239 1 3 0 80 fffffe8212edf200 ssh select
10982 1 3 5 80 fffffe8210521b80 sh wait
5126 1 3 0 80 fffffe820f982a60 ssh select
8692 1 3 2 80 fffffe821c1f80a0 sh wait
9318 1 3 0 80 fffffe82098348a0 ssh select
9227 1 3 2 80 fffffe821f97e140 sh wait
10068 1 3 0 80 fffffe821dfe99a0 ssh select
8697 1 3 0 80 fffffe821e69f5c0 sh wait
10511 1 3 0 80 fffffe82036d0320 ssh select
11284 1 3 2 80 fffffe82201ad100 sh wait
9755 1 3 0 80 fffffe82289472a0 ssh select
9929 1 3 5 80 fffffe821fad9000 sh wait
4650 1 3 0 80 fffffe820de6aa80 ssh select
9232 1 3 1 80 fffffe8215475000 sh wait
11976 1 3 0 80 fffffe820acaa920 ssh select
8477 1 3 4 80 fffffe815de49520 sh wait
5558 1 3 0 80 fffffe820d891420 ssh select
3911 1 3 3 80 fffffe82111a0ac0 sh wait
9329 1 3 0 80 fffffe815de49100 ssh select
9759 1 3 6 80 fffffe8221af76a0 sh wait
11080 1 3 0 80 fffffe82172c4760 ssh select
12525 1 3 5 80 fffffe820b060900 sh wait
10080 1 3 0 80 fffffe8209834480 ssh select
12878 1 3 7 80 fffffe822b3fb480 sh wait
14096 1 3 0 80 fffffe82260d4340 ssh select
9034 1 3 7 80 fffffe8221e7ba60 sh wait
8694 1 3 0 80 fffffe8164637560 ssh select
4956 1 3 7 80 fffffe8226e1e0c0 sh wait
8298 1 3 0 80 fffffe8215bee680 ssh select
8048 1 3 7 80 fffffe820e8582c0 sh wait
6948 1 3 0 80 fffffe8214227180 ssh select
10692 1 3 7 80 fffffe821df299c0 sh wait
3628 1 3 0 80 fffffe821227e460 ssh select
4171 1 3 6 80 fffffe822da91960 sh wait
11767 1 3 0 80 fffffe8215236b60 ssh select
11095 1 3 0 80 fffffe82172c4340 ssh select
7282 1 3 5 80 fffffe822995e1e0 sh wait
9931 1 3 6 80 fffffe82204798c0 sh wait
11290 1 3 0 80 fffffe821b623ac0 ssh select
13455 1 3 0 80 fffffe8215236320 ssh select
12282 1 3 6 80 fffffe822acb2880 sh wait
9284 1 3 7 80 fffffe821ba38640 sh wait
7897 1 3 0 80 fffffe821e31fae0 ssh select
10861 1 3 0 80 fffffe8206f1aaa0 ssh select
9946 1 3 6 80 fffffe8224850320 sh wait
4820 1 3 7 80 fffffe821e9dc880 sh wait
8676 1 3 0 80 fffffe8228cb7b00 ssh select
11199 1 3 6 80 fffffe821e40d040 sh wait
10988 1 3 0 80 fffffe8221af7280 ssh select
10711 1 3 0 80 fffffe8211d1f5e0 sh wait
9326 1 3 0 80 fffffe820d891840 ssh select
6637 1 3 2 80 fffffe820fe60b40 sh wait
5607 1 3 0 80 fffffe82143bb780 ssh select
6223 1 3 7 80 fffffe8218c8f620 sh wait
6174 1 3 0 80 fffffe82273070a0 ssh select
3660 1 3 0 80 fffffe820a90e2c0 sh wait
3691 1 3 0 80 fffffe821e9dc040 ssh select
13059 1 3 0 80 fffffe8211b16ba0 sh wait
8242 1 3 0 80 fffffe822c00eb20 ssh select
10272 1 3 3 80 fffffe821dc674e0 sh wait
9712 1 3 7 80 fffffe816482f120 bash select
8589 1 3 0 80 fffffe8229aeda00 sshd select
10949 1 3 1 80 fffffe8224d7d360 conserver select
7765 1 3 4 80 fffffe821f05da80 sshd select
11101 1 3 7 0 fffffe820e858b00 conserver tstile
11558 1 3 6 0 fffffe820b0604e0 conserver tstile
8956 1 3 5 80 fffffe8212bd1940 conserver select
10634 1 3 7 80 fffffe820e350300 conserver select
9547 1 3 0 80 fffffe820d6e9020 conserver select
7586 1 3 4 0 fffffe8212536a60 conserver tstile
8569 1 3 6 0 fffffe8218c8f200 conserver tstile
11721 1 3 6 0 fffffe8225b3a120 conserver tstile
9474 1 3 5 80 fffffe821c068940 conserver select
9068 1 3 0 80 fffffe8212a4d4a0 conserver select
8864 1 3 0 80 fffffe82101bc860 conserver select
6021 1 3 0 80 fffffe82238ef020 getty ttyraw
747 1 3 4 80 fffffe821e715680 bash wait
1233 1 3 5 80 fffffe82285c76a0 ssh select
336 1 3 0 80 fffffe821ba38a60 sh wait
1101 1 3 4 80 fffffe821ed7ea40 ssh select
1228 1 3 0 80 fffffe821bf101e0 sh wait
459 1 3 3 80 fffffe821bf10600 ssh select
458 1 3 0 80 fffffe821bf10a20 sh wait
836 1 3 5 80 fffffe82285c7ac0 ssh select
322 1 3 5 80 fffffe821e69f9e0 sh wait
321 1 3 0 80 fffffe821df29180 ssh select
320 1 3 0 80 fffffe821df295a0 sh wait
1470 1 3 7 80 fffffe8222107660 ssh select
829 1 3 7 80 fffffe821e4a1160 sh wait
956 1 3 4 80 fffffe821e4a1580 ssh select
1211 1 3 0 80 fffffe821e4a19a0 sh wait
1203 1 3 6 80 fffffe821de42540 ssh select
306 1 3 0 80 fffffe821de42960 sh wait
1455 1 3 6 80 fffffe82201ad940 ssh select
1326 1 3 0 80 fffffe821f1730e0 sh wait
813 1 3 2 80 fffffe821f173500 ssh select
1196 1 3 0 80 fffffe821f173920 sh wait
299 1 3 2 80 fffffe82201860c0 ssh select
298 1 3 5 80 fffffe82201864e0 sh wait
297 1 3 5 80 fffffe8220186900 ssh select
296 1 3 5 80 fffffe821eca10a0 sh wait
1191 1 3 7 80 fffffe821eca14c0 ssh select
1062 1 3 0 80 fffffe821eca18e0 sh wait
1445 1 3 6 80 fffffe8220596080 ssh select
1188 1 3 0 80 fffffe82205964a0 sh wait
1443 1 3 5 80 fffffe82205968c0 ssh select
290 1 3 0 80 fffffe821f131060 sh wait
289 1 3 4 80 fffffe821f131480 ssh select
288 1 3 0 80 fffffe821f1318a0 sh wait
1439 1 3 4 80 fffffe8221441040 ssh select
1438 1 3 0 80 fffffe8221441460 sh wait
1181 1 3 7 80 fffffe8222326260 ssh select
540 1 3 0 80 fffffe82209cb780 sh wait
1422 1 3 2 80 fffffe822d8b55a0 ssh select
1165 1 3 5 80 fffffe82209cb360 sh wait
1164 1 3 6 80 fffffe822c5039e0 ssh select
267 1 3 4 80 fffffe822da9c160 sh wait
264 1 3 5 80 fffffe82209cbba0 ssh select
775 1 3 3 80 fffffe8222326680 sh wait
1156 1 3 7 80 fffffe8222107240 ssh select
386 1 3 7 80 fffffe8220131340 sh wait
385 1 3 5 80 fffffe8220131760 ssh select
384 1 3 0 80 fffffe8220131b80 sh wait
780 1 3 6 80 fffffe8221a55320 ssh select
144 1 3 0 80 fffffe8221a55740 sh wait
146 1 3 5 80 fffffe82253a8300 ssh select
1279 1 3 7 80 fffffe8221a55b60 sh wait
1278 1 3 4 80 fffffe822105b300 ssh select
893 1 3 0 80 fffffe822105b720 sh wait
1019 1 3 3 80 fffffe822105bb40 ssh select
1146 1 3 0 80 fffffe8221dc52e0 sh wait
1080 1 3 6 80 fffffe8221dc5700 ssh select
694 1 3 0 80 fffffe8221dc5b20 sh wait
370 1 3 6 80 fffffe8220ab16e0 ssh select
1073 1 3 6 80 fffffe8220ab1b00 sh wait
176 1 3 3 80 fffffe8220d512a0 ssh select
1071 1 3 0 80 fffffe8220d516c0 sh wait
1198 1 3 0 80 fffffe8220d51ae0 ssh select
877 1 3 0 80 fffffe82218a3280 sh wait
795 1 3 3 80 fffffe822227b1e0 ssh select
986 1 3 0 80 fffffe822227b600 sh wait
985 1 3 4 80 fffffe822227ba20 ssh select
1240 1 3 0 80 fffffe82223491c0 sh wait
727 1 3 0 80 fffffe82223495e0 ssh select
790 1 3 0 80 fffffe8222349a00 sh wait
1173 1 3 1 80 fffffe82232021a0 ssh select
980 1 3 1 80 fffffe82232025c0 sh wait
659 1 3 1 80 fffffe82232029e0 ssh select
210 1 3 1 80 fffffe822a57f180 sh wait
913 1 3 5 80 fffffe822a57f5a0 ssh select
208 1 3 1 80 fffffe822a57f9c0 sh wait
1231 1 3 7 80 fffffe822bd73160 ssh select
1038 1 3 1 80 fffffe822bd73580 sh wait
973 1 3 2 80 fffffe822bd739a0 ssh select
844 1 3 1 80 fffffe8223fb7140 sh wait
139 1 3 1 80 fffffe8223fb7560 ssh select
138 1 3 1 80 fffffe8223fb7980 sh wait
508 1 3 1 80 fffffe82238ef440 cron nanoslp
827 1 3 1 80 fffffe82238ef860 python2.7 select
112 1 3 0 80 fffffe822d8b5180 inetd kqueue
743 1 3 0 80 fffffe8224bf4420 nginx kqueue
870 1 3 0 80 fffffe8224bf4840 nginx pause
974 1 3 1 80 fffffe822604bb20 qmgr kqueue
991 1 3 2 80 fffffe8224850740 master kqueue
647 1 3 4 80 fffffe822da9c9a0 sshd select
701 1 3 2 80 fffffe822995ea20 tac_plus select
685 1 3 1 80 fffffe822d9c9560 powerd kqueue
630 1 3 0 80 fffffe82289476c0 ntpd pause
595 4 3 6 80 fffffe8228947ae0 dhcpd parked
595 3 3 0 80 fffffe82284e8680 dhcpd kqueue
595 2 3 6 80 fffffe82284e8aa0 dhcpd parked
595 1 3 0 80 fffffe82288da660 dhcpd parked
439 1 3 7 0 fffffe82288da240 syslogd tstile
1 1 3 2 80 fffffe810f9b20a0 init wait
0 123 3 5 200 fffffe8229aed1c0 npfgc-0 xchicv
0 122 3 0 200 fffffe822d8b59c0 ipmi0 ipmi0
0 121 3 0 200 fffffe822ddb5500 physiod physiod
0 120 3 0 200 fffffe822dd44520 aiodoned aiodoned
0 119 3 6 200 fffffe822dd44940 ioflush biolock
0 118 3 0 200 fffffe822ddb50e0 pgdaemon pgdaemon
0 115 3 0 280 fffffe810f41e0c0 spkr1 bellcv
0 114 3 5 280 fffffe810f41e4e0 audiomix play
0 113 3 5 280 fffffe810ed322a0 audiorec record
0 112 3 5 200 fffffe810f2c9300 atapibus0 sccomp
0 110 3 3 200 fffffe810f2e0b60 usb5 usbevt
0 109 3 5 200 fffffe810f2c9b40 usb4 usbevt
0 108 3 0 200 fffffe810f1fc2c0 usb1 usbevt
0 107 3 0 200 fffffe810f2c9720 usb0 usbevt
0 106 3 5 200 fffffe810f2ba2e0 usb3 usbevt
0 105 3 5 200 fffffe810f41e900 usb2 usbevt
0 104 3 0 200 fffffe810f9b24c0 rt_free rt_free
0 103 3 0 200 fffffe810f9b28e0 unpgc unpgc
0 102 3 2 200 fffffe810f47b080 key_timehandler key_timehandler
0 101 3 7 200 fffffe810f47b4a0 icmp6_wqinput/7 icmp6_wqinput
0 100 3 6 200 fffffe810f47b8c0 icmp6_wqinput/6 icmp6_wqinput
0 99 3 5 200 fffffe810f3b4060 icmp6_wqinput/5 icmp6_wqinput
0 98 3 4 200 fffffe810f3b4480 icmp6_wqinput/4 icmp6_wqinput
0 97 3 3 200 fffffe810f3b48a0 icmp6_wqinput/3 icmp6_wqinput
0 96 3 2 200 fffffe810f435040 icmp6_wqinput/2 icmp6_wqinput
0 95 3 1 200 fffffe810f435460 icmp6_wqinput/1 icmp6_wqinput
0 94 3 0 200 fffffe810f435880 icmp6_wqinput/0 icmp6_wqinput
0 93 3 0 200 fffffe810f34e020 nd6_timer nd6_timer
0 92 3 7 200 fffffe810f34e440 icmp_wqinput/7 icmp_wqinput
0 91 3 6 200 fffffe810f34e860 icmp_wqinput/6 icmp_wqinput
0 90 3 5 200 fffffe810f337000 icmp_wqinput/5 icmp_wqinput
0 89 3 4 200 fffffe810f337420 icmp_wqinput/4 icmp_wqinput
0 88 3 3 200 fffffe810f337840 icmp_wqinput/3 icmp_wqinput
0 87 3 2 200 fffffe810f360360 icmp_wqinput/2 icmp_wqinput
0 86 3 1 200 fffffe810f360780 icmp_wqinput/1 icmp_wqinput
0 85 3 0 200 fffffe810f360ba0 icmp_wqinput/0 icmp_wqinput
0 84 3 5 200 fffffe810f2ba700 rt_timer rt_timer
0 83 3 5 200 fffffe810f2bab20 vmem_rehash vmem_rehash
0 82 3 3 200 fffffe810f2d7340 coretemp3 coretemp3
0 81 3 6 200 fffffe810f2d7760 coretemp2 coretemp2
0 80 3 1 200 fffffe810f2d7b80 coretemp1 coretemp1
0 79 3 7 200 fffffe810f2e0320 coretemp0 coretemp0
0 78 3 6 200 fffffe810f2e0740 mfi0 mfi0
0 69 3 0 200 fffffe810f1fc6e0 atabus1 atath
0 68 3 0 200 fffffe810f1fcb00 atabus0 atath
0 66 3 0 200 fffffe810ed326c0 scsibus0 sccomp
0 65 3 5 200 fffffe810ed32ae0 usbtask-dr usbtsk
0 64 3 0 200 fffffe810eca9280 usbtask-hc usbtsk
0 63 3 7 200 fffffe810eca96a0 bnx3 bnx3
0 62 3 4 200 fffffe810eca9ac0 bnx2 bnx2
0 61 3 0 200 fffffe810eb60260 bnx1 bnx1
0 60 3 7 200 fffffe810eb60680 bnx0 bnx0
0 59 3 5 200 fffffe810eb60aa0 ipmi ipmipoll
0 58 3 7 200 fffffe810ea73240 xcall/7 xcall
0 57 1 7 200 fffffe810ea73660 softser/7
0 56 1 7 200 fffffe810ea73a80 softclk/7
0 55 1 7 200 fffffe810ea54220 softbio/7
0 54 1 7 200 fffffe810ea54640 softnet/7
0 : 53 7 7 201 fffffe810ea54a60 idle/7
0 52 3 6 200 fffffe810ea3d200 xcall/6 xcall
0 51 1 6 200 fffffe810ea3d620 softser/6
0 50 1 6 200 fffffe810ea3da40 softclk/6
0 49 1 6 200 fffffe810ea161e0 softbio/6
0 48 1 6 200 fffffe810ea16600 softnet/6
0 : 47 7 6 201 fffffe810ea16a20 idle/6
0 46 3 5 200 fffffe810e9d71c0 xcall/5 xcall
0 45 1 5 200 fffffe810e9d75e0 softser/5
0 44 1 5 200 fffffe810e9d7a00 softclk/5
0 43 1 5 200 fffffe810e9d01a0 softbio/5
0 42 1 5 200 fffffe810e9d05c0 softnet/5
0 : 41 7 5 201 fffffe810e9d09e0 idle/5
0 40 3 4 200 fffffe810e9a1180 xcall/4 xcall
0 39 1 4 200 fffffe810e9a15a0 softser/4
0 38 1 4 200 fffffe810e9a19c0 softclk/4
0 37 1 4 200 fffffe810e97a160 softbio/4
0 36 1 4 200 fffffe810e97a580 softnet/4
0 : 35 7 4 201 fffffe810e97a9a0 idle/4
0 34 3 3 200 fffffe810e943140 xcall/3 xcall
0 33 1 3 200 fffffe810e943560 softser/3
0 32 1 3 200 fffffe810e943980 softclk/3
0 31 1 3 200 fffffe810e934120 softbio/3
0 30 1 3 200 fffffe810e934540 softnet/3
0 : 29 7 3 201 fffffe810e934960 idle/3
0 28 3 2 200 fffffe810e90d100 xcall/2 xcall
0 27 1 2 200 fffffe810e90d520 softser/2
0 26 1 2 200 fffffe810e90d940 softclk/2
0 25 1 2 200 fffffe810e8f60e0 softbio/2
0 24 1 2 200 fffffe810e8f6500 softnet/2
0 : 23 7 2 201 fffffe810e8f6920 idle/2
0 22 3 1 200 fffffe810e8c50c0 xcall/1 xcall
0 21 1 1 200 fffffe810e8c54e0 softser/1
0 20 1 1 200 fffffe810e8c5900 softclk/1
0 19 1 1 200 fffffe810e8a90a0 softbio/1
0 18 1 1 200 fffffe810e8a94c0 softnet/1
0 : 17 7 1 201 fffffe810e8a98e0 idle/1
0 16 3 0 200 fffffe822de9e080 lnxsyswq lnxsyswq
0 15 3 5 200 fffffe822de9e4a0 sysmon smtaskq
0 14 3 7 200 fffffe822de9e8c0 pmfsuspend pmfsuspend
0 13 3 4 200 fffffe822e2c5060 pmfevent pmfevent
0 12 3 0 200 fffffe822e2c5480 sopendfree sopendfr
0 11 3 2 200 fffffe822e2c58a0 nfssilly nfssilly
0 10 3 6 200 fffffe822f6dc040 cachegc cachegc
0 9 3 6 200 fffffe822f6dc460 vdrain vdrain
0 8 3 1 200 fffffe822f6dc880 modunload mod_unld
0 7 3 0 200 fffffe822f6fd020 xcall/0 xcall
0 : 6 7 0 200 fffffe822f6fd440 softser/0
0 : 5 7 0 200 fffffe822f6fd860 softclk/0
0 4 1 0 200 fffffe822f719000 softbio/0
0 3 1 0 200 fffffe822f719420 softnet/0
0 2 1 0 201 fffffe822f719840 idle/0
0 1 3 3 200 ffffffff81481b20 swapper uvm
db{0}:
and here's the dmesg output for the host:
Copyright (c) 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005,
2006, 2007, 2008, 2009, 2010, 2011, 2012, 2013, 2014, 2015, 2016, 2017
The NetBSD Foundation, Inc. All rights reserved.
Copyright (c) 1982, 1986, 1989, 1991, 1993
The Regents of the University of California. All rights reserved.
NetBSD 8.0_BETA (GENERIC.201803261630Z)
total memory = 8179 MB
avail memory = 7920 MB
timecounter: Timecounters tick every 10.000 msec
Kernelized RAIDframe activated
running cgd selftest aes-xts-256 aes-xts-512 done
timecounter: Timecounter "i8254" frequency 1193182 Hz quality 100
Dell Inc. PowerEdge R610
mainbus0 (root)
ACPI: RSDP 0x00000000000F1150 000024 (v02 DELL )
ACPI: XSDT 0x00000000000F1254 000094 (v01 DELL PE_SC3 00000001 DELL 00000001)
ACPI: FACP 0x00000000CF3B3F9C 0000F4 (v03 DELL PE_SC3 00000001 DELL 00000001)
ACPI: DSDT 0x00000000CF38F000 003DD0 (v01 DELL PE_SC3 00000001 INTL 20050624)
ACPI: FACS 0x00000000CF3B6000 000040
ACPI: FACS 0x00000000CF3B6000 000040
ACPI: APIC 0x00000000CF3B3478 00015E (v01 DELL PE_SC3 00000001 DELL 00000001)
ACPI: SPCR 0x00000000CF3B35D8 000050 (v01 DELL PE_SC3 00000001 DELL 00000001)
ACPI: HPET 0x00000000CF3B362C 000038 (v01 DELL PE_SC3 00000001 DELL 00000001)
ACPI: DM__ 0x00000000CF3B3668 0001A8 (v01 DELL PE_SC3 00000001 DELL 00000001)
ACPI: MCFG 0x00000000CF3B38C4 00003C (v01 DELL PE_SC3 00000001 DELL 00000001)
ACPI: WD__ 0x00000000CF3B3904 000134 (v01 DELL PE_SC3 00000001 DELL 00000001)
ACPI: SLIC 0x00000000CF3B3A3C 000176 (v01 DELL PE_SC3 00000001 DELL 00000001)
ACPI: ERST 0x00000000CF392F70 000270 (v01 DELL PE_SC3 00000001 DELL 00000001)
ACPI: HEST 0x00000000CF3931E0 0003A8 (v01 DELL PE_SC3 00000001 DELL 00000001)
ACPI: BERT 0x00000000CF392DD0 000030 (v01 DELL PE_SC3 00000001 DELL 00000001)
ACPI: EINJ 0x00000000CF392E00 000170 (v01 DELL PE_SC3 00000001 DELL 00000001)
ACPI: SRAT 0x00000000CF3B3BC0 000370 (v01 DELL PE_SC3 00000001 DELL 00000001)
ACPI: TCPA 0x00000000CF3B3F34 000064 (v02 DELL PE_SC3 00000001 DELL 00000001)
ACPI: 1 ACPI AML tables successfully acquired and loaded
ioapic0 at mainbus0 apid 0: pa 0xfec00000, version 0x20, 24 pins
ioapic1 at mainbus0 apid 1: pa 0xfec80000, version 0x20, 24 pins
cpu0 at mainbus0 apid 32
cpu0: Intel(R) Xeon(R) CPU E5640 @ 2.67GHz, id 0x206c2
cpu0: package 1, core 0, smt 0
cpu1 at mainbus0 apid 34
cpu1: Intel(R) Xeon(R) CPU E5640 @ 2.67GHz, id 0x206c2
cpu1: package 1, core 1, smt 0
cpu2 at mainbus0 apid 50
cpu2: Intel(R) Xeon(R) CPU E5640 @ 2.67GHz, id 0x206c2
cpu2: package 1, core 9, smt 0
cpu3 at mainbus0 apid 52
cpu3: Intel(R) Xeon(R) CPU E5640 @ 2.67GHz, id 0x206c2
cpu3: package 1, core 10, smt 0
cpu4 at mainbus0 apid 33
cpu4: Intel(R) Xeon(R) CPU E5640 @ 2.67GHz, id 0x206c2
cpu4: package 1, core 0, smt 1
cpu5 at mainbus0 apid 35
cpu5: Intel(R) Xeon(R) CPU E5640 @ 2.67GHz, id 0x206c2
cpu5: package 1, core 1, smt 1
cpu6 at mainbus0 apid 51
cpu6: Intel(R) Xeon(R) CPU E5640 @ 2.67GHz, id 0x206c2
cpu6: package 1, core 9, smt 1
cpu7 at mainbus0 apid 53
cpu7: Intel(R) Xeon(R) CPU E5640 @ 2.67GHz, id 0x206c2
cpu7: package 1, core 10, smt 1
acpi0 at mainbus0: Intel ACPICA 20170303
acpi0: X/RSDT: OemId <DELL ,PE_SC3 ,00000001>, AslId <DELL,00000001>
acpi0: MCFG: segment 0, bus 0-255, address 0x00000000e0000000
acpi0: SCI interrupting at int 9
timecounter: Timecounter "ACPI-Fast" frequency 3579545 Hz quality 1000
hpet0 at acpi0: high precision event timer (mem 0xfed00000-0xfed00400)
timecounter: Timecounter "hpet0" frequency 14318180 Hz quality 2000
WHEA (PNP0C33) at acpi0 not configured
PMI0 (ACPI000D) at acpi0 not configured
SPK (PNP0C01) at acpi0 not configured
attimer1 at acpi0 (TMR, PNP0100): io 0x40-0x5f irq 0
COMA (PNP0501) at acpi0 not configured
COMB (PNP0501) at acpi0 not configured
MBIO (PNP0C01) at acpi0 not configured
NIPM (IPI0001) at acpi0 not configured
PEHB (PNP0C02) at acpi0 not configured
VTD (PNP0C02) at acpi0 not configured
acpiwmi0 at acpi0 (SRIO, PNP0C14-SRIO): ACPI WMI Interface
acpiwmibus at acpiwmi0 not configured
ACPI: Enabled 1 GPEs in block 00 to 3F
ipmi0 at mainbus0
pci0 at mainbus0 bus 0: configuration mode 1
pci0: i/o space, memory space enabled, rd/line, rd/mult, wr/inv ok
pchb0 at pci0 dev 0 function 0: vendor 8086 product 3403 (rev. 0x13)
ppb0 at pci0 dev 1 function 0: vendor 8086 product 3408 (rev. 0x13)
ppb0: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x4 @ 5.0GT/s
ppb0: link is x4 @ 2.5GT/s
pci1 at ppb0 bus 1
pci1: i/o space, memory space enabled, rd/line, wr/inv ok
bnx0 at pci1 dev 0 function 0: Broadcom NetXtreme II BCM5709 1000Base-T
bnx0: Ethernet address f0:4d:a2:03:7b:f3
bnx0: interrupting at ioapic1 pin 4
bnx0: ASIC BCM5709 C0 (0x57092003)
bnx0: PCIe x4 2.5Gbps
bnx0: Coal (RX:6,6,18,18; TX:20,20,80,80)
brgphy0 at bnx0 phy 1: BCM5709 10/100/1000baseT PHY, rev. 8
brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
bnx1 at pci1 dev 0 function 1: Broadcom NetXtreme II BCM5709 1000Base-T
bnx1: Ethernet address f0:4d:a2:03:7b:f5
bnx1: interrupting at ioapic1 pin 16
bnx1: ASIC BCM5709 C0 (0x57092003)
bnx1: PCIe x4 2.5Gbps
bnx1: Coal (RX:6,6,18,18; TX:20,20,80,80)
brgphy1 at bnx1 phy 1: BCM5709 10/100/1000baseT PHY, rev. 8
brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
ppb1 at pci0 dev 3 function 0: vendor 8086 product 340a (rev. 0x13)
ppb1: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x4 @ 5.0GT/s
ppb1: link is x4 @ 2.5GT/s
pci2 at ppb1 bus 2
pci2: i/o space, memory space enabled, rd/line, wr/inv ok
bnx2 at pci2 dev 0 function 0: Broadcom NetXtreme II BCM5709 1000Base-T
bnx2: Ethernet address f0:4d:a2:03:7b:f7
bnx2: interrupting at ioapic1 pin 0
bnx2: ASIC BCM5709 C0 (0x57092003)
bnx2: PCIe x4 2.5Gbps
bnx2: Coal (RX:6,6,18,18; TX:20,20,80,80)
brgphy2 at bnx2 phy 1: BCM5709 10/100/1000baseT PHY, rev. 8
brgphy2: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
bnx3 at pci2 dev 0 function 1: Broadcom NetXtreme II BCM5709 1000Base-T
bnx3: Ethernet address f0:4d:a2:03:7b:f9
bnx3: interrupting at ioapic1 pin 10
bnx3: ASIC BCM5709 C0 (0x57092003)
bnx3: PCIe x4 2.5Gbps
bnx3: Coal (RX:6,6,18,18; TX:20,20,80,80)
brgphy3 at bnx3 phy 1: BCM5709 10/100/1000baseT PHY, rev. 8
brgphy3: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
ppb2 at pci0 dev 7 function 0: vendor 8086 product 340e (rev. 0x13)
ppb2: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x8 @ 5.0GT/s
pci3 at ppb2 bus 4
pci3: i/o space, memory space enabled, rd/line, wr/inv ok
ppb3 at pci0 dev 9 function 0: vendor 8086 product 3410 (rev. 0x13)
ppb3: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x8 @ 5.0GT/s
pci4 at ppb3 bus 5
pci4: i/o space, memory space enabled, rd/line, wr/inv ok
vendor 8086 product 342e (interrupt system, generic 8259, revision 0x13) at pci0 dev 20 function 0 not configured
vendor 8086 product 3422 (interrupt system, generic 8259, revision 0x13) at pci0 dev 20 function 1 not configured
vendor 8086 product 3423 (interrupt system, generic 8259, revision 0x13) at pci0 dev 20 function 2 not configured
uhci0 at pci0 dev 26 function 0: vendor 8086 product 2937 (rev. 0x02)
uhci0: interrupting at ioapic0 pin 17
usb0 at uhci0: USB revision 1.0
uhci1 at pci0 dev 26 function 1: vendor 8086 product 2938 (rev. 0x02)
uhci1: interrupting at ioapic0 pin 18
usb1 at uhci1: USB revision 1.0
ehci0 at pci0 dev 26 function 7: vendor 8086 product 293c (rev. 0x02)
ehci0: interrupting at ioapic0 pin 19
ehci0: BIOS has given up ownership
ehci0: EHCI version 1.0
ehci0: 2 companion controllers, 2 ports each: uhci0 uhci1
usb2 at ehci0: USB revision 2.0
ppb4 at pci0 dev 28 function 0: vendor 8086 product 2940 (rev. 0x02)
ppb4: PCI Express capability version 1 <Root Port of PCI-E Root Complex> x4 @ 2.5GT/s
pci5 at ppb4 bus 3
pci5: i/o space, memory space enabled, rd/line, wr/inv ok
mfi0 at pci5 dev 0 function 0: Dell PERC H700 Integrated
mfi0: interrupting at ioapic0 pin 16
mfi0: PERC H700 Integrated version 12.10.4-0001
mfi0: logical drives 2, 1024MB RAM, BBU type BBU, status good
scsibus0 at mfi0: 64 targets, 8 luns per target
uhci2 at pci0 dev 29 function 0: vendor 8086 product 2934 (rev. 0x02)
uhci2: interrupting at ioapic0 pin 21
usb3 at uhci2: USB revision 1.0
uhci3 at pci0 dev 29 function 1: vendor 8086 product 2935 (rev. 0x02)
uhci3: interrupting at ioapic0 pin 20
usb4 at uhci3: USB revision 1.0
ehci1 at pci0 dev 29 function 7: vendor 8086 product 293a (rev. 0x02)
ehci1: interrupting at ioapic0 pin 21
ehci1: EHCI version 1.0
ehci1: 2 companion controllers, 2 ports each: uhci2 uhci3
usb5 at ehci1: USB revision 2.0
ppb5 at pci0 dev 30 function 0: vendor 8086 product 244e (rev. 0x92)
pci6 at ppb5 bus 6
pci6: i/o space, memory space enabled
vga0 at pci6 dev 3 function 0: vendor 102b product 0532 (rev. 0x0a)
wsdisplay0 at vga0 kbdmux 1
wsmux1: connecting to wsdisplay0
drm at vga0 not configured
ichlpcib0 at pci0 dev 31 function 0: vendor 8086 product 2918 (rev. 0x02)
timecounter: Timecounter "ichlpcib0" frequency 3579545 Hz quality 1000
ichlpcib0: 24-bit timer
tco0 at ichlpcib0: TCO (watchdog) timer configured.
tco0: Min/Max interval 1/367 seconds
piixide0 at pci0 dev 31 function 2: Intel 82801I Serial ATA Controller (ICH9) (rev. 0x02)
piixide0: bus-master DMA support present
piixide0: primary channel configured to native-PCI mode
piixide0: using ioapic0 pin 23 for native-PCI interrupt
atabus0 at piixide0 channel 0
piixide0: secondary channel configured to native-PCI mode
atabus1 at piixide0 channel 1
isa0 at ichlpcib0
tpm0 at isa0 iomem 0xfed40000-0xfed44fff irq 7: device 0x0000104a rev 0x4e
com0 at isa0 port 0x3f8-0x3ff irq 4: ns16550a, working fifo
com0: console
com1 at isa0 port 0x2f8-0x2ff irq 3: ns16550a, working fifo
pckbc0 at isa0 port 0x60-0x64
pcppi0 at isa0 port 0x61
spkr0 at pcppi0: PC Speaker
midi0 at pcppi0: PC speaker
sysbeep0 at pcppi0
attimer1: attached to pcppi0
acpicpu0 at cpu0: ACPI CPU
acpicpu0: C1: HLT, lat 0 us, pow 0 mW
coretemp0 at cpu0: thermal sensor, 1 C resolution, Tjmax=95
acpicpu1 at cpu1: ACPI CPU
coretemp1 at cpu1: thermal sensor, 1 C resolution, Tjmax=95
acpicpu2 at cpu2: ACPI CPU
coretemp2 at cpu2: thermal sensor, 1 C resolution, Tjmax=95
acpicpu3 at cpu3: ACPI CPU
coretemp3 at cpu3: thermal sensor, 1 C resolution, Tjmax=95
acpicpu4 at cpu4: ACPI CPU
acpicpu5 at cpu5: ACPI CPU
acpicpu6 at cpu6: ACPI CPU
acpicpu7 at cpu7: ACPI CPU
timecounter: Timecounter "clockinterrupt" frequency 100 Hz quality 0
timecounter: Timecounter "TSC" frequency 2660187410 Hz quality 3000
scsibus0: waiting 2 seconds for devices to settle...
IPsec: Initialized Security Association Processing.
uhub0 at usb4: vendor 8086 (0x8086) UHCI root hub (0000), class 9/0, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
uhub1 at usb1: vendor 8086 (0x8086) UHCI root hub (0000), class 9/0, rev 1.00/1.00, addr 1
uhub1: 2 ports with 2 removable, self powered
uhub2 at usb3: vendor 8086 (0x8086) UHCI root hub (0000), class 9/0, rev 1.00/1.00, addr 1
uhub2: 2 ports with 2 removable, self powered
uhub3 at usb2: vendor 8086 (0x8086) EHCI root hub (0000), class 9/0, rev 2.00/1.00, addr 1
uhub3: 4 ports with 4 removable, self powered
uhub4 at usb0: vendor 8086 (0x8086) UHCI root hub (0000), class 9/0, rev 1.00/1.00, addr 1
uhub4: 2 ports with 2 removable, self powered
uhub5 at usb5: vendor 8086 (0x8086) EHCI root hub (0000), class 9/0, rev 2.00/1.00, addr 1
uhub5: 4 ports with 4 removable, self powered
ehci0: handing over low speed device on port 1 to uhci0
ehci1: handing over full speed device on port 2 to uhci2
sd0 at scsibus0 target 0 lun 0: <DELL, PERC H700, 2.10> disk fixed
sd0: fabricating a geometry
sd0: 69376 MB, 69376 cyl, 64 head, 32 sec, 512 bytes/sect x 142082048 sectors
sd0: fabricating a geometry
sd0: tagged queueing
sd1 at scsibus0 target 1 lun 0: <DELL, PERC H700, 2.10> disk fixed
sd1: fabricating a geometry
sd1: 558 GB, 571776 cyl, 64 head, 32 sec, 512 bytes/sect x 1170997248 sectors
sd1: fabricating a geometry
sd1: tagged queueing
uhub6 at uhub3 port 3: vendor 0424 (0x424) product 2514 (0x2514), class 9/0, rev 2.00/0.00, addr 2
uhub6: multiple transaction translators
uhub6: 3 ports with 3 removable, self powered
uhidev0 at uhub4 port 1 configuration 1 interface 0
uhidev0: LITE-ON Technology (0x413c) Dell USB/PS2 Combo Rackmount Keyboard (0x2103), rev 1.10/1.00, addr 2, iclass 3/1
ukbd0 at uhidev0: 8 Variable keys, 6 Array codes
uhidev1 at uhub2 port 2 configuration 1 interface 0
uhidev1: Avocent (0x624) USB Composite Device-0 (0x248), rev 1.10/0.00, addr 2, iclass 3/1
ukbd1 at uhidev1: 8 Variable keys, 6 Array codes
wskbd0 at ukbd0 mux 1
wskbd0: connecting to wsdisplay0
uhidev2 at uhub4 port 1 configuration 1 interface 1
uhidev2: LITE-ON Technology (0x413c) Dell USB/PS2 Combo Rackmount Keyboard (0x2103), rev 1.10/1.00, addr 2, iclass 3/1
ums0 at uhidev2: 2 buttons
wsmouse0 at ums0 mux 0
wskbd1 at ukbd1 mux 1
wskbd1: connecting to wsdisplay0
uhidev3 at uhub2 port 2 configuration 1 interface 1
uhidev3: Avocent (0x624) USB Composite Device-0 (0x248), rev 1.10/0.00, addr 2, iclass 3/1
ums1 at uhidev3: 3 buttons and Z dir
wsmouse1 at ums1 mux 0
atapibus0 at atabus0: 2 targets
cd0 at atapibus0 drive 0: <TEAC DVD-ROM DV-28SW, 10092412144820, R.2A> cdrom removable
cd0: 32-bit data port
cd0: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 5 (Ultra/100)
cd0(piixide0:0:0): using PIO mode 4, Ultra-DMA mode 5 (Ultra/100) (using DMA)
pad0: outputs: 44100Hz, 16-bit, stereo
audio0 at pad0: half duplex, playback, capture, mmap
pad0: Virtual format configured - Format SLINEAR, precision 16, channels 2, frequency 44100
pad0: Latency: 139 milliseconds
spkr1 at audio0: PC Speaker (synthesized)
boot device: sd0
root on sd0a dumps on sd0b
root file system type: ffs
kern.module.path=/stand/amd64/8.0/modules
mfi0: normal state on 'mfi0:0' (online)
mfi0: normal state on 'mfi0:1' (online)
ipmi0: version 2.0 interface KCS iobase 0xca8/8 spacing 4
wsdisplay0: screen 1 added (80x25, vt100 emulation)
wsdisplay0: screen 2 added (80x25, vt100 emulation)
wsdisplay0: screen 3 added (80x25, vt100 emulation)
wsdisplay0: screen 4 added (80x25, vt100 emulation)
>How-To-Repeat:
Configure a host with 3 active interfaces, use it moderately,
watch it wedge after less than a day.
(We have other identical systems which only use one network
interface and which don't wedge.)
>Fix:
Sorry, don't know.
I'm asking for more information about what to do next to zero
in on the root cause of this problem.
A kernel with DEBUG? DIAGNOSTIC? LOCKDEBUG? All of them? Or
only two?
What other information needs to be collected next time it
wedges to get closer to the root cause of the problem?
Home |
Main Index |
Thread Index |
Old Index