NetBSD-Bugs archive

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]

Re: port-amd64/53155: OS wedges after <12h uptime when >2 bnx network interfaces in use



The following reply was made to PR port-amd64/53155; it has been noted by GNATS.

From: Ryota Ozaki <ozaki-r%netbsd.org@localhost>
To: "gnats-bugs%NetBSD.org@localhost" <gnats-bugs%netbsd.org@localhost>
Cc: port-amd64-maintainer%netbsd.org@localhost, gnats-admin%netbsd.org@localhost, 
	netbsd-bugs%netbsd.org@localhost, Havard Eidnes <he%netbsd.org@localhost>
Subject: Re: port-amd64/53155: OS wedges after <12h uptime when >2 bnx network
 interfaces in use
Date: Fri, 6 Apr 2018 02:24:11 +0900

 On Thu, Apr 5, 2018 at 9:25 PM, Havard Eidnes <he%netbsd.org@localhost> wrote:
 > The following reply was made to PR port-amd64/53155; it has been noted by=
  GNATS.
 >
 > From: Havard Eidnes <he%NetBSD.org@localhost>
 > To: gnats-bugs%NetBSD.org@localhost
 > Cc:
 > Subject: Re: port-amd64/53155: OS wedges after <12h uptime when >2 bnx
 >  network interfaces in use
 > Date: Thu, 05 Apr 2018 14:22:17 +0200 (CEST)
 >
 >  Following ozaki-r's hints, here's more information with the locks
 >  dumped on another wedge event.
 
 I've tried to compose a resource dependency graph from the outputs
 (if the graph has a loop, there is a deadlock) and this is a result:
 
   [expect] vfs_suspend_lock, fstrans_lock =3D> pserialize_perform =3D> kpau=
 se =3D>
   [tcp_timer_rexmt (softclk/?)] softnet_lock =3D> [ip6intr (softnet/0)]
 sowakeup =3D> ???
 
 I don't know what is going on in sowakeup. If it gets stuck because of
 vfs_suspend_lock or fstrans_lock, a loop appears.
 
 vfs experts would find a missing link.
 
   ozaki-r
 
 
 >
 >  "DDB break sequence keyed in"
 >  fatal breakpoint trap in supervisor mode
 >  trap type 1 code 0 rip 0xffffffff8021dbb5 cs 0x8 rflags 0x202 cr2 0xffff=
 80009da69000 ilevel 0x8 rsp 0xffff80008f69bcf8
 >  curlwp 0xfffffe822f6eb440 pid 0.6 lowest kstack 0xffff80008f6972c0
 >  Stopped in pid 0.6 (system) at  netbsd:breakpoint+0x5:  leave
 >  db{0}: show all locks
 >  [Locks tracked through LWPs]
 >  Locks held by an LWP (expect):
 >  Lock 0 (initialized at fstrans_init)
 >  lock address : 0xffffffff815cb9b8 type     :     sleep/adaptive
 >  initialized  : 0xffffffff809fe690
 >  shared holds :                  0 exclusive:                  1
 >  shares wanted:                  0 exclusive:                  0
 >  current cpu  :                  0 last held:                  3
 >  current lwp  : 0xfffffe822f6eb440 last held: 0xfffffe821e439080
 >  last locked* : 0xffffffff80a00523 unlocked : 0xffffffff80a0315f
 >  owner field  : 0xfffffe821e439080 wait/spin:                0/0
 >
 >  Turnstile chain at 0xffffffff814c5130.
 >  =3D: No active turnstile for this lock.
 >  Lock 1 (initialized at fstrans_init)
 >  lock address : 0xffffffff815cb9b0 type     :     sleep/adaptive
 >  initialized  : 0xffffffff809fe6a3
 >  shared holds :                  0 exclusive:                  1
 >  shares wanted:                  0 exclusive:                  0
 >  current cpu  :                  0 last held:                  3
 >  current lwp  : 0xfffffe822f6eb440 last held: 0xfffffe821e439080
 >  last locked* : 0xffffffff809ffb6d unlocked : 0xffffffff809fecc4
 >  owner field  : 0xfffffe821e439080 wait/spin:                0/0
 >
 >  Turnstile chain at 0xffffffff814c5120.
 >  =3D: No active turnstile for this lock.
 >
 >  Locks held by an LWP (pickup):
 >  Lock 0 (initialized at fork1)
 >  lock address : 0xfffffe821dce4a30 type     :     sleep/adaptive
 >  initialized  : 0xffffffff809599ab
 >  shared holds :                  0 exclusive:                  1
 >  shares wanted:                  0 exclusive:                  0
 >  current cpu  :                  0 last held:                  2
 >  current lwp  : 0xfffffe822f6eb440 last held: 0xfffffe81b102da80
 >  last locked* : 0xffffffff809580c1 unlocked : 0xffffffff80879889
 >  owner/count  : 0xfffffe81b102da80 flags    : 0x0000000000000004
 >
 >  Turnstile chain at 0xffffffff814c4e20.
 >  =3D: No active turnstile for this lock.
 >  Lock 1 (initialized at filedesc_ctor)
 >  lock address : 0xfffffe821f62f880 type     :     sleep/adaptive
 >  initialized  : 0xffffffff8094d11f
 >  shared holds :                  0 exclusive:                  1
 >  shares wanted:                  0 exclusive:                  0
 >  current cpu  :                  0 last held:                  2
 >  current lwp  : 0xfffffe822f6eb440 last held: 0xfffffe81b102da80
 >  last locked* : 0xffffffff80953c76 unlocked : 0xffffffff8094e4a5
 >  owner field  : 0xfffffe81b102da80 wait/spin:                0/0
 >
 >  Turnstile chain at 0xffffffff814c4ec0.
 >  =3D: No active turnstile for this lock.
 >
 >  Locks held by an LWP (master):
 >  Lock 0 (initialized at filedesc_ctor)
 >  lock address : 0xfffffe822870adc0 type     :     sleep/adaptive
 >  initialized  : 0xffffffff8094d11f
 >  shared holds :                  0 exclusive:                  1
 >  shares wanted:                  0 exclusive:                  0
 >  current cpu  :                  0 last held:                  1
 >  current lwp  : 0xfffffe822f6eb440 last held: 0xfffffe822962bac0
 >  last locked* : 0xffffffff809522e8 unlocked : 0xffffffff8094ec84
 >  owner field  : 0xfffffe822962bac0 wait/spin:                0/0
 >
 >  Turnstile chain at 0xffffffff814c5140.
 >  =3D: No active turnstile for this lock.
 >
 >  Locks held by an LWP (ioflush):
 >  Lock 0 (initialized at vcache_alloc)
 >  lock address : 0xfffffe8061cb6fa0 type     :     sleep/adaptive
 >  initialized  : 0xffffffff80a01652
 >  shared holds :                  0 exclusive:                  1
 >  shares wanted:                  0 exclusive:                  0
 >  current cpu  :                  0 last held:                  7
 >  current lwp  : 0xfffffe822f6eb440 last held: 0xfffffe822dce8100
 >  last locked* : 0xffffffff80a17d69 unlocked : 0xffffffff80a17db4
 >  owner/count  : 0xfffffe822dce8100 flags    : 0x0000000000000004
 >
 >  Turnstile chain at 0xffffffff814c5100.
 >  =3D: No active turnstile for this lock.
 >
 >  Locks held by an LWP (softnet/0):
 >  Lock 0 (initialized at soinit)
 >  lock address : 0xfffffe822fb97f40 type     :     sleep/adaptive
 >  initialized  : 0xffffffff809db0cb
 >  shared holds :                  0 exclusive:                  1
 >  shares wanted:                  0 exclusive:                 14
 >  current cpu  :                  0 last held:                  0
 >  current lwp  : 0xfffffe822f6eb440 last held: 0xfffffe822f707420
 >  last locked* : 0xffffffff806d7add unlocked : 0xffffffff80951f2c
 >  owner field  : 0xfffffe822f707420 wait/spin:                1/0
 >
 >  Turnstile chain at 0xffffffff814c5040.
 >  =3D: Turnstile at 0xfffffe810f381d20 (wrq=3D0xfffffe810f381d40, rdq=3D0x=
 fffffe810f381d
 >  50).
 >  =3D: 0 waiting readers:
 >  =3D: 14 waiting writers: 0xfffffe810f396880 0xfffffe810e9a29c0 0xfffffe8=
 10e9e0a00 0xfffffe810e94c980 0xfffffe82212fc700 0xfffffe82228e28e0 0xfffffe=
 8222950b60 0xfffffe82212fcb20 0xfffffe822962b6a0 0xfffffe822c341200 0xfffff=
 e8220e621e0 0xfffffe821ea02260 0xfffffe821f0986c0 0xfffffe810f2da300
 >
 >
 >  [Locks tracked through CPUs]
 >  Locks held on CPU 0:
 >  Lock 0 (initialized at main)
 >  lock address : 0xffffffff814c3840 type     :               spin
 >  initialized  : 0xffffffff80d02d91
 >  shared holds :                  0 exclusive:                  1
 >  shares wanted:                  0 exclusive:                  6
 >  current cpu  :                  0 last held:                  0
 >  current lwp  : 0xfffffe822f6eb440 last held: 0xfffffe822f707420
 >  last locked* : 0xffffffff806d7ae7 unlocked : 0xffffffff80a3a00f
 >  curcpu holds :                  1 wanted by: 000000000000000000
 >
 >  Lock 1 (initialized at com_attach_subr)
 >  lock address : 0xfffffe810f20b1e0 type     :               spin
 >  initialized  : 0xffffffff805ce644
 >  shared holds :                  0 exclusive:                  1
 >  shares wanted:                  0 exclusive:                  0
 >  current cpu  :                  0 last held:                  0
 >  current lwp  : 0xfffffe822f6eb440 last held: 0xfffffe822f6eb440
 >  last locked* : 0xffffffff805cdba0 unlocked : 0xffffffff805cdd7f
 >  owner field  : 0x0000000000010800 wait/spin:                0/1
 >
 >
 >  db{0}: ps
 >  PID    LID S CPU     FLAGS       STRUCT LWP *               NAME WAIT
 >  6110 :   1 7   3         0   fffffe821e439080             expect
 >  16029    1 3   5        80   fffffe8223e0d680                 sh wait
 >  17269    1 3   5        80   fffffe821e4398c0               perl pipe_rd
 >  6258     1 3   5        80   fffffe8220e10960                 sh wait
 >  6160     1 3   4        80   fffffe821db62940                ssh select
 >  9045     2 3   2        80   fffffe8207c29900             expect select
 >  9045     1 3   5        80   fffffe821d8e9120             expect parked
 >  8628     1 3   2        80   fffffe8217495860                 sh wait
 >  6162     1 3   0        80   fffffe821baa01a0               perl pipe_rd
 >  10236    1 3   4        80   fffffe8220439aa0                 sh wait
 >  10536    1 3   4     40000   fffffe821ea02260                ssh tstile
 >  16657    2 3   4        80   fffffe822d304a00             expect select
 >  16657    1 3   0        80   fffffe822244f160             expect parked
 >  1568     1 3   2        80   fffffe821c6c44c0                 sh wait
 >  621      1 3   3        80   fffffe821eb29980               perl pipe_rd
 >  1714     1 3   5        80   fffffe82220db9a0                 sh wait
 >  20537    1 3   7        80   fffffe8220e62600                ssh select
 >  855      2 3   3        80   fffffe8220c66920             expect select
 >  855  :   1 7   6         0   fffffe820e54e100             expect
 >  2913     1 3   6        80   fffffe8220439680                 sh wait
 >  10978    1 3   6        80   fffffe821d9671e0                ssh select
 >  26960    1 3   6        80   fffffe821f312a60               perl pipe_rd
 >  13813    1 3   0        80   fffffe820e54e940                 sh wait
 >  4350     2 3   6        80   fffffe8222d32880             expect select
 >  4350     1 3   0        80   fffffe82220e8b80             expect parked
 >  22724    1 3   7        80   fffffe822a7bc960                 sh wait
 >  5198     1 3   0        80   fffffe822301aba0               perl pipe_rd
 >  3944     1 3   5        80   fffffe821fe156e0                 sh wait
 >  6695     1 3   5        80   fffffe8221b59560                par pause
 >  1700     1 3   5        80   fffffe81dc6c72a0                 sh wait
 >  9549     1 3   1        80   fffffe821c9580e0                 sh wait
 >  6024     1 3   1        80   fffffe8220975780                 sh wait
 >  7673     1 3   1        80   fffffe822244f580                 sh wait
 >  10638    1 3   1        80   fffffe821ed0c9c0               cron pipe_rd
 >  4839     1 3   6        80   fffffe820e0aa200               sshd select
 >  3563     1 3   6        80   fffffe821f7e8a60               sshd select
 >  11359    1 3   1        80   fffffe821f4f2b40                ssh select
 >  1612     1 3   1        80   fffffe81dc6c7ae0                 sh wait
 >  16815    1 3   1        80   fffffe821ea02aa0               bash select
 >  5195     1 3   0        80   fffffe820f859840               sshd select
 >  19300    1 3   0        80   fffffe8220e62a20               sshd select
 >  6945     1 3   1        80   fffffe821d1d9340               bash wait
 >  5497     1 3   2        80   fffffe8226609b40               sshd select
 >  3611     1 3   2        80   fffffe8226a51b20               sshd select
 >  18181    1 3   6        80   fffffe82228e20a0                ssh select
 >  29538    1 3   6        80   fffffe82174aa600                 sh wait
 >  1782     1 3   2     40000   fffffe821f0986c0               ping tstile
 >  23170    1 3   4        80   fffffe822345f900                ssh select
 >  25239    1 3   6        80   fffffe8220e10540                 sh wait
 >  22752    1 3   2        80   fffffe8223e968c0                ssh select
 >  21643    1 3   6        80   fffffe8221723ac0                 sh wait
 >  22354    1 3   1        80   fffffe822301a780                ssh select
 >  12292    1 3   6        80   fffffe8221b59140                 sh wait
 >  440      1 3   1        80   fffffe821f2f9760               bash select
 >  16624    1 3   4        80   fffffe821dd60320               sshd select
 >  24686    1 3   3        80   fffffe82219b8480               sshd select
 >  17072:   1 7   2         0   fffffe81b102da80             pickup
 >  17333    1 3   3        80   fffffe821e378ba0               bash wait
 >  12287    1 3   5        80   fffffe8223e0d260               sshd select
 >  28431    1 3   3        80   fffffe821f62b300               sshd select
 >  25668    1 3   5        80   fffffe821db62100                ssh select
 >  18777    1 3   7        80   fffffe821d548460                 sh wait
 >  23483    1 3   6        80   fffffe821dfed5e0                ssh select
 >  24114    1 3   1        80   fffffe82219b8060                 sh wait
 >  18841    1 3   2        80   fffffe821db62520                ssh select
 >  8541     1 3   1        80   fffffe821c347020                 sh wait
 >  20854    1 3   3        80   fffffe8220a11420                ssh select
 >  28316    1 3   7        80   fffffe821d449760                 sh wait
 >  21952    1 3   6        80   fffffe8223e964a0                ssh select
 >  21821    1 3   7        80   fffffe81b0264680                 sh wait
 >  22659    1 3   7        80   fffffe82220db580                ssh select
 >  15239    1 3   7        80   fffffe8200e69640                 sh wait
 >  20787    1 3   0        80   fffffe8222093620                ssh select
 >  25294    1 3   7        80   fffffe821e959b20                 sh wait
 >  20182    1 3   4        80   fffffe82205cf440                ssh select
 >  21140    1 3   1        80   fffffe822301a360                 sh wait
 >  10348    1 3   1        80   fffffe822084f900                ssh select
 >  19979    1 3   6        80   fffffe8219d9d9e0                 sh wait
 >  20748    1 3   0        80   fffffe81b102d240                ssh select
 >  29870    1 3   6        80   fffffe821ea84a60                 sh wait
 >  28154    1 3   3        80   fffffe821e6f1060                ssh select
 >  21713    1 3   1        80   fffffe82215225a0                 sh wait
 >  22666    1 3   5        80   fffffe821fe912a0                ssh select
 >  19782    1 3   3        80   fffffe8228f16ae0                 sh wait
 >  23668    1 3   4        80   fffffe822325b440                ssh select
 >  24824    1 3   3        80   fffffe821c347440                 sh wait
 >  21452    1 3   1        80   fffffe821e6f18a0                ssh select
 >  18115    1 3   6        80   fffffe8223c84b20                 sh wait
 >  23734    1 3   3        80   fffffe82101970e0                ssh select
 >  23642    1 3   3        80   fffffe821b7f01c0                 sh wait
 >  15721    1 3   2        80   fffffe822d3045e0                ssh select
 >  24741    1 3   6        80   fffffe8222d32040                 sh wait
 >  25785    1 3   4        80   fffffe820e91e8c0                ssh select
 >  29353    1 3   6        80   fffffe822d96d580                 sh wait
 >  17591    1 3   3        80   fffffe8211ded180                ssh select
 >  22243    1 3   6        80   fffffe821e378360                 sh wait
 >  11016    1 3   7        80   fffffe820d036160                ssh select
 >  23915    1 3   6        80   fffffe822d9f1560                 sh wait
 >  23755    1 3   2        80   fffffe82220e8760                ssh select
 >  28517    1 3   3        80   fffffe821d967600                 sh wait
 >  21937    1 3   1        80   fffffe8222b59420                ssh select
 >  24531    1 3   3        80   fffffe8222093a40                 sh wait
 >  21091    1 3   5        80   fffffe82101cf480                ssh select
 >  24050    1 3   6        80   fffffe82174aaa20                 sh wait
 >  21377    1 3   7        80   fffffe821dfed1c0                ssh select
 >  25968    1 3   6        80   fffffe822d9f1140                 sh wait
 >  19956    1 3   5        80   fffffe8215f17980                ssh select
 >  22513    1 3   1        80   fffffe821d1d9b80                 sh wait
 >  23875    1 3   1        80   fffffe821e2da1e0                ssh select
 >  20549    1 3   1        80   fffffe821eb29560                 sh wait
 >  21480    1 3   6        80   fffffe822281b940                ssh select
 >  19370    1 3   6        80   fffffe8221343200                 sh wait
 >  27941    1 3   3        80   fffffe821d548040                ssh select
 >  1308     1 3   3        80   fffffe821abcc300                 sh wait
 >  16930    1 3   5        80   fffffe821e2a7160                ssh select
 >  20374    1 3   6        80   fffffe8221b59980                 sh wait
 >  17114    1 3   4        80   fffffe82219c66e0                ssh select
 >  19866    1 3   6        80   fffffe820f859000                 sh wait
 >  26412    1 3   6        80   fffffe821b800780                ssh select
 >  21138    1 3   1        80   fffffe821c0755a0                 sh wait
 >  19764    1 3   7        80   fffffe8220e10120                ssh select
 >  19992    1 3   6        80   fffffe82219c62c0                 sh wait
 >  8561     1 3   4        80   fffffe822c0c4660                ssh select
 >  22282    1 3   5        80   fffffe820a38b0a0                 sh wait
 >  21455    1 3   5        80   fffffe82205446c0                ssh select
 >  19503    1 3   7        80   fffffe822a7bc540                 sh wait
 >  20237    1 3   2        80   fffffe820f859420                ssh select
 >  23846    1 3   7        80   fffffe821b7f05e0                 sh wait
 >  23390    1 3   0        80   fffffe821f62b720                ssh select
 >  6312     1 3   3        80   fffffe822325b860                 sh wait
 >  22688    1 3   6        80   fffffe8200e69220                ssh select
 >  26232    1 3   6        80   fffffe8220975360                 sh wait
 >  25797    1 3   1        80   fffffe82217cba00                ssh select
 >  26094    1 3   5        80   fffffe822d77e5c0                 sh wait
 >  18349    1 3   2        80   fffffe82224e1920                ssh select
 >  18457    1 3   5        80   fffffe821b800360                 sh wait
 >  4150     1 3   6        80   fffffe8222ec34a0                ssh select
 >  17097    1 3   1        80   fffffe821dfeda00                 sh wait
 >  21786    1 3   2        80   fffffe81b0264260                ssh select
 >  21190    1 3   5        80   fffffe821e959700                 sh wait
 >  21970    1 3   4        80   fffffe8226a51700                ssh select
 >  19183    1 3   5        80   fffffe821f2f9b80                 sh wait
 >  18769    1 3   2        80   fffffe821db454e0                ssh select
 >  23677    1 3   1        80   fffffe821c958500                 sh wait
 >  21567    1 3   1        80   fffffe822232c060                ssh select
 >  27597    1 3   2        80   fffffe821ed0c5a0                 sh wait
 >  23189    1 3   0        80   fffffe8217495440                ssh select
 >  24479    1 3   0        80   fffffe82205cf860                 sh wait
 >  19747    1 3   5        80   fffffe820e91e080                ssh select
 >  22977    1 3   0        80   fffffe822d7a19c0                 sh wait
 >  19741    1 3   6        80   fffffe8211524880                ssh select
 >  21217    1 3   5        80   fffffe820a38b8e0                 sh wait
 >  17887    1 3   1        80   fffffe821f7e8640                ssh select
 >  20134    1 3   7        80   fffffe821f62bb40                 sh wait
 >  17673    1 3   3        80   fffffe8222ec3080                ssh select
 >  16512    1 3   5        80   fffffe8222d32460                 sh wait
 >  22179    1 3   7        80   fffffe8220c66500                ssh select
 >  23863    1 3   3        80   fffffe821ea84220                 sh wait
 >  15669    1 3   5        80   fffffe820e91e4a0                ssh select
 >  19089    1 3   3        80   fffffe821f4f2300                 sh wait
 >  22480    1 3   2        80   fffffe8222b59000                ssh select
 >  15576    1 3   6        80   fffffe8220439260                 sh wait
 >  16125    1 3   2        80   fffffe821f098ae0                ssh select
 >  14729    1 3   6        80   fffffe810f2f1b60                 sh wait
 >  20188    1 3   2        80   fffffe822d77e1a0                ssh select
 >  23671    1 3   6        80   fffffe8219d9d1a0                 sh wait
 >  2378     1 3   4        80   fffffe822244f9a0                ssh select
 >  13692    1 3   3        80   fffffe8226a512e0                 sh wait
 >  16255    1 3   6        80   fffffe8224cb4940                ssh select
 >  13845    1 3   3        80   fffffe822084f4e0                 sh wait
 >  21973    1 3   3        80   fffffe821c958920                ssh select
 >  13867    1 3   3        80   fffffe821e6f1480                 sh wait
 >  13804    1 3   4        80   fffffe82212fc2e0                ssh select
 >  20798    1 3   6        80   fffffe822325b020                 sh wait
 >  17218    1 3   2        80   fffffe8229c95960                ssh select
 >  3258     1 3   0        80   fffffe821fe152c0                 sh wait
 >  21575    1 3   1        80   fffffe82200a1660                ssh select
 >  18008    1 3   6        80   fffffe81b102d660                 sh wait
 >  19955    1 3   6        80   fffffe821db45900                ssh select
 >  19174    1 3   6        80   fffffe822dcc7120                 sh wait
 >  16916    1 3   2        80   fffffe822962b280                ssh select
 >  2248     1 3   6        80   fffffe82224e10e0                 sh wait
 >  16945    1 3   0        80   fffffe8222b59840                ssh select
 >  21163    1 3   2        80   fffffe8211524460                 sh wait
 >  22509    1 3   2        80   fffffe8223c84700                ssh select
 >  18626    1 3   2        80   fffffe82220e8340                 sh wait
 >  18828    1 3   6        80   fffffe821de0a8e0                ssh select
 >  15805    1 3   7        80   fffffe8221343a40                 sh wait
 >  20827    1 3   4        80   fffffe822c0c4a80                ssh select
 >  14384    1 3   0        80   fffffe821e4a6a40                 sh wait
 >  20713    1 3   6        80   fffffe82164eab60               bash select
 >  9812     1 3   3        80   fffffe82280a41a0               sshd select
 >  13062    1 3   3        80   fffffe8220975ba0               sshd select
 >  17386    1 3   6        80   fffffe820e0aaa40                ssh select
 >  11169    1 3   2        80   fffffe82101cf060                 sh wait
 >  1442     1 3   0        80   fffffe821c075180               sshd select
 >  458      1 3   0        80   fffffe821d8e9540          conserver select
 >  1083     1 3   4         0   fffffe822c341200          conserver tstile
 >  1182     1 3   4         0   fffffe82228e28e0          conserver tstile
 >  1179     1 3   4         0   fffffe82212fcb20          conserver tstile
 >  534      1 3   0        80   fffffe8220e93660          conserver select
 >  900      1 3   2         0   fffffe82212fc700          conserver tstile
 >  935      1 3   4         0   fffffe8220e621e0          conserver tstile
 >  775      1 3   4        80   fffffe822345f0c0          conserver select
 >  871      1 3   4        80   fffffe8222950740          conserver select
 >  902      1 3   4         0   fffffe8222950b60          conserver tstile
 >  724      1 3   7        80   fffffe822dd720e0              getty ttyraw
 >  799      1 3   4         0   fffffe822962b6a0          conserver tstile
 >  894      1 3   4        80   fffffe8226609300          conserver select
 >  891      1 3   4        80   fffffe8226609720               cron nanoslp
 >  570      1 3   4        80   fffffe822d7a15a0          python2.7 select
 >  558      1 3   4        80   fffffe8228f166c0              inetd kqueue
 >  485      1 3   7        80   fffffe822c0c4240              nginx kqueue
 >  548      1 3   7        80   fffffe8228f162a0              nginx pause
 >  397      1 3   6        80   fffffe822d405a20               qmgr kqueue
 >  759  :   1 7   1         0   fffffe822962bac0             master
 >  473      1 3   0        80   fffffe822a7ffaa0           tac_plus select
 >  428      1 3   2        80   fffffe822d3041c0             powerd kqueue
 >  408      1 3   4        80   fffffe822c9dfa60               ntpd pause
 >  342      4 3   3        80   fffffe822c9df220              dhcpd parked
 >  342      3 3   7        80   fffffe822c9df640              dhcpd kqueue
 >  342  :   2 7   0         0   fffffe822d7a1180              dhcpd
 >  342      1 3   1        80   fffffe822c341a40              dhcpd parked
 >  83       1 3   2         0   fffffe810f2da300            syslogd tstile
 >  1        1 3   7        80   fffffe810f512900               init wait
 >  0      123 3   0       200   fffffe822d77e9e0            npfgc-0 npfgccv
 >  0      122 3   5       200   fffffe822d405600              ipmi0 ipmi0
 >  0      121 3   7       200   fffffe822dce8940            physiod physiod
 >  0      120 3   0       200   fffffe822dcc7960           aiodoned aiodone=
 d
 >  0    : 119 7   7       200   fffffe822dce8100            ioflush
 >  0      118 3   0       200   fffffe822dce8520           pgdaemon pgdaemo=
 n
 >  0      115 3   0       280   fffffe822dd72500              spkr1 bellcv
 >  0      114 3   5       280   fffffe822dd72920           audiomix play
 >  0      113 3   5       280   fffffe810ed3b2a0           audiorec record
 >  0      112 3   0       200   fffffe810f5120c0          atapibus0 sccomp
 >  0      110 3   4       200   fffffe810f20d2c0               usb4 usbevt
 >  0      109 3   4       200   fffffe810f2cb2e0               usb0 usbevt
 >  0      108 3   4       200   fffffe810f2dab40               usb5 usbevt
 >  0      107 3   0       200   fffffe810f2cbb20               usb3 usbevt
 >  0      106 3   4       200   fffffe810f2da720               usb2 usbevt
 >  0      105 3   4       200   fffffe810f5124e0               usb1 usbevt
 >  0      104 3   0       200   fffffe810f4a30a0            rt_free rt_free
 >  0      103 3   0       200   fffffe810f4a34c0              unpgc unpgc
 >  0      102 3   0       200   fffffe810f4a38e0    key_timehandler key_tim=
 ehandler
 >  0      101 3   7       200   fffffe810f474080    icmp6_wqinput/7 icmp6_w=
 qinput
 >  0      100 3   6       200   fffffe810f4744a0    icmp6_wqinput/6 icmp6_w=
 qinput
 >  0       99 3   5       200   fffffe810f4748c0    icmp6_wqinput/5 icmp6_w=
 qinput
 >  0       98 3   4       200   fffffe810f495060    icmp6_wqinput/4 icmp6_w=
 qinput
 >  0       97 3   3       200   fffffe810f495480    icmp6_wqinput/3 icmp6_w=
 qinput
 >  0       96 3   2       200   fffffe810f4958a0    icmp6_wqinput/2 icmp6_w=
 qinput
 >  0       95 3   1       200   fffffe810f396040    icmp6_wqinput/1 icmp6_w=
 qinput
 >  0       94 3   0       200   fffffe810f396460    icmp6_wqinput/0 icmp6_w=
 qinput
 >  0       93 3   1     40200   fffffe810f396880          nd6_timer tstile
 >  0       92 3   7       200   fffffe810f35f020     icmp_wqinput/7 icmp_wq=
 input
 >  0       91 3   6       200   fffffe810f35f440     icmp_wqinput/6 icmp_wq=
 input
 >  0       90 3   5       200   fffffe810f35f860     icmp_wqinput/5 icmp_wq=
 input
 >  0       89 3   4       200   fffffe810f370000     icmp_wqinput/4 icmp_wq=
 input
 >  0       88 3   3       200   fffffe810f370420     icmp_wqinput/3 icmp_wq=
 input
 >  0       87 3   2       200   fffffe810f370840     icmp_wqinput/2 icmp_wq=
 input
 >  0       86 3   1       200   fffffe810f33e360     icmp_wqinput/1 icmp_wq=
 input
 >  0       85 3   0       200   fffffe810f33e780     icmp_wqinput/0 icmp_wq=
 input
 >  0       84 3   4       200   fffffe810f33eba0           rt_timer rt_time=
 r
 >  0       83 3   2       200   fffffe810f2cb700        vmem_rehash vmem_re=
 hash
 >  0       82 3   2       200   fffffe810f2f0340          coretemp3 coretem=
 p3
 >  0       81 3   3       200   fffffe810f2f0760          coretemp2 coretem=
 p2
 >  0       80 3   4       200   fffffe810f2f0b80          coretemp1 coretem=
 p1
 >  0       79 3   5       200   fffffe810f2f1320          coretemp0 coretem=
 p0
 >  0       78 3   5       200   fffffe810f2f1740               mfi0 mfi0
 >  0       69 3   5       200   fffffe810f20d6e0            atabus1 atath
 >  0       68 3   7       200   fffffe810f20db00            atabus0 atath
 >  0       66 3   0       200   fffffe810ed3b6c0           scsibus0 sccomp
 >  0       65 3   2       200   fffffe810ed3bae0         usbtask-dr usbtsk
 >  0       64 3   0       200   fffffe810ecaa280         usbtask-hc usbtsk
 >  0       63 3   7       200   fffffe810ecaa6a0               bnx3 bnx3
 >  0       62 3   4       200   fffffe810ecaaac0               bnx2 bnx2
 >  0       61 3   2       200   fffffe810eb61260               bnx1 bnx1
 >  0       60 3   5       200   fffffe810eb61680               bnx0 bnx0
 >  0    :  59 7   5       200   fffffe810eb61aa0               ipmi
 >  0       58 3   7       200   fffffe810ea7c240            xcall/7 xcall
 >  0       57 1   7       200   fffffe810ea7c660          softser/7
 >  0       56 1   7       200   fffffe810ea7ca80          softclk/7
 >  0       55 1   7       200   fffffe810ea5d220          softbio/7
 >  0       54 1   7       200   fffffe810ea5d640          softnet/7
 >  0       53 1   7       201   fffffe810ea5da60             idle/7
 >  0       52 3   6       200   fffffe810ea36200            xcall/6 xcall
 >  0       51 1   6       200   fffffe810ea36620          softser/6
 >  0       50 1   6       200   fffffe810ea36a40          softclk/6
 >  0       49 1   6       200   fffffe810ea0f1e0          softbio/6
 >  0       48 1   6       200   fffffe810ea0f600          softnet/6
 >  0       47 1   6       201   fffffe810ea0fa20             idle/6
 >  0       46 3   5       200   fffffe810e9e01c0            xcall/5 xcall
 >  0       45 1   5       200   fffffe810e9e05e0          softser/5
 >  0       44 3   5       200   fffffe810e9e0a00          softclk/5 tstile
 >  0       43 1   5       200   fffffe810e9d11a0          softbio/5
 >  0       42 1   5       200   fffffe810e9d15c0          softnet/5
 >  0       41 1   5       201   fffffe810e9d19e0             idle/5
 >  0       40 3   4       200   fffffe810e9a2180            xcall/4 xcall
 >  0       39 1   4       200   fffffe810e9a25a0          softser/4
 >  0       38 3   4       200   fffffe810e9a29c0          softclk/4 tstile
 >  0       37 1   4       200   fffffe810e973160          softbio/4
 >  0       36 1   4       200   fffffe810e973580          softnet/4
 >  0    :  35 7   4       201   fffffe810e9739a0             idle/4
 >  0       34 3   3       200   fffffe810e94c140            xcall/3 xcall
 >  0       33 1   3       200   fffffe810e94c560          softser/3
 >  0       32 3   3       200   fffffe810e94c980          softclk/3 tstile
 >  0       31 1   3       200   fffffe810e93d120          softbio/3
 >  0       30 1   3       200   fffffe810e93d540          softnet/3
 >  0       29 1   3       201   fffffe810e93d960             idle/3
 >  0       28 3   2       200   fffffe810e906100            xcall/2 xcall
 >  0       27 1   2       200   fffffe810e906520          softser/2
 >  0       26 1   2       200   fffffe810e906940          softclk/2
 >  0       25 1   2       200   fffffe810e8ef0e0          softbio/2
 >  0       24 1   2       200   fffffe810e8ef500          softnet/2
 >  0       23 1   2       201   fffffe810e8ef920             idle/2
 >  0       22 3   1       200   fffffe810e8c50c0            xcall/1 xcall
 >  0       21 1   1       200   fffffe810e8c54e0          softser/1
 >  0       20 1   1       200   fffffe810e8c5900          softclk/1
 >  0       19 1   1       200   fffffe810e8b10a0          softbio/1
 >  0       18 1   1       200   fffffe810e8b14c0          softnet/1
 >  0       17 1   1       201   fffffe810e8b18e0             idle/1
 >  0       16 3   0       200   fffffe822de92080           lnxsyswq lnxsysw=
 q
 >  0       15 3   0       200   fffffe822de924a0             sysmon smtaskq
 >  0       14 3   5       200   fffffe822de928c0         pmfsuspend pmfsusp=
 end
 >  0       13 3   7       200   fffffe822e2b1060           pmfevent pmfeven=
 t
 >  0       12 3   0       200   fffffe822e2b1480         sopendfree sopendf=
 r
 >  0       11 3   1       200   fffffe822e2b18a0           nfssilly nfssill=
 y
 >  0       10 3   4       200   fffffe822f6d0040            cachegc cachegc
 >  0        9 3   5       200   fffffe822f6d0460             vdrain vdrain
 >  0        8 3   0       200   fffffe822f6d0880          modunload mod_unl=
 d
 >  0        7 3   0       200   fffffe822f6eb020            xcall/0 xcall
 >  0    :   6 7   0       200   fffffe822f6eb440          softser/0
 >  0        5 1   0       200   fffffe822f6eb860          softclk/0
 >  0        4 1   0       200   fffffe822f707000          softbio/0
 >  0    :   3 7   0       200   fffffe822f707420          softnet/0
 >  0        2 1   0       201   fffffe822f707840             idle/0
 >  0        1 3   4       200   ffffffff81481b20            swapper uvm
 >  db{0}: trace/t 0t10536
 >  trace: pid 10536 lid 1 at 0xffff80009f171b00
 >  sleepq_block() at netbsd:sleepq_block+0x97
 >  turnstile_block() at netbsd:turnstile_block+0x3e5
 >  mutex_enter() at netbsd:mutex_enter+0x36d
 >  sopoll() at netbsd:sopoll+0x1c
 >  sel_do_scan() at netbsd:sel_do_scan+0x324
 >  selcommon.part.2() at netbsd:selcommon.part.2+0x18b
 >  sys___select50() at netbsd:sys___select50+0x6f
 >  syscall() at netbsd:syscall+0x1ed
 >  --- syscall (number 417) ---
 >  739a9de3e10a:
 >  db{0}: trace/t 0t1782
 >  trace: pid 1782 lid 1 at 0xffff80009f18ad00
 >  sleepq_block() at netbsd:sleepq_block+0x97
 >  turnstile_block() at netbsd:turnstile_block+0x3e5
 >  mutex_enter() at netbsd:mutex_enter+0x36d
 >  sosetopt() at netbsd:sosetopt+0x2e
 >  sys_setsockopt() at netbsd:sys_setsockopt+0x91
 >  syscall() at netbsd:syscall+0x1ed
 >  --- syscall (number 105) ---
 >  72968e6ba14a:
 >  db{0}: trace/t 0t1083
 >  trace: pid 1083 lid 1 at 0xffff80009e0b9b00
 >  sleepq_block() at netbsd:sleepq_block+0x97
 >  turnstile_block() at netbsd:turnstile_block+0x3e5
 >  mutex_enter() at netbsd:mutex_enter+0x36d
 >  sopoll() at netbsd:sopoll+0x1c
 >  sel_do_scan() at netbsd:sel_do_scan+0x324
 >  selcommon.part.2() at netbsd:selcommon.part.2+0x18b
 >  sys___select50() at netbsd:sys___select50+0x6f
 >  syscall() at netbsd:syscall+0x1ed
 >  --- syscall (number 417) ---
 >  7bc97bc3e10a:
 >  db{0}: trace/t 0t1182
 >  trace: pid 1182 lid 1 at 0xffff80009e9aeb00
 >  sleepq_block() at netbsd:sleepq_block+0x97
 >  turnstile_block() at netbsd:turnstile_block+0x3e5
 >  mutex_enter() at netbsd:mutex_enter+0x36d
 >  sopoll() at netbsd:sopoll+0x1c
 >  sel_do_scan() at netbsd:sel_do_scan+0x324
 >  selcommon.part.2() at netbsd:selcommon.part.2+0x18b
 >  sys___select50() at netbsd:sys___select50+0x6f
 >  syscall() at netbsd:syscall+0x1ed
 >  --- syscall (number 417) ---
 >  7bc97bc3e10a:
 >  db{0}: trace/t 0t1179
 >  trace: pid 1179 lid 1 at 0xffff80009eb5db00
 >  sleepq_block() at netbsd:sleepq_block+0x97
 >  turnstile_block() at netbsd:turnstile_block+0x3e5
 >  mutex_enter() at netbsd:mutex_enter+0x36d
 >  sopoll() at netbsd:sopoll+0x1c
 >  sel_do_scan() at netbsd:sel_do_scan+0x324
 >  selcommon.part.2() at netbsd:selcommon.part.2+0x18b
 >  sys___select50() at netbsd:sys___select50+0x6f
 >  syscall() at netbsd:syscall+0x1ed
 >  --- syscall (number 417) ---
 >  7bc97bc3e10a:
 >  db{0}: trace/t 0t900
 >  trace: pid 900 lid 1 at 0xffff80009eb74b00
 >  sleepq_block() at netbsd:sleepq_block+0x97
 >  turnstile_block() at netbsd:turnstile_block+0x3e5
 >  mutex_enter() at netbsd:mutex_enter+0x36d
 >  sopoll() at netbsd:sopoll+0x1c
 >  sel_do_scan() at netbsd:sel_do_scan+0x324
 >  selcommon.part.2() at netbsd:selcommon.part.2+0x18b
 >  sys___select50() at netbsd:sys___select50+0x6f
 >  syscall() at netbsd:syscall+0x1ed
 >  --- syscall (number 417) ---
 >  7bc97bc3e10a:
 >  db{0}: trace/t 0t935
 >  trace: pid 935 lid 1 at 0xffff80009eab8b00
 >  sleepq_block() at netbsd:sleepq_block+0x97
 >  turnstile_block() at netbsd:turnstile_block+0x3e5
 >  mutex_enter() at netbsd:mutex_enter+0x36d
 >  sopoll() at netbsd:sopoll+0x1c
 >  sel_do_scan() at netbsd:sel_do_scan+0x324
 >  selcommon.part.2() at netbsd:selcommon.part.2+0x18b
 >  sys___select50() at netbsd:sys___select50+0x6f
 >  syscall() at netbsd:syscall+0x1ed
 >  --- syscall (number 417) ---
 >  7bc97bc3e10a:
 >  db{0}: trace/t 0t902
 >  trace: pid 902 lid 1 at 0xffff80009e84eb00
 >  sleepq_block() at netbsd:sleepq_block+0x97
 >  turnstile_block() at netbsd:turnstile_block+0x3e5
 >  mutex_enter() at netbsd:mutex_enter+0x36d
 >  sopoll() at netbsd:sopoll+0x1c
 >  sel_do_scan() at netbsd:sel_do_scan+0x324
 >  selcommon.part.2() at netbsd:selcommon.part.2+0x18b
 >  sys___select50() at netbsd:sys___select50+0x6f
 >  syscall() at netbsd:syscall+0x1ed
 >  --- syscall (number 417) ---
 >  7bc97bc3e10a:
 >  db{0}: trace/t 0t799
 >  trace: pid 799 lid 1 at 0xffff80009e517b00
 >  sleepq_block() at netbsd:sleepq_block+0x97
 >  turnstile_block() at netbsd:turnstile_block+0x3e5
 >  mutex_enter() at netbsd:mutex_enter+0x36d
 >  sopoll() at netbsd:sopoll+0x1c
 >  sel_do_scan() at netbsd:sel_do_scan+0x324
 >  selcommon.part.2() at netbsd:selcommon.part.2+0x18b
 >  sys___select50() at netbsd:sys___select50+0x6f
 >  syscall() at netbsd:syscall+0x1ed
 >  --- syscall (number 417) ---
 >  7bc97bc3e10a:
 >  db{0}: trace/t 0t83
 >  trace: pid 83 lid 1 at 0xffff80009db73ae0
 >  sleepq_block() at netbsd:sleepq_block+0x97
 >  turnstile_block() at netbsd:turnstile_block+0x3e5
 >  mutex_enter() at netbsd:mutex_enter+0x36d
 >  sosend() at netbsd:sosend+0x48
 >  do_sys_sendmsg_so() at netbsd:do_sys_sendmsg_so+0x272
 >  do_sys_sendmsg() at netbsd:do_sys_sendmsg+0x85
 >  sys_sendto() at netbsd:sys_sendto+0x5c
 >  syscall() at netbsd:syscall+0x1ed
 >  --- syscall (number 133) ---
 >  7d35dd0eea7a:
 >  db{0}: trace/a fffffe810f396880
 >  trace: pid 0 lid 93 at 0xffff80009dbc5d60
 >  sleepq_block() at netbsd:sleepq_block+0x97
 >  turnstile_block() at netbsd:turnstile_block+0x3e5
 >  mutex_enter() at netbsd:mutex_enter+0x36d
 >  nd6_timer_work() at netbsd:nd6_timer_work+0x3f
 >  workqueue_worker() at netbsd:workqueue_worker+0xcd
 >  db{0}: trace/a fffffe810e9e0a00
 >  trace: pid 0 lid 44 at 0xffff80008f797e00
 >  sleepq_block() at netbsd:sleepq_block+0x97
 >  turnstile_block() at netbsd:turnstile_block+0x3e5
 >  mutex_enter() at netbsd:mutex_enter+0x36d
 >  tcp_timer_rexmt() at netbsd:tcp_timer_rexmt+0x27
 >  callout_softclock() at netbsd:callout_softclock+0x201
 >  softint_dispatch() at netbsd:softint_dispatch+0xd3
 >  DDB lost frame for netbsd:Xsoftintr+0x4f, trying 0xffff80008f797ff0
 >  Xsoftintr() at netbsd:Xsoftintr+0x4f
 >  --- interrupt ---
 >  0:
 >  db{0}: trace/a fffffe810e9a29c0
 >  trace: pid 0 lid 38 at 0xffff80008f771e00
 >  sleepq_block() at netbsd:sleepq_block+0x97
 >  turnstile_block() at netbsd:turnstile_block+0x3e5
 >  mutex_enter() at netbsd:mutex_enter+0x36d
 >  tcp_timer_rexmt() at netbsd:tcp_timer_rexmt+0x27
 >  callout_softclock() at netbsd:callout_softclock+0x201
 >  softint_dispatch() at netbsd:softint_dispatch+0xd3
 >  DDB lost frame for netbsd:Xsoftintr+0x4f, trying 0xffff80008f771ff0
 >  Xsoftintr() at netbsd:Xsoftintr+0x4f
 >  --- interrupt ---
 >  0:
 >  db{0}:
 >  breakpoint() at netbsd:breakpoint+0x5
 >  comintr() at netbsd:comintr+0x562
 >  Xhandle_ioapic_edge13() at netbsd:Xhandle_ioapic_edge13+0x66
 >  --- interrupt ---
 >  DDB lost frame for netbsd:Xdoreti, trying 0xffff80008f69bd70
 >  Xdoreti() at netbsd:Xdoreti
 >  --- interrupt ---
 >  Bad frame pointer: 0xffff800000000000
 >  202:
 >  db{0}: trace/a fffffe810e94c980
 >  trace: pid 0 lid 32 at 0xffff80008f74be00
 >  sleepq_block() at netbsd:sleepq_block+0x97
 >  turnstile_block() at netbsd:turnstile_block+0x3e5
 >  mutex_enter() at netbsd:mutex_enter+0x36d
 >  tcp_timer_rexmt() at netbsd:tcp_timer_rexmt+0x27
 >  callout_softclock() at netbsd:callout_softclock+0x201
 >  softint_dispatch() at netbsd:softint_dispatch+0xd3
 >  DDB lost frame for netbsd:Xsoftintr+0x4f, trying 0xffff80008f74bff0
 >  Xsoftintr() at netbsd:Xsoftintr+0x4f
 >  --- interrupt ---
 >  0:
 >  db{0}: show all locks /t
 >  [Locks tracked through LWPs]
 >  Locks held by an LWP (expect):
 >  Lock 0 (initialized at fstrans_init)
 >  lock address : 0xffffffff815cb9b8 type     :     sleep/adaptive
 >  initialized  : 0xffffffff809fe690
 >  shared holds :                  0 exclusive:                  1
 >  shares wanted:                  0 exclusive:                  0
 >  current cpu  :                  0 last held:                  3
 >  current lwp  : 0xfffffe822f6eb440 last held: 0xfffffe821e439080
 >  last locked* : 0xffffffff80a00523 unlocked : 0xffffffff80a0315f
 >  owner field  : 0xfffffe821e439080 wait/spin:                0/0
 >
 >  Turnstile chain at 0xffffffff814c5130.
 >  =3D: No active turnstile for this lock.
 >  Lock 1 (initialized at fstrans_init)
 >  lock address : 0xffffffff815cb9b0 type     :     sleep/adaptive
 >  initialized  : 0xffffffff809fe6a3
 >  shared holds :                  0 exclusive:                  1
 >  shares wanted:                  0 exclusive:                  0
 >  current cpu  :                  0 last held:                  3
 >  current lwp  : 0xfffffe822f6eb440 last held: 0xfffffe821e439080
 >  last locked* : 0xffffffff809ffb6d unlocked : 0xffffffff809fecc4
 >  owner field  : 0xfffffe821e439080 wait/spin:                0/0
 >
 >  Turnstile chain at 0xffffffff814c5120.
 >  =3D: No active turnstile for this lock.
 >  trace: pid 6110 lid 1 at 0xffff80009ed098a0
 >  sleepq_block() at netbsd:sleepq_block+0x1c5
 >  kpause() at netbsd:kpause+0xea
 >  pserialize_perform() at netbsd:pserialize_perform+0xf4
 >  fstrans_setstate() at netbsd:fstrans_setstate+0x42
 >  genfs_suspendctl() at netbsd:genfs_suspendctl+0x57
 >  VFS_SUSPENDCTL() at netbsd:VFS_SUSPENDCTL+0x1f
 >  vfs_suspend() at netbsd:vfs_suspend+0x5b
 >  vrevoke_suspend_next() at netbsd:vrevoke_suspend_next+0x2a
 >  vrevoke() at netbsd:vrevoke+0x2b
 >  genfs_revoke() at netbsd:genfs_revoke+0x13
 >  VOP_REVOKE() at netbsd:VOP_REVOKE+0x54
 >  pty_grant_slave() at netbsd:pty_grant_slave+0xa8
 >  ptmioctl() at netbsd:ptmioctl+0x90
 >  cdev_ioctl() at netbsd:cdev_ioctl+0x88
 >  VOP_IOCTL() at netbsd:VOP_IOCTL+0x3b
 >  vn_ioctl() at netbsd:vn_ioctl+0xa6
 >  sys_ioctl() at netbsd:sys_ioctl+0x101
 >  syscall() at netbsd:syscall+0x1ed
 >  --- syscall (number 54) ---
 >  74c471efeeaa:
 >
 >  Locks held by an LWP (pickup):
 >  Lock 0 (initialized at fork1)
 >  lock address : 0xfffffe821dce4a30 type     :     sleep/adaptive
 >  initialized  : 0xffffffff809599ab
 >  shared holds :                  0 exclusive:                  1
 >  shares wanted:                  0 exclusive:                  0
 >  current cpu  :                  0 last held:                  2
 >  current lwp  : 0xfffffe822f6eb440 last held: 0xfffffe81b102da80
 >  last locked* : 0xffffffff809580c1 unlocked : 0xffffffff80879889
 >  owner/count  : 0xfffffe81b102da80 flags    : 0x0000000000000004
 >
 >  Turnstile chain at 0xffffffff814c4e20.
 >  =3D: No active turnstile for this lock.
 >  Lock 1 (initialized at filedesc_ctor)
 >  lock address : 0xfffffe821f62f880 type     :     sleep/adaptive
 >  initialized  : 0xffffffff8094d11f
 >  shared holds :                  0 exclusive:                  1
 >  shares wanted:                  0 exclusive:                  0
 >  current cpu  :                  0 last held:                  2
 >  current lwp  : 0xfffffe822f6eb440 last held: 0xfffffe81b102da80
 >  last locked* : 0xffffffff80953c76 unlocked : 0xffffffff8094e4a5
 >  owner field  : 0xfffffe81b102da80 wait/spin:                0/0
 >
 >  Turnstile chain at 0xffffffff814c4ec0.
 >  =3D: No active turnstile for this lock.
 >  trace: pid 17072 lid 1 at 0xffff80009fa24ca0
 >  knote_detach() at netbsd:knote_detach+0x66
 >  knote_fdclose() at netbsd:knote_fdclose+0x44
 >  fd_close() at netbsd:fd_close+0x388
 >  fd_free() at netbsd:fd_free+0x17e
 >  exit1() at netbsd:exit1+0x11d
 >  sys_exit() at netbsd:sys_exit+0x3d
 >  syscall() at netbsd:syscall+0x1ed
 >  --- syscall (number 1) ---
 >  7947772fe52a:
 >
 >  Locks held by an LWP (master):
 >  Lock 0 (initialized at filedesc_ctor)
 >  lock address : 0xfffffe822870adc0 type     :     sleep/adaptive
 >  initialized  : 0xffffffff8094d11f
 >  shared holds :                  0 exclusive:                  1
 >  shares wanted:                  0 exclusive:                  0
 >  current cpu  :                  0 last held:                  1
 >  current lwp  : 0xfffffe822f6eb440 last held: 0xfffffe822962bac0
 >  last locked* : 0xffffffff809522e8 unlocked : 0xffffffff8094ec84
 >  owner field  : 0xfffffe822962bac0 wait/spin:                0/0
 >
 >  Turnstile chain at 0xffffffff814c5140.
 >  =3D: No active turnstile for this lock.
 >  trace: pid 759 lid 1 at 0x81051570
 >  ?() at 0
 >  address 0x81051578 is invalid
 >  address 0x81051570 is invalid
 >
 >  Locks held by an LWP (ioflush):
 >  Lock 0 (initialized at vcache_alloc)
 >  lock address : 0xfffffe8061cb6fa0 type     :     sleep/adaptive
 >  initialized  : 0xffffffff80a01652
 >  shared holds :                  0 exclusive:                  1
 >  shares wanted:                  0 exclusive:                  0
 >  current cpu  :                  0 last held:                  7
 >  current lwp  : 0xfffffe822f6eb440 last held: 0xfffffe822dce8100
 >  last locked* : 0xffffffff80a17d69 unlocked : 0xffffffff80a17db4
 >  owner/count  : 0xfffffe822dce8100 flags    : 0x0000000000000004
 >
 >  Turnstile chain at 0xffffffff814c5100.
 >  =3D: No active turnstile for this lock.
 >  trace: pid 0 lid 119 at 0xffff80009dce9790
 >  scsipi_adapter_request() at netbsd:scsipi_adapter_request+0x52
 >  scsipi_run_queue() at netbsd:scsipi_run_queue+0xe2
 >  scsipi_execute_xs() at netbsd:scsipi_execute_xs+0x1bb
 >  sd_diskstart() at netbsd:sd_diskstart+0x25b
 >  dk_start() at netbsd:dk_start+0xde
 >  spec_strategy() at netbsd:spec_strategy+0x9a
 >  VOP_STRATEGY() at netbsd:VOP_STRATEGY+0x54
 >  genfs_do_io() at netbsd:genfs_do_io+0x1b4
 >  genfs_gop_write() at netbsd:genfs_gop_write+0x52
 >  genfs_do_putpages() at netbsd:genfs_do_putpages+0xb9c
 >  VOP_PUTPAGES() at netbsd:VOP_PUTPAGES+0x3a
 >  ffs_full_fsync() at netbsd:ffs_full_fsync+0x116
 >  ffs_fsync() at netbsd:ffs_fsync+0x3a
 >  VOP_FSYNC() at netbsd:VOP_FSYNC+0x3e
 >  sched_sync() at netbsd:sched_sync+0x198
 >
 >  Locks held by an LWP (softnet/0):
 >  Lock 0 (initialized at soinit)
 >  lock address : 0xfffffe822fb97f40 type     :     sleep/adaptive
 >  initialized  : 0xffffffff809db0cb
 >  shared holds :                  0 exclusive:                  1
 >  shares wanted:                  0 exclusive:                 14
 >  current cpu  :                  0 last held:                  0
 >  current lwp  : 0xfffffe822f6eb440 last held: 0xfffffe822f707420
 >  last locked* : 0xffffffff806d7add unlocked : 0xffffffff80951f2c
 >  owner field  : 0xfffffe822f707420 wait/spin:                1/0
 >
 >  Turnstile chain at 0xffffffff814c5040.
 >  =3D: Turnstile at 0xfffffe810f381d20 (wrq=3D0xfffffe810f381d40, rdq=3D0x=
 fffffe810f381d50).
 >  =3D: 0 waiting readers:
 >  =3D: 14 waiting writers: 0xfffffe810f396880 0xfffffe810e9a29c0 0xfffffe8=
 10e9e0a00 0xfffffe810e94c980 0xfffffe82212fc700 0xfffffe82228e28e0 0xfffffe=
 8222950b60 0xfffffe82212fcb20 0xfffffe822962b6a0 0xfffffe822c341200 0xfffff=
 e8220e621e0 0xfffffe821ea02260 0xfffffe821f0986c0 0xfffffe810f2da300
 >  trace: pid 0 lid 3 at 0xffff80008f68cc00
 >  sowakeup() at netbsd:sowakeup+0x58
 >  tcp_input() at netbsd:tcp_input+0x2f61
 >  tcp6_input() at netbsd:tcp6_input+0x49
 >  ip6_input() at netbsd:ip6_input+0x69e
 >  ip6intr() at netbsd:ip6intr+0x7b
 >  softint_dispatch() at netbsd:softint_dispatch+0xd3
 >  DDB lost frame for netbsd:Xsoftintr+0x4f, trying 0xffff80008f68cff0
 >  Xsoftintr() at netbsd:Xsoftintr+0x4f
 >  --- interrupt ---
 >  0:
 >
 >
 >  [Locks tracked through CPUs]
 >  Locks held on CPU 0:
 >  Lock 0 (initialized at main)
 >  lock address : 0xffffffff814c3840 type     :               spin
 >  initialized  : 0xffffffff80d02d91
 >  shared holds :                  0 exclusive:                  1
 >  shares wanted:                  0 exclusive:                  6
 >  current cpu  :                  0 last held:                  0
 >  current lwp  : 0xfffffe822f6eb440 last held: 0xfffffe822f707420
 >  last locked* : 0xffffffff806d7ae7 unlocked : 0xffffffff80a3a00f
 >  curcpu holds :                  1 wanted by: 000000000000000000
 >  trace: pid 0 lid 6 at 0xffff80008f69bcf8
 >  breakpoint() at netbsd:breakpoint+0x5
 >  comintr() at netbsd:comintr+0x562
 >  Xhandle_ioapic_edge13() at netbsd:Xhandle_ioapic_edge13+0x66
 >  --- interrupt ---
 >  DDB lost frame for netbsd:Xdoreti, trying 0xffff80008f69bd70
 >  Xdoreti() at netbsd:Xdoreti
 >  --- interrupt ---
 >  Bad frame pointer: 0xffff800000000000
 >  202:
 >
 >  Lock 1 (initialized at com_attach_subr)
 >  lock address : 0xfffffe810f20b1e0 type     :               spin
 >  initialized  : 0xffffffff805ce644
 >  shared holds :                  0 exclusive:                  1
 >  shares wanted:                  0 exclusive:                  0
 >  current cpu  :                  0 last held:                  0
 >  current lwp  : 0xfffffe822f6eb440 last held: 0xfffffe822f6eb440
 >  last locked* : 0xffffffff805cdba0 unlocked : 0xffffffff805cdd7f
 >  owner field  : 0x0000000000010800 wait/spin:                0/1
 >  trace: pid 0 lid 6 at 0xffff80008f69bcf8
 >  breakpoint() at netbsd:breakpoint+0x5
 >  comintr() at netbsd:comintr+0x562
 >  Xhandle_ioapic_edge13() at netbsd:Xhandle_ioapic_edge13+0x66
 >  --- interrupt ---
 >  DDB lost frame for netbsd:Xdoreti, trying 0xffff80008f69bd70
 >  Xdoreti() at netbsd:Xdoreti
 >  --- interrupt ---
 >  Bad frame pointer: 0xffff800000000000
 >  202:
 >
 >
 >  db{0}: call cpu_reset
 >
 >
 


Home | Main Index | Thread Index | Old Index