NetBSD-Bugs archive
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]
Re: port-amd64/53155: OS wedges after <12h uptime when >2 bnx network interfaces in use
The following reply was made to PR port-amd64/53155; it has been noted by GNATS.
From: Havard Eidnes <he%NetBSD.org@localhost>
To: gnats-bugs%NetBSD.org@localhost
Cc:
Subject: Re: port-amd64/53155: OS wedges after <12h uptime when >2 bnx
network interfaces in use
Date: Wed, 16 May 2018 11:44:47 +0200 (CEST)
Hi,
we provoked another wedge, and captured a kernel core dump from
the wedging machine. The kernel core dump and NetBSD images are
available for looking at.
using gdb and crash, here's a brief summary of the "interesting"
processes in the crash dump, and below that I include backtraces
of all the waiting processes.
There's lots of contention for fstrans_lock.
Offhand I don't see a deadlock which might explain the observed
behaviour (goes totally "deaf" on the network, i.e. doesn't even
respond to ping).
It doesn't look like gdb can trace through interrupt frames (?),
looking at proc 788 all I get is:
(gdb) kvm proc 0xfffffe8220b8e360
0xffffffff8021cfe0 in softintr_ret ()
(gdb) where
#0 0xffffffff8021cfe0 in softintr_ret ()
#1 0x0000000000000000 in ?? ()
(gdb) =
Crash manages to do this one, though, apparently (see below).
Furthermore, using the various gdb scripts in
/usr/src/sys/gdbscripts/ I can look at some of the locks.
It is quite possible that up'ing the interface in question causes
lots of activity for opening pty pairs, and that the root cause
of the issue is there rather than related to networking in itself(?)
Further hints?
Regards,
- H=E5vard
------------------------------
PID LID S CPU FLAGS STRUCT LWP * NAME WAIT
7052 1 3 1 8020000 fffffe8220c58540 cron tstile=
Wants fstrans_lock
9187 1 3 6 8020000 fffffe821faa60c0 expect xchicv=
Holds fstrans_lock, in pserialize_perform, waits on condition variabl=
e
after doing xc_broadcast(XC_HIGHPRI, nullop)
Doing (roughly) pty_grant_slave -> genfs_revoke -> vfs_suspend -> =
fstrans_setstate -> pserialize_perform -> xc_wait -> cv_wait
3794 1 3 7 8020000 fffffe82045da540 ssh tstile=
Wants fstrans_lock
2853 2 3 6 8020000 fffffe8216d35140 expect tstile=
Wants fstrans_lock
2853 1 3 7 8020000 fffffe82214bf2c0 expect fdclos=
e
Doing cv_wait(&ff->ff_closing, &fdp->fd_lock);
8327 2 3 3 8020000 fffffe8225709000 expect tstile=
Wants fstrans_lock
8327 1 3 1 8020000 fffffe820df34480 expect fdclos=
e
Doing cv_wait(&ff->ff_closing, &fdp->fd_lock);
5687 2 3 3 8020000 fffffe8207fd0360 expect tstile=
Wants fstrans_lock
5687 1 3 2 8020000 fffffe822346f080 expect fdclos=
e
Doing cv_wait(&ff->ff_closing, &fdp->fd_lock);
9671 2 3 5 8020000 fffffe821d987a40 expect tstile=
Wants fstrans_lock
9671 1 3 4 8020000 fffffe821e90c240 expect fdclos=
e
Doing cv_wait(&ff->ff_closing, &fdp->fd_lock);
704 1 3 6 8020000 fffffe821d362980 conserver tstile=
Wants rw_enter(&vip->vi_lock, op);, lock held by 788 apparently
564 1 3 1 8020000 fffffe8229b924c0 conserver tstile=
Wants fstrans_lock
788 > 1 7 0 8020000 fffffe8220b8e360 conserver
Doing softintr_ret(), gdb doesn't trace further (interrupt frame?)
Crash, though, says:
crash> trace/a 0xfffffe8220b8e360
trace: pid 788 lid 1 at 0xffff80009ebfdc40
ufs_post_write_update.isra.0() at ufs_post_write_update.isra.0+0x95
ffs_write() at ffs_write+0x56f
VOP_WRITE() at VOP_WRITE+0x37
vn_write() at vn_write+0xec
dofilewrite() at dofilewrite+0x97
sys_write() at sys_write+0x5f
syscall() at syscall+0x1ed
--- syscall (number 4) ---
764fb503e02a:
crash> =
275 1 3 5 8020000 fffffe8220b8e780 conserver tstile=
Wants rw_enter(&vip->vi_lock, op);, lock held by 788 apparently
878 1 3 2 8020000 fffffe8221e57600 conserver tstile=
Wants fstrans_lock
136 1 3 3 8020000 fffffe8222569900 conserver tstile=
Wants fstrans_lock
773 1 3 1 8020000 fffffe8225709840 conserver tstile=
Wants fstrans_lock
------------------------------
crash> ps
PID LID S CPU FLAGS STRUCT LWP * NAME WAIT
7052 1 3 1 8020000 fffffe8220c58540 cron tstile=
8587 1 3 1 8020000 fffffe821d362560 cron wait
9187 1 3 6 8020000 fffffe821faa60c0 expect xchicv=
5064 1 2 6 8020000 fffffe8219f93540 sh
7813 1 2 0 8020000 fffffe8220ecf860 perl
7354 1 2 0 8020000 fffffe8207aba240 sh
3794 1 3 7 8020000 fffffe82045da540 ssh tstile=
2853 2 3 6 8020000 fffffe8216d35140 expect tstile=
2853 1 3 7 8020000 fffffe82214bf2c0 expect fdclos=
e
6097 1 2 0 8020000 fffffe8221165720 sh
5738 1 2 0 8020000 fffffe821e90ca80 perl
4461 1 2 0 8020000 fffffe8207a90aa0 sh
4310 1 2 3 8020000 fffffe8220c2c5a0 ssh
8327 2 3 3 8020000 fffffe8225709000 expect tstile=
8327 1 3 1 8020000 fffffe820df34480 expect fdclos=
e
6086 1 2 5 8020000 fffffe821d2d9a60 sh
3214 1 2 0 8020000 fffffe821f5d8360 perl
5921 1 2 0 8020000 fffffe8207a90260 sh
2890 1 2 2 8020000 fffffe8228bacae0 ssh
3772 1 2 0 8020000 fffffe821a27f420 sh
4425 1 2 0 8020000 fffffe821f5d8780 ssh
5793 1 2 0 8020000 fffffe821d342340 sh
4833 1 2 0 8020000 fffffe82207f5460 ssh
7238 1 2 0 8020000 fffffe822123b640 sh
6312 1 2 4 8020000 fffffe8222a9b500 ssh
7003 1 2 0 8020000 fffffe822160e700 sh
6900 1 2 0 8020000 fffffe8221d82140 ssh
4139 1 2 0 8020000 fffffe822346f8c0 sh
3765 1 2 0 8020000 fffffe821f94f060 ssh
5386 1 2 1 8020000 fffffe8222a7a8c0 sh
4633 1 2 0 8020000 fffffe821f8969c0 ssh
9691 1 2 0 8020000 fffffe821928d180 sh
6528 1 2 7 8020000 fffffe8207f4b460 ssh
5816 1 2 0 8020000 fffffe8207f4b880 sh
6285 1 2 0 8020000 fffffe821e1e28c0 ssh
8366 1 2 0 8020000 fffffe820d267520 sh
8041 1 2 0 8020000 fffffe821f94f8a0 ssh
3407 1 2 0 8020000 fffffe82045da960 sh
2815 1 2 0 8020000 fffffe8225709420 ssh
5687 2 3 3 8020000 fffffe8207fd0360 expect tstile=
5687 1 3 2 8020000 fffffe822346f080 expect fdclos=
e
2928 1 2 0 8020000 fffffe8228bac2a0 sh
5127 1 2 0 8020000 fffffe821b498860 perl
5658 1 2 0 8020000 fffffe820ea5eac0 sh
6746 1 2 0 8020000 fffffe821d443520 ssh
9671 2 3 5 8020000 fffffe821d987a40 expect tstile=
9671 1 3 4 8020000 fffffe821e90c240 expect fdclos=
e
9105 1 2 0 8020000 fffffe8226ea8b40 sh
3990 1 2 0 8020000 fffffe8227069700 perl
4504 1 2 0 8020000 fffffe8207a90680 sh
9019 1 2 0 8020000 fffffe821f4c78e0 ssh
2825 1 2 0 8020000 fffffe821f896180 sh
5779 1 2 0 8020000 fffffe821a27f840 ssh
2846 1 2 0 8020000 fffffe822af57440 sh
3544 1 2 0 8020000 fffffe82216b1a40 ssh
6513 1 2 0 8020000 fffffe822728b460 sh
5965 1 2 0 8020000 fffffe821faa6900 ssh
6327 1 2 0 8020000 fffffe8221837a80 sh
2739 1 2 0 8020000 fffffe822708e740 ssh
6361 1 2 0 8020000 fffffe82239772a0 sh
3534 1 2 0 8020000 fffffe821f94f480 ssh
5988 1 2 0 8020000 fffffe8222a7a080 sh
7283 1 2 0 8020000 fffffe8222b99980 ssh
6596 1 2 0 8020000 fffffe820ea5e6a0 sh
3343 1 2 0 8020000 fffffe8223049740 ssh
7708 1 2 0 8020000 fffffe822da31140 sh
6381 1 2 0 8020000 fffffe8221d82980 ssh
7056 1 2 0 8020000 fffffe821a542500 sh
4161 1 2 0 8020000 fffffe821c708100 ssh
7144 1 2 0 8020000 fffffe8223049b60 sh
6276 1 2 0 8020000 fffffe821d2d9220 ssh
4460 1 2 0 8020000 fffffe821f36a040 sh
6845 1 2 0 8020000 fffffe8222a9b0e0 ssh
4669 1 2 0 8020000 fffffe821e1e24a0 sh
3652 1 2 0 8020000 fffffe821c708520 ssh
5131 1 2 0 8020000 fffffe820df34060 sh
5704 1 2 0 8020000 fffffe8220ce6760 ssh
6031 1 2 0 8020000 fffffe821ecaea00 sh
5875 1 2 0 8020000 fffffe82240071a0 ssh
5464 1 2 0 8020000 fffffe8205110580 sh
2852 1 2 0 8020000 fffffe82207f5040 ssh
3432 1 2 0 8020000 fffffe820dd5e6e0 sh
4917 1 2 0 8020000 fffffe8221317ac0 ssh
2850 1 2 0 8020000 fffffe8207fd0780 sh
3399 1 2 0 8020000 fffffe822d92e9c0 ssh
3497 1 2 0 8020000 fffffe821d987200 sh
3880 1 2 0 8020000 fffffe821d342b80 ssh
4728 1 2 0 8020000 fffffe822188a5a0 sh
3904 1 2 0 8020000 fffffe820df348a0 ssh
4847 1 2 0 8020000 fffffe8204072900 sh
3465 1 2 0 8020000 fffffe8207fd0ba0 ssh
3881 1 2 0 8020000 fffffe821a27f000 sh
4000 1 2 0 8020000 fffffe821928d9c0 ssh
4242 1 2 0 8020000 fffffe8221165300 sh
4074 1 2 0 8020000 fffffe82207f5880 ssh
3902 1 2 0 8020000 fffffe8205110160 sh
3293 1 2 0 8020000 fffffe8224d918a0 ssh
3228 1 2 0 8020000 fffffe821d362140 sh
4064 1 2 0 8020000 fffffe8224b0c760 ssh
4762 1 2 0 8020000 fffffe822037f1a0 sh
2903 1 2 0 8020000 fffffe8221dab1a0 ssh
2218 1 2 0 8020000 fffffe821fdf9b00 sh
2497 1 2 0 8020000 fffffe822728b880 ssh
3080 1 2 0 8020000 fffffe8223563b40 sh
2573 1 2 0 8020000 fffffe8206fea440 ssh
2635 1 2 0 8020000 fffffe822af57020 sh
2114 1 2 0 8020000 fffffe82220aa520 ssh
4141 1 2 0 8020000 fffffe82240079e0 sh
4477 1 2 0 8020000 fffffe822160eb20 ssh
3978 1 2 0 8020000 fffffe821f6f9b60 sh
3243 1 2 0 8020000 fffffe821f1b0680 ssh
2652 1 2 0 8020000 fffffe821c49f5e0 sh
3804 1 2 0 8020000 fffffe821f37d9a0 ssh
4348 1 2 0 8020000 fffffe822c1e7660 sh
4334 1 2 0 8020000 fffffe8220c2c9c0 ssh
3781 1 2 0 8020000 fffffe82214bfb00 sh
3422 1 2 0 8020000 fffffe82216b1200 ssh
3277 1 2 0 8020000 fffffe8221165b40 sh
3997 1 2 0 8020000 fffffe8206fea020 ssh
3863 1 2 0 8020000 fffffe82239776c0 sh
2950 1 2 0 8020000 fffffe821f6f9320 par
2644 1 2 0 8020000 fffffe822220f9a0 ssh
2418 1 2 0 8020000 fffffe822253d1c0 sh
2616 1 2 0 8020000 fffffe821e1e2080 ssh
2724 1 2 0 8020000 fffffe821b0306a0 sh
1968 1 2 0 8020000 fffffe8224d91060 sh
3042 1 2 0 8020000 fffffe8221dab5c0 sh
2259 1 2 0 8020000 fffffe821c4bb4e0 sh
2733 1 2 0 8020000 fffffe8223c97a40 sh
2608 1 2 0 8020000 fffffe821b498020 cron
2402 1 2 0 8020000 fffffe822123ba60 ssh
2346 1 2 0 8020000 fffffe821f6f9740 sh
3141 1 2 0 8020000 fffffe8221837240 ssh
1970 1 2 0 8020000 fffffe821f4c70a0 sh
2649 1 2 0 8020000 fffffe821a5f28e0 ssh
2129 1 2 0 8020000 fffffe8227c3cb00 sh
2384 1 2 0 8020000 fffffe8221afe480 ssh
2971 1 2 0 8020000 fffffe82225690c0 sh
2070 1 2 0 8020000 fffffe82212562e0 ssh
2098 1 2 0 8020000 fffffe82201c92a0 sh
2764 1 2 0 8020000 fffffe821bf22680 ssh
3322 1 2 0 8020000 fffffe8221256b20 sh
2511 1 2 0 8020000 fffffe821f37d160 ssh
2661 1 2 0 8020000 fffffe821ecae1c0 sh
3491 1 2 0 8020000 fffffe822220f160 ssh
3195 1 2 0 8020000 fffffe822188a9c0 sh
3305 1 2 0 8020000 fffffe821b800600 ssh
2197 1 2 0 8020000 fffffe821d2d9640 sh
3011 1 2 0 8020000 fffffe82214bf6e0 ssh
3056 1 2 0 8020000 fffffe82288f2ac0 sh
2350 1 2 0 8020000 fffffe8219f93960 ssh
2297 1 2 0 8020000 fffffe8221e571e0 sh
2638 1 2 0 8020000 fffffe821a5f20a0 ssh
2169 1 2 0 8020000 fffffe821c4bb0c0 sh
2550 1 2 0 8020000 fffffe82213176a0 ssh
2225 1 2 0 8020000 fffffe82220aa100 sh
2677 1 2 0 8020000 fffffe821e90c660 ssh
3183 1 2 0 8020000 fffffe8229af4260 sh
2214 1 2 0 8020000 fffffe821f232000 ssh
3259 1 2 0 8020000 fffffe8223563720 sh
2092 1 2 0 8020000 fffffe822220f580 ssh
2331 1 2 0 8020000 fffffe8223563300 sh
2750 1 2 0 8020000 fffffe8226888000 ssh
1921 1 2 0 8020000 fffffe821bf22aa0 sh
2636 1 2 0 8020000 fffffe822d818160 ssh
3223 1 2 0 8020000 fffffe821d443100 sh
2773 1 2 0 8020000 fffffe8226888420 ssh
2150 1 2 0 8020000 fffffe8223049320 sh
2310 1 2 0 8020000 fffffe8222b99560 ssh
1587 1 2 0 8020000 fffffe8220d110e0 sh
2901 1 2 0 8020000 fffffe822188a180 ssh
2627 1 2 0 8020000 fffffe821c4bb900 sh
2060 1 2 0 8020000 fffffe821f36a460 ssh
2599 1 2 0 8020000 fffffe821bf22260 sh
2422 1 2 0 8020000 fffffe821f8965a0 ssh
2164 1 2 0 8020000 fffffe821d443940 sh
2022 1 2 0 8020000 fffffe821f556960 ssh
2000 1 2 0 8020000 fffffe821a542920 sh
1593 1 2 0 8020000 fffffe822d481a40 bash
1914 1 2 0 8020000 fffffe821f5d8ba0 sshd
2167 1 2 0 8020000 fffffe822037f5c0 sshd
1821 1 2 0 8020000 fffffe8220d11500 sshd
1590 1 2 0 8020000 fffffe822dcff120 sshd
1041 1 2 0 8020000 fffffe821c708940 bash
594 1 2 0 8020000 fffffe822037f9e0 bash
895 1 2 0 8020000 fffffe822708eb60 sshd
1533 1 2 0 8020000 fffffe8227069b20 sshd
704 1 3 6 8020000 fffffe821d362980 conserver tstile=
564 1 3 1 8020000 fffffe8229b924c0 conserver tstile=
789 1 2 0 8020000 fffffe821f232840 conserver
788 > 1 7 0 8020000 fffffe8220b8e360 conserver
275 1 3 5 8020000 fffffe8220b8e780 conserver tstile=
772 1 2 0 8020000 fffffe8221256700 conserver
878 1 3 2 8020000 fffffe8221e57600 conserver tstile=
136 1 3 3 8020000 fffffe8222569900 conserver tstile=
773 1 3 1 8020000 fffffe8225709840 conserver tstile=
643 1 2 0 8020000 fffffe82251ce360 conserver
162 1 2 0 8020000 fffffe822dd620e0 getty
861 1 2 0 8020000 fffffe82251ce780 conserver
575 1 2 0 8020000 fffffe82251ceba0 conserver
892 1 2 0 8020000 fffffe8224b0c340 cron
570 1 2 0 8020000 fffffe8224b0cb80 python2.7
107 1 2 0 8020000 fffffe822d7de5c0 inetd
740 1 2 0 8020000 fffffe822cf91a00 nginx
97 1 2 0 8020000 fffffe822d4cd600 nginx
677 1 2 0 8020000 fffffe822d481200 qmgr
479 1 2 0 8020000 fffffe822c312a60 pickup
760 1 2 0 8020000 fffffe822c1e7240 master
436 1 2 0 8020000 fffffe822d818580 sshd
474 1 2 0 8020000 fffffe822d92e5a0 tac_plus
428 1 2 0 8020000 fffffe822cf915e0 powerd
431 1 2 0 8020000 fffffe822d8189a0 ntpd
342 4 2 4 8020000 fffffe822c1e7a80 dhcpd
342 3 2 0 8020000 fffffe822c312220 dhcpd
342 2 2 1 8020000 fffffe822c312640 dhcpd
342 1 2 3 8020000 fffffe822d481620 dhcpd
83 > 1 7 6 8020000 fffffe822cf911c0 syslogd
1 1 2 0 8020000 fffffe810f4fa900 init
0 123 3 7 200 fffffe822d4cd1e0 npfgc-0 xchicv=
0 122 3 7 200 fffffe822d4cda20 ipmi0 ipmi0
0 121 3 0 200 fffffe822dd10940 physiod physio=
d
0 120 3 3 200 fffffe822dcff960 aiodoned aiodon=
ed
0 119 3 5 200 fffffe822dd10100 ioflush biowai=
t
0 118 3 0 200 fffffe822dd10520 pgdaemon pgdaem=
on
0 115 3 0 280 fffffe822dd62500 spkr1 bellcv=
0 114 3 3 280 fffffe822dd62920 audiomix play
0 113 3 3 280 fffffe810ed3b2a0 audiorec record=
0 112 3 0 200 fffffe810f4fa0c0 atapibus0 sccomp=
0 110 3 6 200 fffffe810f2e9b60 usb1 usbevt=
0 109 3 7 200 fffffe810f2c3b20 usb3 usbevt=
0 108 3 6 200 fffffe810f20d2c0 usb5 usbevt=
0 107 3 0 200 fffffe810f2da300 usb0 usbevt=
0 106 3 0 200 fffffe810f2c32e0 usb4 usbevt=
0 105 3 0 200 fffffe810f4fa4e0 usb2 usbevt=
0 104 3 0 200 fffffe810f4a30a0 rt_free rt_fre=
e
0 103 3 0 200 fffffe810f4a34c0 unpgc unpgc
0 102 3 7 200 fffffe810f4a38e0 key_timehandler key_ti=
mehandler
0 101 3 7 200 fffffe810f45c080 icmp6_wqinput/7 icmp6_=
wqinput
0 100 3 6 200 fffffe810f45c4a0 icmp6_wqinput/6 icmp6_=
wqinput
0 99 3 5 200 fffffe810f45c8c0 icmp6_wqinput/5 icmp6_=
wqinput
0 98 3 4 200 fffffe810f4b5060 icmp6_wqinput/4 icmp6_=
wqinput
0 97 3 3 200 fffffe810f4b5480 icmp6_wqinput/3 icmp6_=
wqinput
0 96 3 2 200 fffffe810f4b58a0 icmp6_wqinput/2 icmp6_=
wqinput
0 95 3 1 200 fffffe810f396040 icmp6_wqinput/1 icmp6_=
wqinput
0 94 3 0 200 fffffe810f396460 icmp6_wqinput/0 icmp6_=
wqinput
0 93 3 2 200 fffffe810f396880 nd6_timer nd6_ti=
mer
0 92 3 7 200 fffffe810f367020 icmp_wqinput/7 icmp_w=
qinput
0 91 3 6 200 fffffe810f367440 icmp_wqinput/6 icmp_w=
qinput
0 90 3 5 200 fffffe810f367860 icmp_wqinput/5 icmp_w=
qinput
0 89 3 4 200 fffffe810f378000 icmp_wqinput/4 icmp_w=
qinput
0 88 3 3 200 fffffe810f378420 icmp_wqinput/3 icmp_w=
qinput
0 87 3 2 200 fffffe810f378840 icmp_wqinput/2 icmp_w=
qinput
0 86 3 1 200 fffffe810f329360 icmp_wqinput/1 icmp_w=
qinput
0 85 3 0 200 fffffe810f329780 icmp_wqinput/0 icmp_w=
qinput
0 84 3 0 200 fffffe810f2da720 rt_timer rt_tim=
er
0 83 3 7 200 fffffe810f329ba0 vmem_rehash vmem_r=
ehash
0 82 3 6 200 fffffe810f2f8340 coretemp3 corete=
mp3
0 81 3 7 200 fffffe810f2f8760 coretemp2 corete=
mp2
0 80 3 2 200 fffffe810f2f8b80 coretemp1 corete=
mp1
0 79 3 3 200 fffffe810f2e9320 coretemp0 corete=
mp0
0 78 3 3 200 fffffe810f2e9740 mfi0 mfi0
0 69 3 5 200 fffffe810f20d6e0 atabus1 atath
0 68 3 4 200 fffffe810f20db00 atabus0 atath
0 66 3 0 200 fffffe810ed3b6c0 scsibus0 sccomp=
0 65 3 0 200 fffffe810ed3bae0 usbtask-dr usbtsk=
0 64 3 0 200 fffffe810ecaa280 usbtask-hc usbtsk=
0 63 3 0 200 fffffe810ecaa6a0 bnx3 bnx3
0 62 3 0 200 fffffe810ecaaac0 bnx2 bnx2
0 61 3 0 200 fffffe810eb61260 bnx1 bnx1
0 60 3 7 200 fffffe810eb61680 bnx0 bnx0
0 > 59 7 2 200 fffffe810eb61aa0 ipmi
0 58 3 7 200 fffffe810ea7c240 xcall/7 xcall
0 57 1 7 200 fffffe810ea7c660 softser/7
0 56 1 7 200 fffffe810ea7ca80 softclk/7
0 55 1 7 200 fffffe810ea5d220 softbio/7
0 54 1 7 200 fffffe810ea5d640 softnet/7
0 > 53 7 7 201 fffffe810ea5da60 idle/7
0 52 3 6 200 fffffe810ea36200 xcall/6 xcall
0 51 1 6 200 fffffe810ea36620 softser/6
0 50 1 6 200 fffffe810ea36a40 softclk/6
0 49 1 6 200 fffffe810ea0f1e0 softbio/6
0 48 1 6 200 fffffe810ea0f600 softnet/6
0 47 1 6 201 fffffe810ea0fa20 idle/6
0 46 3 5 200 fffffe810e9e01c0 xcall/5 xcall
0 45 1 5 200 fffffe810e9e05e0 softser/5
0 44 1 5 200 fffffe810e9e0a00 softclk/5
0 43 1 5 200 fffffe810e9d11a0 softbio/5
0 42 1 5 200 fffffe810e9d15c0 softnet/5
0 > 41 7 5 201 fffffe810e9d19e0 idle/5
0 40 3 4 200 fffffe810e9a2180 xcall/4 xcall
0 39 1 4 200 fffffe810e9a25a0 softser/4
0 38 1 4 200 fffffe810e9a29c0 softclk/4
0 37 1 4 200 fffffe810e973160 softbio/4
0 36 1 4 200 fffffe810e973580 softnet/4
0 > 35 7 4 201 fffffe810e9739a0 idle/4
0 34 3 3 200 fffffe810e94c140 xcall/3 xcall
0 33 1 3 200 fffffe810e94c560 softser/3
0 32 1 3 200 fffffe810e94c980 softclk/3
0 31 1 3 200 fffffe810e93d120 softbio/3
0 30 1 3 200 fffffe810e93d540 softnet/3
0 > 29 7 3 201 fffffe810e93d960 idle/3
0 28 3 2 200 fffffe810e906100 xcall/2 xcall
0 27 1 2 200 fffffe810e906520 softser/2
0 26 1 2 200 fffffe810e906940 softclk/2
0 25 1 2 200 fffffe810e8ef0e0 softbio/2
0 24 1 2 200 fffffe810e8ef500 softnet/2
0 23 1 2 201 fffffe810e8ef920 idle/2
0 22 3 1 200 fffffe810e8c50c0 xcall/1 xcall
0 21 1 1 200 fffffe810e8c54e0 softser/1
0 20 1 1 200 fffffe810e8c5900 softclk/1
0 19 1 1 200 fffffe810e8b10a0 softbio/1
0 18 1 1 200 fffffe810e8b14c0 softnet/1
0 > 17 7 1 201 fffffe810e8b18e0 idle/1
0 16 3 0 200 fffffe822de92080 lnxsyswq lnxsys=
wq
0 15 3 0 200 fffffe822de924a0 sysmon smtask=
q
0 14 3 2 200 fffffe822de928c0 pmfsuspend pmfsus=
pend
0 13 3 7 200 fffffe822e2b1060 pmfevent pmfeve=
nt
0 12 3 0 200 fffffe822e2b1480 sopendfree sopend=
fr
0 11 3 2 200 fffffe822e2b18a0 nfssilly nfssil=
ly
0 10 3 2 200 fffffe822f6d0040 cachegc cacheg=
c
0 9 3 3 200 fffffe822f6d0460 vdrain vdrain=
0 8 3 0 200 fffffe822f6d0880 modunload mod_un=
ld
0 7 3 0 200 fffffe822f6eb020 xcall/0 xcall
0 > 6 7 0 200 fffffe822f6eb440 softser/0
0 > 5 7 0 200 fffffe822f6eb860 softclk/0
0 4 1 0 200 fffffe822f707000 softbio/0
0 3 1 0 200 fffffe822f707420 softnet/0
0 2 1 0 201 fffffe822f707840 idle/0
0 1 3 4 200 ffffffff81481b20 swapper uvm
crash> =
Backtraces for all the lwps which have non-zero "WAIT" strings:
crash> trace/a fffffe8220c58540
trace: pid 7052 lid 1 at 0xffff80009ea3d8f0
sleepq_block() at sleepq_block+0x97
turnstile_block() at turnstile_block+0x3e5
mutex_enter() at mutex_enter+0x36d
fstrans_start() at fstrans_start+0x460
VOP_LOCK() at VOP_LOCK+0x4d
vn_lock() at vn_lock+0x90
namei_tryemulroot() at namei_tryemulroot+0x193
namei() at namei+0x29
vn_open() at vn_open+0x92
do_open() at do_open+0x112
do_sys_openat() at do_sys_openat+0x68
sys_open() at sys_open+0x24
syscall() at syscall+0x1ed
--- syscall (number 5) ---
70efab63e2ca:
crash>
crash> trace/a fffffe821d362560
trace: pid 8587 lid 1 at 0xffff80009edb8d20
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
fork1() at fork1+0x774
sys___vfork14() at sys___vfork14+0x35
syscall() at syscall+0x1ed
--- syscall (number 282) ---
70efab68204c:
crash>
crash> trace/a fffffe821faa60c0
trace: pid 9187 lid 1 at 0xffff80009ed4e890
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
xc_wait() at xc_wait+0x7c
pserialize_perform() at pserialize_perform+0xdf
fstrans_setstate() at fstrans_setstate+0x42
genfs_suspendctl() at genfs_suspendctl+0x57
VFS_SUSPENDCTL() at VFS_SUSPENDCTL+0x1f
vfs_suspend() at vfs_suspend+0x5b
vrevoke_suspend_next() at vrevoke_suspend_next+0x2a
vrevoke() at vrevoke+0x2b
genfs_revoke() at genfs_revoke+0x13
VOP_REVOKE() at VOP_REVOKE+0x54
pty_grant_slave() at pty_grant_slave+0xa8
ptmioctl() at ptmioctl+0x90
cdev_ioctl() at cdev_ioctl+0x88
VOP_IOCTL() at VOP_IOCTL+0x3b
vn_ioctl() at vn_ioctl+0xa6
sys_ioctl() at sys_ioctl+0x101
syscall() at syscall+0x1ed
--- syscall (number 54) ---
6f9ce08feeaa:
crash>
crash> trace/a fffffe82045da540
trace: pid 3794 lid 1 at 0xffff80009f6c6be0
sleepq_block() at sleepq_block+0x97
turnstile_block() at turnstile_block+0x3e5
mutex_enter() at mutex_enter+0x36d
fstrans_start() at fstrans_start+0x74d
VOP_LOCK() at VOP_LOCK+0x4d
vn_lock() at vn_lock+0x90
vn_write() at vn_write+0x9b
dofilewrite() at dofilewrite+0x97
sys_write() at sys_write+0x5f
syscall() at syscall+0x1ed
--- syscall (number 4) ---
73b7cfe3e02a:
crash>
crash> trace/a fffffe8216d35140
trace: pid 2853 lid 2 at 0xffff80009f6eaab0
sleepq_block() at sleepq_block+0x97
turnstile_block() at turnstile_block+0x3e5
mutex_enter() at mutex_enter+0x36d
fstrans_start() at fstrans_start+0x460
VOP_POLL() at VOP_POLL+0x37
sel_do_scan() at sel_do_scan+0x324
selcommon.part.2() at selcommon.part.2+0x18b
sys___select50() at sys___select50+0x6f
syscall() at syscall+0x1ed
--- syscall (number 417) ---
7b328823e10a:
crash>
crash> trace/a fffffe82214bf2c0
trace: pid 2853 lid 1 at 0xffff80009ef1ddb0
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
fd_close() at fd_close+0x3ba
sys_close() at sys_close+0x20
syscall() at syscall+0x1ed
--- syscall (number 6) ---
7b328823e4ea:
crash>
crash> trace/a fffffe8225709000
trace: pid 8327 lid 2 at 0xffff80009e90eab0
sleepq_block() at sleepq_block+0x97
turnstile_block() at turnstile_block+0x3e5
mutex_enter() at mutex_enter+0x36d
fstrans_start() at fstrans_start+0x74d
VOP_POLL() at VOP_POLL+0x37
sel_do_scan() at sel_do_scan+0x324
selcommon.part.2() at selcommon.part.2+0x18b
sys___select50() at sys___select50+0x6f
syscall() at syscall+0x1ed
--- syscall (number 417) ---
7aeb6723e10a:
crash>
crash> trace/a fffffe820df34480
trace: pid 8327 lid 1 at 0xffff80009f668db0
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
fd_close() at fd_close+0x3ba
sys_close() at sys_close+0x20
syscall() at syscall+0x1ed
--- syscall (number 6) ---
7aeb6723e4ea:
crash>
crash> trace/a fffffe8207fd0360
trace: pid 5687 lid 2 at 0xffff80009f5f9ab0
sleepq_block() at sleepq_block+0x97
turnstile_block() at turnstile_block+0x3e5
mutex_enter() at mutex_enter+0x36d
fstrans_start() at fstrans_start+0x74d
VOP_POLL() at VOP_POLL+0x37
sel_do_scan() at sel_do_scan+0x324
selcommon.part.2() at selcommon.part.2+0x18b
sys___select50() at sys___select50+0x6f
syscall() at syscall+0x1ed
--- syscall (number 417) ---
7d665343e10a:
crash>
crash> trace/a fffffe822346f080
trace: pid 5687 lid 1 at 0xffff80009efd4db0
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
fd_close() at fd_close+0x3ba
sys_close() at sys_close+0x20
syscall() at syscall+0x1ed
--- syscall (number 6) ---
7d665343e4ea:
crash>
crash> trace/a fffffe821d987a40
trace: pid 9671 lid 2 at 0xffff80009ee64ab0
sleepq_block() at sleepq_block+0x97
turnstile_block() at turnstile_block+0x3e5
mutex_enter() at mutex_enter+0x36d
fstrans_start() at fstrans_start+0x74d
VOP_POLL() at VOP_POLL+0x37
sel_do_scan() at sel_do_scan+0x324
selcommon.part.2() at selcommon.part.2+0x18b
sys___select50() at sys___select50+0x6f
syscall() at syscall+0x1ed
--- syscall (number 417) ---
7ea7fc43e10a:
crash>
crash> trace/a fffffe821e90c240
trace: pid 9671 lid 1 at 0xffff80009ee94db0
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
fd_close() at fd_close+0x3ba
sys_close() at sys_close+0x20
syscall() at syscall+0x1ed
--- syscall (number 6) ---
7ea7fc43e4ea:
crash>
crash> trace/a fffffe821d362980
trace: pid 704 lid 1 at 0xffff80009edaebc0
sleepq_block() at sleepq_block+0x97
turnstile_block() at turnstile_block+0x3e5
rw_enter() at rw_enter+0x49d
genfs_lock() at genfs_lock+0x3c
VOP_LOCK() at VOP_LOCK+0x67
vn_lock() at vn_lock+0x90
vn_write() at vn_write+0x9b
dofilewrite() at dofilewrite+0x97
sys_write() at sys_write+0x5f
syscall() at syscall+0x1ed
--- syscall (number 4) ---
764fb503e02a:
crash>
crash> trace/a fffffe8229b924c0
trace: pid 564 lid 1 at 0xffff80009e9c3ab0
sleepq_block() at sleepq_block+0x97
turnstile_block() at turnstile_block+0x3e5
mutex_enter() at mutex_enter+0x36d
fstrans_start() at fstrans_start+0x74d
VOP_POLL() at VOP_POLL+0x37
sel_do_scan() at sel_do_scan+0x324
selcommon.part.2() at selcommon.part.2+0x18b
sys___select50() at sys___select50+0x6f
syscall() at syscall+0x1ed
--- syscall (number 417) ---
764fb503e10a:
crash>
crash> trace/a fffffe8220b8e780
trace: pid 275 lid 1 at 0xffff80009ebf8bc0
sleepq_block() at sleepq_block+0x97
turnstile_block() at turnstile_block+0x3e5
rw_enter() at rw_enter+0x49d
genfs_lock() at genfs_lock+0x3c
VOP_LOCK() at VOP_LOCK+0x67
vn_lock() at vn_lock+0x90
vn_write() at vn_write+0x9b
dofilewrite() at dofilewrite+0x97
sys_write() at sys_write+0x5f
syscall() at syscall+0x1ed
--- syscall (number 4) ---
764fb503e02a:
crash>
crash> trace/a fffffe8221e57600
trace: pid 878 lid 1 at 0xffff80009eae8ab0
sleepq_block() at sleepq_block+0x97
turnstile_block() at turnstile_block+0x3e5
mutex_enter() at mutex_enter+0x36d
fstrans_start() at fstrans_start+0x74d
VOP_POLL() at VOP_POLL+0x37
sel_do_scan() at sel_do_scan+0x324
selcommon.part.2() at selcommon.part.2+0x18b
sys___select50() at sys___select50+0x6f
syscall() at syscall+0x1ed
--- syscall (number 417) ---
764fb503e10a:
crash>
crash> trace/a fffffe8222569900
trace: pid 136 lid 1 at 0xffff80009e9cdab0
sleepq_block() at sleepq_block+0x97
turnstile_block() at turnstile_block+0x3e5
mutex_enter() at mutex_enter+0x36d
fstrans_start() at fstrans_start+0x74d
VOP_POLL() at VOP_POLL+0x37
sel_do_scan() at sel_do_scan+0x324
selcommon.part.2() at selcommon.part.2+0x18b
sys___select50() at sys___select50+0x6f
syscall() at syscall+0x1ed
--- syscall (number 417) ---
764fb503e10a:
crash>
crash> trace/a fffffe8225709840
trace: pid 773 lid 1 at 0xffff80009e904ab0
sleepq_block() at sleepq_block+0x97
turnstile_block() at turnstile_block+0x3e5
mutex_enter() at mutex_enter+0x36d
fstrans_start() at fstrans_start+0x74d
VOP_POLL() at VOP_POLL+0x37
sel_do_scan() at sel_do_scan+0x324
selcommon.part.2() at selcommon.part.2+0x18b
sys___select50() at sys___select50+0x6f
syscall() at syscall+0x1ed
--- syscall (number 417) ---
764fb503e10a:
crash>
crash> trace/a fffffe822d4cd1e0
trace: pid 0 lid 123 at 0xffff80009dee1da0
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
xc_broadcast() at xc_broadcast+0x17a
pserialize_perform() at pserialize_perform+0xd7
npf_conn_gc() at npf_conn_gc+0x1b5
npf_worker() at npf_worker+0x4b
crash>
crash> trace/a fffffe822d4cda20
trace: pid 0 lid 122 at 0xffff80009dec3e60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe822dd10940
trace: pid 0 lid 121 at 0xffff80009ddc4e60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe822dcff960
trace: pid 0 lid 120 at 0xffff80009dceee60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe822dd10100
trace: pid 0 lid 119 at 0xffff80009dce9bf0
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
biowait() at biowait+0x5d
wapbl_buffered_flush() at wapbl_buffered_flush+0xc6
wapbl_buffered_write() at wapbl_buffered_write+0x69
wapbl_circ_write() at wapbl_circ_write+0xa7
wapbl_flush() at wapbl_flush+0x354
ffs_sync() at ffs_sync+0x221
VFS_SYNC() at VFS_SYNC+0x1c
sched_sync() at sched_sync+0x91
crash>
crash> trace/a fffffe822dd10520
trace: pid 0 lid 118 at 0xffff80009dce4d80
sleepq_block() at sleepq_block+0x97
mtsleep() at mtsleep+0x102
uvm_pageout() at uvm_pageout+0x62e
crash>
crash> trace/a fffffe822dd62500
trace: pid 0 lid 115 at 0xffff80009dc8ee60
sleepq_block() at sleepq_block+0x97
cv_wait_sig() at cv_wait_sig+0x12b
bell_thread() at bell_thread+0x5f
crash>
crash> trace/a fffffe822dd62920
trace: pid 0 lid 114 at 0xffff80009db5fe80
sleepq_block() at sleepq_block+0x97
cv_wait_sig() at cv_wait_sig+0x12b
audio_play_thread() at audio_play_thread+0x55
crash>
crash> trace/a fffffe810ed3b2a0
trace: pid 0 lid 113 at 0xffff80009dc89e90
sleepq_block() at sleepq_block+0x97
cv_wait_sig() at cv_wait_sig+0x12b
audio_rec_thread() at audio_rec_thread+0x3a
crash>
crash> trace/a fffffe810f4fa0c0
trace: pid 0 lid 112 at 0xffff80009dc32e80
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
scsipi_completion_thread() at scsipi_completion_thread+0xf5
crash>
crash> trace/a fffffe810f2e9b60
trace: pid 0 lid 110 at 0xffff80009dc27e80
sleepq_block() at sleepq_block+0x106
cv_timedwait() at cv_timedwait+0x131
usb_event_thread() at usb_event_thread+0xa2
crash>
crash> trace/a fffffe810f2c3b20
trace: pid 0 lid 109 at 0xffff80009dc22e80
sleepq_block() at sleepq_block+0x106
cv_timedwait() at cv_timedwait+0x131
usb_event_thread() at usb_event_thread+0xa2
crash>
crash> trace/a fffffe810f20d2c0
trace: pid 0 lid 108 at 0xffff80009db64e80
sleepq_block() at sleepq_block+0x106
cv_timedwait() at cv_timedwait+0x131
usb_event_thread() at usb_event_thread+0xa2
crash>
crash> trace/a fffffe810f2da300
trace: pid 0 lid 107 at 0xffff80009dc1de80
sleepq_block() at sleepq_block+0x106
cv_timedwait() at cv_timedwait+0x131
usb_event_thread() at usb_event_thread+0xa2
crash>
crash> trace/a fffffe810f2c32e0
trace: pid 0 lid 106 at 0xffff80009dc18e80
sleepq_block() at sleepq_block+0x106
cv_timedwait() at cv_timedwait+0x131
usb_event_thread() at usb_event_thread+0xa2
crash>
crash> trace/a fffffe810f4fa4e0
trace: pid 0 lid 105 at 0xffff80009dc13e80
sleepq_block() at sleepq_block+0x106
cv_timedwait() at cv_timedwait+0x131
usb_event_thread() at usb_event_thread+0xa2
crash>
crash> trace/a fffffe810f4a30a0
trace: pid 0 lid 104 at 0xffff80009dbfce60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810f4a34c0
trace: pid 0 lid 103 at 0xffff80009dbf7e60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
unp_thread() at unp_thread+0x700
crash>
crash> trace/a fffffe810f4a38e0
trace: pid 0 lid 102 at 0xffff80009dbf2e60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810f45c080
trace: pid 0 lid 101 at 0xffff80009dbede60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810f45c4a0
trace: pid 0 lid 100 at 0xffff80009dbe8e60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810f45c8c0
trace: pid 0 lid 99 at 0xffff80009dbe3e60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810f4b5060
trace: pid 0 lid 98 at 0xffff80009dbdee60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810f4b5480
trace: pid 0 lid 97 at 0xffff80009dbd9e60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810f4b58a0
trace: pid 0 lid 96 at 0xffff80009dbd4e60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810f396040
trace: pid 0 lid 95 at 0xffff80009dbcfe60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810f396460
trace: pid 0 lid 94 at 0xffff80009dbcae60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810f396880
trace: pid 0 lid 93 at 0xffff80009dbc5e60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810f367020
trace: pid 0 lid 92 at 0xffff80009dbc0e60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810f367440
trace: pid 0 lid 91 at 0xffff80009dbbbe60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810f367860
trace: pid 0 lid 90 at 0xffff80009dbb6e60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash> =
crash> trace/a fffffe810f378000
trace: pid 0 lid 89 at 0xffff80009dbb1e60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810f378420
trace: pid 0 lid 88 at 0xffff80009dbace60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810f378840
trace: pid 0 lid 87 at 0xffff80009dba7e60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810f329360
trace: pid 0 lid 86 at 0xffff80009dba2e60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810f329780
trace: pid 0 lid 85 at 0xffff80009db6ee60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810f2da720
trace: pid 0 lid 84 at 0xffff80009db9de60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810f329ba0
trace: pid 0 lid 83 at 0xffff80009db98e60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810f2f8340
trace: pid 0 lid 82 at 0xffff80009db91e60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810f2f8760
trace: pid 0 lid 81 at 0xffff80009db8ce60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810f2f8b80
trace: pid 0 lid 80 at 0xffff80009db87e60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810f2e9320
trace: pid 0 lid 79 at 0xffff80009db82e60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810f2e9740
trace: pid 0 lid 78 at 0xffff80009db7de60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810f20d6e0
trace: pid 0 lid 69 at 0xffff80009d349eb0
sleepq_block() at sleepq_block+0x97
atabus_thread() at atabus_thread+0xcc
crash>
crash> trace/a fffffe810f20db00
trace: pid 0 lid 68 at 0xffff80009d344eb0
sleepq_block() at sleepq_block+0x97
atabus_thread() at atabus_thread+0xcc
crash>
crash> trace/a fffffe810ed3b6c0
trace: pid 0 lid 66 at 0xffff80009d0ffe80
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
scsipi_completion_thread() at scsipi_completion_thread+0xf5
crash>
crash> trace/a fffffe810ed3bae0
trace: pid 0 lid 65 at 0xffff800099072e70
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
usb_task_thread() at usb_task_thread+0x8a
crash>
crash> trace/a fffffe810ecaa280
trace: pid 0 lid 64 at 0xffff80009906de70
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
usb_task_thread() at usb_task_thread+0x8a
crash>
crash> trace/a fffffe810ecaa6a0
trace: pid 0 lid 63 at 0xffff800099056e60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810ecaaac0
trace: pid 0 lid 62 at 0xffff800096a41e60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810eb61260
trace: pid 0 lid 61 at 0xffff80009442ae60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810eb61680
trace: pid 0 lid 60 at 0xffff800091e15e60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe810eb61aa0
trace: pid 0 lid 59 at 0xffff80008f7f8e30
sleepq_block() at sleepq_block+0x1c5
cv_timedwait() at cv_timedwait+0x131
ipmi_thread() at ipmi_thread+0x2f4
crash>
crash> trace/a fffffe810ea7c240
trace: pid 0 lid 58 at 0xffff80008f7ede70
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
xc_thread() at xc_thread+0x5a
crash>
crash> trace/a fffffe810ea36200
trace: pid 0 lid 52 at 0xffff80008f7c7e70
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
xc_thread() at xc_thread+0x5a
crash>
crash> trace/a fffffe810e9e01c0
trace: pid 0 lid 46 at 0xffff80008f7a1e70
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
xc_thread() at xc_thread+0x5a
crash>
crash> trace/a fffffe810e9a2180
trace: pid 0 lid 40 at 0xffff80008f77be70
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
xc_thread() at xc_thread+0x5a
crash>
crash> trace/a fffffe810e94c140
trace: pid 0 lid 34 at 0xffff80008f755e70
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
xc_thread() at xc_thread+0x5a
crash>
crash> trace/a fffffe810e906100
trace: pid 0 lid 28 at 0xffff80008f72fe70
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
xc_thread() at xc_thread+0x5a
crash>
crash> trace/a fffffe810e8c50c0
trace: pid 0 lid 22 at 0xffff80008f706e70
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
xc_thread() at xc_thread+0x5a
crash>
crash> trace/a fffffe822de92080
trace: pid 0 lid 16 at 0xffff80008f6cde60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe822de924a0
trace: pid 0 lid 15 at 0xffff80008f6c8e90
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
sysmon_task_queue_thread() at sysmon_task_queue_thread+0x81
crash>
crash> trace/a fffffe822de928c0
trace: pid 0 lid 14 at 0xffff80008f6c3e60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe822e2b1060
trace: pid 0 lid 13 at 0xffff80008f6bee60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe822e2b1480
trace: pid 0 lid 12 at 0xffff80008f6b9e60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
sopendfree_thread() at sopendfree_thread+0x1da
crash>
crash> trace/a fffffe822e2b18a0
trace: pid 0 lid 11 at 0xffff80008f6b4e60
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
workqueue_worker() at workqueue_worker+0x8f
crash>
crash> trace/a fffffe822f6d0040
trace: pid 0 lid 10 at 0xffff80008f6afe80
sleepq_block() at sleepq_block+0x106
kpause() at kpause+0xea
cache_thread() at cache_thread+0x30
crash>
crash> trace/a fffffe822f6d0460
trace: pid 0 lid 9 at 0xffff80008f6aae30
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
vdrain_thread() at vdrain_thread+0x3f1
crash>
crash> trace/a fffffe822f6d0880
trace: pid 0 lid 8 at 0xffff80008f6a5e80
sleepq_block() at sleepq_block+0x97
cv_timedwait() at cv_timedwait+0x131
module_thread() at module_thread+0xe9
crash>
crash> trace/a fffffe822f6eb020
trace: pid 0 lid 7 at 0xffff80008f6a0e70
sleepq_block() at sleepq_block+0x97
cv_wait() at cv_wait+0x127
xc_thread() at xc_thread+0x5a
crash>
crash> trace/a ffffffff81481b20
trace: pid 0 lid 1 at 0xffffffff817dde20
sleepq_block() at sleepq_block+0x106
kpause() at kpause+0xea
uvm_scheduler() at uvm_scheduler+0x69
sysctl_alloc() at sysctl_alloc
crash>
------------------------------
(gdb) kvm proc 0xfffffe8220c58540
0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe8220c58540)
at /usr/src/sys/kern/kern_synch.c:720
720 prevlwp =3D cpu_switchto(l, newl, returning);
(gdb) where
#0 0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe8220c58540)
at /usr/src/sys/kern/kern_synch.c:720
#1 0xffffffff8097d5fd in sleepq_block (timo=3Dtimo@entry=3D0, =
catch_p=3Dcatch_p@entry=3Dfalse) at /usr/src/sys/kern/kern_sleepq.c=
:264
#2 0xffffffff8098b761 in turnstile_block (ts=3D<optimized out>, =
ts@entry=3D0xfffffe82123900c8, q=3Dq@entry=3D1, =
obj=3Dobj@entry=3D0xffffffff815cb9b0 <fstrans_lock>, =
sobj=3Dsobj@entry=3D0xffffffff814821a0 <mutex_syncobj>)
at /usr/src/sys/kern/kern_turnstile.c:430
#3 0xffffffff80965a59 in mutex_vector_enter (
mtx=3D0xffffffff815cb9b0 <fstrans_lock>)
at /usr/src/sys/kern/kern_mutex.c:693
#4 0xffffffff809fec40 in fstrans_alloc_lwp_info (mp=3D0xfffffe822dd7a0=
08)
at /usr/src/sys/kern/vfs_trans.c:274
#5 fstrans_get_lwp_info (do_alloc=3Dtrue, mp=3D0xfffffe822dd7a008)
at /usr/src/sys/kern/vfs_trans.c:331
#6 _fstrans_start (wait=3D1, lock_type=3DFSTRANS_SHARED, mp=3D<optimiz=
ed out>)
at /usr/src/sys/kern/vfs_trans.c:375
#7 fstrans_start (mp=3D<optimized out>) at /usr/src/sys/kern/vfs_trans=
.c:414
#8 0xffffffff80a0ed1b in vop_pre (vp=3D0xfffffe810f2f2930, =
vp=3D0xfffffe810f2f2930, op=3DFST_YES, mpsafe=3D<synthetic pointer>=
, =
mp=3D<synthetic pointer>) at /usr/src/sys/kern/vnode_if.c:77
#9 VOP_LOCK (vp=3Dvp@entry=3D0xfffffe810f2f2930, flags=3Dflags@entry=3D=
131074)
at /usr/src/sys/kern/vnode_if.c:1281
#10 0xffffffff80a05846 in vn_lock (vp=3Dvp@entry=3D0xfffffe810f2f2930, =
flags=3Dflags@entry=3D131074) at /usr/src/sys/kern/vfs_vnops.c:1036=
#11 0xffffffff809ef7c3 in namei_start (startdir_ret=3D0xffff80009ea3db2=
8, =
isnfsd=3D0, state=3D0xffff80009ea3dbd0) at /usr/src/sys/kern/vfs_lo=
okup.c:681
#12 namei_oneroot (isnfsd=3D0, inhibitmagic=3D0, neverfollow=3D0, =
state=3D0xffff80009ea3dbd0) at /usr/src/sys/kern/vfs_lookup.c:1156
#13 namei_tryemulroot (state=3Dstate@entry=3D0xffff80009ea3dbd0, =
neverfollow=3Dneverfollow@entry=3D0, inhibitmagic=3Dinhibitmagic@en=
try=3D0, =
isnfsd=3Disnfsd@entry=3D0) at /usr/src/sys/kern/vfs_lookup.c:1510
#14 0xffffffff809f1905 in namei (ndp=3Dndp@entry=3D0xffff80009ea3dd58)
at /usr/src/sys/kern/vfs_lookup.c:1546
#15 0xffffffff80a061fd in vn_open (ndp=3Dndp@entry=3D0xffff80009ea3dd58=
, =
fmode=3Dfmode@entry=3D4194305, cmode=3Dcmode@entry=3D3116)
at /usr/src/sys/kern/vfs_vnops.c:175
#16 0xffffffff809fb7c4 in do_open (l=3Dl@entry=3D0xfffffe8220c58540, dv=
p=3D0x0, =
pb=3D<optimized out>, open_flags=3Dopen_flags@entry=3D4194304, =
open_mode=3Dopen_mode@entry=3D774778414, fd=3Dfd@entry=3D0xffff8000=
9ea3de7c)
at /usr/src/sys/kern/vfs_syscalls.c:1576
#17 0xffffffff809fb915 in do_sys_openat (l=3D0xfffffe8220c58540, =
fdat=3Dfdat@entry=3D-100, path=3D<optimized out>, flags=3D4194304, =
mode=3D774778414, =
fd=3Dfd@entry=3D0xffff80009ea3de7c) at /usr/src/sys/kern/vfs_syscal=
ls.c:1656
#18 0xffffffff809fb9d3 in sys_open (l=3D<optimized out>, uap=3D<optimiz=
ed out>, =
retval=3D0xffff80009ea3deb0) at /usr/src/sys/kern/vfs_syscalls.c:16=
76
#19 0xffffffff80248dbd in sy_call (rval=3D0xffff80009ea3deb0, =
uap=3D0xffff80009ea3df00, l=3D0xfffffe8220c58540, =
sy=3D0xffffffff8147da58 <sysent+120>) at /usr/src/sys/sys/syscallva=
r.h:65
#20 sy_invoke (code=3D5, rval=3D0xffff80009ea3deb0, uap=3D0xffff80009ea=
3df00, =
l=3D0xfffffe8220c58540, sy=3D0xffffffff8147da58 <sysent+120>)
at /usr/src/sys/sys/syscallvar.h:94
#21 syscall (frame=3D0xffff80009ea3df00)
at /usr/src/sys/arch/x86/x86/syscall.c:144
#22 0xffffffff8020768d in handle_syscall ()
#23 0x000070efab549000 in ?? ()
#24 0x0000000000400000 in ?? ()
#25 0x2e2e2e2e2e2e2e2e in ?? ()
#26 0x0000000000000000 in ?? ()
(gdb)
Looking at fstrans_lock:
(gdb) lock 0xffffffff815cb9b0
lock address : 0xffffffff815cb9b0 type : sleep/adaptive
initialized : 0xffffffff809fe6a3
shared holds : 0 exclusive: 1
shares wanted: 0 exclusive: 10
cpu last held: 6
current lwp : 000000000000000000 last held: 0xfffffe821faa60c0
last locked : 0xffffffff809ffb6d unlocked : 0xffffffff809fecc4
(gdb) =
What I don't understand is that "current lwp" is 0x0, even though
this one seems to be held at the moment, and there's lots of
contention for the lock judging by the "shares wanted, exclusive: 10".
"last held" appears to point to
9187 1 3 6 8020000 fffffe821faa60c0 expect xchicv=
(gdb) kvm proc 0xfffffe821faa60c0
0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe821faa60c0)
at /usr/src/sys/kern/kern_synch.c:720
720 prevlwp =3D cpu_switchto(l, newl, returning);
(gdb) where
#0 0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe821faa60c0)
at /usr/src/sys/kern/kern_synch.c:720
#1 0xffffffff8097d5fd in sleepq_block (timo=3Dtimo@entry=3D0, =
catch_p=3Dcatch_p@entry=3Dfalse) at /usr/src/sys/kern/kern_sleepq.c=
:264
#2 0xffffffff8094afca in cv_wait (
cv=3Dcv@entry=3D0xffffffff814c5c88 <xc_high_pri+8>, =
mtx=3Dmtx@entry=3D0xffffffff814c5c80 <xc_high_pri>)
at /usr/src/sys/kern/kern_condvar.c:217
#3 0xffffffff809b1293 in xc_wait (where=3D64992)
at /usr/src/sys/kern/subr_xcall.c:321
#4 0xffffffff809aa122 in pserialize_perform (psz=3D0xfffffe822fbd20e8)=
at /usr/src/sys/kern/subr_pserialize.c:187
#5 0xffffffff809ffb7c in fstrans_setstate (mp=3D0xfffffe822c993008, =
new_state=3Dnew_state@entry=3DFSTRANS_SUSPENDED)
at /usr/src/sys/kern/vfs_trans.c:530
#6 0xffffffff80a17729 in genfs_suspendctl (mp=3D0xfffffe822c993008, =
cmd=3D<optimized out>) at /usr/src/sys/miscfs/genfs/genfs_vfsops.c:=
86
#7 0xffffffff809f781e in VFS_SUSPENDCTL (mp=3Dmp@entry=3D0xfffffe822c9=
93008, =
a=3Da@entry=3D1) at /usr/src/sys/kern/vfs_subr.c:1478
#8 0xffffffff80a00530 in vfs_suspend (mp=3D<optimized out>, =
mp@entry=3D0xfffffe822c993008, nowait=3Dnowait@entry=3D0)
at /usr/src/sys/kern/vfs_trans.c:587
#9 0xffffffff80a01769 in vrevoke_suspend_next (lastmp=3D<optimized out=
>, =
thismp=3D0xfffffe822c993008) at /usr/src/sys/kern/vfs_vnode.c:978
#10 0xffffffff80a030ed in vrevoke (vp=3D0xfffffe8221e36690)
at /usr/src/sys/kern/vfs_vnode.c:1002
#11 0xffffffff80a17caa in genfs_revoke (v=3D<optimized out>)
at /usr/src/sys/miscfs/genfs/genfs_vnops.c:273
#12 0xffffffff80a0e4f7 in VOP_REVOKE (vp=3D0xfffffe8221e36690, =
flags=3Dflags@entry=3D1) at /usr/src/sys/kern/vnode_if.c:744
#13 0xffffffff809cfb00 in pty_grant_slave (l=3Dl@entry=3D0xfffffe821faa=
60c0, =
dev=3D<optimized out>, mp=3D<optimized out>) at /usr/src/sys/kern/t=
ty_ptm.c:245
#14 0xffffffff809cfd7b in ptmioctl (dev=3D<optimized out>, cmd=3D<optim=
ized out>, =
data=3D0xfffffe822d624008, flag=3D<optimized out>, l=3D0xfffffe821f=
aa60c0)
at /usr/src/sys/kern/tty_ptm.c:397
#15 0xffffffff80996a52 in cdev_ioctl (dev=3D42241, cmd=3D1208513606, =
data=3D0xfffffe822d624008, flag=3D3, l=3D0xfffffe821faa60c0)
at /usr/src/sys/kern/subr_devsw.c:938
#16 0xffffffff80a0e2b8 in VOP_IOCTL (vp=3Dvp@entry=3D0xfffffe822caabd20=
, =
command=3Dcommand@entry=3D1208513606, data=3Ddata@entry=3D0xfffffe8=
22d624008, =
fflag=3D<optimized out>, cred=3D<optimized out>)
at /usr/src/sys/kern/vnode_if.c:610
#17 0xffffffff80a05e1e in vn_ioctl (fp=3D0xfffffe821d011a40, com=3D1208=
513606, =
data=3D0xfffffe822d624008) at /usr/src/sys/kern/vfs_vnops.c:765
#18 0xffffffff809b4e81 in sys_ioctl (l=3D<optimized out>, =
uap=3D0xffff80009ed4ef00, retval=3D<optimized out>)
at /usr/src/sys/kern/sys_generic.c:671
#19 0xffffffff80248dbd in sy_call (rval=3D0xffff80009ed4eeb0, =
uap=3D0xffff80009ed4ef00, l=3D0xfffffe821faa60c0, =
sy=3D0xffffffff8147def0 <sysent+1296>) at /usr/src/sys/sys/syscallv=
ar.h:65
#20 sy_invoke (code=3D54, rval=3D0xffff80009ed4eeb0, uap=3D0xffff80009e=
d4ef00, =
l=3D0xfffffe821faa60c0, sy=3D0xffffffff8147def0 <sysent+1296>)
at /usr/src/sys/sys/syscallvar.h:94
#21 syscall (frame=3D0xffff80009ed4ef00)
at /usr/src/sys/arch/x86/x86/syscall.c:144
#22 0xffffffff8020768d in handle_syscall ()
#23 0x0000000000000003 in ?? ()
#24 0x0000000048087446 in ?? ()
#25 0x00007f7fff318360 in ?? ()
#26 0x0000000000000000 in ?? ()
(gdb)
The xc_high_pri looks like this:
(gdb) lock 0xffffffff814c5c80
lock address : 0xffffffff814c5c80 type : sleep/adaptive
initialized : 0xffffffff809b1053
shared holds : 0 exclusive: 0
shares wanted: 0 exclusive: 0
cpu last held: 7
current lwp : 000000000000000000 last held: 000000000000000000
last locked : 0xffffffff809b17d1 unlocked : 0xffffffff8094afb7
(gdb) =
but that doesn't appear to lead anywhere.
------------------------------
Decode of the stack backtraces of the non-kernel lwps using gdb:
(gdb) kvm proc 0xfffffe8220c58540
0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe8220c58540)
at /usr/src/sys/kern/kern_synch.c:720
720 prevlwp =3D cpu_switchto(l, newl, returning);
(gdb) where
#0 0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe8220c58540)
at /usr/src/sys/kern/kern_synch.c:720
#1 0xffffffff8097d5fd in sleepq_block (timo=3Dtimo@entry=3D0, =
catch_p=3Dcatch_p@entry=3Dfalse) at /usr/src/sys/kern/kern_sleepq.c=
:264
#2 0xffffffff8098b761 in turnstile_block (ts=3D<optimized out>, =
ts@entry=3D0xfffffe82123900c8, q=3Dq@entry=3D1, =
obj=3Dobj@entry=3D0xffffffff815cb9b0 <fstrans_lock>, =
sobj=3Dsobj@entry=3D0xffffffff814821a0 <mutex_syncobj>)
at /usr/src/sys/kern/kern_turnstile.c:430
#3 0xffffffff80965a59 in mutex_vector_enter (
mtx=3D0xffffffff815cb9b0 <fstrans_lock>)
at /usr/src/sys/kern/kern_mutex.c:693
#4 0xffffffff809fec40 in fstrans_alloc_lwp_info (mp=3D0xfffffe822dd7a0=
08)
at /usr/src/sys/kern/vfs_trans.c:274
#5 fstrans_get_lwp_info (do_alloc=3Dtrue, mp=3D0xfffffe822dd7a008)
at /usr/src/sys/kern/vfs_trans.c:331
#6 _fstrans_start (wait=3D1, lock_type=3DFSTRANS_SHARED, mp=3D<optimiz=
ed out>)
at /usr/src/sys/kern/vfs_trans.c:375
#7 fstrans_start (mp=3D<optimized out>) at /usr/src/sys/kern/vfs_trans=
.c:414
#8 0xffffffff80a0ed1b in vop_pre (vp=3D0xfffffe810f2f2930, =
vp=3D0xfffffe810f2f2930, op=3DFST_YES, mpsafe=3D<synthetic pointer>=
, =
mp=3D<synthetic pointer>) at /usr/src/sys/kern/vnode_if.c:77
#9 VOP_LOCK (vp=3Dvp@entry=3D0xfffffe810f2f2930, flags=3Dflags@entry=3D=
131074)
at /usr/src/sys/kern/vnode_if.c:1281
#10 0xffffffff80a05846 in vn_lock (vp=3Dvp@entry=3D0xfffffe810f2f2930, =
flags=3Dflags@entry=3D131074) at /usr/src/sys/kern/vfs_vnops.c:1036=
#11 0xffffffff809ef7c3 in namei_start (startdir_ret=3D0xffff80009ea3db2=
8, =
isnfsd=3D0, state=3D0xffff80009ea3dbd0) at /usr/src/sys/kern/vfs_lo=
okup.c:681
#12 namei_oneroot (isnfsd=3D0, inhibitmagic=3D0, neverfollow=3D0, =
state=3D0xffff80009ea3dbd0) at /usr/src/sys/kern/vfs_lookup.c:1156
#13 namei_tryemulroot (state=3Dstate@entry=3D0xffff80009ea3dbd0, =
neverfollow=3Dneverfollow@entry=3D0, inhibitmagic=3Dinhibitmagic@en=
try=3D0, =
isnfsd=3Disnfsd@entry=3D0) at /usr/src/sys/kern/vfs_lookup.c:1510
#14 0xffffffff809f1905 in namei (ndp=3Dndp@entry=3D0xffff80009ea3dd58)
at /usr/src/sys/kern/vfs_lookup.c:1546
#15 0xffffffff80a061fd in vn_open (ndp=3Dndp@entry=3D0xffff80009ea3dd58=
, =
fmode=3Dfmode@entry=3D4194305, cmode=3Dcmode@entry=3D3116)
at /usr/src/sys/kern/vfs_vnops.c:175
#16 0xffffffff809fb7c4 in do_open (l=3Dl@entry=3D0xfffffe8220c58540, dv=
p=3D0x0, =
pb=3D<optimized out>, open_flags=3Dopen_flags@entry=3D4194304, =
open_mode=3Dopen_mode@entry=3D774778414, fd=3Dfd@entry=3D0xffff8000=
9ea3de7c)
at /usr/src/sys/kern/vfs_syscalls.c:1576
#17 0xffffffff809fb915 in do_sys_openat (l=3D0xfffffe8220c58540, =
fdat=3Dfdat@entry=3D-100, path=3D<optimized out>, flags=3D4194304, =
mode=3D774778414, =
fd=3Dfd@entry=3D0xffff80009ea3de7c) at /usr/src/sys/kern/vfs_syscal=
ls.c:1656
#18 0xffffffff809fb9d3 in sys_open (l=3D<optimized out>, uap=3D<optimiz=
ed out>, =
retval=3D0xffff80009ea3deb0) at /usr/src/sys/kern/vfs_syscalls.c:16=
76
#19 0xffffffff80248dbd in sy_call (rval=3D0xffff80009ea3deb0, =
uap=3D0xffff80009ea3df00, l=3D0xfffffe8220c58540, =
sy=3D0xffffffff8147da58 <sysent+120>) at /usr/src/sys/sys/syscallva=
r.h:65
#20 sy_invoke (code=3D5, rval=3D0xffff80009ea3deb0, uap=3D0xffff80009ea=
3df00, =
l=3D0xfffffe8220c58540, sy=3D0xffffffff8147da58 <sysent+120>)
at /usr/src/sys/sys/syscallvar.h:94
#21 syscall (frame=3D0xffff80009ea3df00)
at /usr/src/sys/arch/x86/x86/syscall.c:144
#22 0xffffffff8020768d in handle_syscall ()
#23 0x000070efab549000 in ?? ()
#24 0x0000000000400000 in ?? ()
#25 0x2e2e2e2e2e2e2e2e in ?? ()
#26 0x0000000000000000 in ?? ()
(gdb)
(gdb) kvm proc 0xfffffe821d362560
0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe821d362560)
at /usr/src/sys/kern/kern_synch.c:720
720 prevlwp =3D cpu_switchto(l, newl, returning);
(gdb) where
#0 0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe821d362560)
at /usr/src/sys/kern/kern_synch.c:720
#1 0xffffffff8097d5fd in sleepq_block (timo=3Dtimo@entry=3D0, =
catch_p=3Dcatch_p@entry=3Dfalse) at /usr/src/sys/kern/kern_sleepq.c=
:264
#2 0xffffffff8094afca in cv_wait (cv=3Dcv@entry=3D0xfffffe8210396788, =
mtx=3D0xfffffe822fb97f00) at /usr/src/sys/kern/kern_condvar.c:217
#3 0xffffffff80959f24 in fork1 (l1=3D0xfffffe821d362560, flags=3Dflags=
@entry=3D3, =
exitsig=3Dexitsig@entry=3D20, stack=3Dstack@entry=3D0x0, =
stacksize=3Dstacksize@entry=3D0, func=3Dfunc@entry=3D0x0, arg=3Darg=
@entry=3D0x0, =
retval=3D0xffff80009edb8eb0, rnewprocp=3Drnewprocp@entry=3D0x0)
at /usr/src/sys/kern/kern_fork.c:592
#4 0xffffffff8095a424 in sys___vfork14 (l=3D<optimized out>, v=3D<opti=
mized out>, =
retval=3D<optimized out>) at /usr/src/sys/kern/kern_fork.c:143
#5 0xffffffff80248dbd in sy_call (rval=3D0xffff80009edb8eb0, =
uap=3D0xffff80009edb8f00, l=3D0xfffffe821d362560, =
sy=3D0xffffffff8147f450 <sysent+6768>) at /usr/src/sys/sys/syscallv=
ar.h:65
#6 sy_invoke (code=3D282, rval=3D0xffff80009edb8eb0, uap=3D0xffff80009=
edb8f00, =
l=3D0xfffffe821d362560, sy=3D0xffffffff8147f450 <sysent+6768>)
at /usr/src/sys/sys/syscallvar.h:94
#7 syscall (frame=3D0xffff80009edb8f00)
at /usr/src/sys/arch/x86/x86/syscall.c:144
#8 0xffffffff8020768d in handle_syscall ()
#9 0x00007f7fff9fa3d8 in ?? ()
#10 0x0000000000000000 in ?? ()
(gdb)
(gdb) kvm proc 0xfffffe821faa60c0
0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe821faa60c0)
at /usr/src/sys/kern/kern_synch.c:720
720 prevlwp =3D cpu_switchto(l, newl, returning);
(gdb) where
#0 0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe821faa60c0)
at /usr/src/sys/kern/kern_synch.c:720
#1 0xffffffff8097d5fd in sleepq_block (timo=3Dtimo@entry=3D0, =
catch_p=3Dcatch_p@entry=3Dfalse) at /usr/src/sys/kern/kern_sleepq.c=
:264
#2 0xffffffff8094afca in cv_wait (
cv=3Dcv@entry=3D0xffffffff814c5c88 <xc_high_pri+8>, =
mtx=3Dmtx@entry=3D0xffffffff814c5c80 <xc_high_pri>)
at /usr/src/sys/kern/kern_condvar.c:217
#3 0xffffffff809b1293 in xc_wait (where=3D64992)
at /usr/src/sys/kern/subr_xcall.c:321
#4 0xffffffff809aa122 in pserialize_perform (psz=3D0xfffffe822fbd20e8)=
at /usr/src/sys/kern/subr_pserialize.c:187
#5 0xffffffff809ffb7c in fstrans_setstate (mp=3D0xfffffe822c993008, =
new_state=3Dnew_state@entry=3DFSTRANS_SUSPENDED)
at /usr/src/sys/kern/vfs_trans.c:530
#6 0xffffffff80a17729 in genfs_suspendctl (mp=3D0xfffffe822c993008, =
cmd=3D<optimized out>) at /usr/src/sys/miscfs/genfs/genfs_vfsops.c:=
86
#7 0xffffffff809f781e in VFS_SUSPENDCTL (mp=3Dmp@entry=3D0xfffffe822c9=
93008, =
a=3Da@entry=3D1) at /usr/src/sys/kern/vfs_subr.c:1478
#8 0xffffffff80a00530 in vfs_suspend (mp=3D<optimized out>, =
mp@entry=3D0xfffffe822c993008, nowait=3Dnowait@entry=3D0)
at /usr/src/sys/kern/vfs_trans.c:587
#9 0xffffffff80a01769 in vrevoke_suspend_next (lastmp=3D<optimized out=
>, =
thismp=3D0xfffffe822c993008) at /usr/src/sys/kern/vfs_vnode.c:978
#10 0xffffffff80a030ed in vrevoke (vp=3D0xfffffe8221e36690)
at /usr/src/sys/kern/vfs_vnode.c:1002
#11 0xffffffff80a17caa in genfs_revoke (v=3D<optimized out>)
at /usr/src/sys/miscfs/genfs/genfs_vnops.c:273
#12 0xffffffff80a0e4f7 in VOP_REVOKE (vp=3D0xfffffe8221e36690, =
flags=3Dflags@entry=3D1) at /usr/src/sys/kern/vnode_if.c:744
#13 0xffffffff809cfb00 in pty_grant_slave (l=3Dl@entry=3D0xfffffe821faa=
60c0, =
dev=3D<optimized out>, mp=3D<optimized out>) at /usr/src/sys/kern/t=
ty_ptm.c:245
#14 0xffffffff809cfd7b in ptmioctl (dev=3D<optimized out>, cmd=3D<optim=
ized out>, =
data=3D0xfffffe822d624008, flag=3D<optimized out>, l=3D0xfffffe821f=
aa60c0)
at /usr/src/sys/kern/tty_ptm.c:397
#15 0xffffffff80996a52 in cdev_ioctl (dev=3D42241, cmd=3D1208513606, =
data=3D0xfffffe822d624008, flag=3D3, l=3D0xfffffe821faa60c0)
at /usr/src/sys/kern/subr_devsw.c:938
#16 0xffffffff80a0e2b8 in VOP_IOCTL (vp=3Dvp@entry=3D0xfffffe822caabd20=
, =
command=3Dcommand@entry=3D1208513606, data=3Ddata@entry=3D0xfffffe8=
22d624008, =
fflag=3D<optimized out>, cred=3D<optimized out>)
at /usr/src/sys/kern/vnode_if.c:610
#17 0xffffffff80a05e1e in vn_ioctl (fp=3D0xfffffe821d011a40, com=3D1208=
513606, =
data=3D0xfffffe822d624008) at /usr/src/sys/kern/vfs_vnops.c:765
#18 0xffffffff809b4e81 in sys_ioctl (l=3D<optimized out>, =
uap=3D0xffff80009ed4ef00, retval=3D<optimized out>)
at /usr/src/sys/kern/sys_generic.c:671
#19 0xffffffff80248dbd in sy_call (rval=3D0xffff80009ed4eeb0, =
uap=3D0xffff80009ed4ef00, l=3D0xfffffe821faa60c0, =
sy=3D0xffffffff8147def0 <sysent+1296>) at /usr/src/sys/sys/syscallv=
ar.h:65
#20 sy_invoke (code=3D54, rval=3D0xffff80009ed4eeb0, uap=3D0xffff80009e=
d4ef00, =
l=3D0xfffffe821faa60c0, sy=3D0xffffffff8147def0 <sysent+1296>)
at /usr/src/sys/sys/syscallvar.h:94
#21 syscall (frame=3D0xffff80009ed4ef00)
at /usr/src/sys/arch/x86/x86/syscall.c:144
#22 0xffffffff8020768d in handle_syscall ()
#23 0x0000000000000003 in ?? ()
#24 0x0000000048087446 in ?? ()
#25 0x00007f7fff318360 in ?? ()
#26 0x0000000000000000 in ?? ()
(gdb)
(gdb) kvm proc 0xfffffe82045da540
0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe82045da540)
at /usr/src/sys/kern/kern_synch.c:720
720 prevlwp =3D cpu_switchto(l, newl, returning);
(gdb) where
#0 0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe82045da540)
at /usr/src/sys/kern/kern_synch.c:720
#1 0xffffffff8097d5fd in sleepq_block (timo=3Dtimo@entry=3D0, =
catch_p=3Dcatch_p@entry=3Dfalse) at /usr/src/sys/kern/kern_sleepq.c=
:264
#2 0xffffffff8098b761 in turnstile_block (ts=3D<optimized out>, =
ts@entry=3D0xfffffe82123900c8, q=3Dq@entry=3D1, =
obj=3Dobj@entry=3D0xffffffff815cb9b0 <fstrans_lock>, =
sobj=3Dsobj@entry=3D0xffffffff814821a0 <mutex_syncobj>)
at /usr/src/sys/kern/kern_turnstile.c:430
#3 0xffffffff80965a59 in mutex_vector_enter (
mtx=3D0xffffffff815cb9b0 <fstrans_lock>)
at /usr/src/sys/kern/kern_mutex.c:693
#4 0xffffffff809fef2d in _fstrans_start (wait=3D1, lock_type=3DFSTRANS=
_SHARED, =
mp=3D<optimized out>) at /usr/src/sys/kern/vfs_trans.c:399
#5 fstrans_start (mp=3D<optimized out>) at /usr/src/sys/kern/vfs_trans=
.c:414
#6 0xffffffff80a0ed1b in vop_pre (vp=3D0xfffffe821a9bc7e0, =
vp=3D0xfffffe821a9bc7e0, op=3DFST_YES, mpsafe=3D<synthetic pointer>=
, =
mp=3D<synthetic pointer>) at /usr/src/sys/kern/vnode_if.c:77
#7 VOP_LOCK (vp=3Dvp@entry=3D0xfffffe821a9bc7e0, flags=3Dflags@entry=3D=
131074)
at /usr/src/sys/kern/vnode_if.c:1281
#8 0xffffffff80a05846 in vn_lock (vp=3Dvp@entry=3D0xfffffe821a9bc7e0, =
flags=3Dflags@entry=3D131074) at /usr/src/sys/kern/vfs_vnops.c:1036=
#9 0xffffffff80a0601d in vn_write (fp=3D<optimized out>, =
offset=3D0xfffffe821ed94300, uio=3D0xffff80009f6c6df0, =
cred=3D0xfffffe8220120e40, flags=3D1) at /usr/src/sys/kern/vfs_vnop=
s.c:592
#10 0xffffffff809b4c1d in dofilewrite (fd=3Dfd@entry=3D2, fp=3D0xfffffe=
821ed94300, =
buf=3D0x7f7fff0d1230, nbyte=3D102, offset=3D<optimized out>, =
flags=3Dflags@entry=3D1, retval=3Dretval@entry=3D0xffff80009f6c6eb0=
)
at /usr/src/sys/kern/sys_generic.c:350
#11 0xffffffff809b4d22 in sys_write (l=3D<optimized out>, =
uap=3D0xffff80009f6c6f00, retval=3D0xffff80009f6c6eb0)
at /usr/src/sys/kern/sys_generic.c:318
#12 0xffffffff80248dbd in sy_call (rval=3D0xffff80009f6c6eb0, =
uap=3D0xffff80009f6c6f00, l=3D0xfffffe82045da540, =
sy=3D0xffffffff8147da40 <sysent+96>) at /usr/src/sys/sys/syscallvar=
.h:65
#13 sy_invoke (code=3D4, rval=3D0xffff80009f6c6eb0, uap=3D0xffff80009f6=
c6f00, =
l=3D0xfffffe82045da540, sy=3D0xffffffff8147da40 <sysent+96>)
at /usr/src/sys/sys/syscallvar.h:94
#14 syscall (frame=3D0xffff80009f6c6f00)
at /usr/src/sys/arch/x86/x86/syscall.c:144
#15 0xffffffff8020768d in handle_syscall ()
#16 0x0000000000000002 in ?? ()
#17 0x00007f7fff0d1230 in ?? ()
#18 0x0000000000000066 in ?? ()
#19 0x00007f7fff0d129a in ?? ()
#20 0x0101010101010101 in ?? ()
#21 0x00007f7fff0d128c in ?? ()
#22 0x0000000000000000 in ?? ()
(gdb)
(gdb) kvm proc 0xfffffe8216d35140
0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe8216d35140)
at /usr/src/sys/kern/kern_synch.c:720
720 prevlwp =3D cpu_switchto(l, newl, returning);
(gdb) where
#0 0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe8216d35140)
at /usr/src/sys/kern/kern_synch.c:720
#1 0xffffffff8097d5fd in sleepq_block (timo=3Dtimo@entry=3D0, =
catch_p=3Dcatch_p@entry=3Dfalse) at /usr/src/sys/kern/kern_sleepq.c=
:264
#2 0xffffffff8098b761 in turnstile_block (ts=3D<optimized out>, ts@ent=
ry=3D0x0, =
q=3Dq@entry=3D1, obj=3Dobj@entry=3D0xffffffff815cb9b0 <fstrans_lock=
>, =
sobj=3Dsobj@entry=3D0xffffffff814821a0 <mutex_syncobj>)
at /usr/src/sys/kern/kern_turnstile.c:430
#3 0xffffffff80965a59 in mutex_vector_enter (
mtx=3D0xffffffff815cb9b0 <fstrans_lock>)
at /usr/src/sys/kern/kern_mutex.c:693
#4 0xffffffff809fec40 in fstrans_alloc_lwp_info (mp=3D0xfffffe822c9930=
08)
at /usr/src/sys/kern/vfs_trans.c:274
#5 fstrans_get_lwp_info (do_alloc=3Dtrue, mp=3D0xfffffe822c993008)
at /usr/src/sys/kern/vfs_trans.c:331
#6 _fstrans_start (wait=3D1, lock_type=3DFSTRANS_SHARED, mp=3D<optimiz=
ed out>)
at /usr/src/sys/kern/vfs_trans.c:375
#7 fstrans_start (mp=3D<optimized out>) at /usr/src/sys/kern/vfs_trans=
.c:414
#8 0xffffffff80a0e399 in vop_pre (vp=3D0xfffffe82226253f0, =
vp=3D0xfffffe82226253f0, op=3DFST_YES, mpsafe=3D<synthetic pointer>=
, =
mp=3D<synthetic pointer>) at /usr/src/sys/kern/vnode_if.c:77
#9 VOP_POLL (vp=3D0xfffffe82226253f0, events=3D<optimized out>)
at /usr/src/sys/kern/vnode_if.c:677
#10 0xffffffff809bd7e8 in selscan (retval=3D0xffff80009f6eaeb0, ni=3D0,=
nfd=3D5, =
bits=3D0xffff80009f6ead48 "\030") at /usr/src/sys/kern/sys_select.c=
:402
#11 sel_do_scan (op=3Dop@entry=3D1, fds=3Dfds@entry=3D0xffff80009f6ead4=
8, =
nf=3Dnf@entry=3D5, ni=3Dni@entry=3D4, ts=3Dts@entry=3D0x0, mask=3Dm=
ask@entry=3D0x0, =
retval=3Dretval@entry=3D0xffff80009f6eaeb0)
at /usr/src/sys/kern/sys_select.c:264
#12 0xffffffff809bdb96 in selcommon (retval=3Dretval@entry=3D0xffff8000=
9f6eaeb0, =
nd=3D5, u_in=3D0x7b32875fff40, u_ou=3D0x7b32875fff60, u_ex=3D0x7b32=
875fff80, =
ts=3D0x0, mask=3Dmask@entry=3D0x0) at /usr/src/sys/kern/sys_select.=
c:362
#13 0xffffffff809bdeab in selcommon (mask=3D0x0, ts=3D<optimized out>, =
u_ex=3D<optimized out>, u_ou=3D<optimized out>, u_in=3D<optimized o=
ut>, =
nd=3D<optimized out>, retval=3D0xffff80009f6eaeb0)
at /usr/src/sys/kern/sys_select.c:337
#14 sys___select50 (l=3D<optimized out>, uap=3D0xffff80009f6eaf00, =
retval=3D0xffff80009f6eaeb0) at /usr/src/sys/kern/sys_select.c:212
#15 0xffffffff80248dbd in sy_call (rval=3D0xffff80009f6eaeb0, =
uap=3D0xffff80009f6eaf00, l=3D0xfffffe8216d35140, =
sy=3D0xffffffff814800f8 <sysent+10008>) at /usr/src/sys/sys/syscall=
var.h:65
#16 sy_invoke (code=3D417, rval=3D0xffff80009f6eaeb0, uap=3D0xffff80009=
f6eaf00, =
l=3D0xfffffe8216d35140, sy=3D0xffffffff814800f8 <sysent+10008>)
at /usr/src/sys/sys/syscallvar.h:94
#17 syscall (frame=3D0xffff80009f6eaf00)
at /usr/src/sys/arch/x86/x86/syscall.c:144
#18 0xffffffff8020768d in handle_syscall ()
#19 0x0000000000000005 in ?? ()
#20 0x00007b32875fff40 in ?? ()
#21 0x00007b32875fff60 in ?? ()
#22 0x00007b32875fff80 in ?? ()
#23 0x0000000000000000 in ?? ()
(gdb)
(gdb) kvm proc 0xfffffe82214bf2c0
0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe82214bf2c0)
at /usr/src/sys/kern/kern_synch.c:720
720 prevlwp =3D cpu_switchto(l, newl, returning);
(gdb) where
#0 0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe82214bf2c0)
at /usr/src/sys/kern/kern_synch.c:720
#1 0xffffffff8097d5fd in sleepq_block (timo=3Dtimo@entry=3D0, =
catch_p=3Dcatch_p@entry=3Dfalse) at /usr/src/sys/kern/kern_sleepq.c=
:264
#2 0xffffffff8094afca in cv_wait (cv=3Dcv@entry=3D0xfffffe8221620998, =
mtx=3Dmtx@entry=3D0xfffffe8221620a00) at /usr/src/sys/kern/kern_con=
dvar.c:217
#3 0xffffffff8094e4e5 in fd_close (fd=3D<optimized out>)
at /usr/src/sys/kern/kern_descrip.c:684
#4 0xffffffff809b3c88 in sys_close (l=3D0xfffffe82214bf2c0, =
uap=3D0xffff80009ef1df00, retval=3D<optimized out>)
at /usr/src/sys/kern/sys_descrip.c:488
#5 0xffffffff80248dbd in sy_call (rval=3D0xffff80009ef1deb0, =
uap=3D0xffff80009ef1df00, l=3D0xfffffe82214bf2c0, =
sy=3D0xffffffff8147da70 <sysent+144>) at /usr/src/sys/sys/syscallva=
r.h:65
#6 sy_invoke (code=3D6, rval=3D0xffff80009ef1deb0, uap=3D0xffff80009ef=
1df00, =
l=3D0xfffffe82214bf2c0, sy=3D0xffffffff8147da70 <sysent+144>)
at /usr/src/sys/sys/syscallvar.h:94
#7 syscall (frame=3D0xffff80009ef1df00)
at /usr/src/sys/arch/x86/x86/syscall.c:144
#8 0xffffffff8020768d in handle_syscall ()
#9 0x0000000000000004 in ?? ()
#10 0x0000000000000000 in ?? ()
(gdb)
(gdb) kvm proc 0xfffffe8225709000
0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe8225709000)
at /usr/src/sys/kern/kern_synch.c:720
720 prevlwp =3D cpu_switchto(l, newl, returning);
(gdb) where
#0 0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe8225709000)
at /usr/src/sys/kern/kern_synch.c:720
#1 0xffffffff8097d5fd in sleepq_block (timo=3Dtimo@entry=3D0, =
catch_p=3Dcatch_p@entry=3Dfalse) at /usr/src/sys/kern/kern_sleepq.c=
:264
#2 0xffffffff8098b761 in turnstile_block (ts=3D<optimized out>, =
ts@entry=3D0xfffffe82123900c8, q=3Dq@entry=3D1, =
obj=3Dobj@entry=3D0xffffffff815cb9b0 <fstrans_lock>, =
sobj=3Dsobj@entry=3D0xffffffff814821a0 <mutex_syncobj>)
at /usr/src/sys/kern/kern_turnstile.c:430
#3 0xffffffff80965a59 in mutex_vector_enter (
mtx=3D0xffffffff815cb9b0 <fstrans_lock>)
at /usr/src/sys/kern/kern_mutex.c:693
#4 0xffffffff809fef2d in _fstrans_start (wait=3D1, lock_type=3DFSTRANS=
_SHARED, =
mp=3D<optimized out>) at /usr/src/sys/kern/vfs_trans.c:399
#5 fstrans_start (mp=3D<optimized out>) at /usr/src/sys/kern/vfs_trans=
.c:414
#6 0xffffffff80a0e399 in vop_pre (vp=3D0xfffffe82220a8690, =
vp=3D0xfffffe82220a8690, op=3DFST_YES, mpsafe=3D<synthetic pointer>=
, =
mp=3D<synthetic pointer>) at /usr/src/sys/kern/vnode_if.c:77
#7 VOP_POLL (vp=3D0xfffffe82220a8690, events=3D<optimized out>)
at /usr/src/sys/kern/vnode_if.c:677
#8 0xffffffff809bd7e8 in selscan (retval=3D0xffff80009e90eeb0, ni=3D0,=
nfd=3D5, =
bits=3D0xffff80009e90ed48 "\030") at /usr/src/sys/kern/sys_select.c=
:402
#9 sel_do_scan (op=3Dop@entry=3D1, fds=3Dfds@entry=3D0xffff80009e90ed4=
8, =
nf=3Dnf@entry=3D5, ni=3Dni@entry=3D4, ts=3Dts@entry=3D0x0, mask=3Dm=
ask@entry=3D0x0, =
retval=3Dretval@entry=3D0xffff80009e90eeb0)
at /usr/src/sys/kern/sys_select.c:264
#10 0xffffffff809bdb96 in selcommon (retval=3Dretval@entry=3D0xffff8000=
9e90eeb0, =
nd=3D5, u_in=3D0x7aeb665fff40, u_ou=3D0x7aeb665fff60, u_ex=3D0x7aeb=
665fff80, =
ts=3D0x0, mask=3Dmask@entry=3D0x0) at /usr/src/sys/kern/sys_select.=
c:362
#11 0xffffffff809bdeab in selcommon (mask=3D0x0, ts=3D<optimized out>, =
u_ex=3D<optimized out>, u_ou=3D<optimized out>, u_in=3D<optimized o=
ut>, =
nd=3D<optimized out>, retval=3D0xffff80009e90eeb0)
at /usr/src/sys/kern/sys_select.c:337
#12 sys___select50 (l=3D<optimized out>, uap=3D0xffff80009e90ef00, =
retval=3D0xffff80009e90eeb0) at /usr/src/sys/kern/sys_select.c:212
#13 0xffffffff80248dbd in sy_call (rval=3D0xffff80009e90eeb0, =
uap=3D0xffff80009e90ef00, l=3D0xfffffe8225709000, =
sy=3D0xffffffff814800f8 <sysent+10008>) at /usr/src/sys/sys/syscall=
var.h:65
#14 sy_invoke (code=3D417, rval=3D0xffff80009e90eeb0, uap=3D0xffff80009=
e90ef00, =
l=3D0xfffffe8225709000, sy=3D0xffffffff814800f8 <sysent+10008>)
at /usr/src/sys/sys/syscallvar.h:94
#15 syscall (frame=3D0xffff80009e90ef00)
at /usr/src/sys/arch/x86/x86/syscall.c:144
#16 0xffffffff8020768d in handle_syscall ()
#17 0x0000000000000005 in ?? ()
#18 0x00007aeb665fff40 in ?? ()
#19 0x00007aeb665fff60 in ?? ()
#20 0x00007aeb665fff80 in ?? ()
#21 0x0000000000000000 in ?? ()
(gdb)
(gdb) kvm proc 0xfffffe820df34480
0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe820df34480)
at /usr/src/sys/kern/kern_synch.c:720
720 prevlwp =3D cpu_switchto(l, newl, returning);
(gdb) where
#0 0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe820df34480)
at /usr/src/sys/kern/kern_synch.c:720
#1 0xffffffff8097d5fd in sleepq_block (timo=3Dtimo@entry=3D0, =
catch_p=3Dcatch_p@entry=3Dfalse) at /usr/src/sys/kern/kern_sleepq.c=
:264
#2 0xffffffff8094afca in cv_wait (cv=3Dcv@entry=3D0xfffffe8207461358, =
mtx=3Dmtx@entry=3D0xfffffe82074613c0) at /usr/src/sys/kern/kern_con=
dvar.c:217
#3 0xffffffff8094e4e5 in fd_close (fd=3D<optimized out>)
at /usr/src/sys/kern/kern_descrip.c:684
#4 0xffffffff809b3c88 in sys_close (l=3D0xfffffe820df34480, =
uap=3D0xffff80009f668f00, retval=3D<optimized out>)
at /usr/src/sys/kern/sys_descrip.c:488
#5 0xffffffff80248dbd in sy_call (rval=3D0xffff80009f668eb0, =
uap=3D0xffff80009f668f00, l=3D0xfffffe820df34480, =
sy=3D0xffffffff8147da70 <sysent+144>) at /usr/src/sys/sys/syscallva=
r.h:65
#6 sy_invoke (code=3D6, rval=3D0xffff80009f668eb0, uap=3D0xffff80009f6=
68f00, =
l=3D0xfffffe820df34480, sy=3D0xffffffff8147da70 <sysent+144>)
at /usr/src/sys/sys/syscallvar.h:94
#7 syscall (frame=3D0xffff80009f668f00)
at /usr/src/sys/arch/x86/x86/syscall.c:144
#8 0xffffffff8020768d in handle_syscall ()
#9 0x0000000000000004 in ?? ()
#10 0x0000000000000000 in ?? ()
(gdb)
(gdb) kvm proc 0xfffffe8207fd0360
0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe8207fd0360)
at /usr/src/sys/kern/kern_synch.c:720
720 prevlwp =3D cpu_switchto(l, newl, returning);
(gdb) where
#0 0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe8207fd0360)
at /usr/src/sys/kern/kern_synch.c:720
#1 0xffffffff8097d5fd in sleepq_block (timo=3Dtimo@entry=3D0, =
catch_p=3Dcatch_p@entry=3Dfalse) at /usr/src/sys/kern/kern_sleepq.c=
:264
#2 0xffffffff8098b761 in turnstile_block (ts=3D<optimized out>, =
ts@entry=3D0xfffffe82123900c8, q=3Dq@entry=3D1, =
obj=3Dobj@entry=3D0xffffffff815cb9b0 <fstrans_lock>, =
sobj=3Dsobj@entry=3D0xffffffff814821a0 <mutex_syncobj>)
at /usr/src/sys/kern/kern_turnstile.c:430
#3 0xffffffff80965a59 in mutex_vector_enter (
mtx=3D0xffffffff815cb9b0 <fstrans_lock>)
at /usr/src/sys/kern/kern_mutex.c:693
#4 0xffffffff809fef2d in _fstrans_start (wait=3D1, lock_type=3DFSTRANS=
_SHARED, =
mp=3D<optimized out>) at /usr/src/sys/kern/vfs_trans.c:399
#5 fstrans_start (mp=3D<optimized out>) at /usr/src/sys/kern/vfs_trans=
.c:414
#6 0xffffffff80a0e399 in vop_pre (vp=3D0xfffffe822122fa88, =
vp=3D0xfffffe822122fa88, op=3DFST_YES, mpsafe=3D<synthetic pointer>=
, =
mp=3D<synthetic pointer>) at /usr/src/sys/kern/vnode_if.c:77
#7 VOP_POLL (vp=3D0xfffffe822122fa88, events=3D<optimized out>)
at /usr/src/sys/kern/vnode_if.c:677
#8 0xffffffff809bd7e8 in selscan (retval=3D0xffff80009f5f9eb0, ni=3D0,=
nfd=3D5, =
bits=3D0xffff80009f5f9d48 "\030") at /usr/src/sys/kern/sys_select.c=
:402
#9 sel_do_scan (op=3Dop@entry=3D1, fds=3Dfds@entry=3D0xffff80009f5f9d4=
8, =
nf=3Dnf@entry=3D5, ni=3Dni@entry=3D4, ts=3Dts@entry=3D0x0, mask=3Dm=
ask@entry=3D0x0, =
retval=3Dretval@entry=3D0xffff80009f5f9eb0)
at /usr/src/sys/kern/sys_select.c:264
#10 0xffffffff809bdb96 in selcommon (retval=3Dretval@entry=3D0xffff8000=
9f5f9eb0, =
nd=3D5, u_in=3D0x7d66527fff40, u_ou=3D0x7d66527fff60, u_ex=3D0x7d66=
527fff80, =
ts=3D0x0, mask=3Dmask@entry=3D0x0) at /usr/src/sys/kern/sys_select.=
c:362
#11 0xffffffff809bdeab in selcommon (mask=3D0x0, ts=3D<optimized out>, =
u_ex=3D<optimized out>, u_ou=3D<optimized out>, u_in=3D<optimized o=
ut>, =
nd=3D<optimized out>, retval=3D0xffff80009f5f9eb0)
at /usr/src/sys/kern/sys_select.c:337
#12 sys___select50 (l=3D<optimized out>, uap=3D0xffff80009f5f9f00, =
retval=3D0xffff80009f5f9eb0) at /usr/src/sys/kern/sys_select.c:212
#13 0xffffffff80248dbd in sy_call (rval=3D0xffff80009f5f9eb0, =
uap=3D0xffff80009f5f9f00, l=3D0xfffffe8207fd0360, =
sy=3D0xffffffff814800f8 <sysent+10008>) at /usr/src/sys/sys/syscall=
var.h:65
#14 sy_invoke (code=3D417, rval=3D0xffff80009f5f9eb0, uap=3D0xffff80009=
f5f9f00, =
l=3D0xfffffe8207fd0360, sy=3D0xffffffff814800f8 <sysent+10008>)
at /usr/src/sys/sys/syscallvar.h:94
#15 syscall (frame=3D0xffff80009f5f9f00)
at /usr/src/sys/arch/x86/x86/syscall.c:144
#16 0xffffffff8020768d in handle_syscall ()
#17 0x0000000000000005 in ?? ()
#18 0x00007d66527fff40 in ?? ()
#19 0x00007d66527fff60 in ?? ()
#20 0x00007d66527fff80 in ?? ()
#21 0x0000000000000000 in ?? ()
(gdb)
(gdb) kvm proc 0xfffffe822346f080
0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe822346f080)
at /usr/src/sys/kern/kern_synch.c:720
720 prevlwp =3D cpu_switchto(l, newl, returning);
(gdb) where
#0 0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe822346f080)
at /usr/src/sys/kern/kern_synch.c:720
#1 0xffffffff8097d5fd in sleepq_block (timo=3Dtimo@entry=3D0, =
catch_p=3Dcatch_p@entry=3Dfalse) at /usr/src/sys/kern/kern_sleepq.c=
:264
#2 0xffffffff8094afca in cv_wait (cv=3Dcv@entry=3D0xfffffe82243bfc18, =
mtx=3Dmtx@entry=3D0xfffffe82243bfc80) at /usr/src/sys/kern/kern_con=
dvar.c:217
#3 0xffffffff8094e4e5 in fd_close (fd=3D<optimized out>)
at /usr/src/sys/kern/kern_descrip.c:684
#4 0xffffffff809b3c88 in sys_close (l=3D0xfffffe822346f080, =
uap=3D0xffff80009efd4f00, retval=3D<optimized out>)
at /usr/src/sys/kern/sys_descrip.c:488
#5 0xffffffff80248dbd in sy_call (rval=3D0xffff80009efd4eb0, =
uap=3D0xffff80009efd4f00, l=3D0xfffffe822346f080, =
sy=3D0xffffffff8147da70 <sysent+144>) at /usr/src/sys/sys/syscallva=
r.h:65
#6 sy_invoke (code=3D6, rval=3D0xffff80009efd4eb0, uap=3D0xffff80009ef=
d4f00, =
l=3D0xfffffe822346f080, sy=3D0xffffffff8147da70 <sysent+144>)
at /usr/src/sys/sys/syscallvar.h:94
#7 syscall (frame=3D0xffff80009efd4f00)
at /usr/src/sys/arch/x86/x86/syscall.c:144
#8 0xffffffff8020768d in handle_syscall ()
#9 0x0000000000000004 in ?? ()
#10 0x0000000000000000 in ?? ()
(gdb)
(gdb) kvm proc 0xfffffe821d987a40
0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe821d987a40)
at /usr/src/sys/kern/kern_synch.c:720
720 prevlwp =3D cpu_switchto(l, newl, returning);
(gdb) where
#0 0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe821d987a40)
at /usr/src/sys/kern/kern_synch.c:720
#1 0xffffffff8097d5fd in sleepq_block (timo=3Dtimo@entry=3D0, =
catch_p=3Dcatch_p@entry=3Dfalse) at /usr/src/sys/kern/kern_sleepq.c=
:264
#2 0xffffffff8098b761 in turnstile_block (ts=3D<optimized out>, =
ts@entry=3D0xfffffe82123900c8, q=3Dq@entry=3D1, =
obj=3Dobj@entry=3D0xffffffff815cb9b0 <fstrans_lock>, =
sobj=3Dsobj@entry=3D0xffffffff814821a0 <mutex_syncobj>)
at /usr/src/sys/kern/kern_turnstile.c:430
#3 0xffffffff80965a59 in mutex_vector_enter (
mtx=3D0xffffffff815cb9b0 <fstrans_lock>)
at /usr/src/sys/kern/kern_mutex.c:693
#4 0xffffffff809fef2d in _fstrans_start (wait=3D1, lock_type=3DFSTRANS=
_SHARED, =
mp=3D<optimized out>) at /usr/src/sys/kern/vfs_trans.c:399
#5 fstrans_start (mp=3D<optimized out>) at /usr/src/sys/kern/vfs_trans=
.c:414
#6 0xffffffff80a0e399 in vop_pre (vp=3D0xfffffe820ecde930, =
vp=3D0xfffffe820ecde930, op=3DFST_YES, mpsafe=3D<synthetic pointer>=
, =
mp=3D<synthetic pointer>) at /usr/src/sys/kern/vnode_if.c:77
#7 VOP_POLL (vp=3D0xfffffe820ecde930, events=3D<optimized out>)
at /usr/src/sys/kern/vnode_if.c:677
#8 0xffffffff809bd7e8 in selscan (retval=3D0xffff80009ee64eb0, ni=3D0,=
nfd=3D5, =
bits=3D0xffff80009ee64d48 "\030") at /usr/src/sys/kern/sys_select.c=
:402
#9 sel_do_scan (op=3Dop@entry=3D1, fds=3Dfds@entry=3D0xffff80009ee64d4=
8, =
nf=3Dnf@entry=3D5, ni=3Dni@entry=3D4, ts=3Dts@entry=3D0x0, mask=3Dm=
ask@entry=3D0x0, =
retval=3Dretval@entry=3D0xffff80009ee64eb0)
at /usr/src/sys/kern/sys_select.c:264
#10 0xffffffff809bdb96 in selcommon (retval=3Dretval@entry=3D0xffff8000=
9ee64eb0, =
nd=3D5, u_in=3D0x7ea7fb7fff40, u_ou=3D0x7ea7fb7fff60, u_ex=3D0x7ea7=
fb7fff80, =
ts=3D0x0, mask=3Dmask@entry=3D0x0) at /usr/src/sys/kern/sys_select.=
c:362
#11 0xffffffff809bdeab in selcommon (mask=3D0x0, ts=3D<optimized out>, =
u_ex=3D<optimized out>, u_ou=3D<optimized out>, u_in=3D<optimized o=
ut>, =
nd=3D<optimized out>, retval=3D0xffff80009ee64eb0)
at /usr/src/sys/kern/sys_select.c:337
#12 sys___select50 (l=3D<optimized out>, uap=3D0xffff80009ee64f00, =
retval=3D0xffff80009ee64eb0) at /usr/src/sys/kern/sys_select.c:212
#13 0xffffffff80248dbd in sy_call (rval=3D0xffff80009ee64eb0, =
uap=3D0xffff80009ee64f00, l=3D0xfffffe821d987a40, =
sy=3D0xffffffff814800f8 <sysent+10008>) at /usr/src/sys/sys/syscall=
var.h:65
#14 sy_invoke (code=3D417, rval=3D0xffff80009ee64eb0, uap=3D0xffff80009=
ee64f00, =
l=3D0xfffffe821d987a40, sy=3D0xffffffff814800f8 <sysent+10008>)
at /usr/src/sys/sys/syscallvar.h:94
#15 syscall (frame=3D0xffff80009ee64f00)
at /usr/src/sys/arch/x86/x86/syscall.c:144
#16 0xffffffff8020768d in handle_syscall ()
#17 0x0000000000000005 in ?? ()
#18 0x00007ea7fb7fff40 in ?? ()
#19 0x00007ea7fb7fff60 in ?? ()
#20 0x00007ea7fb7fff80 in ?? ()
#21 0x0000000000000000 in ?? ()
(gdb)
(gdb) kvm proc 0xfffffe821e90c240
0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe821e90c240)
at /usr/src/sys/kern/kern_synch.c:720
720 prevlwp =3D cpu_switchto(l, newl, returning);
(gdb) where
#0 0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe821e90c240)
at /usr/src/sys/kern/kern_synch.c:720
#1 0xffffffff8097d5fd in sleepq_block (timo=3Dtimo@entry=3D0, =
catch_p=3Dcatch_p@entry=3Dfalse) at /usr/src/sys/kern/kern_sleepq.c=
:264
#2 0xffffffff8094afca in cv_wait (cv=3Dcv@entry=3D0xfffffe822400e918, =
mtx=3Dmtx@entry=3D0xfffffe822400e980) at /usr/src/sys/kern/kern_con=
dvar.c:217
#3 0xffffffff8094e4e5 in fd_close (fd=3D<optimized out>)
at /usr/src/sys/kern/kern_descrip.c:684
#4 0xffffffff809b3c88 in sys_close (l=3D0xfffffe821e90c240, =
uap=3D0xffff80009ee94f00, retval=3D<optimized out>)
at /usr/src/sys/kern/sys_descrip.c:488
#5 0xffffffff80248dbd in sy_call (rval=3D0xffff80009ee94eb0, =
uap=3D0xffff80009ee94f00, l=3D0xfffffe821e90c240, =
sy=3D0xffffffff8147da70 <sysent+144>) at /usr/src/sys/sys/syscallva=
r.h:65
#6 sy_invoke (code=3D6, rval=3D0xffff80009ee94eb0, uap=3D0xffff80009ee=
94f00, =
l=3D0xfffffe821e90c240, sy=3D0xffffffff8147da70 <sysent+144>)
at /usr/src/sys/sys/syscallvar.h:94
#7 syscall (frame=3D0xffff80009ee94f00)
at /usr/src/sys/arch/x86/x86/syscall.c:144
#8 0xffffffff8020768d in handle_syscall ()
#9 0x0000000000000004 in ?? ()
#10 0x0000000000000000 in ?? ()
(gdb)
(gdb) kvm proc 0xfffffe821d362980
0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe821d362980)
at /usr/src/sys/kern/kern_synch.c:720
720 prevlwp =3D cpu_switchto(l, newl, returning);
(gdb) where
#0 0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe821d362980)
at /usr/src/sys/kern/kern_synch.c:720
#1 0xffffffff8097d5fd in sleepq_block (timo=3Dtimo@entry=3D0, =
catch_p=3Dcatch_p@entry=3Dfalse) at /usr/src/sys/kern/kern_sleepq.c=
:264
#2 0xffffffff8098b761 in turnstile_block (ts=3D<optimized out>, =
ts@entry=3D0xfffffe821f9db480, q=3Dq@entry=3D1, =
obj=3Dobj@entry=3D0xfffffe8224a7b130, =
sobj=3Dsobj@entry=3D0xffffffff81482720 <rw_syncobj>)
at /usr/src/sys/kern/kern_turnstile.c:430
#3 0xffffffff80977cb3 in rw_vector_enter (rw=3D0xfffffe8224a7b130, op=3D=
RW_WRITER)
at /usr/src/sys/kern/kern_rwlock.c:395
#4 0xffffffff80a17d7e in genfs_lock (v=3D<optimized out>)
at /usr/src/sys/miscfs/genfs/genfs_vnops.c:343
#5 0xffffffff80a0ed35 in VOP_LOCK (vp=3Dvp@entry=3D0xfffffe8224a7b000,=
=
flags=3Dflags@entry=3D131074) at /usr/src/sys/kern/vnode_if.c:1284
#6 0xffffffff80a05846 in vn_lock (vp=3Dvp@entry=3D0xfffffe8224a7b000, =
flags=3Dflags@entry=3D131074) at /usr/src/sys/kern/vfs_vnops.c:1036=
#7 0xffffffff80a0601d in vn_write (fp=3D<optimized out>, =
offset=3D0xfffffe8225588b00, uio=3D0xffff80009edaedf0, =
cred=3D0xfffffe822f724f00, flags=3D1) at /usr/src/sys/kern/vfs_vnop=
s.c:592
#8 0xffffffff809b4c1d in dofilewrite (fd=3Dfd@entry=3D2, fp=3D0xfffffe=
8225588b00, =
buf=3D0x764fb6902000, nbyte=3D94, offset=3D<optimized out>, flags=3D=
flags@entry=3D1, =
retval=3Dretval@entry=3D0xffff80009edaeeb0)
at /usr/src/sys/kern/sys_generic.c:350
#9 0xffffffff809b4d22 in sys_write (l=3D<optimized out>, =
uap=3D0xffff80009edaef00, retval=3D0xffff80009edaeeb0)
at /usr/src/sys/kern/sys_generic.c:318
#10 0xffffffff80248dbd in sy_call (rval=3D0xffff80009edaeeb0, =
uap=3D0xffff80009edaef00, l=3D0xfffffe821d362980, =
sy=3D0xffffffff8147da40 <sysent+96>) at /usr/src/sys/sys/syscallvar=
.h:65
#11 sy_invoke (code=3D4, rval=3D0xffff80009edaeeb0, uap=3D0xffff80009ed=
aef00, =
l=3D0xfffffe821d362980, sy=3D0xffffffff8147da40 <sysent+96>)
at /usr/src/sys/sys/syscallvar.h:94
#12 syscall (frame=3D0xffff80009edaef00)
at /usr/src/sys/arch/x86/x86/syscall.c:144
#13 0xffffffff8020768d in handle_syscall ()
#14 0x0000000000000002 in ?? ()
#15 0x0000764fb6902000 in ?? ()
#16 0x000000000000005e in ?? ()
#17 0x0000764fb690205e in ?? ()
#18 0x000000000000001f in ?? ()
#19 0x0000000000000001 in ?? ()
#20 0x0000000000000000 in ?? ()
(gdb)
(gdb) kvm proc 0xfffffe8229b924c0
0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe8229b924c0)
at /usr/src/sys/kern/kern_synch.c:720
720 prevlwp =3D cpu_switchto(l, newl, returning);
(gdb) where
#0 0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe8229b924c0)
at /usr/src/sys/kern/kern_synch.c:720
#1 0xffffffff8097d5fd in sleepq_block (timo=3Dtimo@entry=3D0, =
catch_p=3Dcatch_p@entry=3Dfalse) at /usr/src/sys/kern/kern_sleepq.c=
:264
#2 0xffffffff8098b761 in turnstile_block (ts=3D<optimized out>, =
ts@entry=3D0xfffffe82123900c8, q=3Dq@entry=3D1, =
obj=3Dobj@entry=3D0xffffffff815cb9b0 <fstrans_lock>, =
sobj=3Dsobj@entry=3D0xffffffff814821a0 <mutex_syncobj>)
at /usr/src/sys/kern/kern_turnstile.c:430
#3 0xffffffff80965a59 in mutex_vector_enter (
mtx=3D0xffffffff815cb9b0 <fstrans_lock>)
at /usr/src/sys/kern/kern_mutex.c:693
#4 0xffffffff809fef2d in _fstrans_start (wait=3D1, lock_type=3DFSTRANS=
_SHARED, =
mp=3D<optimized out>) at /usr/src/sys/kern/vfs_trans.c:399
#5 fstrans_start (mp=3D<optimized out>) at /usr/src/sys/kern/vfs_trans=
.c:414
#6 0xffffffff80a0e399 in vop_pre (vp=3D0xfffffe821d7d1690, =
vp=3D0xfffffe821d7d1690, op=3DFST_YES, mpsafe=3D<synthetic pointer>=
, =
mp=3D<synthetic pointer>) at /usr/src/sys/kern/vnode_if.c:77
#7 VOP_POLL (vp=3D0xfffffe821d7d1690, events=3D<optimized out>)
at /usr/src/sys/kern/vnode_if.c:677
#8 0xffffffff809bd7e8 in selscan (retval=3D0xffff80009e9c3eb0, ni=3D36=
39083008, =
nfd=3D48, bits=3D0xffff80009e9c3d48 "\b@\350\330(")
at /usr/src/sys/kern/sys_select.c:402
#9 sel_do_scan (op=3Dop@entry=3D1, fds=3Dfds@entry=3D0xffff80009e9c3d4=
8, =
nf=3Dnf@entry=3D48, ni=3Dni@entry=3D8, ts=3Dts@entry=3D0xffff80009e=
9c3e70, =
mask=3Dmask@entry=3D0x0, retval=3Dretval@entry=3D0xffff80009e9c3eb0=
)
at /usr/src/sys/kern/sys_select.c:264
#10 0xffffffff809bdb96 in selcommon (retval=3Dretval@entry=3D0xffff8000=
9e9c3eb0, =
nd=3D48, u_in=3D0x7f7fff4c5a10, u_ou=3D0x7f7fff4c5a30, u_ex=3D0x0, =
ts=3D0xffff80009e9c3e70, mask=3Dmask@entry=3D0x0)
at /usr/src/sys/kern/sys_select.c:362
#11 0xffffffff809bdeab in selcommon (mask=3D0x0, ts=3D<optimized out>, =
u_ex=3D<optimized out>, u_ou=3D<optimized out>, u_in=3D<optimized o=
ut>, =
nd=3D<optimized out>, retval=3D0xffff80009e9c3eb0)
at /usr/src/sys/kern/sys_select.c:337
#12 sys___select50 (l=3D<optimized out>, uap=3D0xffff80009e9c3f00, =
retval=3D0xffff80009e9c3eb0) at /usr/src/sys/kern/sys_select.c:212
#13 0xffffffff80248dbd in sy_call (rval=3D0xffff80009e9c3eb0, =
uap=3D0xffff80009e9c3f00, l=3D0xfffffe8229b924c0, =
sy=3D0xffffffff814800f8 <sysent+10008>) at /usr/src/sys/sys/syscall=
var.h:65
#14 sy_invoke (code=3D417, rval=3D0xffff80009e9c3eb0, uap=3D0xffff80009=
e9c3f00, =
l=3D0xfffffe8229b924c0, sy=3D0xffffffff814800f8 <sysent+10008>)
at /usr/src/sys/sys/syscallvar.h:94
#15 syscall (frame=3D0xffff80009e9c3f00)
at /usr/src/sys/arch/x86/x86/syscall.c:144
#16 0xffffffff8020768d in handle_syscall ()
#17 0x0000000000000030 in ?? ()
#18 0x00007f7fff4c5a10 in ?? ()
#19 0x00007f7fff4c5a30 in ?? ()
#20 0x0000000000000000 in ?? ()
(gdb)
(gdb) kvm proc 0xfffffe8220b8e780
0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe8220b8e780)
at /usr/src/sys/kern/kern_synch.c:720
720 prevlwp =3D cpu_switchto(l, newl, returning);
(gdb) where
#0 0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe8220b8e780)
at /usr/src/sys/kern/kern_synch.c:720
#1 0xffffffff8097d5fd in sleepq_block (timo=3Dtimo@entry=3D0, =
catch_p=3Dcatch_p@entry=3Dfalse) at /usr/src/sys/kern/kern_sleepq.c=
:264
#2 0xffffffff8098b761 in turnstile_block (ts=3D<optimized out>, ts@ent=
ry=3D0x0, =
q=3Dq@entry=3D1, obj=3Dobj@entry=3D0xfffffe8224a7b130, =
sobj=3Dsobj@entry=3D0xffffffff81482720 <rw_syncobj>)
at /usr/src/sys/kern/kern_turnstile.c:430
#3 0xffffffff80977cb3 in rw_vector_enter (rw=3D0xfffffe8224a7b130, op=3D=
RW_WRITER)
at /usr/src/sys/kern/kern_rwlock.c:395
#4 0xffffffff80a17d7e in genfs_lock (v=3D<optimized out>)
at /usr/src/sys/miscfs/genfs/genfs_vnops.c:343
#5 0xffffffff80a0ed35 in VOP_LOCK (vp=3Dvp@entry=3D0xfffffe8224a7b000,=
=
flags=3Dflags@entry=3D131074) at /usr/src/sys/kern/vnode_if.c:1284
#6 0xffffffff80a05846 in vn_lock (vp=3Dvp@entry=3D0xfffffe8224a7b000, =
flags=3Dflags@entry=3D131074) at /usr/src/sys/kern/vfs_vnops.c:1036=
#7 0xffffffff80a0601d in vn_write (fp=3D<optimized out>, =
offset=3D0xfffffe8225588b00, uio=3D0xffff80009ebf8df0, =
cred=3D0xfffffe822f724f00, flags=3D1) at /usr/src/sys/kern/vfs_vnop=
s.c:592
#8 0xffffffff809b4c1d in dofilewrite (fd=3Dfd@entry=3D2, fp=3D0xfffffe=
8225588b00, =
buf=3D0x764fb6902000, nbyte=3D90, offset=3D<optimized out>, flags=3D=
flags@entry=3D1, =
retval=3Dretval@entry=3D0xffff80009ebf8eb0)
at /usr/src/sys/kern/sys_generic.c:350
#9 0xffffffff809b4d22 in sys_write (l=3D<optimized out>, =
uap=3D0xffff80009ebf8f00, retval=3D0xffff80009ebf8eb0)
at /usr/src/sys/kern/sys_generic.c:318
#10 0xffffffff80248dbd in sy_call (rval=3D0xffff80009ebf8eb0, =
uap=3D0xffff80009ebf8f00, l=3D0xfffffe8220b8e780, =
sy=3D0xffffffff8147da40 <sysent+96>) at /usr/src/sys/sys/syscallvar=
.h:65
#11 sy_invoke (code=3D4, rval=3D0xffff80009ebf8eb0, uap=3D0xffff80009eb=
f8f00, =
l=3D0xfffffe8220b8e780, sy=3D0xffffffff8147da40 <sysent+96>)
at /usr/src/sys/sys/syscallvar.h:94
#12 syscall (frame=3D0xffff80009ebf8f00)
at /usr/src/sys/arch/x86/x86/syscall.c:144
#13 0xffffffff8020768d in handle_syscall ()
#14 0x0000000000000002 in ?? ()
#15 0x0000764fb6902000 in ?? ()
#16 0x000000000000005a in ?? ()
#17 0x0000764fb690205a in ?? ()
#18 0x000000000000001e in ?? ()
#19 0x0000000000000001 in ?? ()
#20 0x0000000000000000 in ?? ()
(gdb)
(gdb) kvm proc 0xfffffe8221e57600
0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe8221e57600)
at /usr/src/sys/kern/kern_synch.c:720
720 prevlwp =3D cpu_switchto(l, newl, returning);
(gdb) where
#0 0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe8221e57600)
at /usr/src/sys/kern/kern_synch.c:720
#1 0xffffffff8097d5fd in sleepq_block (timo=3Dtimo@entry=3D0, =
catch_p=3Dcatch_p@entry=3Dfalse) at /usr/src/sys/kern/kern_sleepq.c=
:264
#2 0xffffffff8098b761 in turnstile_block (ts=3D<optimized out>, =
ts@entry=3D0xfffffe82123900c8, q=3Dq@entry=3D1, =
obj=3Dobj@entry=3D0xffffffff815cb9b0 <fstrans_lock>, =
sobj=3Dsobj@entry=3D0xffffffff814821a0 <mutex_syncobj>)
at /usr/src/sys/kern/kern_turnstile.c:430
#3 0xffffffff80965a59 in mutex_vector_enter (
mtx=3D0xffffffff815cb9b0 <fstrans_lock>)
at /usr/src/sys/kern/kern_mutex.c:693
#4 0xffffffff809fef2d in _fstrans_start (wait=3D1, lock_type=3DFSTRANS=
_SHARED, =
mp=3D<optimized out>) at /usr/src/sys/kern/vfs_trans.c:399
#5 fstrans_start (mp=3D<optimized out>) at /usr/src/sys/kern/vfs_trans=
.c:414
#6 0xffffffff80a0e399 in vop_pre (vp=3D0xfffffe8221e36bd0, =
vp=3D0xfffffe8221e36bd0, op=3DFST_YES, mpsafe=3D<synthetic pointer>=
, =
mp=3D<synthetic pointer>) at /usr/src/sys/kern/vnode_if.c:77
#7 VOP_POLL (vp=3D0xfffffe8221e36bd0, events=3D<optimized out>)
at /usr/src/sys/kern/vnode_if.c:677
#8 0xffffffff809bd7e8 in selscan (retval=3D0xffff80009eae8eb0, ni=3D20=
46820352, =
nfd=3D52, bits=3D0xffff80009eae8d48 "H") at /usr/src/sys/kern/sys_s=
elect.c:402
#9 sel_do_scan (op=3Dop@entry=3D1, fds=3Dfds@entry=3D0xffff80009eae8d4=
8, =
nf=3Dnf@entry=3D52, ni=3Dni@entry=3D8, ts=3Dts@entry=3D0xffff80009e=
ae8e70, =
mask=3Dmask@entry=3D0x0, retval=3Dretval@entry=3D0xffff80009eae8eb0=
)
at /usr/src/sys/kern/sys_select.c:264
#10 0xffffffff809bdb96 in selcommon (retval=3Dretval@entry=3D0xffff8000=
9eae8eb0, =
nd=3D52, u_in=3D0x7f7fff4c5a10, u_ou=3D0x7f7fff4c5a30, u_ex=3D0x0, =
ts=3D0xffff80009eae8e70, mask=3Dmask@entry=3D0x0)
at /usr/src/sys/kern/sys_select.c:362
#11 0xffffffff809bdeab in selcommon (mask=3D0x0, ts=3D<optimized out>, =
u_ex=3D<optimized out>, u_ou=3D<optimized out>, u_in=3D<optimized o=
ut>, =
nd=3D<optimized out>, retval=3D0xffff80009eae8eb0)
at /usr/src/sys/kern/sys_select.c:337
#12 sys___select50 (l=3D<optimized out>, uap=3D0xffff80009eae8f00, =
retval=3D0xffff80009eae8eb0) at /usr/src/sys/kern/sys_select.c:212
#13 0xffffffff80248dbd in sy_call (rval=3D0xffff80009eae8eb0, =
uap=3D0xffff80009eae8f00, l=3D0xfffffe8221e57600, =
sy=3D0xffffffff814800f8 <sysent+10008>) at /usr/src/sys/sys/syscall=
var.h:65
#14 sy_invoke (code=3D417, rval=3D0xffff80009eae8eb0, uap=3D0xffff80009=
eae8f00, =
l=3D0xfffffe8221e57600, sy=3D0xffffffff814800f8 <sysent+10008>)
at /usr/src/sys/sys/syscallvar.h:94
#15 syscall (frame=3D0xffff80009eae8f00)
at /usr/src/sys/arch/x86/x86/syscall.c:144
#16 0xffffffff8020768d in handle_syscall ()
#17 0x0000000000000034 in ?? ()
#18 0x00007f7fff4c5a10 in ?? ()
#19 0x00007f7fff4c5a30 in ?? ()
#20 0x0000000000000000 in ?? ()
(gdb)
(gdb) kvm proc 0xfffffe8222569900
0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe8222569900)
at /usr/src/sys/kern/kern_synch.c:720
720 prevlwp =3D cpu_switchto(l, newl, returning);
(gdb) where
#0 0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe8222569900)
at /usr/src/sys/kern/kern_synch.c:720
#1 0xffffffff8097d5fd in sleepq_block (timo=3Dtimo@entry=3D0, =
catch_p=3Dcatch_p@entry=3Dfalse) at /usr/src/sys/kern/kern_sleepq.c=
:264
#2 0xffffffff8098b761 in turnstile_block (ts=3D<optimized out>, =
ts@entry=3D0xfffffe82123900c8, q=3Dq@entry=3D1, =
obj=3Dobj@entry=3D0xffffffff815cb9b0 <fstrans_lock>, =
sobj=3Dsobj@entry=3D0xffffffff814821a0 <mutex_syncobj>)
at /usr/src/sys/kern/kern_turnstile.c:430
#3 0xffffffff80965a59 in mutex_vector_enter (
mtx=3D0xffffffff815cb9b0 <fstrans_lock>)
at /usr/src/sys/kern/kern_mutex.c:693
#4 0xffffffff809fef2d in _fstrans_start (wait=3D1, lock_type=3DFSTRANS=
_SHARED, =
mp=3D<optimized out>) at /usr/src/sys/kern/vfs_trans.c:399
#5 fstrans_start (mp=3D<optimized out>) at /usr/src/sys/kern/vfs_trans=
.c:414
#6 0xffffffff80a0e399 in vop_pre (vp=3D0xfffffe8223aa62a0, =
vp=3D0xfffffe8223aa62a0, op=3DFST_YES, mpsafe=3D<synthetic pointer>=
, =
mp=3D<synthetic pointer>) at /usr/src/sys/kern/vnode_if.c:77
#7 VOP_POLL (vp=3D0xfffffe8223aa62a0, events=3D<optimized out>)
at /usr/src/sys/kern/vnode_if.c:677
#8 0xffffffff809bd7e8 in selscan (retval=3D0xffff80009e9cdeb0, ni=3D79=
6917760, =
nfd=3D53, bits=3D0xffff80009e9cdd48 "\b") at /usr/src/sys/kern/sys_=
select.c:402
#9 sel_do_scan (op=3Dop@entry=3D1, fds=3Dfds@entry=3D0xffff80009e9cdd4=
8, =
nf=3Dnf@entry=3D53, ni=3Dni@entry=3D8, ts=3Dts@entry=3D0xffff80009e=
9cde70, =
mask=3Dmask@entry=3D0x0, retval=3Dretval@entry=3D0xffff80009e9cdeb0=
)
at /usr/src/sys/kern/sys_select.c:264
#10 0xffffffff809bdb96 in selcommon (retval=3Dretval@entry=3D0xffff8000=
9e9cdeb0, =
nd=3D53, u_in=3D0x7f7fff4c5a10, u_ou=3D0x7f7fff4c5a30, u_ex=3D0x0, =
ts=3D0xffff80009e9cde70, mask=3Dmask@entry=3D0x0)
at /usr/src/sys/kern/sys_select.c:362
#11 0xffffffff809bdeab in selcommon (mask=3D0x0, ts=3D<optimized out>, =
u_ex=3D<optimized out>, u_ou=3D<optimized out>, u_in=3D<optimized o=
ut>, =
nd=3D<optimized out>, retval=3D0xffff80009e9cdeb0)
at /usr/src/sys/kern/sys_select.c:337
#12 sys___select50 (l=3D<optimized out>, uap=3D0xffff80009e9cdf00, =
retval=3D0xffff80009e9cdeb0) at /usr/src/sys/kern/sys_select.c:212
#13 0xffffffff80248dbd in sy_call (rval=3D0xffff80009e9cdeb0, =
uap=3D0xffff80009e9cdf00, l=3D0xfffffe8222569900, =
sy=3D0xffffffff814800f8 <sysent+10008>) at /usr/src/sys/sys/syscall=
var.h:65
#14 sy_invoke (code=3D417, rval=3D0xffff80009e9cdeb0, uap=3D0xffff80009=
e9cdf00, =
l=3D0xfffffe8222569900, sy=3D0xffffffff814800f8 <sysent+10008>)
at /usr/src/sys/sys/syscallvar.h:94
#15 syscall (frame=3D0xffff80009e9cdf00)
at /usr/src/sys/arch/x86/x86/syscall.c:144
#16 0xffffffff8020768d in handle_syscall ()
#17 0x0000000000000035 in ?? ()
#18 0x00007f7fff4c5a10 in ?? ()
#19 0x00007f7fff4c5a30 in ?? ()
#20 0x0000000000000000 in ?? ()
(gdb)
(gdb) kvm proc 0xfffffe8225709840
0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe8225709840)
at /usr/src/sys/kern/kern_synch.c:720
720 prevlwp =3D cpu_switchto(l, newl, returning);
(gdb) where
#0 0xffffffff80980841 in mi_switch (l=3Dl@entry=3D0xfffffe8225709840)
at /usr/src/sys/kern/kern_synch.c:720
#1 0xffffffff8097d5fd in sleepq_block (timo=3Dtimo@entry=3D0, =
catch_p=3Dcatch_p@entry=3Dfalse) at /usr/src/sys/kern/kern_sleepq.c=
:264
#2 0xffffffff8098b761 in turnstile_block (ts=3D<optimized out>, =
ts@entry=3D0xfffffe82123900c8, q=3Dq@entry=3D1, =
obj=3Dobj@entry=3D0xffffffff815cb9b0 <fstrans_lock>, =
sobj=3Dsobj@entry=3D0xffffffff814821a0 <mutex_syncobj>)
at /usr/src/sys/kern/kern_turnstile.c:430
#3 0xffffffff80965a59 in mutex_vector_enter (
mtx=3D0xffffffff815cb9b0 <fstrans_lock>)
at /usr/src/sys/kern/kern_mutex.c:693
#4 0xffffffff809fef2d in _fstrans_start (wait=3D1, lock_type=3DFSTRANS=
_SHARED, =
mp=3D<optimized out>) at /usr/src/sys/kern/vfs_trans.c:399
#5 fstrans_start (mp=3D<optimized out>) at /usr/src/sys/kern/vfs_trans=
.c:414
#6 0xffffffff80a0e399 in vop_pre (vp=3D0xfffffe8222fe4bd8, =
vp=3D0xfffffe8222fe4bd8, op=3DFST_YES, mpsafe=3D<synthetic pointer>=
, =
mp=3D<synthetic pointer>) at /usr/src/sys/kern/vnode_if.c:77
#7 VOP_POLL (vp=3D0xfffffe8222fe4bd8, events=3D<optimized out>)
at /usr/src/sys/kern/vnode_if.c:677
#8 0xffffffff809bd7e8 in selscan (retval=3D0xffff80009e904eb0, ni=3D26=
25634304, =
nfd=3D53, bits=3D0xffff80009e904d48 "\b") at /usr/src/sys/kern/sys_=
select.c:402
#9 sel_do_scan (op=3Dop@entry=3D1, fds=3Dfds@entry=3D0xffff80009e904d4=
8, =
nf=3Dnf@entry=3D53, ni=3Dni@entry=3D8, ts=3Dts@entry=3D0xffff80009e=
904e70, =
mask=3Dmask@entry=3D0x0, retval=3Dretval@entry=3D0xffff80009e904eb0=
)
at /usr/src/sys/kern/sys_select.c:264
#10 0xffffffff809bdb96 in selcommon (retval=3Dretval@entry=3D0xffff8000=
9e904eb0, =
nd=3D53, u_in=3D0x7f7fff4c5a10, u_ou=3D0x7f7fff4c5a30, u_ex=3D0x0, =
ts=3D0xffff80009e904e70, mask=3Dmask@entry=3D0x0)
at /usr/src/sys/kern/sys_select.c:362
#11 0xffffffff809bdeab in selcommon (mask=3D0x0, ts=3D<optimized out>, =
u_ex=3D<optimized out>, u_ou=3D<optimized out>, u_in=3D<optimized o=
ut>, =
nd=3D<optimized out>, retval=3D0xffff80009e904eb0)
at /usr/src/sys/kern/sys_select.c:337
#12 sys___select50 (l=3D<optimized out>, uap=3D0xffff80009e904f00, =
retval=3D0xffff80009e904eb0) at /usr/src/sys/kern/sys_select.c:212
#13 0xffffffff80248dbd in sy_call (rval=3D0xffff80009e904eb0, =
uap=3D0xffff80009e904f00, l=3D0xfffffe8225709840, =
sy=3D0xffffffff814800f8 <sysent+10008>) at /usr/src/sys/sys/syscall=
var.h:65
#14 sy_invoke (code=3D417, rval=3D0xffff80009e904eb0, uap=3D0xffff80009=
e904f00, =
l=3D0xfffffe8225709840, sy=3D0xffffffff814800f8 <sysent+10008>)
at /usr/src/sys/sys/syscallvar.h:94
#15 syscall (frame=3D0xffff80009e904f00)
at /usr/src/sys/arch/x86/x86/syscall.c:144
#16 0xffffffff8020768d in handle_syscall ()
#17 0x0000000000000035 in ?? ()
#18 0x00007f7fff4c5a10 in ?? ()
#19 0x00007f7fff4c5a30 in ?? ()
#20 0x0000000000000000 in ?? ()
(gdb)
Home |
Main Index |
Thread Index |
Old Index