NetBSD-Bugs archive
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]
Re: kern/50375: layerfs (nullfs) locking problem leading to livelock
The following reply was made to PR kern/50375; it has been noted by GNATS.
From: Jeff Rizzo <riz%tastylime.net@localhost>
To: gnats-bugs%NetBSD.org@localhost
Cc:
Subject: Re: kern/50375: layerfs (nullfs) locking problem leading to livelock
Date: Wed, 28 Oct 2015 11:48:26 -0700
I got it to happen again; the system is still running for now (in case
more info is needed).
I used gdb to get some more information about *vp for some of the lwps.
crash> ps/l |grep tstile
17838 1 3 0 0 94eed4a0 libtool-wrapper tstile
7793 1 3 3 0 95b74be0 sh tstile
24091 1 3 2 0 95c6a940 libtool-wrapper tstile
16789 1 3 2 0 95369360 sh tstile
28195 1 3 0 0 95893960 libtool-wrapper tstile
18132 1 3 1 0 958628c0 sh tstile
25124 1 3 2 0 95768060 make tstile
0 67 3 0 200 91c37120 ioflush tstile
0 9 3 3 200 91596840 vdrain tstile
crash> ps/w |grep tstile
17838 1 libtool-wrapper netbsd 27 tstile 9222643c
7793 1 sh netbsd 27 tstile 9222643c
24091 1 libtool-wrapper netbsd 27 tstile 9222643c
16789 1 sh netbsd 27 tstile 9222643c
28195 1 libtool-wrapper netbsd 27 tstile 9222643c
18132 1 sh netbsd 27 tstile 92314e9c
25124 1 make netbsd 27 tstile 94c17784
0 67 system netbsd 124 tstile 92314e9c
0 9 system netbsd 125 tstile 92314e9c
db{1}> show lock 9222643c
lock address : 0x000000009222643c type : sleep/adaptive
initialized : 0x000000008136442c
shared holds : 0 exclusive: 1
shares wanted: 0 exclusive: 5
current cpu : 1 last held: 1
current lwp : 0x00000000915a9360 last held: 0x00000000958628c0
last locked* : 0x00000000813795f8 unlocked : 0x0000000081379714
owner/count : 0x00000000958628c0 flags : 0x0000000000000007
Turnstile chain at 0x81609eb8.
=> Turnstile at 0x9512c7b0 (wrq=0x9512c7c0, rdq=0x9512c7c8).
=> 0 waiting readers:
=> 5 waiting writers: 0x95893960 0x95369360 0x95c6a940 0x95b74be0 0x94eed4a0
db{1}> show lock 92314e9c
lock address : 0x0000000092314e9c type : sleep/adaptive
initialized : 0x000000008136442c
shared holds : 0 exclusive: 1
shares wanted: 0 exclusive: 3
current cpu : 1 last held: 2
current lwp : 0x00000000915a9360 last held: 0x0000000095768060
last locked* : 0x00000000813795f8 unlocked : 0x0000000081379714
owner/count : 0x0000000095768060 flags : 0x0000000000000007
Turnstile chain at 0x81609f18.
=> Turnstile at 0x9512d4d0 (wrq=0x9512d4e0, rdq=0x9512d4e8).
=> 0 waiting readers:
=> 3 waiting writers: 0x91596840 0x91c37120 0x958628c0
db{1}> show lock 94c17784
lock address : 0x0000000094c17784 type : sleep/adaptive
initialized : 0x000000008136442c
shared holds : 0 exclusive: 1
shares wanted: 0 exclusive: 1
current cpu : 1 last held: 1
current lwp : 0x00000000915a9360 last held: 0x0000000095863c00
last locked* : 0x00000000813795f8 unlocked : 0x0000000081379714
owner/count : 0x0000000095863c00 flags : 0x0000000000000007
Turnstile chain at 0x8160a000.
=> Turnstile at 0x91598070 (wrq=0x91598080, rdq=0x91598088).
=> 0 waiting readers:
=> 1 waiting writers: 0x95768060
db{1}>
db{1}> bt/a 0x00000000958628c0
trace: pid 18132 lid 1 at 0xa3e9daa4
0xa3e9daa4: netbsd:mi_switch+0x10
0xa3e9dad4: netbsd:sleepq_block+0xb4
0xa3e9db14: netbsd:turnstile_block+0x318
0xa3e9db8c: netbsd:rw_enter+0x3c0
0xa3e9dbbc: netbsd:genfs_lock+0x68
0xa3e9dbe4: netbsd:VOP_LOCK+0x40
0xa3e9dc0c: netbsd:layer_lock+0x44
0xa3e9dc34: netbsd:VOP_LOCK+0x40
0xa3e9dc5c: netbsd:vn_lock+0x88
0xa3e9dcac: netbsd:lookup_once+0x224
0xa3e9dd7c: netbsd:namei_tryemulroot+0x528
0xa3e9ddb4: netbsd:namei+0x34
0xa3e9dddc: netbsd:fd_nameiat.isra.0+0x64
0xa3e9de4c: netbsd:do_sys_statat+0x84
0xa3e9df04: netbsd:sys___stat50+0x2c
0xa3e9df7c: netbsd:syscall+0xb8
0xa3e9dfac: netbsd:swi_handler+0xa0
db{1}> bt/a 0x0000000095768060
trace: pid 25124 lid 1 at 0xa3bc5a44
0xa3bc5a44: netbsd:mi_switch+0x10
0xa3bc5a74: netbsd:sleepq_block+0xb4
0xa3bc5ab4: netbsd:turnstile_block+0x318
0xa3bc5b2c: netbsd:rw_enter+0x3c0
0xa3bc5b5c: netbsd:genfs_lock+0x68
0xa3bc5b84: netbsd:VOP_LOCK+0x40
0xa3bc5bac: netbsd:layer_lock+0x44
0xa3bc5bd4: netbsd:VOP_LOCK+0x40
0xa3bc5bfc: netbsd:vn_lock+0x88
0xa3bc5c4c: netbsd:lookup_once+0x498
0xa3bc5d1c: netbsd:namei_tryemulroot+0x528
0xa3bc5d54: netbsd:namei+0x34
0xa3bc5e2c: netbsd:vn_open+0x94
0xa3bc5eac: netbsd:do_open+0xb0
0xa3bc5edc: netbsd:do_sys_openat+0x7c
0xa3bc5f04: netbsd:sys_open+0x38
0xa3bc5f7c: netbsd:syscall+0xb8
0xa3bc5fac: netbsd:swi_handler+0xa0
db{1}> bt/a 0x0000000095863c00
trace: pid 21191 lid 1 at 0xa1a398c4
0xa1a398c4: netbsd:mi_switch+0x10
0xa1a398f4: netbsd:sleepq_block+0xb4
0xa1a3992c: netbsd:cv_wait+0x130
0xa1a39954: netbsd:vwait+0x50
0xa1a3997c: netbsd:vget+0xd4
0xa1a399e4: netbsd:vcache_get+0x158
0xa1a39a14: netbsd:layer_node_create+0x2c
0xa1a39a44: netbsd:layer_lookup+0xfc
0xa1a39a7c: netbsd:VOP_LOOKUP+0x48
0xa1a39bdc: netbsd:getcwd_common+0x258
0xa1a39bfc: netbsd:vn_isunder+0x2c
0xa1a39c4c: netbsd:lookup_once+0xfc
0xa1a39d1c: netbsd:namei_tryemulroot+0x528
0xa1a39d54: netbsd:namei+0x34
0xa1a39e2c: netbsd:vn_open+0x94
0xa1a39eac: netbsd:do_open+0xb0
0xa1a39edc: netbsd:do_sys_openat+0x7c
0xa1a39f04: netbsd:sys_open+0x38
0xa1a39f7c: netbsd:syscall+0xb8
0xa1a39fac: netbsd:swi_handler+0xa0
db{1}> bt/a 94eed4a0
trace: pid 17838 lid 1 at 0x9f3f7a0c
0x9f3f7a0c: netbsd:mi_switch+0x10
0x9f3f7a3c: netbsd:sleepq_block+0xb4
0x9f3f7a7c: netbsd:turnstile_block+0x318
0x9f3f7af4: netbsd:rw_enter+0x3c0
0x9f3f7b24: netbsd:genfs_lock+0x68
0x9f3f7b4c: netbsd:VOP_LOCK+0x40
0x9f3f7b74: netbsd:layer_lock+0x44
0x9f3f7b9c: netbsd:VOP_LOCK+0x68
0x9f3f7bc4: netbsd:vn_lock+0x88
0x9f3f7bdc: netbsd:layerfs_root+0x38
0x9f3f7bfc: netbsd:VFS_ROOT+0x30
0x9f3f7c4c: netbsd:lookup_once+0x29c
0x9f3f7d1c: netbsd:namei_tryemulroot+0x528
0x9f3f7d54: netbsd:namei+0x34
0x9f3f7e2c: netbsd:vn_open+0x94
0x9f3f7eac: netbsd:do_open+0xb0
0x9f3f7edc: netbsd:do_sys_openat+0x7c
0x9f3f7f04: netbsd:sys_open+0x38
0x9f3f7f7c: netbsd:syscall+0xb8
0x9f3f7fac: netbsd:swi_handler+0xa0
db{1}> bt/a 95b74be0
trace: pid 7793 lid 1 at 0xa3bcba0c
0xa3bcba0c: netbsd:mi_switch+0x10
0xa3bcba3c: netbsd:sleepq_block+0xb4
0xa3bcba7c: netbsd:turnstile_block+0x318
0xa3bcbaf4: netbsd:rw_enter+0x3c0
0xa3bcbb24: netbsd:genfs_lock+0x68
0xa3bcbb4c: netbsd:VOP_LOCK+0x40
0xa3bcbb74: netbsd:layer_lock+0x44
0xa3bcbb9c: netbsd:VOP_LOCK+0x68
0xa3bcbbc4: netbsd:vn_lock+0x88
0xa3bcbbdc: netbsd:layerfs_root+0x38
0xa3bcbbfc: netbsd:VFS_ROOT+0x30
0xa3bcbc4c: netbsd:lookup_once+0x29c
0xa3bcbd1c: netbsd:namei_tryemulroot+0x528
0xa3bcbd54: netbsd:namei+0x34
0xa3bcbe2c: netbsd:vn_open+0x94
0xa3bcbeac: netbsd:do_open+0xb0
0xa3bcbedc: netbsd:do_sys_openat+0x7c
0xa3bcbf04: netbsd:sys_open+0x38
0xa3bcbf7c: netbsd:syscall+0xb8
0xa3bcbfac: netbsd:swi_handler+0xa0
db{1}> bt/a 95c6a940
trace: pid 24091 lid 1 at 0xa3a03a0c
0xa3a03a0c: netbsd:mi_switch+0x10
0xa3a03a3c: netbsd:sleepq_block+0xb4
0xa3a03a7c: netbsd:turnstile_block+0x318
0xa3a03af4: netbsd:rw_enter+0x3c0
0xa3a03b24: netbsd:genfs_lock+0x68
0xa3a03b4c: netbsd:VOP_LOCK+0x40
0xa3a03b74: netbsd:layer_lock+0x44
0xa3a03b9c: netbsd:VOP_LOCK+0x68
0xa3a03bc4: netbsd:vn_lock+0x88
0xa3a03bdc: netbsd:layerfs_root+0x38
0xa3a03bfc: netbsd:VFS_ROOT+0x30
0xa3a03c4c: netbsd:lookup_once+0x29c
0xa3a03d1c: netbsd:namei_tryemulroot+0x528
0xa3a03d54: netbsd:namei+0x34
0xa3a03e2c: netbsd:vn_open+0x94
0xa3a03eac: netbsd:do_open+0xb0
0xa3a03edc: netbsd:do_sys_openat+0x7c
0xa3a03f04: netbsd:sys_open+0x38
0xa3a03f7c: netbsd:syscall+0xb8
0xa3a03fac: netbsd:swi_handler+0xa0
db{1}> bt/a 95369360
trace: pid 16789 lid 1 at 0x9e569a6c
0x9e569a6c: netbsd:mi_switch+0x10
0x9e569a9c: netbsd:sleepq_block+0xb4
0x9e569adc: netbsd:turnstile_block+0x318
0x9e569b54: netbsd:rw_enter+0x3c0
0x9e569b84: netbsd:genfs_lock+0x68
0x9e569bac: netbsd:VOP_LOCK+0x40
0x9e569bd4: netbsd:layer_lock+0x44
0x9e569bfc: netbsd:VOP_LOCK+0x68
0x9e569c24: netbsd:vn_lock+0x88
0x9e569c3c: netbsd:layerfs_root+0x38
0x9e569c5c: netbsd:VFS_ROOT+0x30
0x9e569cac: netbsd:lookup_once+0x29c
0x9e569d7c: netbsd:namei_tryemulroot+0x528
0x9e569db4: netbsd:namei+0x34
0x9e569ddc: netbsd:fd_nameiat.isra.0+0x64
0x9e569e4c: netbsd:do_sys_statat+0x84
0x9e569f04: netbsd:sys___stat50+0x2c
0x9e569f7c: netbsd:syscall+0xb8
0x9e569fac: netbsd:swi_handler+0xa0
db{1}> bt/a 95893960
trace: pid 28195 lid 1 at 0xa11ffa0c
0xa11ffa0c: netbsd:mi_switch+0x10
0xa11ffa3c: netbsd:sleepq_block+0xb4
0xa11ffa7c: netbsd:turnstile_block+0x318
0xa11ffaf4: netbsd:rw_enter+0x3c0
0xa11ffb24: netbsd:genfs_lock+0x68
0xa11ffb4c: netbsd:VOP_LOCK+0x40
0xa11ffb74: netbsd:layer_lock+0x44
0xa11ffb9c: netbsd:VOP_LOCK+0x68
0xa11ffbc4: netbsd:vn_lock+0x88
0xa11ffbdc: netbsd:layerfs_root+0x38
0xa11ffbfc: netbsd:VFS_ROOT+0x30
0xa11ffc4c: netbsd:lookup_once+0x29c
0xa11ffd1c: netbsd:namei_tryemulroot+0x528
0xa11ffd54: netbsd:namei+0x34
0xa11ffe2c: netbsd:vn_open+0x94
0xa11ffeac: netbsd:do_open+0xb0
0xa11ffedc: netbsd:do_sys_openat+0x7c
0xa11fff04: netbsd:sys_open+0x38
0xa11fff7c: netbsd:syscall+0xb8
0xa11fffac: netbsd:swi_handler+0xa0
db{1}> bt/a 958628c0
trace: pid 18132 lid 1 at 0xa3e9daa4
0xa3e9daa4: netbsd:mi_switch+0x10
0xa3e9dad4: netbsd:sleepq_block+0xb4
0xa3e9db14: netbsd:turnstile_block+0x318
0xa3e9db8c: netbsd:rw_enter+0x3c0
0xa3e9dbbc: netbsd:genfs_lock+0x68
0xa3e9dbe4: netbsd:VOP_LOCK+0x40
0xa3e9dc0c: netbsd:layer_lock+0x44
0xa3e9dc34: netbsd:VOP_LOCK+0x40
0xa3e9dc5c: netbsd:vn_lock+0x88
0xa3e9dcac: netbsd:lookup_once+0x224
0xa3e9dd7c: netbsd:namei_tryemulroot+0x528
0xa3e9ddb4: netbsd:namei+0x34
0xa3e9dddc: netbsd:fd_nameiat.isra.0+0x64
0xa3e9de4c: netbsd:do_sys_statat+0x84
0xa3e9df04: netbsd:sys___stat50+0x2c
0xa3e9df7c: netbsd:syscall+0xb8
0xa3e9dfac: netbsd:swi_handler+0xa0
db{1}> bt/a 95768060
trace: pid 25124 lid 1 at 0xa3bc5a44
0xa3bc5a44: netbsd:mi_switch+0x10
0xa3bc5a74: netbsd:sleepq_block+0xb4
0xa3bc5ab4: netbsd:turnstile_block+0x318
0xa3bc5b2c: netbsd:rw_enter+0x3c0
0xa3bc5b5c: netbsd:genfs_lock+0x68
0xa3bc5b84: netbsd:VOP_LOCK+0x40
0xa3bc5bac: netbsd:layer_lock+0x44
0xa3bc5bd4: netbsd:VOP_LOCK+0x40
0xa3bc5bfc: netbsd:vn_lock+0x88
0xa3bc5c4c: netbsd:lookup_once+0x498
0xa3bc5d1c: netbsd:namei_tryemulroot+0x528
0xa3bc5d54: netbsd:namei+0x34
0xa3bc5e2c: netbsd:vn_open+0x94
0xa3bc5eac: netbsd:do_open+0xb0
0xa3bc5edc: netbsd:do_sys_openat+0x7c
0xa3bc5f04: netbsd:sys_open+0x38
0xa3bc5f7c: netbsd:syscall+0xb8
0xa3bc5fac: netbsd:swi_handler+0xa0
db{1}> bt/a 91c37120
trace: pid 0 lid 67 at 0x9aaabd64
0x9aaabd64: netbsd:mi_switch+0x10
0x9aaabd94: netbsd:sleepq_block+0xb4
0x9aaabdd4: netbsd:turnstile_block+0x318
0x9aaabe4c: netbsd:rw_enter+0x3c0
0x9aaabe7c: netbsd:genfs_lock+0x68
0x9aaabea4: netbsd:VOP_LOCK+0x40
0x9aaabecc: netbsd:vn_lock+0x88
0x9aaabf2c: netbsd:ffs_sync+0xb0
0x9aaabf4c: netbsd:VFS_SYNC+0x30
0x9aaabfac: netbsd:sched_sync+0x27c
db{1}> bt/a 91596840
trace: pid 0 lid 9 at 0x9a825d74
0x9a825d74: netbsd:mi_switch+0x10
0x9a825da4: netbsd:sleepq_block+0xb4
0x9a825de4: netbsd:turnstile_block+0x318
0x9a825e5c: netbsd:rw_enter+0x3c0
0x9a825e8c: netbsd:genfs_lock+0x68
0x9a825eb4: netbsd:VOP_LOCK+0x40
0x9a825edc: netbsd:layer_lock+0x44
0x9a825f04: netbsd:VOP_LOCK+0x40
0x9a825f2c: netbsd:vn_lock+0x88
0x9a825f5c: netbsd:vclean+0x74
0x9a825f8c: netbsd:cleanvnode+0xf4
0x9a825fac: netbsd:vdrain_thread+0x68
db{1}>
(gdb) kvm proc 0x0000000095863c00
0x812e9eb8 in mi_switch (l=l@entry=0x95863c00) at
/home/riz/src/sys/kern/kern_synch.c:719
719 in /home/riz/src/sys/kern/kern_synch.c
(gdb) bt
#0 0x812e9eb8 in mi_switch (l=l@entry=0x95863c00) at
/home/riz/src/sys/kern/kern_synch.c:719
#1 0x812e6b9c in sleepq_block (timo=timo@entry=0,
catch_p=catch_p@entry=false) at /home/riz/src/sys/kern/kern_sleepq.c:264
#2 0x812b80c0 in cv_wait (cv=cv@entry=0x9436ef4c, mtx=0x91f3f640) at
/home/riz/src/sys/kern/kern_condvar.c:217
#3 0x81363fc8 in vwait (vp=0x9436ef20, flags=flags@entry=1048576) at
/home/riz/src/sys/kern/vfs_vnode.c:1469
#4 0x813654a8 in vget (vp=vp@entry=0x9436ef20, flags=flags@entry=0,
waitok=waitok@entry=true) at /home/riz/src/sys/kern/vfs_vnode.c:463
#5 0x81365f74 in vcache_get (mp=0x94efd008, key=key@entry=0xa1a399f4,
key_len=key_len@entry=4, vpp=vpp@entry=0xa1a399fc) at
/home/riz/src/sys/kern/vfs_vnode.c:1148
#6 0x81379c74 in layer_node_create (mp=<optimized out>,
lowervp=lowervp@entry=0x92314df8, nvpp=0xa1a39ac4) at
/home/riz/src/sys/miscfs/genfs/layer_subr.c:120
#7 0x8137a478 in layer_lookup (v=0xa1a39a50) at
/home/riz/src/sys/miscfs/genfs/layer_vnops.c:385
#8 0x8136f380 in VOP_LOOKUP (dvp=dvp@entry=0x92b811e0,
vpp=vpp@entry=0xa1a39ac4, cnp=cnp@entry=0xa1a39ad8) at
/home/riz/src/sys/kern/vnode_if.c:119
#9 0x813531f4 in getcwd_scandir (l=0x95863c00, bufp=0x0,
bpp=0xa1a39ac8, uvpp=0xa1a39ac4, lvpp=<synthetic pointer>) at
/home/riz/src/sys/kern/vfs_getcwd.c:136
#10 getcwd_common (lvp=lvp@entry=0x92b811e0, rvp=<optimized out>,
bpp=bpp@entry=0x0, bufp=bufp@entry=0x0, limit=limit@entry=512,
flags=flags@entry=0, l=l@entry=0x95863c00)
at /home/riz/src/sys/kern/vfs_getcwd.c:415
#11 0x8135358c in vn_isunder (lvp=lvp@entry=0x92b811e0, rvp=<optimized
out>, l=l@entry=0x95863c00) at /home/riz/src/sys/kern/vfs_getcwd.c:456
#12 0x813552d4 in lookup_once (state=state@entry=0xa1a39d28,
searchdir=0x92b811e0, newsearchdir_ret=newsearchdir_ret@entry=0xa1a39cb4,
foundobj_ret=foundobj_ret@entry=0xa1a39cb8) at
/home/riz/src/sys/kern/vfs_lookup.c:947
#13 0x813560a8 in namei_oneroot (isnfsd=<optimized out>,
inhibitmagic=<optimized out>, neverfollow=<optimized out>,
state=<optimized out>)
at /home/riz/src/sys/kern/vfs_lookup.c:1215
#14 namei_tryemulroot (state=state@entry=0xa1a39d28,
neverfollow=neverfollow@entry=0, inhibitmagic=inhibitmagic@entry=0,
isnfsd=isnfsd@entry=0)
at /home/riz/src/sys/kern/vfs_lookup.c:1469
#15 0x813571a8 in namei (ndp=ndp@entry=0xa1a39e48) at
/home/riz/src/sys/kern/vfs_lookup.c:1505
#16 0x813683dc in vn_open (ndp=ndp@entry=0xa1a39e48,
fmode=fmode@entry=1, cmode=cmode@entry=420) at
/home/riz/src/sys/kern/vfs_vnops.c:175
#17 0x8135f938 in do_open (l=l@entry=0x95863c00, dvp=0x0, pb=<optimized
out>, open_flags=open_flags@entry=0, open_mode=open_mode@entry=438,
fd=fd@entry=0xa1a39eec)
at /home/riz/src/sys/kern/vfs_syscalls.c:1578
#18 0x8135fa78 in do_sys_openat (l=0x95863c00, fdat=fdat@entry=-100,
path=<optimized out>, flags=0, mode=438, fd=fd@entry=0xa1a39eec)
at /home/riz/src/sys/kern/vfs_syscalls.c:1658
#19 0x8135fb60 in sys_open (l=<optimized out>, uap=<optimized out>,
retval=0xa1a39f18) at /home/riz/src/sys/kern/vfs_syscalls.c:1678
#20 0x81012cc4 in sy_call (rval=0xa1a39f18, uap=<optimized out>,
l=0x95863c00, sy=0x8153c384 <sysent+100>) at
/home/riz/src/sys/sys/syscallvar.h:65
#21 sy_invoke (code=5, rval=0xa1a39f18, uap=<optimized out>,
l=0x95863c00, sy=0x8153c384 <sysent+100>) at
/home/riz/src/sys/sys/syscallvar.h:94
#22 syscall (tf=0xa1a39fb0, l=0x95863c00, insn=<optimized out>) at
/home/riz/src/sys/arch/arm/arm/syscall.c:253
#23 0x81012ecc in swi_handler (tf=0xa1a39fb0, tf@entry=<error reading
variable: Register 25 is not available>) at
/home/riz/src/sys/arch/arm/arm/syscall.c:188
(gdb) up
#1 0x812e6b9c in sleepq_block (timo=timo@entry=0,
catch_p=catch_p@entry=false) at /home/riz/src/sys/kern/kern_sleepq.c:264
264 /home/riz/src/sys/kern/kern_sleepq.c: No such file or directory.
(gdb) up
#2 0x812b80c0 in cv_wait (cv=cv@entry=0x9436ef4c, mtx=0x91f3f640) at
/home/riz/src/sys/kern/kern_condvar.c:217
217 /home/riz/src/sys/kern/kern_condvar.c: No such file or directory.
(gdb) up
#3 0x81363fc8 in vwait (vp=0x9436ef20, flags=flags@entry=1048576) at
/home/riz/src/sys/kern/vfs_vnode.c:1469
1469 /home/riz/src/sys/kern/vfs_vnode.c: No such file or directory.
(gdb) l
1464 in /home/riz/src/sys/kern/vfs_vnode.c
(gdb) print *vp
$1 = {v_uobj = {vmobjlock = 0x91f3f640, pgops = 0x81423cc0
<uvm_vnodeops>, memq = {tqh_first = 0x0, tqh_last = 0x9436ef28},
uo_npages = 0, uo_refs = 2, rb_tree = {
rbt_root = 0x0, rbt_ops = 0x81423c00 <uvm_page_tree_ops>,
rbt_minmax = {0x0, 0x0}}, uo_ubc = {lh_first = 0x0}}, v_cv = {cv_opaque
= {0x95863c00, 0x95863cb8,
0x8146e51c}}, v_size = 0, v_writesize = 0, v_iflag = 1048576,
v_vflag = 16, v_uflag = 0, v_numoutput = 0, v_writecount = 0, v_holdcnt
= 0, v_synclist_slot = 0,
v_mount = 0x94efd008, v_op = 0x9159ac48, v_freelist = {tqe_next =
0x0, tqe_prev = 0x8160afc0 <vnode_free_list>}, v_freelisthd = 0x0,
v_mntvnodes = {tqe_next = 0x0,
tqe_prev = 0x92b81258}, v_cleanblkhd = {lh_first = 0x0},
v_dirtyblkhd = {lh_first = 0x0}, v_synclist = {tqe_next = 0x0, tqe_prev
= 0x0}, v_dnclist = {lh_first = 0x0},
v_nclist = {lh_first = 0x0}, v_un = {vu_mountedhere = 0x0, vu_socket
= 0x0, vu_specnode = 0x0, vu_fifoinfo = 0x0, vu_ractx = 0x0}, v_type =
VDIR, v_tag = VT_NULL, v_lock = {
rw_owner = 0}, v_data = 0x9659f760, v_klist = {slh_first = 0x0}}
(gdb)
(gdb) kvm proc 0x00000000958628c0
0x812e9eb8 in mi_switch (l=l@entry=0x958628c0) at
/home/riz/src/sys/kern/kern_synch.c:719
719 /home/riz/src/sys/kern/kern_synch.c: No such file or directory.
(gdb) bt
#0 0x812e9eb8 in mi_switch (l=l@entry=0x958628c0) at
/home/riz/src/sys/kern/kern_synch.c:719
#1 0x812e6b9c in sleepq_block (timo=timo@entry=0,
catch_p=catch_p@entry=false) at /home/riz/src/sys/kern/kern_sleepq.c:264
#2 0x812f4dd0 in turnstile_block (ts=<optimized out>,
ts@entry=0x9512d4d0, q=q@entry=1, obj=obj@entry=0x92314e9c,
sobj=sobj@entry=0x8153f5ac <rw_syncobj>)
at /home/riz/src/sys/kern/kern_turnstile.c:430
#3 0x812e1834 in rw_vector_enter (rw=rw@entry=0x92314e9c,
op=op@entry=RW_WRITER) at /home/riz/src/sys/kern/kern_rwlock.c:387
#4 0x813795f8 in genfs_lock (v=<optimized out>) at
/home/riz/src/sys/miscfs/genfs/genfs_vnops.c:384
#5 0x813706dc in VOP_LOCK (vp=0x92314df8, flags=<optimized out>) at
/home/riz/src/sys/kern/vnode_if.c:1166
#6 0x8137a990 in layer_lock (v=<optimized out>) at
/home/riz/src/sys/miscfs/genfs/layer_vnops.c:733
#7 0x813706dc in VOP_LOCK (vp=vp@entry=0x975cd640, flags=flags@entry=2)
at /home/riz/src/sys/kern/vnode_if.c:1166
#8 0x81367a34 in vn_lock (vp=0x975cd640, flags=flags@entry=2) at
/home/riz/src/sys/kern/vfs_vnops.c:1034
#9 0x813553fc in lookup_once (state=state@entry=0xa3e9dd88,
searchdir=0x922ae9d0, newsearchdir_ret=newsearchdir_ret@entry=0xa3e9dd14,
foundobj_ret=foundobj_ret@entry=0xa3e9dd18) at
/home/riz/src/sys/kern/vfs_lookup.c:1065
#10 0x813560a8 in namei_oneroot (isnfsd=<optimized out>,
inhibitmagic=<optimized out>, neverfollow=<optimized out>,
state=<optimized out>)
at /home/riz/src/sys/kern/vfs_lookup.c:1215
#11 namei_tryemulroot (state=state@entry=0xa3e9dd88,
neverfollow=neverfollow@entry=0, inhibitmagic=inhibitmagic@entry=0,
isnfsd=isnfsd@entry=0)
at /home/riz/src/sys/kern/vfs_lookup.c:1469
#12 0x813571a8 in namei (ndp=ndp@entry=0xa3e9ddf0) at
/home/riz/src/sys/kern/vfs_lookup.c:1505
#13 0x8135ce74 in fd_nameiat (fdat=fdat@entry=-100,
ndp=ndp@entry=0xa3e9ddf0, l=<optimized out>) at
/home/riz/src/sys/kern/vfs_syscalls.c:179
#14 0x81361004 in do_sys_statat (l=<optimized out>,
fdat=fdat@entry=-100, userpath=0x7fffde5e <error: Cannot access memory
at address 0x7fffde5e>, nd_flag=nd_flag@entry=64,
sb=sb@entry=0xa3e9de58) at /home/riz/src/sys/kern/vfs_syscalls.c:3042
#15 0x813610c4 in sys___stat50 (l=<optimized out>, uap=0xa3e9dfb8,
retval=<optimized out>) at /home/riz/src/sys/kern/vfs_syscalls.c:3067
#16 0x81012cc4 in sy_call (rval=0xa3e9df18, uap=<optimized out>,
l=0x958628c0, sy=0x8153e56c <sysent+8780>) at
/home/riz/src/sys/sys/syscallvar.h:65
#17 sy_invoke (code=439, rval=0xa3e9df18, uap=<optimized out>,
l=0x958628c0, sy=0x8153e56c <sysent+8780>) at
/home/riz/src/sys/sys/syscallvar.h:94
#18 syscall (tf=0xa3e9dfb0, l=0x958628c0, insn=<optimized out>) at
/home/riz/src/sys/arch/arm/arm/syscall.c:253
#19 0x81012ecc in swi_handler (tf=0xa3e9dfb0, tf@entry=<error reading
variable: Register 25 is not available>) at
/home/riz/src/sys/arch/arm/arm/syscall.c:188
(gdb) up
#1 0x812e6b9c in sleepq_block (timo=timo@entry=0,
catch_p=catch_p@entry=false) at /home/riz/src/sys/kern/kern_sleepq.c:264
264 /home/riz/src/sys/kern/kern_sleepq.c: No such file or directory.
(gdb) up
#2 0x812f4dd0 in turnstile_block (ts=<optimized out>,
ts@entry=0x9512d4d0, q=q@entry=1, obj=obj@entry=0x92314e9c,
sobj=sobj@entry=0x8153f5ac <rw_syncobj>)
at /home/riz/src/sys/kern/kern_turnstile.c:430
430 /home/riz/src/sys/kern/kern_turnstile.c: No such file or directory.
(gdb) up
#3 0x812e1834 in rw_vector_enter (rw=rw@entry=0x92314e9c,
op=op@entry=RW_WRITER) at /home/riz/src/sys/kern/kern_rwlock.c:387
387 /home/riz/src/sys/kern/kern_rwlock.c: No such file or directory.
(gdb) up
#4 0x813795f8 in genfs_lock (v=<optimized out>) at
/home/riz/src/sys/miscfs/genfs/genfs_vnops.c:384
384 /home/riz/src/sys/miscfs/genfs/genfs_vnops.c: No such file or
directory.
(gdb) print vp->v_lock
$2 = {rw_owner = 2507571303}
(gdb) print *vp
$3 = {v_uobj = {vmobjlock = 0x91f3f640, pgops = 0x81423cc0
<uvm_vnodeops>, memq = {tqh_first = 0x0, tqh_last = 0x92314e00},
uo_npages = 0, uo_refs = 5, rb_tree = {
rbt_root = 0x0, rbt_ops = 0x81423c00 <uvm_page_tree_ops>,
rbt_minmax = {0x0, 0x0}}, uo_ubc = {lh_first = 0x0}}, v_cv = {cv_opaque
= {0x0, 0x92314e24, 0x8146e51c}},
v_size = 2048, v_writesize = 2048, v_iflag = 0, v_vflag = 48, v_uflag
= 0, v_numoutput = 0, v_writecount = 0, v_holdcnt = 1, v_synclist_slot =
0, v_mount = 0x920d3008,
v_op = 0x9159a548, v_freelist = {tqe_next = 0x93142430, tqe_prev =
0x940c2fbc}, v_freelisthd = 0x0, v_mntvnodes = {tqe_next = 0x966c42f0,
tqe_prev = 0x92f3c428},
v_cleanblkhd = {lh_first = 0x94d56328}, v_dirtyblkhd = {lh_first =
0x0}, v_synclist = {tqe_next = 0x0, tqe_prev = 0x0}, v_dnclist =
{lh_first = 0x93489880}, v_nclist = {
lh_first = 0x93496380}, v_un = {vu_mountedhere = 0x0, vu_socket =
0x0, vu_specnode = 0x0, vu_fifoinfo = 0x0, vu_ractx = 0x0}, v_type =
VDIR, v_tag = VT_UFS, v_lock = {
rw_owner = 2507571303}, v_data = 0x92f40198, v_klist = {slh_first =
0x0}}
(gdb) kvm proc 0x0000000095768060
0x812e9eb8 in mi_switch (l=l@entry=0x95768060) at
/home/riz/src/sys/kern/kern_synch.c:719
719 /home/riz/src/sys/kern/kern_synch.c: No such file or directory.
(gdb) bt
#0 0x812e9eb8 in mi_switch (l=l@entry=0x95768060) at
/home/riz/src/sys/kern/kern_synch.c:719
#1 0x812e6b9c in sleepq_block (timo=timo@entry=0,
catch_p=catch_p@entry=false) at /home/riz/src/sys/kern/kern_sleepq.c:264
#2 0x812f4dd0 in turnstile_block (ts=<optimized out>, ts@entry=0x0,
q=q@entry=1, obj=obj@entry=0x94c17784, sobj=sobj@entry=0x8153f5ac
<rw_syncobj>)
at /home/riz/src/sys/kern/kern_turnstile.c:430
#3 0x812e1834 in rw_vector_enter (rw=rw@entry=0x94c17784,
op=op@entry=RW_WRITER) at /home/riz/src/sys/kern/kern_rwlock.c:387
#4 0x813795f8 in genfs_lock (v=<optimized out>) at
/home/riz/src/sys/miscfs/genfs/genfs_vnops.c:384
#5 0x813706dc in VOP_LOCK (vp=0x94c176e0, flags=<optimized out>) at
/home/riz/src/sys/kern/vnode_if.c:1166
#6 0x8137a990 in layer_lock (v=<optimized out>) at
/home/riz/src/sys/miscfs/genfs/layer_vnops.c:733
#7 0x813706dc in VOP_LOCK (vp=vp@entry=0x948159a0,
flags=flags@entry=131074) at /home/riz/src/sys/kern/vnode_if.c:1166
#8 0x81367a34 in vn_lock (vp=vp@entry=0x948159a0, flags=131074) at
/home/riz/src/sys/kern/vfs_vnops.c:1034
#9 0x81355670 in lookup_once (state=state@entry=0xa3bc5d28,
searchdir=0x948159a0, newsearchdir_ret=newsearchdir_ret@entry=0xa3bc5cb4,
foundobj_ret=foundobj_ret@entry=0xa3bc5cb8) at
/home/riz/src/sys/kern/vfs_lookup.c:1067
#10 0x813560a8 in namei_oneroot (isnfsd=<optimized out>,
inhibitmagic=<optimized out>, neverfollow=<optimized out>,
state=<optimized out>)
at /home/riz/src/sys/kern/vfs_lookup.c:1215
#11 namei_tryemulroot (state=state@entry=0xa3bc5d28,
neverfollow=neverfollow@entry=0, inhibitmagic=inhibitmagic@entry=0,
isnfsd=isnfsd@entry=0)
at /home/riz/src/sys/kern/vfs_lookup.c:1469
#12 0x813571a8 in namei (ndp=ndp@entry=0xa3bc5e48) at
/home/riz/src/sys/kern/vfs_lookup.c:1505
#13 0x813683dc in vn_open (ndp=ndp@entry=0xa3bc5e48,
fmode=fmode@entry=1, cmode=cmode@entry=1324) at
/home/riz/src/sys/kern/vfs_vnops.c:175
#14 0x8135f938 in do_open (l=l@entry=0x95768060, dvp=0x0, pb=<optimized
out>, open_flags=open_flags@entry=0, open_mode=open_mode@entry=5420,
fd=fd@entry=0xa3bc5eec)
at /home/riz/src/sys/kern/vfs_syscalls.c:1578
#15 0x8135fa78 in do_sys_openat (l=0x95768060, fdat=fdat@entry=-100,
path=<optimized out>, flags=0, mode=5420, fd=fd@entry=0xa3bc5eec)
at /home/riz/src/sys/kern/vfs_syscalls.c:1658
#16 0x8135fb60 in sys_open (l=<optimized out>, uap=<optimized out>,
retval=0xa3bc5f18) at /home/riz/src/sys/kern/vfs_syscalls.c:1678
#17 0x81012cc4 in sy_call (rval=0xa3bc5f18, uap=<optimized out>,
l=0x95768060, sy=0x8153c384 <sysent+100>) at
/home/riz/src/sys/sys/syscallvar.h:65
#18 sy_invoke (code=5, rval=0xa3bc5f18, uap=<optimized out>,
l=0x95768060, sy=0x8153c384 <sysent+100>) at
/home/riz/src/sys/sys/syscallvar.h:94
#19 syscall (tf=0xa3bc5fb0, l=0x95768060, insn=<optimized out>) at
/home/riz/src/sys/arch/arm/arm/syscall.c:253
#20 0x81012ecc in swi_handler (tf=0xa3bc5fb0, tf@entry=<error reading
variable: Register 25 is not available>) at
/home/riz/src/sys/arch/arm/arm/syscall.c:188
(gdb) up
#1 0x812e6b9c in sleepq_block (timo=timo@entry=0,
catch_p=catch_p@entry=false) at /home/riz/src/sys/kern/kern_sleepq.c:264
264 /home/riz/src/sys/kern/kern_sleepq.c: No such file or directory.
(gdb) up
#2 0x812f4dd0 in turnstile_block (ts=<optimized out>, ts@entry=0x0,
q=q@entry=1, obj=obj@entry=0x94c17784, sobj=sobj@entry=0x8153f5ac
<rw_syncobj>)
at /home/riz/src/sys/kern/kern_turnstile.c:430
430 /home/riz/src/sys/kern/kern_turnstile.c: No such file or directory.
(gdb) up
#3 0x812e1834 in rw_vector_enter (rw=rw@entry=0x94c17784,
op=op@entry=RW_WRITER) at /home/riz/src/sys/kern/kern_rwlock.c:387
387 /home/riz/src/sys/kern/kern_rwlock.c: No such file or directory.
(gdb) up
#4 0x813795f8 in genfs_lock (v=<optimized out>) at
/home/riz/src/sys/miscfs/genfs/genfs_vnops.c:384
384 /home/riz/src/sys/miscfs/genfs/genfs_vnops.c: No such file or
directory.
(gdb) print *vp
$4 = {v_uobj = {vmobjlock = 0x946fde00, pgops = 0x81423cc0
<uvm_vnodeops>, memq = {tqh_first = 0x0, tqh_last = 0x94c176e8},
uo_npages = 0, uo_refs = 2, rb_tree = {
rbt_root = 0x0, rbt_ops = 0x81423c00 <uvm_page_tree_ops>,
rbt_minmax = {0x0, 0x0}}, uo_ubc = {lh_first = 0x0}}, v_cv = {cv_opaque
= {0x0, 0x94c1770c, 0x8146e51c}},
v_size = 55808, v_writesize = 55808, v_iflag = 0, v_vflag = 48,
v_uflag = 0, v_numoutput = 0, v_writecount = 0, v_holdcnt = 7,
v_synclist_slot = 0, v_mount = 0x920d3008,
v_op = 0x9159a548, v_freelist = {tqe_next = 0x92314df8, tqe_prev =
0x9312eedc}, v_freelisthd = 0x0, v_mntvnodes = {tqe_next = 0x9202c010,
tqe_prev = 0x936a64a8},
v_cleanblkhd = {lh_first = 0x94f54d80}, v_dirtyblkhd = {lh_first =
0x0}, v_synclist = {tqe_next = 0x0, tqe_prev = 0x0}, v_dnclist =
{lh_first = 0x926d78c0}, v_nclist = {
lh_first = 0x9252ba80}, v_un = {vu_mountedhere = 0x0, vu_socket =
0x0, vu_specnode = 0x0, vu_fifoinfo = 0x0, vu_ractx = 0x0}, v_type =
VDIR, v_tag = VT_UFS, v_lock = {
rw_owner = 2508602375}, v_data = 0x924cbc40, v_klist = {slh_first =
0x0}}
(gdb)
Home |
Main Index |
Thread Index |
Old Index