Re: kern/50346: arp panic

[Ryota Ozaki <ozaki-r%netbsd.org@localhost>]

On Mon, Oct 19, 2015 at 10:55 PM,  <martin%netbsd.org@localhost> wrote:
>>Number:         50346
>>Category:       kern
>>Synopsis:       arp panic: kernel diagnostic assertion "rw_write_held(&(la)->lle_lock)" failed: file "../../../../netinet/if_arp.c", line 931
>>Confidential:   no
>>Severity:       critical
>>Priority:       high
>>Responsible:    kern-bug-people
>>State:          open
>>Class:          sw-bug
>>Submitter-Id:   net
>>Arrival-Date:   Mon Oct 19 13:55:00 +0000 2015
>>Originator:     Martin Husemann
>>Release:        NetBSD 7.99.21
>>Organization:
> The NetBSD Foundation, Inc.
>>Environment:
> System: NetBSD seven-days-to-the-wolves.aprisoft.de 7.99.21 NetBSD 7.99.21 (GENERIC) #27: Fri Oct 9 18:24:56 CEST 2015 martin%seven-days-to-the-wolves.aprisoft.de@localhost:/ssd/src/sys/arch/amd64/compile/GENERIC amd64
> Architecture: x86_64
> Machine: amd64
>>Description:
>
> Not sure what was going on at the time it happened - probably some build.sh
> running and displaying output on a remote X server.
>
> (gdb) p panicstr
> $1 = 0xffffffff811b0540 <scratchstr> "kernel diagnostic assertion \"rw_write_held(&(la)->lle_lock)\" failed: file \"../../../../netinet/if_arp.c\", line 931 "
> #0  0xffffffff801196a5 in cpu_reboot (howto=howto@entry=260,
>     bootstr=bootstr@entry=0x0) at ../../../../arch/amd64/amd64/machdep.c:671
> #1  0xffffffff8080f454 in vpanic (
>     fmt=0xffffffff80d33c40 "kernel %sassertion \"%s\" failed: file \"%s\", line %d ", ap=ap@entry=0xfffffe80803098f0) at ../../../../kern/subr_prf.c:342
> #2  0xffffffff80a836c3 in kern_assert (
>     fmt=fmt@entry=0xffffffff80d33c40 "kernel %sassertion \"%s\" failed: file \"%s\", line %d ") at ../../../../../../lib/libkern/kern_assert.c:51
> #3  0xffffffff808cc729 in arpresolve (ifp=ifp@entry=0xffff800007447008,
>     rt=rt@entry=0xfffffe813ad29de0, m=0xfffffe81079d9600,
>     dst=dst@entry=0xfffffe81325526d0,
>     desten=desten@entry=0xfffffe80803099ba "")
>     at ../../../../netinet/if_arp.c:931
> #4  0xffffffff80899bcc in ether_output (ifp0=0xffff800007447008,
>     m0=<optimized out>, dst=0xfffffe81325526d0, rt=0xfffffe813ad29de0)
>     at ../../../../net/if_ethersubr.c:245
> #5  0xffffffff80541803 in klock_if_output (rt=0xfffffe813ad29de0,
>     dst=0xfffffe81325526d0, m=0xfffffe81079d9600, ifp=0xffff800007447008)
>     at ../../../../netinet/ip_output.c:189
> #6  ip_hresolv_output (ifp0=<optimized out>, m=0xfffffe81079d9600,
>     dst=dst@entry=0xfffffe81325526d0, rt00=rt00@entry=0xfffffe813ad29de0)
>     at ../../../../netinet/ip_output.c:314
> #7  0xffffffff80542f6e in ip_output (m0=m0@entry=0xfffffe81079d9600)
>     at ../../../../netinet/ip_output.c:749
> #8  0xffffffff8054d473 in tcp_output (tp=0xfffffe8132abc698)
>     at ../../../../netinet/tcp_output.c:1627
> #9  0xffffffff805537a6 in tcp_send (nam=<optimized out>, l=<optimized out>,
>     control=0x0, m=0xfffffe81079db600, so=0xfffffe8130ee9b68)
>     at ../../../../netinet/tcp_usrreq.c:1158
> #10 tcp_send_wrapper (a=0xfffffe8130ee9b68, b=0xfffffe81079db600,
>     c=<optimized out>, d=0x0, e=<optimized out>)
>     at ../../../../netinet/tcp_usrreq.c:2471
> #11 0xffffffff8083d121 in sosend (so=0xfffffe8130ee9b68, addr=0x0,
>     uio=0xfffffe8080309dc0, top=0xfffffe81079db600, control=0x0,
>     flags=<optimized out>, l=0xfffffe8107f67180)
>     at ../../../../kern/uipc_socket.c:1064
> #12 0xffffffff80824218 in soo_write (fp=<optimized out>,
>     offset=<optimized out>, uio=<optimized out>, cred=<optimized out>,
>     flags=<optimized out>) at ../../../../kern/sys_socket.c:118
> #13 0xffffffff8081979e in do_filewritev (fd=4, iovp=<optimized out>,
>     iovcnt=<optimized out>, offset=0xfffffe8135c3a540, flags=<optimized out>,
>     retval=<optimized out>) at ../../../../kern/sys_generic.c:482
> #14 0xffffffff8013cc9c in sy_call (rval=0xfffffe8080309eb8,
>     uap=0xfffffe8080309f00, l=0xfffffe8107f67180,
>     sy=0xffffffff81100ed8 <sysent+2904>) at ../../../../sys/syscallvar.h:65
> #15 sy_invoke (code=121, rval=0xfffffe8080309eb8, uap=0xfffffe8080309f00,
>     l=0xfffffe8107f67180, sy=0xffffffff81100ed8 <sysent+2904>)
>     at ../../../../sys/syscallvar.h:94
> #16 syscall (frame=0xfffffe8080309f00)
>     at ../../../../arch/x86/x86/syscall.c:156
> #17 0xffffffff80100691 in Xsyscall ()
> ..
> (gdb) p *la
> $2 = {lle_next = {le_next = 0x0, le_prev = 0xfffffe8107fa6610}, r_l3addr = {
>     addr4 = {s_addr = 2674895040}, addr6 = {__u6_addr = {
>         __u6_addr8 = "�¨oŸ", '\000' <repeats 11 times>, __u6_addr16 = {43200,
>           40815, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {2674895040, 0, 0, 0}}}},
>   ll_addr = {mac_aligned = 0, mac16 = {0, 0, 0},
>     mac8 = '\000' <repeats 19 times>}, spare0 = 0, spare1 = 0,
>   lle_tbl = 0xfffffe810800dbf0, lle_head = 0xfffffe8107fa6610,
>   lle_free = 0xffffffff805383ec <in_lltable_destroy_lle>,
>   la_hold = 0xfffffe81077f2400, la_numheld = 1, la_expire = 23764,
>   la_flags = 8256, la_asked = 1, la_preempt = 0, ln_byhint = 0, ln_state = 0,
>   ln_router = 0, ln_ntick = 0, lle_refcnt = 3, lle_chain = {le_next = 0x0,
>     le_prev = 0x0}, lle_timer = {_c_store = {0xfffffe8132b52e70,
>       0xffffffff811aa500 <balance_ch>, 0xffffffff808c997b <arptimer>,
>       0xfffffe807e65fc48, 0xffffffff811aad00 <callout_cpu0>, 0x1020024469f,
>       0x11deeba1, 0x0, 0x0, 0x0}}, lle_lock = {rw_owner = 16},
>   la_rt = 0xfffffe813ad29de0, la_opaque = 0x0}
>
>
>>How-To-Repeat:
> n/a
>
>>Fix:
> n/a
>

This one is the issue that roy and I worked on and fixed at Oct 13
(if_arp.c r1.185).

Could you try a latest kernel?

  ozaki-r