kern/50140: ffs panic: bad dir on a rump kernel

[edwin%etorok.net@localhost]

>Number:         50140
>Category:       kern
>Synopsis:       ffs panic: bad dir on a rump kernel
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    kern-bug-people
>State:          open
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Mon Aug 10 17:25:00 +0000 2015
>Originator:     Török Edwin
>Release:        NetBSD 7.99.17 (RUMP-ROAST)
>Organization:
Skylable Ltd.
>Environment:
Linux debian 4.1.0-1-amd64 #1 SMP Debian 4.1.3-1 (2015-08-03) x86_64 GNU/Linux
>Description:
I'm trying to extract base.tgz from the NetBSD ISO onto a freshly created FFS image  inside a rump kernel. The goal was to try to reproduce http://gnats.netbsd.org/cgi-bin/query-pr-single.pl?number=50139 in userspace.

The rump kernel panics with 'bad dir' every time (different message than the one with the KVM/virtio).

It is quite possible that I'm using newfs and mount_ffs wrongly, this is the first time I try rump kernels.

Stacktrace of panic:
$ gdb -c core buildrump.sh/rump/bin/rump_allserver -ex 'thread apply all bt' -batch
[New LWP 7373]
[New LWP 7379]
[New LWP 7337]
[New LWP 7338]
[New LWP 7340]
[New LWP 7345]
[New LWP 7339]
[New LWP 7342]
[New LWP 7350]
[New LWP 7347]
[New LWP 7341]
[New LWP 7344]
[New LWP 7351]
[New LWP 7366]
[New LWP 7343]
[New LWP 7349]
[New LWP 7368]
[New LWP 7346]
[New LWP 7348]
[New LWP 7352]
[New LWP 7353]
[New LWP 7354]
[New LWP 7355]
[New LWP 7356]
[New LWP 7357]
[New LWP 7358]
[New LWP 7359]
[New LWP 7362]
[New LWP 7363]
[New LWP 7364]
[New LWP 7365]
[New LWP 7367]
[New LWP 7372]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `buildrump.sh/rump/bin/rump_allserver -d key=/netbsd.img hostpath=/mnt/storage/e'.
Program terminated with signal SIGABRT, Aborted.
#0  0x0000003452635107 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56

Thread 33 (Thread 0x7f7ecffff700 (LWP 7372)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x00007f7ef0b68e53 in serv_workbouncer (arg=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_sp.c:762
#2  0x000000330ce080a4 in start_thread (arg=0x7f7ecffff700) at pthread_create.c:309
#3  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 32 (Thread 0x7f7ed97fa700 (LWP 7367)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x00007f7ef0b6abaa in rumpuser_cv_wait (cv=0x198bf50, mtx=0x198bf00) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_pth.c:556
#2  0x00007f7ef0e1becd in docvwait (cv=0x196b408, mtx=0x196b400, ts=0x0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/locks.c:359
#3  0x00007f7ef0de6c63 in workqueue_worker (cookie=0x196b3c0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/../kern/subr_workqueue.c:130
#4  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe900) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#5  0x000000330ce080a4 in start_thread (arg=0x7f7ed97fa700) at pthread_create.c:309
#6  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 31 (Thread 0x7f7eda7fc700 (LWP 7365)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x00007f7ef0b6abaa in rumpuser_cv_wait (cv=0x1b29010, mtx=0x1b8e7c0) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_pth.c:556
#2  0x00007f7ef0e1becd in docvwait (cv=0x196b4c8, mtx=0x196b4c0, ts=0x0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/locks.c:359
#3  0x00007f7ef0de6c63 in workqueue_worker (cookie=0x196b480) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/../kern/subr_workqueue.c:130
#4  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe8a0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#5  0x000000330ce080a4 in start_thread (arg=0x7f7eda7fc700) at pthread_create.c:309
#6  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 30 (Thread 0x7f7edaffd700 (LWP 7364)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x00007f7ef0b6abaa in rumpuser_cv_wait (cv=0x1b8e3d0, mtx=0x1b8e380) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_pth.c:556
#2  0x00007f7ef0e1becd in docvwait (cv=0x196b588, mtx=0x196b580, ts=0x0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/locks.c:359
#3  0x00007f7ef0de6c63 in workqueue_worker (cookie=0x196b540) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/../kern/subr_workqueue.c:130
#4  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe870) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#5  0x000000330ce080a4 in start_thread (arg=0x7f7edaffd700) at pthread_create.c:309
#6  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 29 (Thread 0x7f7edb7fe700 (LWP 7363)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x00007f7ef0b6abaa in rumpuser_cv_wait (cv=0x18f1750, mtx=0x18f1640) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_pth.c:556
#2  0x00007f7ef0e1becd in docvwait (cv=0x7f7ef806cd20, mtx=0x7f7ef806cd40, ts=0x0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/locks.c:359
#3  0x00007f7ef7e665da in sysmon_task_queue_thread (arg=<optimized out>) at /var/tmp/rump/buildrump.sh/src/sys/rump/dev/lib/libsysmon/../../../../dev/sysmon/sysmon_taskq.c:195
#4  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe840) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#5  0x000000330ce080a4 in start_thread (arg=0x7f7edb7fe700) at pthread_create.c:309
#6  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 28 (Thread 0x7f7edbfff700 (LWP 7362)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x00007f7ef0b6abaa in rumpuser_cv_wait (cv=0x18ef850, mtx=0x18ef800) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_pth.c:556
#2  0x00007f7ef0e1becd in docvwait (cv=0x196b648, mtx=0x196b640, ts=0x0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/locks.c:359
#3  0x00007f7ef0de6c63 in workqueue_worker (cookie=0x196b600) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/../kern/subr_workqueue.c:130
#4  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe750) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#5  0x000000330ce080a4 in start_thread (arg=0x7f7edbfff700) at pthread_create.c:309
#6  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 27 (Thread 0x7f7ee1ffb700 (LWP 7359)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x00007f7ef0b6abaa in rumpuser_cv_wait (cv=0x18e95d0, mtx=0x18e9580) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_pth.c:556
#2  0x00007f7ef0e1becd in docvwait (cv=0x7f7ef7a3ea60 <rumpns_cryptoret_cv>, mtx=0x7f7ef7a3ed60 <rumpns_crypto_ret_q_mtx>, ts=0x0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/locks.c:359
#3  0x00007f7ef78384fd in cryptoret () at /var/tmp/rump/buildrump.sh/src/sys/rump/dev/lib/libopencrypto/../../../../opencrypto/crypto.c:1310
#4  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe6c0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#5  0x000000330ce080a4 in start_thread (arg=0x7f7ee1ffb700) at pthread_create.c:309
#6  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 26 (Thread 0x7f7ee27fc700 (LWP 7358)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x00007f7ef0b6abaa in rumpuser_cv_wait (cv=0x1adf390, mtx=0x1adf500) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_pth.c:556
#2  0x00007f7ef0e1becd in docvwait (cv=0x196b708, mtx=0x196b700, ts=0x0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/locks.c:359
#3  0x00007f7ef0de6c63 in workqueue_worker (cookie=0x196b6c0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/../kern/subr_workqueue.c:130
#4  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe690) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#5  0x000000330ce080a4 in start_thread (arg=0x7f7ee27fc700) at pthread_create.c:309
#6  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 25 (Thread 0x7f7ee2ffd700 (LWP 7357)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x00007f7ef0b6abaa in rumpuser_cv_wait (cv=0x1adf2d0, mtx=0x1adf280) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_pth.c:556
#2  0x00007f7ef0e1becd in docvwait (cv=0x196b7c8, mtx=0x196b7c0, ts=0x0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/locks.c:359
#3  0x00007f7ef0de6c63 in workqueue_worker (cookie=0x196b780) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/../kern/subr_workqueue.c:130
#4  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe660) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#5  0x000000330ce080a4 in start_thread (arg=0x7f7ee2ffd700) at pthread_create.c:309
#6  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 24 (Thread 0x7f7ee37fe700 (LWP 7356)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x00007f7ef0b6abaa in rumpuser_cv_wait (cv=0x1a74a10, mtx=0x192af40) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_pth.c:556
#2  0x00007f7ef0e1becd in docvwait (cv=0x7f7ef21fa930, mtx=0x7f7ef105f800 <rumpns_filelist_lock>, ts=0x0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/locks.c:359
#3  0x00007f7ef1ff7139 in unp_thread (cookie=<optimized out>) at /var/tmp/rump/buildrump.sh/src/sys/rump/net/lib/liblocal/../../../../kern/uipc_usrreq.c:1796
#4  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe5d0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#5  0x000000330ce080a4 in start_thread (arg=0x7f7ee37fe700) at pthread_create.c:309
#6  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 23 (Thread 0x7f7ee3fff700 (LWP 7355)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x00007f7ef0b6abaa in rumpuser_cv_wait (cv=0x192a4b0, mtx=0x18b9a40) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_pth.c:556
#2  0x00007f7ef0e1f3e2 in rump_schedlock_cv_wait (cv=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/scheduler.c:188
#3  0x00007f7ef0e21877 in sithread (arg=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/intr.c:171
#4  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe510) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#5  0x000000330ce080a4 in start_thread (arg=0x7f7ee3fff700) at pthread_create.c:309
#6  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 22 (Thread 0x7f7ee8ab8700 (LWP 7354)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x00007f7ef0b6abaa in rumpuser_cv_wait (cv=0x18ab790, mtx=0x18b98c0) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_pth.c:556
#2  0x00007f7ef0e1f3e2 in rump_schedlock_cv_wait (cv=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/scheduler.c:188
#3  0x00007f7ef0e21877 in sithread (arg=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/intr.c:171
#4  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe4e0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#5  0x000000330ce080a4 in start_thread (arg=0x7f7ee8ab8700) at pthread_create.c:309
#6  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 21 (Thread 0x7f7ee92b9700 (LWP 7353)):
#0  0x000000330ce0f18d in nanosleep () at ../sysdeps/unix/syscall-template.S:81
#1  0x00007f7ef0b69f17 in rumpuser_clock_sleep (enum_rumpclock=enum_rumpclock@entry=0, sec=1, nsec=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser.c:131
#2  0x00007f7ef0e21c95 in kpause (wmesg=<optimized out>, intr=<optimized out>, timeo=<optimized out>, mtx=0x7f7ef15b2158) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/emul.c:167
#3  0x00007f7ef1386b3c in sched_sync (arg=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librumpvfs/../../sys/rump/../kern/vfs_subr.c:861
#4  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe4b0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#5  0x000000330ce080a4 in start_thread (arg=0x7f7ee92b9700) at pthread_create.c:309
#6  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 20 (Thread 0x7f7ee9aba700 (LWP 7352)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x00007f7ef0b6abaa in rumpuser_cv_wait (cv=0x1977b90, mtx=0x1977b40) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_pth.c:556
#2  0x00007f7ef0e1becd in docvwait (cv=0x196bdc8, mtx=0x196bdc0, ts=0x0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/locks.c:359
#3  0x00007f7ef0de6c63 in workqueue_worker (cookie=0x196bd80) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/../kern/subr_workqueue.c:130
#4  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe480) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#5  0x000000330ce080a4 in start_thread (arg=0x7f7ee9aba700) at pthread_create.c:309
#6  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 19 (Thread 0x7f7eebb57700 (LWP 7348)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x00007f7ef0b6abaa in rumpuser_cv_wait (cv=0x18aad20, mtx=0x18aac80) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_pth.c:556
#2  0x00007f7ef0e1becd in docvwait (cv=0x7f7ef106fa90, mtx=0x7f7ef106faa8, ts=0x0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/locks.c:359
#3  0x00007f7ef0e1d5f9 in uvm_pageout (arg=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/vm.c:1075
#4  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe3c0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#5  0x000000330ce080a4 in start_thread (arg=0x7f7eebb57700) at pthread_create.c:309
#6  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 18 (Thread 0x7f7eecb59700 (LWP 7346)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x00007f7ef0b6acce in rumpuser_cv_wait_nowrap (cv=0x192a7a0, mtx=0x192a700) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_pth.c:567
#2  0x00007f7ef0e21613 in sithread_cpu_bouncer (arg=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/intr.c:205
#3  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe360) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#4  0x000000330ce080a4 in start_thread (arg=0x7f7eecb59700) at pthread_create.c:309
#5  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 17 (Thread 0x7f7ed8ff9700 (LWP 7368)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x00007f7ef0b6abaa in rumpuser_cv_wait (cv=0x191f910, mtx=0x191fa80) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_pth.c:556
#2  0x00007f7ef0e1becd in docvwait (cv=0x7f7ef105cd08, mtx=0x7f7ef105cd00, ts=0x0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/locks.c:359
#3  0x00007f7ef0de69d3 in xc_wait (where=14) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/../kern/subr_xcall.c:241
#4  0x00007f7ef3b9b1eb in hyp_lwpexit () at /var/tmp/rump/buildrump.sh/src/sys/rump/kern/lib/libsysproxy/sysproxy.c:159
#5  0x00007f7ef0b6798c in lwproc_lwpexit () at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_sp.c:256
#6  serv_handledisco (idx=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_sp.c:577
#7  0x00007f7ef0b685c9 in serv_shutdown () at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_sp.c:603
#8  spserver (arg=0x18ab820) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_sp.c:1296
#9  0x000000330ce080a4 in start_thread (arg=0x7f7ed8ff9700) at pthread_create.c:309
#10 0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 16 (Thread 0x7f7eeb2bd700 (LWP 7349)):
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238
#1  0x00007f7ef0b6ac6e in rumpuser_cv_timedwait (cv=0x19342d0, mtx=0x1940f80, sec=1, nsec=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_pth.c:597
#2  0x00007f7ef0e1be93 in docvwait (cv=0x7f7ef15b14c0, mtx=0x7f7ef15b1580, ts=ts@entry=0x7f7eeb2bceb0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/locks.c:355
#3  0x00007f7ef0e1c18a in cv_timedwait (cv=<optimized out>, mtx=<optimized out>, ticks=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/locks.c:424
#4  0x00007f7ef137abbf in vdrain_thread (cookie=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librumpvfs/../../sys/rump/../kern/vfs_vnode.c:467
#5  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe3f0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#6  0x000000330ce080a4 in start_thread (arg=0x7f7eeb2bd700) at pthread_create.c:309
#7  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 15 (Thread 0x7f7eee35c700 (LWP 7343)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x00007f7ef0b6abaa in rumpuser_cv_wait (cv=0x192a470, mtx=0x18b9a40) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_pth.c:556
#2  0x00007f7ef0e1f3e2 in rump_schedlock_cv_wait (cv=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/scheduler.c:188
#3  0x00007f7ef0e21877 in sithread (arg=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/intr.c:171
#4  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe2d0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#5  0x000000330ce080a4 in start_thread (arg=0x7f7eee35c700) at pthread_create.c:309
#6  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 14 (Thread 0x7f7ed9ffb700 (LWP 7366)):
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238
#1  0x00007f7ef0b6ac6e in rumpuser_cv_timedwait (cv=0x1c0c6d0, mtx=0x1c0c680, sec=5, nsec=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_pth.c:597
#2  0x00007f7ef0e1be93 in docvwait (cv=0x7f7ef2420970, mtx=0x7f7ef2420988, ts=ts@entry=0x7f7ed9ffaea0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/locks.c:355
#3  0x00007f7ef0e1c18a in cv_timedwait (cv=<optimized out>, mtx=<optimized out>, ticks=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/locks.c:424
#4  0x00007f7ef2216da9 in npf_worker (arg=<optimized out>) at /var/tmp/rump/buildrump.sh/src/sys/rump/net/lib/libnpf/../../../../net/npf/npf_worker.c:157
#5  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe8d0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#6  0x000000330ce080a4 in start_thread (arg=0x7f7ed9ffb700) at pthread_create.c:309
#7  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 13 (Thread 0x7f7eea2bb700 (LWP 7351)):
#0  0x000000330ce0f18d in nanosleep () at ../sysdeps/unix/syscall-template.S:81
#1  0x00007f7ef0b69f17 in rumpuser_clock_sleep (enum_rumpclock=enum_rumpclock@entry=0, sec=1, nsec=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser.c:131
#2  0x00007f7ef0e21c95 in kpause (wmesg=<optimized out>, intr=<optimized out>, timeo=<optimized out>, mtx=0x18f6d80) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/emul.c:167
#3  0x00007f7ef13951e4 in cache_thread (arg=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librumpvfs/../../sys/rump/../kern/vfs_cache.c:1155
#4  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe450) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#5  0x000000330ce080a4 in start_thread (arg=0x7f7eea2bb700) at pthread_create.c:309
#6  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 12 (Thread 0x7f7eedb5b700 (LWP 7344)):
#0  __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135
#1  0x000000330ce116b8 in _L_cond_lock_886 () from /lib/x86_64-linux-gnu/libpthread.so.0
#2  0x000000330ce11424 in __pthread_mutex_cond_lock (mutex=0x191fa80) at ../nptl/pthread_mutex_lock.c:79
#3  0x000000330ce0c11f in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:259
#4  0x00007f7ef0b6abaa in rumpuser_cv_wait (cv=0x1934010, mtx=0x191fa80) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_pth.c:556
#5  0x00007f7ef0e1becd in docvwait (cv=0x7f7ef1074018, mtx=0x7f7ef105cd00, ts=0x0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/locks.c:359
#6  0x00007f7ef0de6045 in xc_thread (cookie=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/../kern/subr_xcall.c:308
#7  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe300) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#8  0x000000330ce080a4 in start_thread (arg=0x7f7eedb5b700) at pthread_create.c:309
#9  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 11 (Thread 0x7f7eef35e700 (LWP 7341)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x00007f7ef0b6acce in rumpuser_cv_wait_nowrap (cv=0x192a7a0, mtx=0x192a700) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_pth.c:567
#2  0x00007f7ef0e21613 in sithread_cpu_bouncer (arg=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/intr.c:205
#3  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe270) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#4  0x000000330ce080a4 in start_thread (arg=0x7f7eef35e700) at pthread_create.c:309
#5  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 10 (Thread 0x7f7eec358700 (LWP 7347)):
#0  __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135
#1  0x000000330ce116b8 in _L_cond_lock_886 () from /lib/x86_64-linux-gnu/libpthread.so.0
#2  0x000000330ce11424 in __pthread_mutex_cond_lock (mutex=0x191fa80) at ../nptl/pthread_mutex_lock.c:79
#3  0x000000330ce0c11f in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:259
#4  0x00007f7ef0b6abaa in rumpuser_cv_wait (cv=0x192a9d0, mtx=0x191fa80) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_pth.c:556
#5  0x00007f7ef0e1becd in docvwait (cv=0x7f7ef1074a58, mtx=0x7f7ef105cd00, ts=0x0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/locks.c:359
#6  0x00007f7ef0de6045 in xc_thread (cookie=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/../kern/subr_xcall.c:308
#7  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe390) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#8  0x000000330ce080a4 in start_thread (arg=0x7f7eec358700) at pthread_create.c:309
#9  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 9 (Thread 0x7f7eeaabc700 (LWP 7350)):
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238
#1  0x00007f7ef0b6ac6e in rumpuser_cv_timedwait (cv=0x1977010, mtx=0x1934280, sec=1, nsec=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_pth.c:597
#2  0x00007f7ef0e1be93 in docvwait (cv=0x7f7ef15b1400, mtx=0x7f7ef15b1440, ts=ts@entry=0x7f7eeaabbe90) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/locks.c:355
#3  0x00007f7ef0e1c18a in cv_timedwait (cv=<optimized out>, mtx=<optimized out>, ticks=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/locks.c:424
#4  0x00007f7ef137a815 in vrele_thread (cookie=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librumpvfs/../../sys/rump/../kern/vfs_vnode.c:851
#5  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe420) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#6  0x000000330ce080a4 in start_thread (arg=0x7f7eeaabc700) at pthread_create.c:309
#7  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 8 (Thread 0x7f7eeeb5d700 (LWP 7342)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x00007f7ef0b6abaa in rumpuser_cv_wait (cv=0x18ab890, mtx=0x18b98c0) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_pth.c:556
#2  0x00007f7ef0e1f3e2 in rump_schedlock_cv_wait (cv=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/scheduler.c:188
#3  0x00007f7ef0e21877 in sithread (arg=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/intr.c:171
#4  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe2a0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#5  0x000000330ce080a4 in start_thread (arg=0x7f7eeeb5d700) at pthread_create.c:309
#6  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 7 (Thread 0x7f7ef0360700 (LWP 7339)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x00007f7ef0b6abaa in rumpuser_cv_wait (cv=0x192a430, mtx=0x18b9a40) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_pth.c:556
#2  0x00007f7ef0e1f3e2 in rump_schedlock_cv_wait (cv=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/scheduler.c:188
#3  0x00007f7ef0e21877 in sithread (arg=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/intr.c:171
#4  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe210) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#5  0x000000330ce080a4 in start_thread (arg=0x7f7ef0360700) at pthread_create.c:309
#6  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 6 (Thread 0x7f7eed35a700 (LWP 7345)):
#0  __clock_nanosleep (clock_id=clock_id@entry=1, flags=flags@entry=1, req=req@entry=0x7f7eed359e50, rem=0x34526f2db4 <__clock_nanosleep+132>, rem@entry=0x0) at ../sysdeps/unix/sysv/linux/clock_nanosleep.c:49
#1  0x00007f7ef0b69eb0 in rumpuser_clock_sleep (enum_rumpclock=enum_rumpclock@entry=1, sec=sec@entry=2359, nsec=nsec@entry=655288507) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser.c:141
#2  0x00007f7ef0e210b8 in doclock (noarg=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/intr.c:128
#3  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe330) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#4  0x000000330ce080a4 in start_thread (arg=0x7f7eed35a700) at pthread_create.c:309
#5  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 5 (Thread 0x7f7eefb5f700 (LWP 7340)):
#0  __clock_nanosleep (clock_id=clock_id@entry=1, flags=flags@entry=1, req=req@entry=0x7f7eefb5ee50, rem=0x34526f2db4 <__clock_nanosleep+132>, rem@entry=0x0) at ../sysdeps/unix/sysv/linux/clock_nanosleep.c:49
#1  0x00007f7ef0b69eb0 in rumpuser_clock_sleep (enum_rumpclock=enum_rumpclock@entry=1, sec=sec@entry=2359, nsec=nsec@entry=646021344) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser.c:141
#2  0x00007f7ef0e210b8 in doclock (noarg=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/intr.c:128
#3  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe240) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#4  0x000000330ce080a4 in start_thread (arg=0x7f7eefb5f700) at pthread_create.c:309
#5  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 4 (Thread 0x7f7ef0b61700 (LWP 7338)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x00007f7ef0b6abaa in rumpuser_cv_wait (cv=0x18ab990, mtx=0x18b98c0) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_pth.c:556
#2  0x00007f7ef0e1f3e2 in rump_schedlock_cv_wait (cv=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/scheduler.c:188
#3  0x00007f7ef0e21877 in sithread (arg=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/intr.c:171
#4  0x00007f7ef0e1e35e in threadbouncer (arg=0x18fe1e0) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/threads.c:90
#5  0x000000330ce080a4 in start_thread (arg=0x7f7ef0b61700) at pthread_create.c:309
#6  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 3 (Thread 0x7f7ef8f10740 (LWP 7337)):
#0  sem_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/sem_wait.S:85
#1  0x0000000000401ce2 in main (argc=<optimized out>, argv=0x7ffeb7cabbe8) at /var/tmp/rump/buildrump.sh/src/usr.bin/rump_allserver/rump_allserver.c:476

Thread 2 (Thread 0x7f7eceffd700 (LWP 7379)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
#1  0x00007f7ef0b69aab in biothread (arg=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_bio.c:117
#2  0x000000330ce080a4 in start_thread (arg=0x7f7eceffd700) at pthread_create.c:309
#3  0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 1 (Thread 0x7f7ecf7fe700 (LWP 7373)):
#0  0x0000003452635107 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56
#1  0x00000034526364e8 in __GI_abort () at abort.c:89
#2  0x00007f7ef0b6a154 in rumpuser_exit (rv=rv@entry=-1) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser.c:237
#3  0x00007f7ef0e21f4a in cpu_reboot (howto=<optimized out>, bootstr=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/librump/rumpkern/emul.c:393
#4  0x00007f7ef0decdc5 in vpanic (fmt=0x7f7ef6dd175e "bad dir", ap=ap@entry=0x7f7ecf7fd868) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/../kern/subr_prf.c:340
#5  0x00007f7ef0dece83 in panic (fmt=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/../kern/subr_prf.c:256
#6  0x00007f7ef6dad710 in ufs_dirbad (ip=<optimized out>, offset=<optimized out>, how=<optimized out>) at /var/tmp/rump/buildrump.sh/src/sys/rump/fs/lib/libffs/../../../../ufs/ufs/ufs_lookup.c:661
#7  0x00007f7ef6dae396 in ufs_lookup (v=0x1ca9) at /var/tmp/rump/buildrump.sh/src/sys/rump/fs/lib/libffs/../../../../ufs/ufs/ufs_lookup.c:333
#8  0x00007f7ef0ddff19 in VOP_LOOKUP (dvp=0x1b753e0, vpp=0x7f7ecf7fda08, cnp=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librump/../../sys/rump/../kern/vnode_if.c:119
#9  0x00007f7ef13895f9 in lookup_once (state=state@entry=0x7f7ecf7fdbb0, searchdir=0x1b753e0, newsearchdir_ret=newsearchdir_ret@entry=0x7f7ecf7fdb10, foundobj_ret=foundobj_ret@entry=0x7f7ecf7fdb18) at /var/tmp/rump/buildrump.sh/src/lib/librumpvfs/../../sys/rump/../kern/vfs_lookup.c:985
#10 0x00007f7ef138a404 in namei_oneroot (isnfsd=<optimized out>, inhibitmagic=<optimized out>, neverfollow=<optimized out>, state=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librumpvfs/../../sys/rump/../kern/vfs_lookup.c:1213
#11 namei_tryemulroot (state=state@entry=0x7f7ecf7fdbb0, neverfollow=neverfollow@entry=0, inhibitmagic=inhibitmagic@entry=0, isnfsd=isnfsd@entry=0) at /var/tmp/rump/buildrump.sh/src/lib/librumpvfs/../../sys/rump/../kern/vfs_lookup.c:1467
#12 0x00007f7ef138be22 in namei (ndp=0x7f7ecf7fdd28) at /var/tmp/rump/buildrump.sh/src/lib/librumpvfs/../../sys/rump/../kern/vfs_lookup.c:1503
#13 0x00007f7ef13788d0 in vn_open (ndp=0x7f7ecf7fdd28, fmode=2563, cmode=384) at /var/tmp/rump/buildrump.sh/src/lib/librumpvfs/../../sys/rump/../kern/vfs_vnops.c:175
#14 0x00007f7ef13817b9 in do_open (l=l@entry=0x7f7ebcb41800, dvp=0x0, pb=<optimized out>, open_flags=open_flags@entry=2562, open_mode=open_mode@entry=384, fd=fd@entry=0x7f7ecf7fde3c) at /var/tmp/rump/buildrump.sh/src/lib/librumpvfs/../../sys/rump/../kern/vfs_syscalls.c:1578
#15 0x00007f7ef1381919 in do_sys_openat (l=0x7f7ebcb41800, fdat=fdat@entry=-100, path=<optimized out>, flags=2562, mode=384, fd=fd@entry=0x7f7ecf7fde3c) at /var/tmp/rump/buildrump.sh/src/lib/librumpvfs/../../sys/rump/../kern/vfs_syscalls.c:1658
#16 0x00007f7ef13819f1 in sys_open (l=<optimized out>, uap=<optimized out>, retval=0x7f7ecf7fde60) at /var/tmp/rump/buildrump.sh/src/lib/librumpvfs/../../sys/rump/../kern/vfs_syscalls.c:1678
#17 0x00007f7ef3b9b3f4 in sy_call (rval=0x7f7ecf7fde60, uap=0x7f7ec8001a20, l=0x7f7ebcb41800, sy=0x7f7ef105f9b8 <rumpns_sysent+120>) at /var/tmp/rump/buildrump.sh/src/sys/rump/kern/lib/libsysproxy/../../../../sys/syscallvar.h:65
#18 sy_invoke (code=5, rval=0x7f7ecf7fde60, uap=0x7f7ec8001a20, l=0x7f7ebcb41800, sy=0x7f7ef105f9b8 <rumpns_sysent+120>) at /var/tmp/rump/buildrump.sh/src/sys/rump/kern/lib/libsysproxy/../../../../sys/syscallvar.h:94
#19 hyp_syscall (num=5, arg=0x7f7ec8001a20, retval=0x7f7ecf7fded0) at /var/tmp/rump/buildrump.sh/src/sys/rump/kern/lib/libsysproxy/sysproxy.c:72
#20 0x00007f7ef0b68f1d in rumpsyscall (regrv=0x7f7ecf7fdec0, data=0x7f7ec8001a20, sysnum=5) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_sp.c:267
#21 serv_handlesyscall (rhdr=0x7f7ec80014d8, rhdr=0x7f7ec80014d8, data=0x7f7ec8001a20 "@B!\001", spc=0x7f7ef0d6df50) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_sp.c:690
#22 serv_workbouncer (arg=<optimized out>) at /var/tmp/rump/buildrump.sh/src/lib/librumpuser/rumpuser_sp.c:772
#23 0x000000330ce080a4 in start_thread (arg=0x7f7ecf7fe700) at pthread_create.c:309
#24 0x00000034526e604d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

edwin@debian:/var/tmp/rump/rumpctrl$ git describe
lastdyn-348-g33876f3
edwin@debian:/var/tmp/rump/rumpctrl/src-netbsd$ git describe --always
f419a5f
edwin@debian:/var/tmp/rump/buildrump.sh$ git describe --tags
v20140526-387-gad55254
edwin@debian:/var/tmp/rump/buildrump.sh/src$ git describe --always
75ac29d

Looks like src-netbsd git checkouts aren't the same between buildrump.sh and
rumpctrl. I tried adjusting buildrump.sh/.srcgitrev to f419a5f, and rebuilding but the panic
still reproduces.

>How-To-Repeat:
Create a netbsd.img ext2 filesystem image using containing at least base.tgz from the NetBSD ISO:
$ genext2fs -b 500000 -d /path/to/amd64/binary/sets/ /mnt/storage/edwin/netbsd.img
$ ls -l /mnt/storage/edwin/netbsd.img
-rw-r--r-- 1 edwin edwin 512000000 Aug  9 12:54 /mnt/storage/edwin/netbsd.img
$ ls -l /path/to/amd64/binary/sets/base.tgz
-rw-r--r-- 1 611 input 47394732 Sep 29  2014 /tmp/x/amd64/binary/sets/base.tgz
$ . ./rumpctrl/rumpctrl.sh
rumpctrl (NULL)$ export RUMP_SERVER=unix://rumpserver
rumpctrl (unix://rumpserver)$ rumpctrl_hostcmd buildrump.sh/rump/bin/rump_allserver -d key=/netbsd.img,hostpath=/mnt/storage/edwin/netbsd.img,size=host  -d key=/disk,hostpath=disk.img,size=1073741824 $RUMP_SERVER -s &
rumpctrl (unix://rumpserver)$ sysctl kern.version
kern.version = NetBSD 7.99.17 (RUMP-ROAST)
rumpctrl (unix://rumpserver)$ mkdir /mnt /target
rumpctrl (unix://rumpserver)$ mount_ext2fs -o ro /netbsd.img /mnt
rumpctrl (unix://rumpserver)$ newfs -F /disk
/disk: 1024.0MB (2097152 sectors) block size 16384, fragment size 2048
	using 6 cylinder groups of 170.67MB, 10923 blks, 21504 inodes.
super-block backups (for fsck_ffs -b #) at:
32, 349568, 699104, 1048640, 1398176, 1747712,
rumpctrl (unix://rumpserver)$ mount_ffs /disk /target
rumpctrl (unix://rumpserver)$ dd if=/mnt/base.tgz |zcat | pax -r -s ',/,/target/,'
dd if=/mnt/base.tgz |zcat | pax -r -s ',/,/target/,'
/target: bad dir ino 64512 at offset 52: mangled entry
panic: bad dir
rump kernel halting...
halted
dd: /mnt/base.tgz: Unknown error: 107
1210+0 records in
1210+0 records out
619520 bytes transferred in 18446744072270326769.-319 secs (0 bytes/sec)
pax: Unable to obtain block size for file ./target/bin/sleep (Unknown error: 107)
pax: Failed write to file ./target/bin/sleep (Bad file descriptor)
pax: Cannot close file descriptor on ./target/bin/sleep.XtSUu9 (Unknown error: 107)
pax: Cannot set permissions on ./target/bin/sleep.XtSUu9 (Unknown error: 107)
pax: Access/modification time set failed on: ./target/bin/sleep.XtSUu9 (Unknown error: 107)
pax: Cannot rename ./target/bin/sleep.XtSUu9 to ./target/bin/sleep (Unknown error: 107)
pax: Cannot create ./target/bin/stty.b77UoC (Unknown error: 107)
pax: Cannot create ./target/bin/sync.yNry6J (Unknown error: 107)
pax: Cannot link to ./target/bin/cpio from ./target/bin/tar (Unknown error: 107)
pax: Cannot link to ./target/bin/[ from ./target/bin/test (Unknown error: 107)
pax: Cannot create ./target/dev (Unknown error: 107)
pax: Cannot create ./target/dev/log (Unknown error: 107)
pax: Cannot create ./target/dev/altq (Unknown error: 107)
pax: Cannot create ./target/dev/fd (Unknown error: 107)
pax: Cannot create ./target/etc (Unknown error: 107)
pax: Cannot create ./target/etc/release.MTJmNH (Unknown error: 107)
pax: Cannot create ./target/etc/X11 (Unknown error: 107)
pax: Cannot create ./target/etc/X11/fs (Unknown error: 107)
pax: Cannot create ./target/etc/X11/lbxproxy (Unknown error: 107)
pax: Cannot create ./target/etc/X11/proxymngr (Unknown error: 107)
pax: Cannot create ./target/etc/X11/rstart (Unknown error: 107)
pax: Cannot create ./target/etc/X11/rstart/commands (Unknown error: 107)
pax: Cannot create ./target/etc/X11/rstart/commands/x11r6 (Unknown error: 107)
pax: Cannot create ./target/etc/X11/rstart/contexts (Unknown error: 107)
pax: Cannot create ./target/etc/X11/twm (Unknown error: 107)
pax: Cannot create ./target/etc/X11/xdm (Unknown error: 107)
pax: Cannot create ./target/etc/X11/xinit (Unknown error: 107)
pax: Cannot create ./target/etc/X11/xserver (Unknown error: 107)
pax: Cannot create ./target/etc/X11/xsm (Unknown error: 107)
pax: Cannot create ./target/etc/atf (Unknown error: 107)
pax: Cannot create ./target/etc/cgd (Unknown error: 107)
pax: Cannot create ./target/etc/defaults (Unknown error: 107)
pax: Cannot create ./target/etc/fonts (Unknown error: 107)
pax: Cannot create ./target/etc/fonts/conf.avail (Unknown error: 107)
pax: Cannot create ./target/etc/fonts/conf.d (Unknown error: 107)
pax: Cannot create ./target/etc/iscsi (Unknown error: 107)
pax: Cannot create ./target/etc/kerberosV (Unknown error: 107)
pax: Cannot create ./target/etc/mail (Unknown error: 107)
pax: Cannot create ./target/etc/mtree (Unknown error: 107)
pax: Cannot create ./target/etc/mtree/set.base.hp235J (Unknown error: 107)

gzip: stdin: unexpected end of file
pax: End of archive volume 1 reached
pax: Access/modification time set failed on: ./target/bin (Unknown error: 107)
pax: Access/modification time set failed on: ./target/altroot (Unknown error: 107)
pax: Access/modification time set failed on: . (Unknown error: 107)
[1]+  Aborted                 (core dumped) PATH="${rrPATH}" "$@"


dd: /mnt/base.tgz: Unknown error: 107
1207+0 records in
1207+0 records out
617984 bytes transferred in 18446744072270326879.-238 secs (0 bytes/sec)
pax: Unable to obtain block size for file ./target/bin/sleep (Unknown error: 107)
pax: Failed write to file ./target/bin/sleep (Bad file descriptor)
pax: Cannot close file descriptor on ./target/bin/sleep.CDg7Sn (Unknown error: 107)
pax: Cannot set permissions on ./target/bin/sleep.CDg7Sn (Unknown error: 107)
[...]
pax: Access/modification time set failed on: . (Unknown error: 107)
rumpctrl (unix://rumpserver)$ ls
rumpclient init failed
>Fix: