port-evbarm/49395: cubietruck freezes under i/o load on netbsd-7 and HEAD

[mk%kilbi.de@localhost]

>Number:         49395
>Category:       port-evbarm
>Synopsis:       cubietruck freezes under i/o load on netbsd-7 and HEAD
>Confidential:   no
>Severity:       critical
>Priority:       high
>Responsible:    port-evbarm-maintainer
>State:          open
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Sat Nov 15 19:10:01 +0000 2014
>Originator:     Markus Kilbinger
>Release:        NetBSD 7.0_BETA
>Organization:
	
>Environment:
	
	
System: NetBSD ct1 7.0_BETA NetBSD 7.0_BETA (CUBIETRUCK) #0: Sat Nov 15 19:21:55 MET 2014 root@q:/usr/u/NetBSD/netbsd-7/src/sys/arch/evbarm/compile/CUBIETRUCK evbarm
Architecture: earmv7hf
Machine: evbarm
>Description:
	My cubietruck freezes during e. g. 'cvs -z2 update -dPA' in
	the machine's pkgsrc-tree.

	This happens under netbsd-7 BETA's _and_ HEAD's kernel (normal
	CUBIETRUCK configs) with a netbsd-7 userland.

	The NetBSD system is running on a connected 1 TB sata disk,
	the kernel is loaded from sdcard or via dhcp/tftp.

	The sata disk is populated with several 100 GB of data.

	The boot process runs flawlessly starting several daemons
	(e. g. postfix, dovecot, spamassassin, amavisd, clamd, pgsql).
	After that I can use the idle system quite normal.

	When I start 'cvs -z2 update -dPA' in its pkgsrc-tree folder
	(on the sata disk) the machine freezes after some time
	(secondes to some minutes): The network connections (ssh)
	become quite suddenly stuck. On the serial console pressing
	(pure) CRs repeats the login prompt quite normally, trying to
	login yields the same stuck situation.

	The hangup was not self-limited (waited about an hour).

	At that point I still can successfully ping the system (via
	ipv4 and ipv6) and enter DDB:

	Stopped in pid 1184.1 (getty) at        netbsd:cpu_Debugger+0x4:        bx      r14
	db{0}> show uvm
	Current UVM status:
	  pagesize=8192 (0x2000), pagemask=0x1fff, pageshift=13
	, ncolors=1  258898 VM pages: 152349 active, 78033 inactive, 8 wired, 7921 free
	  pages  45608 anon, 180741 file, 4041 exec
	  freemin=256, free-target=341, wired-max=86299
	  cpu0:
	    faults=267065, traps=559393, intrs=75562009, ctxswitch=744307153
	    softint=201536, syscalls=1116121
	  cpu1:
	    faults=258317, traps=3009273, intrs=305778776, ctxswitch=615049912
	    softint=69794, syscalls=1121207
	  fault counts:
	    noram=0, noanon=0, pgwait=0, pgrele=0
	    ok relocks(total)=1403(1403), anget(retrys)=35147795(0), amapcopy=27230
	    neighbor anon/obj pg=61493/238264, gets(lock/unlock)=71536/1403
	    cases: anon=35105352, anoncow=42444, obj=60644, prcopy=10891, przero=102748
	  daemon and swap counts:
	    woke=307478681, revs=10, scans=60772, obscans=10006, anscans=0
	    busy=0, freed=10006, reactivate=795, deactivate=138886
	    pageouts=0, pending=0, nswget=0
	    nswapdev=1, swpgavail=262143
	    swpages=262143, swpginuse=0, swpgonly=0, paging=0
	db{0}> bt
	0xbfd6d61c: netbsd:comintr+0xc
	0xbfd6d64c: netbsd:pic_dispatch+0xe8
	0xbfd6d6a4: netbsd:armgic_irq_handler+0xd4
	0xbfd6d714: netbsd:irq_entry+0x60
	0xbfd6d73c: netbsd:_splraise+0x3c
	0xbfd6d79c: netbsd:mutex_enter+0x294
	0xbfd6d7bc: netbsd:wakeup+0x44
	0xbfd6d7dc: netbsd:uvm_wait+0x5c
	0xbfd6d82c: netbsd:uvm_km_kmem_alloc+0x270
	0xbfd6d844: netbsd:pool_page_alloc+0x3c
	0xbfd6d884: netbsd:pool_grow+0x38
	0xbfd6d8bc: netbsd:pool_get+0x78
	0xbfd6d904: netbsd:pool_cache_get_slow+0x224
	0xbfd6d93c: netbsd:pool_cache_get_paddr+0x210
	0xbfd6d9bc: netbsd:ffs_loadvnode+0x250
	0xbfd6da24: netbsd:vcache_get+0x30c
	0xbfd6dad4: netbsd:ufs_lookup+0x7a8
	0xbfd6db0c: netbsd:VOP_LOOKUP+0x48
	0xbfd6db5c: netbsd:lookup_once+0x19c
	0xbfd6dc2c: netbsd:namei_tryemulroot+0x520
	0xbfd6dc64: netbsd:namei+0x34
	0xbfd6dd04: netbsd:check_exec+0x40
	0xbfd6dd6c: netbsd:execve_loadvm+0x1b8
	0xbfd6def4: netbsd:execve1+0x28
	0xbfd6df0c: netbsd:sys_execve+0x24
	0xbfd6df7c: netbsd:syscall+0x88
	0xbfd6dfac: netbsd:swi_handler+0x98
	db{0}> mach cpu 1
	kdb_trap: switching to cpu1
	Stopped in pid 3332.1 (cron) at netbsd:nullop:  mov     r0, #0x00000000
	db{1}> bt
	0xbdb4bd14: netbsd:mutex_enter+0xc
	0xbdb4bd64: netbsd:uvm_pagealloc_strat+0xb8
	0xbdb4bd84: netbsd:arm_pmap_alloc_poolpage+0x5c
	0xbdb4bdb4: netbsd:pmap_create+0x9c
	0xbdb4bddc: netbsd:uvmspace_init+0x6c
	0xbdb4be04: netbsd:uvmspace_alloc+0x44
	0xbdb4be34: netbsd:uvmspace_fork+0x2c
	0xbdb4be4c: netbsd:uvm_proc_fork+0x24
	0xbdb4bee4: netbsd:fork1+0x32c
	0xbdb4bf0c: netbsd:sys_fork+0x38
	0xbdb4bf7c: netbsd:syscall+0x88
	0xbdb4bfac: netbsd:swi_handler+0x98
	db{1}> reboot
	syncing disks...

	The 'syncing disks...' does not succeed, so I have to reset
	the machine.
	But: I've got _no_ filesystem corruption (UFS2) so far (did
	several fsck after the freeze / reset).

	Disabling MULTIPROCESSOR did not prevent from freeze.

>How-To-Repeat:

	Install / run a netbsd-7 evbarm-earmv7hf system on/from (a
	populated) sata-harddisk on a cubietruck and try to 'cvs
	update / checkout' a pkgsrc-tree on its harddisk. After some
	time (seconds to minutes) the system freezes ...

	A current HEAD kernel shows the same symptoms.

>Fix:
	Unknown.

>Unformatted: