Re: Shark hangs hard

[Martin Husemann <martin%duskware.de@localhost>]

On Thu, Mar 09, 2017 at 11:27:23AM +0100, Martin Husemann wrote:
> Just a heads up (while still investigating): this week I have been unable
> to run the weekly atf tests on shark.
> 
> The machine hangs hard, randomly, and never survived a full test run.
> We have seen hangs before (on sharks with less memory, even during
> the nightly runs), but never on this 96 MB one.
> 
> My other shark (with 64MB) is happy and never crashed since Nick's recent
> pmap changes. I haven't stressed it a lot nor run atf tests on it though.

It survived a full atf run now, after reverting a local config change:

in testing for kern/52023 I had moved the machine from its ancient, hard
wired network configuration:

ifconfig_cs0="inet 192.168.150.102 netmask 255.255.254.0"
defaultroute=192.168.151.1
rtsol=YES

to:

dhcpcd=YES

and reverting that avoided the problem. I guess having a bpf listener open
causes a race somewhere - this is a tiny machine, and atf loads it
heavily. A full run takes about 12 hours. Full dmesg below.

Martin

Copyright (c) 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005,
    2006, 2007, 2008, 2009, 2010, 2011, 2012, 2013, 2014, 2015, 2016, 2017
    The NetBSD Foundation, Inc.  All rights reserved.
Copyright (c) 1982, 1986, 1989, 1991, 1993
    The Regents of the University of California.  All rights reserved.

NetBSD 7.99.65 (GENERIC) #52: Wed Mar  8 16:29:30 CET 2017
	martin%martins.aprisoft.de@localhost:/ssd/src/sys/arch/shark/compile/GENERIC
total memory = 98304 KB
avail memory = 90944 KB
sysctl_createv: sysctl_create(machine_arch) returned 17
timecounter: Timecounters tick every 15.625 msec
mainbus0 (root)
cpu0 at mainbus0 core 0: SA-110 step S (SA-1 V4 core)
cpu0: DC enabled IC enabled WB enabled EABT
cpu0: 16KB/32B 32-way L1 VIVT Instruction cache
cpu0: 16KB/32B 32-way write-back L1 VIVT Data cache
ofbus0 (root)
ofbus1 at ofbus0 (packages)
client-services at ofbus1 not configured
terminal-emulator at ofbus1 not configured
stringio at ofbus1 not configured
deblocker at ofbus1 not configured
obp-tftp at ofbus1 not configured
ufs-file-system at ofbus1 not configured
fat-file-system at ofbus1 not configured
iso9660-file-system at ofbus1 not configured
disk-label at ofbus1 not configured
dropin-file-system at ofbus1 not configured
sound.wav at ofbus1 not configured
chosen at ofbus0 not configured
openprom at ofbus0 not configured
options at ofbus0 not configured
aliases at ofbus0 not configured
memory@f000000 at ofbus0 not configured
mmu at ofbus0 not configured
ofbus2 at ofbus0 (vlbus)
ofisa0 at ofbus2 (isa)
dma-controller@i00 at ofisa0 not configured
interrupt-controller@i20 at ofisa0 not configured
timer@i40 at ofisa0 not configured
configuration@i15c at ofisa0 not configured
com0 at ofisa0 (serial@i3f8): ns16550a, working fifo
com0: console
lpt0 at ofisa0 (parallel@i378)
pckbc0 at ofisa0 (8042@i60)
power@i380 at ofisa0 not configured
ofbus3 at ofisa0 (gpio@i3e0)
eeprom at ofbus3 not configured
ofrtc0 at ofisa0 (rtc@i70): rtc
ofisascr0 at ofisa0 (scr@i24)
scr0 at ofisascr0
com1 at ofisa0 (ir@i2f8): ns16550a, working fifo
cs0 at ofisa0 (ethernet@i300): CRUS,CS8900
cs0: cs0: CS8900 rev. F, address 08:00:2b:81:65:72, media UTP
joy0 at ofisa0 (game@i201): ESST,game
joy0: joystick not connected
midi@i330 at ofisa0 not configured
ess0 at ofisa0 (sound@i220): ESST,es1887-codec
ess0: ESS Technology ES1887 [version 0x688b]
ess0: audio1 interrupting at irq 9
ess0: audio2 interrupting at irq 15
audio0 at ess0: full duplex, playback, capture, mmap, independent
ess0: Virtual format configured - Format SLINEAR, precision 16, channels 2, frequency 44100
spkr0 at audio0: PC Speaker (synthesized)
opl0 at ess0: model OPL3
midi0 at opl0: ESS Yamaha OPL3
wdc0 at ofisa0 (ide@i1f0)
atabus0 at wdc0 channel 0
pci at ofbus2 not configured
igsfb0 at ofbus2 (display@it3b0): IGS CyberPro 2010 at 0x06000000
unable to find font Gallant 12x22
igsfb0: 2MB, 1024x768, 8bpp
igsfb0: using 8bpp for X
wsdisplay0 at igsfb0 kbdmux 1
wsmux1: connecting to wsdisplay0
ofrom0 at ofbus0 (flash@7000000): 0x7000000-0x707ffff
ofrom1 at ofbus0 (romcard@10000000): 0x10000000-0x10ffffff
ofbus4 at ofbus0 (cpus)
cpu@0 at ofbus4 not configured
ofbus5 at ofbus0 (udp)
nfs at ofbus5 not configured
spl_masks[0]=ffffffff
spl_masks[1]=ffffffff
spl_masks[2]=ffffffff
spl_masks[3]=ffffffff
spl_masks[4]=ffffffff
spl_masks[5]=ffffbf5f
spl_masks[6]=ffff3d5f
spl_masks[7]=ffff3d47
timecounter: Timecounter "clockinterrupt" frequency 64 Hz quality 0
clock: hz=64 stathz = 0 profhz = 0
timecounter: Timecounter "i8253" frequency 1193182 Hz quality 100
wd0 at atabus0 drive 0
wd0: <SAMSUNG HM120IC>
wd0: drive supports 16-sector PIO transfers, LBA48 addressing
wd0: 111 GB, 232581 cyl, 16 head, 63 sec, 512 bytes/sect x 234441648 sectors
wd0: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 5 (Ultra/100)
boot device: wd0
root on wd0a dumps on wd0b
root file system type: ffs
kern.module.path=/stand/shark/7.99.65/modules