panic in netbsd-5 (out of space in kmem_map)

[Jeff Rizzo <riz%tastylime.net@localhost>]

I got a familiar-seeming panic in a netbsd-5 system that was recently
upgraded from 4.99.72.   It's an amd64 box, if that matters:

panic: malloc: out of space in kmem_map
fatal breakpoint trap in supervisor mode
trap type 1 code 0 rip ffffffff804ea125 cs 8 rflags 246 cr2 
7f7ffdb13064 cpl 0 rsp ffff80009fff9750
Stopped in pid 13828.1 (raidctl) at     netbsd:breakpoint+0x5:  leave
db{0}> bt 
breakpoint() at netbsd:breakpoint+0x5
panic() at netbsd:panic+0x260
malloc() at netbsd:malloc+0x3a7
raidioctl() at netbsd:raidioctl+0x478
cdev_ioctl() at netbsd:cdev_ioctl+0x91
VOP_IOCTL() at netbsd:VOP_IOCTL+0x6e
vn_ioctl() at netbsd:vn_ioctl+0x6d
sys_ioctl() at netbsd:sys_ioctl+0x134
syscall() at netbsd:syscall+0xb6
db{0}>

This is netbsd-5 from a couple weeks ago - does this look familiar to
anyone?  It happened (I assume, due to timing) during the daily
housekeeping (from /etc/daily).  Anything else I should be getting from
ddb next time?


Here's a dmesg in case it helps:
booting hd0a:netbsd - starting in 0
9819544+478496+781792 [702096+455719]=0xcacd78
Copyright (c) 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005,
    2006, 2007, 2008
    The NetBSD Foundation, Inc.  All rights reserved.
Copyright (c) 1982, 1986, 1989, 1991, 1993
    The Regents of the University of California.  All rights reserved.

NetBSD 5.0_BETA (GENERIC) #1: Tue Nov 18 11:59:20 PST 2008
   
riz%colossus.corp.revision3.com@localhost:/home/riz/netbsd/src5/sys/arch/amd64/compile/obj.amd64/GENERIC
total memory = 16382 MB
avail memory = 15869 MB
SMBIOS rev. 2.4 @ 0xcff6a000 (46 entries)
Supermicro X7DB8-X (0123456789)
mainbus0 (root)
cpu0 at mainbus0 apid 0: Intel 686-class, 2000MHz, id 0x6f6
cpu1 at mainbus0 apid 6: Intel 686-class, 2000MHz, id 0x6f6
cpu2 at mainbus0 apid 1: Intel 686-class, 2000MHz, id 0x6f6
cpu3 at mainbus0 apid 7: Intel 686-class, 2000MHz, id 0x6f6
ioapic0 at mainbus0 apid 2
ioapic1 at mainbus0 apid 3
acpi0 at mainbus0: Intel ACPICA 20080321
pcppi1 at acpi0 (SPKR, PNP0800)
pcppi1: io 0x61
midi0 at pcppi1: PC speaker (CPU-intensive output)
sysbeep0 at pcppi1
attimer1 at acpi0 (TIME, PNP0100): AT Timer
attimer1: io 0x40-0x43,0x50-0x53 irq 0
FWHD (INT0800) at acpi0 not configured
pckbc1 at acpi0 (KBC0, PNP0303): kbd port
pckbc1: io 0x60,0x64 irq 1
pckbc2 at acpi0 (MSE0, PNP0F13): aux port
pckbc2: irq 12
COM1 (PNP0501) at acpi0 not configured
COM2 (PNP0501) at acpi0 not configured
FDC (PNP0700) at acpi0 not configured
acpibut0 at acpi0 (PWRB, PNP0C0C): ACPI Power Button
attimer1: attached to pcppi1
pci0 at mainbus0 bus 0: configuration mode 1
pchb0 at pci0 dev 0 function 0
pchb0: vendor 0x8086 product 0x25d8 (rev. 0xb1)
ppb0 at pci0 dev 2 function 0: vendor 0x8086 product 0x25f7 (rev. 0xb1)
pci1 at ppb0 bus 1
ppb1 at pci1 dev 0 function 0: vendor 0x8086 product 0x3500 (rev. 0x01)
pci2 at ppb1 bus 2
ppb2 at pci2 dev 0 function 0: vendor 0x8086 product 0x3510 (rev. 0x01)
pci3 at ppb2 bus 3
ppb3 at pci2 dev 2 function 0: vendor 0x8086 product 0x3518 (rev. 0x01)
pci4 at ppb3 bus 4
wm0 at pci4 dev 0 function 0: i80003 dual 1000baseT Ethernet, rev. 1
wm0: interrupting at ioapic0 pin 18
wm0: Ethernet address 00:30:48:7a:1d:42
ikphy0 at wm0 phy 1: i82563 10/100/1000 media interface, rev. 2
ikphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,
1000baseT-FDX, auto
wm1 at pci4 dev 0 function 1: i80003 dual 1000baseT Ethernet, rev. 1
wm1: interrupting at ioapic0 pin 19
wm1: Ethernet address 00:30:48:7a:1d:43
ikphy1 at wm1 phy 1: i82563 10/100/1000 media interface, rev. 2
ikphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,
1000baseT-FDX, auto
ppb4 at pci1 dev 0 function 3: vendor 0x8086 product 0x350c (rev. 0x01)
ppb4: disabling notification events
pci5 at ppb4 bus 5
ppb5 at pci0 dev 4 function 0: vendor 0x8086 product 0x25f8 (rev. 0xb1)
pci6 at ppb5 bus 6
ppb6 at pci6 dev 0 function 0: vendor 0x8086 product 0x0329 (rev. 0x09)
ppb6: disabling notification events
pci7 at ppb6 bus 7
ppb7 at pci6 dev 0 function 2: vendor 0x8086 product 0x032a (rev. 0x09)
ppb7: disabling notification events
pci8 at ppb7 bus 8
ppb8 at pci0 dev 6 function 0: vendor 0x8086 product 0x25f9 (rev. 0xb1)
pci9 at ppb8 bus 9
ppb9 at pci9 dev 0 function 0: vendor 0x8086 product 0x0329 (rev. 0x09)
ppb9: disabling notification events
pci10 at ppb9 bus 10
ppb10 at pci9 dev 0 function 2: vendor 0x8086 product 0x032a (rev. 0x09)
ppb10: disabling notification events
pci11 at ppb10 bus 11
vendor 0x8086 product 0x1a38 (miscellaneous system, revision 0xb1) at
pci0 dev 8 function 0 not configured
pchb1 at pci0 dev 16 function 0
pchb1: vendor 0x8086 product 0x25f0 (rev. 0xb1)
pchb2 at pci0 dev 16 function 1
pchb2: vendor 0x8086 product 0x25f0 (rev. 0xb1)
pchb3 at pci0 dev 16 function 2
pchb3: vendor 0x8086 product 0x25f0 (rev. 0xb1)
pchb4 at pci0 dev 17 function 0
pchb4: vendor 0x8086 product 0x25f1 (rev. 0xb1)
pchb5 at pci0 dev 19 function 0
pchb5: vendor 0x8086 product 0x25f3 (rev. 0xb1)
pchb6 at pci0 dev 21 function 0
pchb6: vendor 0x8086 product 0x25f5 (rev. 0xb1)
pchb7 at pci0 dev 22 function 0
pchb7: vendor 0x8086 product 0x25f6 (rev. 0xb1)
uhci0 at pci0 dev 29 function 0: vendor 0x8086 product 0x2688 (rev. 0x09)
uhci0: interrupting at ioapic0 pin 17
usb0 at uhci0: USB revision 1.0
uhci1 at pci0 dev 29 function 1: vendor 0x8086 product 0x2689 (rev. 0x09)
uhci1: interrupting at ioapic0 pin 19
usb1 at uhci1: USB revision 1.0
uhci2 at pci0 dev 29 function 2: vendor 0x8086 product 0x268a (rev. 0x09)
uhci2: interrupting at ioapic0 pin 18
usb2 at uhci2: USB revision 1.0
ehci0 at pci0 dev 29 function 7: vendor 0x8086 product 0x268c (rev. 0x09)
ehci0: interrupting at ioapic0 pin 17
ehci0: companion controllers, 2 ports each: uhci0 uhci1 uhci2
usb3 at ehci0: USB revision 2.0
ppb11 at pci0 dev 30 function 0: vendor 0x8086 product 0x244e (rev. 0xd9)
pci12 at ppb11 bus 12
vga0 at pci12 dev 1 function 0: vendor 0x1002 product 0x515e (rev. 0x02)
wsdisplay0 at vga0 kbdmux 1
drm at vga0 not configured
ichlpcib0 at pci0 dev 31 function 0
ichlpcib0: vendor 0x8086 product 0x2670 (rev. 0x09)
ichlpcib0: 24-bit timer
piixide0 at pci0 dev 31 function 1
piixide0: Intel 631xESB/632xESB IDE Controller (rev. 0x09)
piixide0: primary channel interrupting at ioapic0 pin 14
atabus0 at piixide0 channel 0
piixide0: secondary channel ignored (disabled)
piixide1 at pci0 dev 31 function 2
piixide1: Intel 631xESB/632xESB Serial ATA Controller (rev. 0x09)
piixide1: using ioapic0 pin 19 for native-PCI interrupt
atabus1 at piixide1 channel 0
atabus2 at piixide1 channel 1
ichsmb0 at pci0 dev 31 function 3: vendor 0x8086 product 0x269b (rev. 0x09)
ichsmb0: interrupting at ioapic0 pin 19
iic0 at ichsmb0: I2C bus
isa0 at ichlpcib0
com0 at isa0 port 0x3f8-0x3ff irq 4: ns16550a, working fifo
com0: console
com1 at isa0 port 0x2f8-0x2ff irq 3: ns16550a, working fifo
fdc0 at isa0 port 0x3f0-0x3f7 irq 6 drq 2
uhub0 at usb0: vendor 0x8086 UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub1 at usb1: vendor 0x8086 UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub2 at usb2: vendor 0x8086 UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub3 at usb3: vendor 0x8086 EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
atapibus0 at atabus0: 2 targets
cd0 at atapibus0 drive 1: <DV-28E-N, , 1.6A> cdrom removable
wd0 at atabus1 drive 0: <ST3750640AS>
wd0: quirks 2<FORCE_LBA48>
wd0: 698 GB, 1453521 cyl, 16 head, 63 sec, 512 bytes/sect x 1465149168
sectors
wd1 at atabus2 drive 1: <ST3750640NS>
wd1: quirks 2<FORCE_LBA48>
wd1: 698 GB, 1453521 cyl, 16 head, 63 sec, 512 bytes/sect x 1465149168
sectors
Kernelized RAIDframe activated
pad0: outputs: 44100Hz, 16-bit, stereo
audio0 at pad0: half duplex
raid0: RAID Level 1
raid0: Components: /dev/wd1a /dev/wd0a
raid0: Total Sectors: 1465148928 (715404 MB)
boot device: raid0
root on raid0a dumps on raid0b