Subject: Re: kern/32162: [netbsd-3.0] kernel dead-lock in MP system
To: None <kern-bug-people@netbsd.org, gnats-admin@netbsd.org,>
From: Andreas Wrede <andreas@planix.com>
List: netbsd-bugs
Date: 02/11/2006 16:00:05
The following reply was made to PR kern/32162; it has been noted by GNATS.

From: Andreas Wrede <andreas@planix.com>
To: gnats-bugs@NetBSD.org
Cc: Jason Thorpe <thorpej@shagadelic.org>,
	Manuel Bouyer <bouyer@antioche.eu.org>, kern-bug-people@NetBSD.org,
	gnats-admin@NetBSD.org, netbsd-bugs@NetBSD.org,
	Chuck Silvers <chuq@chuq.com>
Subject: Re: kern/32162: [netbsd-3.0] kernel dead-lock in MP system
Date: Sat, 11 Feb 2006 10:56:45 -0500

 --Apple-Mail-54-304932109
 Content-Transfer-Encoding: 7bit
 Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed
 
 
 I replaced the two isp(4) with a dual-channel LSI FC929 mpt(4) card  
 on Jan 26 on suggestions that the isp(4) driver could be the cause of  
 the memory corruption. Since then, the kernel paniced 3 times but  
 always with the same "kernel debugging assertion "ph->ph_nmissing !=  
 0" failed". Of the previous 27(!) panics, 2 were also ph- 
  >ph_nmissing != 0 asserts.
 
 The traceback is very similar in the last three panics:
 Thu Feb  9 08:01:39 2006
 panic: kernel debugging assertion "ph->ph_nmissing != 0" failed: file  
 "/u1/netbsd-3.0/src/sys/kern/subr_pool.c", line 1107
 Begin traceback...
 __main(c0676980,c06d16c0,453,c067f449,c079090c) at netbsd:__main
 pool_do_put(c0790a80,c078b940,cf983d8c,c04078c3,c0792e80) at  
 netbsd:pool_do_put+0x221
 pool_put(c0790a80,c078b940,ecd,1000,bfbfe000) at netbsd:pool_put+0x36
 uvmspace_free(c078b940,cf983e14,0,0,0) at netbsd:uvmspace_free+0x94
 sysctl_kern_proc_args(cf983efc,2,808a000,cf983ef0,0) at  
 netbsd:sysctl_kern_proc_args+0x212
 sysctl_dispatch(cf983ef4,4,808a000,cf983ef0,0) at  
 netbsd:sysctl_dispatch+0x76
 sys___sysctl(df60b034,cf983f64,cf983f5c,c0718c18,c033f1bf) at  
 netbsd:sys___sysctl+0xad
 syscall_plain() at netbsd:syscall_plain+0x1a5
 --- syscall (number 202) ---
 0xbdba60af:
 End traceback...
 syncing disks...
 switching with held simple_lock 0xc0790af4 CPU 0 /u1/netbsd-3.0/src/ 
 sys/kern/subr_pool.c:1208
 simple_lock_switchcheck(c071a3b4,1,cf12b8ac,c033ed51,c0719d9c) at  
 netbsd:simple_lock_switchcheck+0x15
 mi_switch(e0a9534c,0,33e,c,c1cd35b4) at netbsd:mi_switch+0x65
 preempt(1,c06d4600,4e8,cf12ba14,c1cd3580) at netbsd:preempt+0x75
 genfs_putpages(cf12ba94,989680,0,0,c05a76e0) at netbsd:genfs_putpages 
 +0x7ec
 VOP_PUTPAGES(d2dd4138,0,0,0,0) at netbsd:VOP_PUTPAGES+0x40
 ffs_full_fsync(cf12bbc4,10,c06cdb40,cf12bb5c,0) at  
 netbsd:ffs_full_fsync+0x3e3
 ffs_fsync(cf12bbc4,d2dd4138,10012,c033f1bf,c05a6f20) at  
 netbsd:ffs_fsync+0x4b
 VOP_FSYNC(d2dd4138,cc2208dc,0,0,0) at netbsd:VOP_FSYNC+0x4c
 ffs_sync(c20f4000,2,cc2208dc,d44f20b8,10b) at netbsd:ffs_sync+0x27a
 sys_sync(e0a9534c,0,0,f8079cd8,100) at netbsd:sys_sync+0x109
 vfs_shutdown(f8079cd8,0,cf12bcdc,c035ef39,100) at netbsd:vfs_shutdown 
 +0x6f
 cpu_reboot(100,0,0,c06ddc80,a7f) at netbsd:cpu_reboot+0x177
 panic(c0708ba0,c0676980,c067f449,c06d16c0,453) at netbsd:panic+0x109
 __main(c0676980,c06d16c0,4c53p,uc1:06 s7fpi44no9,utc0
 7Stopped in pid 18094.1 (check_procs) at netbsd:cpu_Debugger 
 +0x4:        leave
 
 db{1}> machine cpu 0
 using CPU 0
 db{1}> bt
 com_common_putc(801,0,2f8,39,0) at netbsd:com_common_putc+0x52
 comcnputc(801,39,73,c067ca27,1) at netbsd:comcnputc+0x1d
 cnputc(39,0,cf12b62c,2f8,2fd) at netbsd:cnputc+0x26
 putchar(39,1,0,c0725060,0) at netbsd:putchar+0xc5
 kprintf(c067ca25,1,0,0,cf12b6bc) at netbsd:kprintf+0x35d
 printf_nolog(c067ca25,cf12b6c4,c06812ac,cf12b778,39373063) at  
 netbsd:printf_nolog+0x46
 lock_printf(c06812ac,c079090c,cf12b7b4,10,63783020) at  
 netbsd:lock_printf+0x4c
 db_stack_trace_print(cf12b84c,1,fff2,c06a1323,c033d674) at  
 netbsd:db_stack_trace_print+0x12a
 simple_lock_only_held(c071a3b4,c067e2ca,5bd,202,c0725060) at  
 netbsd:simple_lock_only_held+0xf6
 simple_lock_switchcheck(c071a3b4,1,cf12b8ac,c033ed51,c0719d9c) at  
 netbsd:simple_lock_switchcheck+0x15
 mi_switch(e0a9534c,0,33e,c,c1cd35b4) at netbsd:mi_switch+0x65
 preempt(1,c06d4600,4e8,cf12ba14,c1cd3580) at netbsd:preempt+0x75
 genfs_putpages(cf12ba94,989680,0,0,c05a76e0) at netbsd:genfs_putpages 
 +0x7ec
 VOP_PUTPAGES(d2dd4138,0,0,0,0) at netbsd:VOP_PUTPAGES+0x40
 ffs_full_fsync(cf12bbc4,10,c06cdb40,cf12bb5c,0) at  
 netbsd:ffs_full_fsync+0x3e3
 ffs_fsync(cf12bbc4,d2dd4138,10012,c033f1bf,c05a6f20) at  
 netbsd:ffs_fsync+0x4b
 VOP_FSYNC(d2dd4138,cc2208dc,0,0,0) at netbsd:VOP_FSYNC+0x4c
 ffs_sync(c20f4000,2,cc2208dc,d44f20b8,10b) at netbsd:ffs_sync+0x27a
 sys_sync(e0a9534c,0,0,f8079cd8,100) at netbsd:sys_sync+0x109
 vfs_shutdown(f8079cd8,0,cf12bcdc,c035ef39,100) at netbsd:vfs_shutdown 
 +0x6f
 cpu_reboot(100,0,0,c06ddc80,a7f) at netbsd:cpu_reboot+0x177
 panic(c0708ba0,c0676980,c067f449,c06d16c0,453) at netbsd:panic+0x109
 __main(c0676980,c06d16c0,453,c067f449,c079090c) at netbsd:__main
 pool_do_put(c0790a80,c078b940,cf12bd8c,c04078c3,c0792e80) at  
 netbsd:pool_do_put+0x221
 pool_put(c0790a80,c078b940,ecd,1000,bfbff000) at netbsd:pool_put+0x36
 uvmspace_free(c078b940,808a000,37,0,0) at netbsd:uvmspace_free+0x94
 sysctl_kern_proc_args(cf12befc,2,808a000,cf12bef0,0) at  
 netbsd:sysctl_kern_proc_args+0x212
 sysctl_dispatch(cf12bef4,4,808a000,cf12bef0,0) at  
 netbsd:sysctl_dispatch+0x76
 sys___sysctl(e0a9534c,cf12bf64,cf12bf5c,c0718c18,c07928b0) at  
 netbsd:sys___sysctl+0xad
 syscall_plain() at netbsd:syscall_plain+0x1a5
 --- syscall (number 202) ---
 0xbdba60af:
 db{1}> reboot 0x104
 cpu1: spinout while in debugger
 
 here the machine locks up hard, no kernel dump.
 
 The last panic was with the change from r1.111 of subr_pool.c  
 applied, on the off chance that it was related. See kern/32631: Bad  
 concurrency checking can cause a crash in sys/kern/subr_pool.c.
 
 It might be relevant that the kernel is built with LOCKDEBUG and  
 DEBUG, in addition to DIAGNOSTIC.
 
 Is this still memory corruption? Or MP related, should I give up and  
 go to a uniprocessor kernel?
 Any suggestions as to what I could try to narrow down this problem?
 
 
 
 On Jan 13, 2006, at 10:37 , Chuck Silvers wrote:
 
 > CPU 0 got a page-fault in pmap_activate(), and it's trying to print
 > something on the console (before panicing).  the pty code is trying to
 > call wakeup, which needs the sched_lock that is already held by the
 > context-switch code that is calling pmap_activate().
 >
 > CPU 1 is waiting for sched_lock, which is held by CPU 0.
 >
 > looks like more memory corruption.
 >
 > -Chuck
 >
 >
 > On Wed, Jan 11, 2006 at 10:07:55PM -0500, Andreas Wrede wrote:
 >> Any idea what this is and what to do next?
 >>
 >> cpu0: spinout
 >> Stopped in pid 18.1 (aiodoned) at       netbsd:cpu_Debugger
 >> +0x4:        leave
 >> db{0}> bt
 >> cpu_Debugger(c067db95,0,c2bf7cdc,cd262b7c,c0713354) at
 >> netbsd:cpu_Debugger+0x4
 >> __cpu_simple_lock(c0713a1c,0,c2993df4,c36b6100,cd262b7c) at
 >> netbsd:__cpu_simple_lock+0x93
 >> printf_nolog(c06769f5,cd262b7c,c069ace4,cd262c30,a) at
 >> netbsd:printf_nolog+0x32
 >> lock_printf(c069ace4,a080101,cd262c54,c033d966,c3874200) at
 >> netbsd:lock_printf+0x4c
 >> _simple_lock(c0713354,c06cb1c0,440,c,c2b360c0) at netbsd:_simple_lock
 >> +0x235
 >> selwakeup(c2b360c8,989680,0,66,cc2016c0) at netbsd:selwakeup+0x99
 >> ptsstart(cc2016c0,0,c06cb840,7,cc2016c0) at netbsd:ptsstart+0x85
 >> ttstart(cc2016c0,cc2016c0,9ac,1,0) at netbsd:ttstart+0x1e
 >> tputchar(66,7,cc2016c0,cc2016c0,cbfbb024) at netbsd:tputchar+0x79
 >> putchar(66,5,0,6,0) at netbsd:putchar+0x49
 >> kprintf(c067f495,5,0,0,cd262de0) at netbsd:kprintf+0x5c
 >> printf(c067f495,c067f385,cd262e60,1,1ebd4) at netbsd:printf+0x46
 >> trap() at netbsd:trap+0x106
 >> --- trap (number 6) ---
 >> pmap_activate(cc20b8c4,cc2101d0,4c,0,c034cbf9) at  
 >> netbsd:pmap_activate
 >> +0x39
 >> mpidle(cc20b8c4,0,1d9,c0786ff0,c0789608) at netbsd:mpidle+0xcb
 >> ltsleep(c0789600,204,c067744e,0,c0789608) at netbsd:ltsleep+0x4d0
 >> uvm_aiodone_daemon(cc20b8c4,842000,84b000,0,c0100321) at
 >> netbsd:uvm_aiodone_daemon+0x15f
 >
 >
 >> db{0}> machine cpu 1
 >> using CPU 1
 >> db{0}> bt
 >> __cpu_simple_lock(c0713354,c035241b,c07620a8,297,10b) at
 >> netbsd:__cpu_simple_lock+0x6f
 >> _simple_lock(c0713354,c06c8d00,47b,c,c21a303c) at netbsd:_simple_lock
 >> +0x7a
 >> schedclock(cf1859e8,c2266a00,c355a788,c21c4838,ce453c78) at
 >> netbsd:schedclock+0x58
 >> statclock(ce453cbc,c01f7f52,c21c4800,80,c066ea25) at netbsd:statclock
 >> +0xeb
 >> hardclock(ce453cbc,3,c03902b8,ce453cb4,0) at netbsd:hardclock+0x5f3
 >> lapic_clockintr(0,0,c0330010,30,1310010) at netbsd:lapic_clockintr 
 >> +0x48
 >> Xresume_lapic_ltimer() at netbsd:Xresume_lapic_ltimer+0x1b
 >> --- interrupt ---
 >> Xspllower(0,c06c6880,390,206,0) at netbsd:Xspllower+0xe
 >> _lockmgr(c0764180,400006,0,c06d69c0,da4) at netbsd:_lockmgr+0x250
 >> pmap_enter(cfcabc28,81fe000,37762000,3,22) at netbsd:pmap_enter+0x4d6
 >> uvm_fault(ce8ec2b4,81fe000,0,2,2) at netbsd:uvm_fault+0x976
 >> trap() at netbsd:trap+0x36f
 >> --- trap (number 6) ---
 >> 0xbdb685fc:
 >
 
 
 Current dmesg output:
 
 NetBSD 3.0_STABLE (PLANIX.MP) #1: Thu Jan 26 15:00:29 EST 2006
 	root@whome.planix.com:/u1/netbsd-3.0/obj.i386/sys/arch/i386/compile/ 
 PLANIX.MP
 total memory = 1022 MB
 avail memory = 982 MB
 BIOS32 rev. 0 found at 0xfd5c0
 mainbus0 (root)
 mainbus0: Intel MP Specification (Version 1.4) (AMD      HAMMER      )
 cpu0 at mainbus0: apid 0 (boot processor)
 cpu0: AMD Unknown K7 (Athlon) (686-class), 2009.33 MHz, id 0xf5a
 cpu0: features 78bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR>
 cpu0: features 78bfbff<PGE,MCA,CMOV,PAT,PSE36,MPC,MMX>
 cpu0: features 78bfbff<FXSR,SSE,SSE2>
 cpu0: "AMD Opteron(tm) Processor 246"
 cpu0: calibrating local timer
 cpu0: apic clock running at 200 MHz
 cpu1 at mainbus0: apid 1 (application processor)
 cpu1: starting
 cpu1: AMD Unknown K7 (Athlon) (686-class), 2009.26 MHz, id 0xf5a
 cpu1: features 78bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR>
 cpu1: features 78bfbff<PGE,MCA,CMOV,PAT,PSE36,MPC,MMX>
 cpu1: features 78bfbff<FXSR,SSE,SSE2>
 cpu1: "AMD Opteron(tm) Processor 246"
 mpbios: bus 0 is type PCI
 mpbios: bus 1 is type PCI
 mpbios: bus 2 is type PCI
 mpbios: bus 3 is type PCI
 mpbios: bus 8 is type PCI
 mpbios: bus 9 is type PCI
 mpbios: bus 10 is type PCI
 mpbios: bus 11 is type ISA
 ioapic0 at mainbus0 apid 2 (I/O APIC)
 ioapic0: pa 0xfec00000, version 11, 24 pins
 ioapic1 at mainbus0 apid 3 (I/O APIC)
 ioapic1: pa 0xdf200000, version 11, 4 pins
 ioapic2 at mainbus0 apid 4 (I/O APIC)
 ioapic2: pa 0xdf201000, version 11, 4 pins
 pci0 at mainbus0 bus 0: configuration mode 1
 pci0: i/o space, memory space enabled, rd/line, rd/mult, wr/inv ok
 Nvidia product 0x005e (miscellaneous memory, revision 0xa3) at pci0  
 dev 0 function 0 not configured
 pcib0 at pci0 dev 1 function 0
 pcib0: Nvidia product 0x0051 (rev. 0xa3)
 Nvidia nForce4 SMBus (SMBus serial bus, revision 0xa2) at pci0 dev 1  
 function 1 not configured
 ohci0 at pci0 dev 2 function 0: Nvidia product 0x005a (rev. 0xa2)
 ohci0: interrupting at ioapic0 pin 10 (irq 10)
 ohci0: OHCI version 1.0, legacy support
 usb0 at ohci0: USB revision 1.0
 uhub0 at usb0
 uhub0: Nvidia OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
 uhub0: 10 ports with 10 removable, self powered
 ehci0 at pci0 dev 2 function 1: Nvidia product 0x005b (rev. 0xa3)
 ehci0: interrupting at ioapic0 pin 11 (irq 11)
 ehci0: BIOS has given up ownership
 ehci0: EHCI version 1.0
 ehci0: companion controller, 4 ports each: ohci0
 usb1 at ehci0: USB revision 2.0
 uhub1 at usb1
 uhub1: Nvidia EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
 uhub1: single transaction translator
 uhub1: 10 ports with 10 removable, self powered
 viaide0 at pci0 dev 6 function 0
 viaide0: NVIDIA nForce4 IDE Controller (rev. 0xf2)
 viaide0: bus-master DMA support present
 viaide0: primary channel configured to compatibility mode
 viaide0: primary channel ignored (disabled)
 viaide0: secondary channel configured to compatibility mode
 viaide0: secondary channel interrupting at ioapic0 pin 15 (irq 15)
 atabus0 at viaide0 channel 1
 viaide1 at pci0 dev 7 function 0
 viaide1: NVIDIA nForce4 Serial ATA Controller (rev. 0xf3)
 viaide1: bus-master DMA support present
 viaide1: primary channel wired to native-PCI mode
 viaide1: using ioapic0 pin 10 (irq 10) for native-PCI interrupt
 atabus1 at viaide1 channel 0
 viaide1: secondary channel wired to native-PCI mode
 atabus2 at viaide1 channel 1
 viaide2 at pci0 dev 8 function 0
 viaide2: NVIDIA nForce4 Serial ATA Controller (rev. 0xf3)
 viaide2: bus-master DMA support present
 viaide2: primary channel wired to native-PCI mode
 viaide2: using ioapic0 pin 11 (irq 11) for native-PCI interrupt
 atabus3 at viaide2 channel 0
 viaide2: secondary channel wired to native-PCI mode
 atabus4 at viaide2 channel 1
 ppb0 at pci0 dev 9 function 0: Nvidia product 0x005c (rev. 0xa2)
 pci1 at ppb0 bus 1
 pci1: i/o space, memory space enabled
 vga1 at pci1 dev 6 function 0: ATI Technologies Rage XL (rev. 0x27)
 wsdisplay0 at vga1 kbdmux 1
 wsmux1: connecting to wsdisplay0
 fxp0 at pci1 dev 8 function 0: i82550 Ethernet, rev 16
 fxp0: interrupting at ioapic0 pin 10 (irq 10)
 fxp0: Ethernet address 00:e0:81:30:d6:0a
 inphy0 at fxp0 phy 1: i82555 10/100 media interface, rev. 4
 inphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
 ppb1 at pci0 dev 13 function 0: Nvidia product 0x005d (rev. 0xa3)
 pci2 at ppb1 bus 2
 pci2: i/o space, memory space enabled, rd/line, wr/inv ok
 ppb2 at pci0 dev 14 function 0: Nvidia product 0x005d (rev. 0xa3)
 pci3 at ppb2 bus 3
 pci3: i/o space, memory space enabled, rd/line, wr/inv ok
 pchb0 at pci0 dev 24 function 0
 pchb0: Advanced Micro Devices AMD64 HyperTransport configuration  
 (rev. 0x00)
 pchb1 at pci0 dev 24 function 1
 pchb1: Advanced Micro Devices AMD64 Address Map configuration (rev.  
 0x00)
 pchb2 at pci0 dev 24 function 2
 pchb2: Advanced Micro Devices AMD64 DRAM configuration (rev. 0x00)
 pchb3 at pci0 dev 24 function 3
 pchb3: Advanced Micro Devices AMD64 Miscellaneous configuration (rev.  
 0x00)
 pchb4 at pci0 dev 25 function 0
 pchb4: Advanced Micro Devices AMD64 HyperTransport configuration  
 (rev. 0x00)
 pchb5 at pci0 dev 25 function 1
 pchb5: Advanced Micro Devices AMD64 Address Map configuration (rev.  
 0x00)
 pchb6 at pci0 dev 25 function 2
 pchb6: Advanced Micro Devices AMD64 DRAM configuration (rev. 0x00)
 pchb7 at pci0 dev 25 function 3
 pchb7: Advanced Micro Devices AMD64 Miscellaneous configuration (rev.  
 0x00)
 isa0 at pcib0
 lpt0 at isa0 port 0x378-0x37b irq 7
 com0 at isa0 port 0x3f8-0x3ff irq 4: ns16550a, working fifo
 com1 at isa0 port 0x2f8-0x2ff irq 3: ns16550a, working fifo
 com1: console
 pckbc0 at isa0 port 0x60-0x64
 pckbdprobe: reset error 5
 pmsprobe: reset error 5
 lm0 at isa0 port 0x290-0x297: W83627HF
 pcppi0 at isa0 port 0x61
 midi0 at pcppi0: PC speaker
 sysbeep0 at pcppi0
 isapnp0 at isa0 port 0x279: ISA Plug 'n Play device support
 npx0 at isa0 port 0xf0-0xff: using exception 16
 fdc0 at isa0 port 0x3f0-0x3f7 irq 6 drq 2
 isapnp0: no ISA Plug 'n Play devices found
 pci4 at mainbus0 bus 8
 pci4: i/o space, memory space enabled, rd/line, rd/mult, wr/inv ok
 ppb3 at pci4 dev 10 function 0: Advanced Micro Devices AMD8131 PCI-X  
 Tunnel (rev. 0x12)
 pci5 at ppb3 bus 9
 pci5: i/o space, memory space enabled
 Advanced Micro Devices AMD8131 IO Apic (interrupt system, interface  
 0x10, revision 0x01) at pci4 dev 10 function 1 not configured
 ppb4 at pci4 dev 11 function 0: Advanced Micro Devices AMD8131 PCI-X  
 Tunnel (rev. 0x12)
 pci6 at ppb4 bus 10
 pci6: i/o space, memory space enabled
 mpt0 at pci6 dev 3 function 0: LSI Logic FC929 FC Adapter
 mpt0: interrupting at ioapic2 pin 2 (irq 10)
 scsibus0 at mpt0: 256 targets, 8 luns per target
 mpt1 at pci6 dev 3 function 1: LSI Logic FC929 FC Adapter
 mpt1: interrupting at ioapic2 pin 3 (irq 12)
 scsibus1 at mpt1: 256 targets, 8 luns per target
 bge0 at pci6 dev 9 function 0: Broadcom BCM5704C Dual Gigabit Ethernet
 bge0: interrupting at ioapic2 pin 0 (irq 11)
 bge0: ASIC BCM5704 A3 (0x2003), Ethernet address 00:e0:81:30:d6:7c
 brgphy0 at bge0 phy 1: BCM5704 1000BASE-T media interface, rev. 0
 brgphy0: using BCM5704 DSP patch
 brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,  
 1000baseT-FDX, auto
 bge1 at pci6 dev 9 function 1: Broadcom BCM5704C Dual Gigabit Ethernet
 bge1: interrupting at ioapic2 pin 1 (irq 10)
 bge1: ASIC BCM5704 A3 (0x2003), Ethernet address 00:e0:81:30:d6:7d
 brgphy1 at bge1 phy 1: BCM5704 1000BASE-T media interface, rev. 0
 brgphy1: using BCM5704 DSP patch
 brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,  
 1000baseT-FDX, auto
 Advanced Micro Devices AMD8131 IO Apic (interrupt system, interface  
 0x10, revision 0x01) at pci4 dev 11 function 1 not configured
 ioapic0: enabling
 ioapic1: enabling
 ioapic2: enabling
 fd0 at fdc0 drive 0: 1.44MB, 80 cyl, 2 head, 18 sec
 raidattach: Asked for 8 units
 Kernelized RAIDframe activated
 IPsec: Initialized Security Association Processing.
 scsibus0: waiting 2 seconds for devices to settle...
 scsibus1: waiting 2 seconds for devices to settle...
 atapibus0 at atabus0: 2 targets
 cd0 at atapibus0 drive 0: <HL-DT-STDVD-ROM GDR8164B, , 0L06> cdrom  
 removable
 cd0: 32-bit data port
 cd0: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 2 (Ultra/33)
 cd0(viaide0:1:0): using PIO mode 4, Ultra-DMA mode 2 (Ultra/33)  
 (using DMA)
 sd0 at scsibus0 target 0 lun 0: <APPLE, Xserve RAID, 1.26> disk fixed
 sd0: 1035 GB, 132522 cyl, 128 head, 128 sec, 512 bytes/sect x  
 2171240448 sectors
 sd1 at scsibus1 target 0 lun 0: <APPLE, Xserve RAID, 1.26> disk fixed
 sd1: 1035 GB, 132522 cyl, 128 head, 128 sec, 512 bytes/sect x  
 2171240448 sectors
 wd0 at atabus1 drive 0: <WDC WD1600JS-22MHB0>
 wd0: drive supports 16-sector PIO transfers, LBA48 addressing
 wd0: 149 GB, 310101 cyl, 16 head, 63 sec, 512 bytes/sect x 312581808  
 sectors
 wd0: 32-bit data port
 wd0: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 6 (Ultra/133)
 wd0(viaide1:0:0): using PIO mode 4, Ultra-DMA mode 6 (Ultra/133)  
 (using DMA)
 wd1 at atabus3 drive 0: <WDC WD1600JS-00MHB0>
 wd1: drive supports 16-sector PIO transfers, LBA48 addressing
 wd1: 149 GB, 310101 cyl, 16 head, 63 sec, 512 bytes/sect x 312581808  
 sectors
 wd1: 32-bit data port
 wd1: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 6 (Ultra/133)
 wd1(viaide2:0:0): using PIO mode 4, Ultra-DMA mode 6 (Ultra/133)  
 (using DMA)
 Searching for RAID components...
 Component on: wd0a: 312581745
     Row: 0 Column: 0 Num Rows: 1 Num Columns: 2
     Version: 2 Serial Number: 20051218 Mod Counter: 194
     Clean: No Status: 0
     sectPerSU: 128 SUsPerPU: 1 SUsPerRU: 1
     RAID Level: 1  blocksize: 512 numBlocks: 312581632
     Autoconfig: Yes
     Contains root partition: Yes
     Last configured as: raid0
 Component on: wd1a: 312581745
     Row: 0 Column: 1 Num Rows: 1 Num Columns: 2
     Version: 2 Serial Number: 20051218 Mod Counter: 194
     Clean: No Status: 0
     sectPerSU: 128 SUsPerPU: 1 SUsPerRU: 1
     RAID Level: 1  blocksize: 512 numBlocks: 312581632
     Autoconfig: Yes
     Contains root partition: Yes
     Last configured as: raid0
 Found: wd0a at 0
 Found: wd1a at 1
 RAID autoconfigure
 Configuring raid0:
 Starting autoconfiguration of RAID set...
 Looking for 0 in autoconfig
 Found: wd0a at 0
 Looking for 1 in autoconfig
 Found: wd1a at 1
 raid0: allocating 20 buffers of 65536 bytes.
 raid0: RAID Level 1
 raid0: Components: /dev/wd0a /dev/wd1a
 raid0: Total Sectors: 312581632 (152627 MB)
 boot device: raid0
 root on raid0a dumps on raid0b
 mountroot: trying smbfs...
 mountroot: trying msdos...
 mountroot: trying cd9660...
 mountroot: trying nfs...
 mountroot: trying lfs...
 mountroot: trying ext2fs...
 mountroot: trying ffs...
 root file system type: ffs
 cpu1: CPU 1 running
 init: copying out path `/sbin/init' 11
 mag 0 21:1
 mag 1 2e:2
 mag 2 72:3
 mag 3 65:4
 mag 4 73:5
 mag 5 65:6
 mag 6 74:7
 mag 7 2d:8
 mag 8 78:7f
 wsdisplay0: screen 1 added (80x25, vt100 emulation)
 wsdisplay0: screen 2 added (80x25, vt100 emulation)
 wsdisplay0: screen 3 added (80x25, vt100 emulation)
 wsdisplay0: screen 4 added (80x25, vt100 emulation)
 
 -- 
      aew
 
 
 --Apple-Mail-54-304932109
 content-type: application/pgp-signature; x-mac-type=70674453;
 	name=PGP.sig
 content-description: This is a digitally signed message part
 content-disposition: inline; filename=PGP.sig
 content-transfer-encoding: 7bit
 
 -----BEGIN PGP SIGNATURE-----
 Version: GnuPG v1.4.1 (Darwin)
 
 iD8DBQFD7glBEh/h9J/TQyERAl/PAJ45OGY9Pju1T5bcpUUprtpuKbuBhgCggsut
 H0T6HecchBfbKc0B91kWM98=
 =fhUl
 -----END PGP SIGNATURE-----
 
 --Apple-Mail-54-304932109--