port-amd64/46413: 6.0-BETA fails to boot on system w/ >24 cores

To: port-amd64-maintainer%netbsd.org@localhost,gnats-admin%netbsd.org@localhost,netbsd-bugs%netbsd.org@localhost
Subject: port-amd64/46413: 6.0-BETA fails to boot on system w/ >24 cores
From: dwhite%ixsystems.com@localhost
Date: Sat, 5 May 2012 00:15:01 +0000 (UTC)
>Number:         46413
>Category:       port-amd64
>Synopsis:       6.0-BETA fails to boot on system w/ >24 cores
>Confidential:   no
>Severity:       serious
>Priority:       medium
>Responsible:    port-amd64-maintainer
>State:          open
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Sat May 05 00:15:01 +0000 2012
>Originator:     Doug White
>Release:        6.0-BETA
>Organization:
iXsystems
>Environment:
NetBSD hostname 6.0_BETA NetBSD 6.0_BETA (GENERIC) amd64
>Description:
6.0_BETA fails to boot on system with 32 logical cores, crashes with this 
assertion failure on boot:

panic: kernel diagnostic assertion "ci->ci_acpiid < maxcpus" failed: file 
"/usr/src/sys/dev/acpi/acpi_cpu_cstate.c", line 656

Down-coring system to 24 cores allows system to boot normally. The same system 
boots 5.1.2 with all 32 cores enabled without issues. 

System configuration is 2x AMD Opteron 6282 SE in SuperMicro SYS-1042G-TF w/ 
256GB RAM.

dmesg from down-core boot:

Copyright (c) 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005,
    2006, 2007, 2008, 2009, 2010, 2011, 2012
    The NetBSD Foundation, Inc.  All rights reserved.
Copyright (c) 1982, 1986, 1989, 1991, 1993
    The Regents of the University of California.  All rights reserved.

NetBSD 6.0_BETA (GENERIC)
total memory = 255 GB
avail memory = 248 GB
timecounter: Timecounters tick every 10.000 msec
timecounter: Timecounter "i8254" frequency 1193182 Hz quality 100
iXsystems AX1403-SGTF (1234567890)
mainbus0 (root)
cpu0 at mainbus0 apid 32: AMD Opteron(tm) Processor 6282 SE              , id 
0x600f12
cpu1 at mainbus0 apid 33: AMD Opteron(tm) Processor 6282 SE              , id 
0x600f12
cpu2 at mainbus0 apid 34: AMD Opteron(tm) Processor 6282 SE              , id 
0x600f12
cpu3 at mainbus0 apid 35: AMD Opteron(tm) Processor 6282 SE              , id 
0x600f12
cpu4 at mainbus0 apid 36: AMD Opteron(tm) Processor 6282 SE              , id 
0x600f12
cpu5 at mainbus0 apid 37: AMD Opteron(tm) Processor 6282 SE              , id 
0x600f12
cpu6 at mainbus0 apid 38: AMD Opteron(tm) Processor 6282 SE              , id 
0x600f12
cpu7 at mainbus0 apid 39: AMD Opteron(tm) Processor 6282 SE              , id 
0x600f12
cpu8 at mainbus0 apid 40: AMD Opteron(tm) Processor 6282 SE              , id 
0x600f12
cpu9 at mainbus0 apid 41: AMD Opteron(tm) Processor 6282 SE              , id 
0x600f12
cpu10 at mainbus0 apid 42: AMD Opteron(tm) Processor 6282 SE              , id 
0x600f12
cpu11 at mainbus0 apid 43: AMD Opteron(tm) Processor 6282 SE              , id 
0x600f12
cpu12 at mainbus0 apid 64: AMD Opteron(tm) Processor 6282 SE              , id 
0x600f12
cpu13 at mainbus0 apid 65: AMD Opteron(tm) Processor 6282 SE              , id 
0x600f12
cpu14 at mainbus0 apid 66: AMD Opteron(tm) Processor 6282 SE              , id 
0x600f12
cpu15 at mainbus0 apid 67: AMD Opteron(tm) Processor 6282 SE              , id 
0x600f12
cpu16 at mainbus0 apid 68: AMD Opteron(tm) Processor 6282 SE              , id 
0x600f12
cpu17 at mainbus0 apid 69: AMD Opteron(tm) Processor 6282 SE              , id 
0x600f12
cpu18 at mainbus0 apid 70: AMD Opteron(tm) Processor 6282 SE              , id 
0x600f12
cpu19 at mainbus0 apid 71: AMD Opteron(tm) Processor 6282 SE              , id 
0x600f12
cpu20 at mainbus0 apid 72: AMD Opteron(tm) Processor 6282 SE              , id 
0x600f12
cpu21 at mainbus0 apid 73: AMD Opteron(tm) Processor 6282 SE              , id 
0x600f12
cpu22 at mainbus0 apid 74: AMD Opteron(tm) Processor 6282 SE              , id 
0x600f12
cpu23 at mainbus0 apid 75: AMD Opteron(tm) Processor 6282 SE              , id 
0x600f12
ioapic0 at mainbus0 apid 0: pa 0xfec00000, version 21, 24 pins
ioapic1 at mainbus0 apid 1: pa 0xfec20000, version 21, 32 pins
acpi0 at mainbus0: Intel ACPICA 20110623
acpi0: X/RSDT: OemId <SMCI  ,        ,20120411>, AslId <MSFT,00000097>
mpacpi: PCI bus 3 int routing already done!
acpi0: SCI interrupting at int 9
timecounter: Timecounter "ACPI-Safe" frequency 3579545 Hz quality 900
hpet0 at acpi0: high precision event timer (mem 0xfed00000-0xfed00400)
timecounter: Timecounter "hpet0" frequency 14318180 Hz quality 2000
NMEM (PNP0C02) at acpi0 not configured
UMEM (PNP0C02) at acpi0 not configured
attimer1 at acpi0 (TMR, PNP0100): io 0x40-0x43 irq 0
pcppi1 at acpi0 (SPKR, PNP0800): io 0x61
midi0 at pcppi1: PC speaker
sysbeep0 at pcppi1
UAR1 (PNP0501) at acpi0 not configured
UAR2 (PNP0501) at acpi0 not configured
UAR3 (PNP0501) at acpi0 not configured
SIOR (PNP0C02) at acpi0 not configured
SIO2 (PNP0C02) at acpi0 not configured
OMSC (PNP0C02) at acpi0 not configured
RMSC (PNP0C02) at acpi0 not configured
IPMI (PNP0C02) at acpi0 not configured
PCIE (PNP0C02) at acpi0 not configured
RMEM (PNP0C01) at acpi0 not configured
NMEM (PNP0C02) at acpi0 not configured
UMEM (PNP0C02) at acpi0 not configured
acpibut0 at acpi0 (PWRB, PNP0C0C-170): ACPI Power Button
attimer1: attached to pcppi1
ipmi0 at mainbus0
pci0 at mainbus0 bus 0: configuration mode 1
pci0: i/o space, memory space enabled, rd/line, rd/mult, wr/inv ok
pchb0 at pci0 dev 0 function 0: vendor 0x1002 product 0x5a10 (rev. 0x02)
ppb0 at pci0 dev 2 function 0: vendor 0x1002 product 0x5a16 (rev. 0x00)
ppb0: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci1 at ppb0 bus 3
pci1: i/o space, memory space enabled, rd/line, wr/inv ok
vendor 0x8086 product 0x10fb (ethernet network, revision 0x01) at pci1 dev 0 
function 0 not configured
ppb1 at pci0 dev 13 function 0: vendor 0x1002 product 0x5a1e (rev. 0x00)
ppb1: PCI Express 2.0 <Root Port of PCI-E Root Complex>
pci2 at ppb1 bus 2
pci2: i/o space, memory space enabled, rd/line, wr/inv ok
wm0 at pci2 dev 0 function 0: 82576 1000BaseT Ethernet (rev. 0x01)
wm0: interrupting at ioapic1 pin 16
wm0: PCI-Express bus
wm0: 65536 word (16 address bits) SPI EEPROM
wm0: Ethernet address 00:25:90:58:a5:0a
igphy0 at wm0 phy 1: i82566 10/100/1000 media interface, rev. 1
igphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 
1000baseT-FDX, auto
wm1 at pci2 dev 0 function 1: 82576 1000BaseT Ethernet (rev. 0x01)
wm1: interrupting at ioapic1 pin 17
wm1: PCI-Express bus
wm1: 65536 word (16 address bits) SPI EEPROM
wm1: Ethernet address 00:25:90:58:a5:0b
igphy1 at wm1 phy 1: i82566 10/100/1000 media interface, rev. 1
igphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 
1000baseT-FDX, auto
ahcisata0 at pci0 dev 17 function 0: vendor 0x1002 product 0x4394 (rev. 0x00)
ahcisata0: interrupting at ioapic0 pin 22
ahcisata0: 64-bit DMA
ahcisata0: AHCI revision 1.10, 4 ports, 32 slots, CAP 
0xf722ff83<CCCS,PSC,SSC,PMD,SPM,ISS=0x2=Gen2,SCLO,SAL,SALP,SMPS,SSNTF,SNCQ,S64A>
atabus0 at ahcisata0 channel 0
atabus1 at ahcisata0 channel 1
atabus2 at ahcisata0 channel 2
atabus3 at ahcisata0 channel 3
ohci0 at pci0 dev 18 function 0: vendor 0x1002 product 0x4397 (rev. 0x00)
ohci0: interrupting at ioapic0 pin 16
ohci0: OHCI version 1.0, legacy support
usb0 at ohci0: USB revision 1.0
ohci1 at pci0 dev 18 function 1: vendor 0x1002 product 0x4398 (rev. 0x00)
ohci1: interrupting at ioapic0 pin 16
ohci1: OHCI version 1.0, legacy support
usb1 at ohci1: USB revision 1.0
ehci0 at pci0 dev 18 function 2: vendor 0x1002 product 0x4396 (rev. 0x00)
ehci0: interrupting at ioapic0 pin 17
ehci0: dropped intr workaround enabled
ehci0: BIOS has given up ownership
ehci0: EHCI version 1.0
ehci0: companion controllers, 3 ports each: ohci0 ohci1
usb2 at ehci0: USB revision 2.0
ohci2 at pci0 dev 19 function 0: vendor 0x1002 product 0x4397 (rev. 0x00)
ohci2: interrupting at ioapic0 pin 18
ohci2: OHCI version 1.0, legacy support
usb3 at ohci2: USB revision 1.0
ohci3 at pci0 dev 19 function 1: vendor 0x1002 product 0x4398 (rev. 0x00)
ohci3: interrupting at ioapic0 pin 18
ohci3: OHCI version 1.0, legacy support
usb4 at ohci3: USB revision 1.0
ehci1 at pci0 dev 19 function 2: vendor 0x1002 product 0x4396 (rev. 0x00)
ehci1: interrupting at ioapic0 pin 19
ehci1: dropped intr workaround enabled
ehci1: BIOS has given up ownership
ehci1: EHCI version 1.0
ehci1: companion controllers, 3 ports each: ohci2 ohci3
usb5 at ehci1: USB revision 2.0
piixpm0 at pci0 dev 20 function 0: vendor 0x1002 product 0x4385 (rev. 0x3d)
piixpm0: interrupting at SMI, polling
iic0 at piixpm0: I2C bus
pcib0 at pci0 dev 20 function 3: vendor 0x1002 product 0x439d (rev. 0x00)
ppb2 at pci0 dev 20 function 4: vendor 0x1002 product 0x4384 (rev. 0x00)
pci3 at ppb2 bus 1
pci3: i/o space, memory space enabled
vga0 at pci3 dev 4 function 0: vendor 0x102b product 0x0532 (rev. 0x0a)
wsdisplay0 at vga0 kbdmux 1: console (80x25, vt100 emulation)
wsmux1: connecting to wsdisplay0
drm at vga0 not configured
ohci4 at pci0 dev 20 function 5: vendor 0x1002 product 0x4399 (rev. 0x00)
ohci4: interrupting at ioapic0 pin 18
ohci4: OHCI version 1.0, legacy support
usb6 at ohci4: USB revision 1.0
pchb1 at pci0 dev 24 function 0: vendor 0x1022 product 0x1600 (rev. 0x00)
pchb2 at pci0 dev 24 function 1: vendor 0x1022 product 0x1601 (rev. 0x00)
pchb3 at pci0 dev 24 function 2: vendor 0x1022 product 0x1602 (rev. 0x00)
pchb4 at pci0 dev 24 function 3: vendor 0x1022 product 0x1603 (rev. 0x00)
pchb5 at pci0 dev 24 function 4: vendor 0x1022 product 0x1604 (rev. 0x00)
pchb6 at pci0 dev 24 function 5: vendor 0x1022 product 0x1605 (rev. 0x00)
pchb7 at pci0 dev 25 function 0: vendor 0x1022 product 0x1600 (rev. 0x00)
pchb8 at pci0 dev 25 function 1: vendor 0x1022 product 0x1601 (rev. 0x00)
pchb9 at pci0 dev 25 function 2: vendor 0x1022 product 0x1602 (rev. 0x00)
pchb10 at pci0 dev 25 function 3: vendor 0x1022 product 0x1603 (rev. 0x00)
pchb11 at pci0 dev 25 function 4: vendor 0x1022 product 0x1604 (rev. 0x00)
pchb12 at pci0 dev 25 function 5: vendor 0x1022 product 0x1605 (rev. 0x00)
pchb13 at pci0 dev 26 function 0: vendor 0x1022 product 0x1600 (rev. 0x00)
pchb14 at pci0 dev 26 function 1: vendor 0x1022 product 0x1601 (rev. 0x00)
pchb15 at pci0 dev 26 function 2: vendor 0x1022 product 0x1602 (rev. 0x00)
pchb16 at pci0 dev 26 function 3: vendor 0x1022 product 0x1603 (rev. 0x00)
pchb17 at pci0 dev 26 function 4: vendor 0x1022 product 0x1604 (rev. 0x00)
pchb18 at pci0 dev 26 function 5: vendor 0x1022 product 0x1605 (rev. 0x00)
pchb19 at pci0 dev 27 function 0: vendor 0x1022 product 0x1600 (rev. 0x00)
pchb20 at pci0 dev 27 function 1: vendor 0x1022 product 0x1601 (rev. 0x00)
pchb21 at pci0 dev 27 function 2: vendor 0x1022 product 0x1602 (rev. 0x00)
pchb22 at pci0 dev 27 function 3: vendor 0x1022 product 0x1603 (rev. 0x00)
pchb23 at pci0 dev 27 function 4: vendor 0x1022 product 0x1604 (rev. 0x00)
pchb24 at pci0 dev 27 function 5: vendor 0x1022 product 0x1605 (rev. 0x00)
isa0 at pcib0
com0 at isa0 port 0x3f8-0x3ff irq 4: ns16550a, working fifo
com1 at isa0 port 0x2f8-0x2ff irq 3: ns16550a, working fifo
pckbc0 at isa0 port 0x60-0x64
acpicpu0 at cpu0: ACPI CPU
acpicpu0: C1: HLT, lat   0 us, pow     0 mW
acpicpu0: C2: I/O, lat 100 us, pow     0 mW
acpicpu0: P0: FFH, lat   5 us, pow  8076 mW, 2600 MHz
acpicpu0: P1: FFH, lat   5 us, pow  7040 mW, 2300 MHz
acpicpu0: P2: FFH, lat   5 us, pow  5706 mW, 2000 MHz
acpicpu0: P3: FFH, lat   5 us, pow  4641 mW, 1700 MHz
acpicpu0: P4: FFH, lat   5 us, pow  3656 mW, 1400 MHz
acpicpu0: T0: I/O, lat   1 us, pow     0 mW, 100 %
acpicpu0: T1: I/O, lat   1 us, pow     0 mW,  88 %
acpicpu0: T2: I/O, lat   1 us, pow     0 mW,  76 %
acpicpu0: T3: I/O, lat   1 us, pow     0 mW,  64 %
acpicpu0: T4: I/O, lat   1 us, pow     0 mW,  52 %
acpicpu0: T5: I/O, lat   1 us, pow     0 mW,  40 %
acpicpu0: T6: I/O, lat   1 us, pow     0 mW,  28 %
acpicpu0: T7: I/O, lat   1 us, pow     0 mW,  16 %
acpicpu1 at cpu1: ACPI CPU
acpicpu2 at cpu2: ACPI CPU
acpicpu3 at cpu3: ACPI CPU
acpicpu4 at cpu4: ACPI CPU
acpicpu5 at cpu5: ACPI CPU
acpicpu6 at cpu6: ACPI CPU
acpicpu7 at cpu7: ACPI CPU
acpicpu8 at cpu8: ACPI CPU
acpicpu9 at cpu9: ACPI CPU
acpicpu10 at cpu10: ACPI CPU
acpicpu11 at cpu11: ACPI CPU
acpicpu12 at cpu12: ACPI CPU
acpicpu13 at cpu13: ACPI CPU
acpicpu14 at cpu14: ACPI CPU
acpicpu15 at cpu15: ACPI CPU
acpicpu16 at cpu16: ACPI CPU
acpicpu17 at cpu17: ACPI CPU
acpicpu18 at cpu18: ACPI CPU
acpicpu19 at cpu19: ACPI CPU
acpicpu20 at cpu20: ACPI CPU
acpicpu21 at cpu21: ACPI CPU
acpicpu22 at cpu22: ACPI CPU
acpicpu23 at cpu23: ACPI CPU
timecounter: Timecounter "clockinterrupt" frequency 100 Hz quality 0
ERROR: 3860 cycle TSC drift observed
uhub0 at usb0: vendor 0x1002 OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 3 ports with 3 removable, self powered
uhub1 at usb1: vendor 0x1002 OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub1: 3 ports with 3 removable, self powered
uhub2 at usb2: vendor 0x1002 EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
uhub2: 6 ports with 6 removable, self powered
uhub3 at usb3: vendor 0x1002 OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub3: 3 ports with 3 removable, self powered
uhub4 at usb4: vendor 0x1002 OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub4: 3 ports with 3 removable, self powered
uhub5 at usb5: vendor 0x1002 EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
uhub5: 6 ports with 6 removable, self powered
uhub6 at usb6: vendor 0x1002 OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub6: 2 ports with 2 removable, self powered
ahcisata0 port 0: device present, speed: 3.0Gb/s
ahcisata0 port 1: device present, speed: 3.0Gb/s
ahcisata0 port 2: device present, speed: 3.0Gb/s
wd0 at atabus0 drive 0
wd0: <WDC WD2003FYYS-02W0B1>
wd0: drive supports 16-sector PIO transfers, LBA48 addressing
wd0: 1863 GB, 3876021 cyl, 16 head, 63 sec, 512 bytes/sect x 3907029168 sectors
wd0: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 6 (Ultra/133)
wd0(ahcisata0:0:0): using PIO mode 4, DMA mode 2, Ultra-DMA mode 6 (Ultra/133) 
(using DMA)
wd1 at atabus1 drive 0
wd1: <WDC WD2003FYYS-02W0B1>
wd1: drive supports 16-sector PIO transfers, LBA48 addressing
wd1: 1863 GB, 3876021 cyl, 16 head, 63 sec, 512 bytes/sect x 3907029168 sectors
wd1: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 6 (Ultra/133)
wd1(ahcisata0:1:0): using PIO mode 4, DMA mode 2, Ultra-DMA mode 6 (Ultra/133) 
(using DMA)
wd2 at atabus2 drive 0
wd2: <WDC WD2003FYYS-02W0B1>
wd2: drive supports 16-sector PIO transfers, LBA48 addressing
wd2: 1863 GB, 3876021 cyl, 16 head, 63 sec, 512 bytes/sect x 3907029168 sectors
wd2: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 6 (Ultra/133)
wd2(ahcisata0:2:0): using PIO mode 4, DMA mode 2, Ultra-DMA mode 6 (Ultra/133) 
(using DMA)
ehci0: handing over full speed device on port 1 to ohci0
uhidev0 at uhub6 port 1 configuration 1 interface 0
uhidev0: American Megatrends Inc. Virtual Keyboard and Mouse, rev 1.10/1.00, 
addr 2, iclass 3/1
ukbd0 at uhidev0: 8 modifier keys, 6 key codes
wskbd0 at ukbd0: console keyboard, using wsdisplay0
uhidev1 at uhub6 port 1 configuration 1 interface 1
uhidev1: American Megatrends Inc. Virtual Keyboard and Mouse, rev 1.10/1.00, 
addr 2, iclass 3/1
ums0 at uhidev1: 3 buttons
wsmouse0 at ums0 mux 0
Kernelized RAIDframe activated
pad0: outputs: 44100Hz, 16-bit, stereo
audio0 at pad0: half duplex, playback, capture
uhub7 at uhub0 port 1: vendor 0x0557 product 0x7000, class 9/0, rev 1.10/1.00, 
addr 2
boot device: wd0
root on wd0a dumps on wd0b
uhub7: 4 ports with 4 removable, self powered
root file system type: ffs
uhidev2 at uhub7 port 1 configuration 1 interface 0
uhidev2: LITEON Technology USB Multimedia Keyboard, rev 1.10/1.01, addr 3, 
iclass 3/1
ukbd1 at uhidev2: 8 modifier keys, 6 key codes
wskbd1 at ukbd1 mux 1
wskbd1: connecting to wsdisplay0
uhidev3 at uhub7 port 1 configuration 1 interface 1
uhidev3: LITEON Technology USB Multimedia Keyboard, rev 1.10/1.01, addr 3, 
iclass 3/0
uhidev3: 1 report ids
uhid0 at uhidev3 reportid 1: input=1, output=0, feature=0
uhidev4 at uhub7 port 4 configuration 1 interface 0
uhidev4: Logitech USB-PS/2 Optical Mouse, rev 2.00/24.30, addr 4, iclass 3/1
ums1 at uhidev4: 8 buttons, W and Z dirs
wsmouse1 at ums1 mux 0
wsdisplay0: screen 1 added (80x25, vt100 emulation)
wsdisplay0: screen 2 added (80x25, vt100 emulation)
wsdisplay0: screen 3 added (80x25, vt100 emulation)
wsdisplay0: screen 4 added (80x25, vt100 emulation)
ipmi0: version 2.0 interface KCS iobase 0xca2/2 spacing 1

>How-To-Repeat:

>Fix:
Prev by Date: PR/46408 CVS commit: src/usr.sbin/makemandb
Next by Date: Re: bin/46408 (Inconsistent handling of hyphens by apropos(1))
Previous by Thread: PR/46408 CVS commit: src/usr.sbin/makemandb
Next by Thread: Re: port-amd64/46413: 6.0-BETA fails to boot on system w/ >24 cores
Indexes:
Home | Main Index | Thread Index | Old Index