Re: NetBSD on more than 16 cores?

[Jean-Yves Migeon <jeanyves.migeon%free.fr@localhost>]

On 14.01.2011 09:11, Hubert Feyrer wrote:
> pic^Wdmesg or it didn't happen :-)

Attached.

> 
> 
>  - Hubert
> 
> 
> Am 14.01.2011 um Fr. 14.01.2011 00:38 schrieb Jean-Yves Migeon:
> 
>> On 13.01.2011 22:03, Phil Nelson wrote:
>>> Hello,
>>>
>>>   I was wondering if there is anyone who has run NetBSD
>>> (either i386 or amd64) on a SMP with more than 16 cores.
>>>
>>> I'm interested in any experience with 16 to 48 core machines.
>>
>> I've run and used NetBSD on a Dell (M710), with up to 24 core detected.
>>
>> However, max number of CPU is 32; IIRC, we still use a bitmask on an int
>> for CPU tracking, and well, int => 4 bytes => 32 bits (heh).
>>
>> -- 
>> Jean-Yves Migeon
>> jeanyves.migeon%free.fr@localhost
> 


-- 
Jean-Yves Migeon
jeanyves.migeon%free.fr@localhost

Copyright (c) 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005,
    2006, 2007, 2008, 2009, 2010
    The NetBSD Foundation, Inc.  All rights reserved.
Copyright (c) 1982, 1986, 1989, 1991, 1993
    The Regents of the University of California.  All rights reserved.

NetBSD 5.99.40 (INSTALL) #0: Tue Nov 30 22:39:55 CET 2010
        
jean%6bone.informatik.uni-leipzig.de@localhost:/mnt/raid0/jean/nb-current/obj/sys/arch/amd64/compile/INSTALL
total memory = 49142 MB
avail memory = 47630 MB
timecounter: Timecounters tick every 10.000 msec
timecounter: Timecounter "i8254" frequency 1193182 Hz quality 100
Dell Inc. PowerEdge M710
mainbus0 (root)
cpu0 at mainbus0 apid 32: Intel 686-class, 2261MHz, id 0x206c2
cpu1 at mainbus0 apid 0: Intel 686-class, 2261MHz, id 0x206c2
cpu2 at mainbus0 apid 34: Intel 686-class, 2261MHz, id 0x206c2
cpu3 at mainbus0 apid 2: Intel 686-class, 2261MHz, id 0x206c2
cpu4 at mainbus0 apid 36: Intel 686-class, 2261MHz, id 0x206c2
cpu5 at mainbus0 apid 4: Intel 686-class, 2261MHz, id 0x206c2
cpu6 at mainbus0 apid 48: Intel 686-class, 2261MHz, id 0x206c2
cpu7 at mainbus0 apid 16: Intel 686-class, 2261MHz, id 0x206c2
cpu8 at mainbus0 apid 50: Intel 686-class, 2261MHz, id 0x206c2
cpu9 at mainbus0 apid 18: Intel 686-class, 2261MHz, id 0x206c2
cpu10 at mainbus0 apid 52: Intel 686-class, 2261MHz, id 0x206c2
cpu11 at mainbus0 apid 20: Intel 686-class, 2261MHz, id 0x206c2
cpu12 at mainbus0 apid 33: Intel 686-class, 2261MHz, id 0x206c2
cpu13 at mainbus0 apid 1: Intel 686-class, 2261MHz, id 0x206c2
cpu14 at mainbus0 apid 35: Intel 686-class, 2261MHz, id 0x206c2
cpu15 at mainbus0 apid 3: Intel 686-class, 2261MHz, id 0x206c2
cpu16 at mainbus0 apid 37: Intel 686-class, 2261MHz, id 0x206c2
cpu17 at mainbus0 apid 5: Intel 686-class, 2261MHz, id 0x206c2
cpu18 at mainbus0 apid 49: Intel 686-class, 2261MHz, id 0x206c2
cpu19 at mainbus0 apid 17: Intel 686-class, 2261MHz, id 0x206c2
cpu20 at mainbus0 apid 51: Intel 686-class, 2261MHz, id 0x206c2
cpu21 at mainbus0 apid 19: Intel 686-class, 2261MHz, id 0x206c2
cpu22 at mainbus0 apid 53: Intel 686-class, 2261MHz, id 0x206c2
cpu23 at mainbus0 apid 21: Intel 686-class, 2261MHz, id 0x206c2
ioapic0 at mainbus0 apid 0: pa 0xfec00000, version 20, 24 pins
ioapic1 at mainbus0 apid 1: pa 0xfec80000, version 20, 24 pins
acpi0 at mainbus0: Intel ACPICA 20100528
acpi0: X/RSDT: OemId <DELL  ,PE_SC3  ,00000001>, AslId <DELL,00000001>
acpi0: SCI interrupting at int 9
timecounter: Timecounter "ACPI-Fast" frequency 3579545 Hz quality 1000
CPU1 (ACPI Object Type 'Processor' [0x0c]) at acpi0 not configured
CPU2 (ACPI Object Type 'Processor' [0x0c]) at acpi0 not configured
CPU3 (ACPI Object Type 'Processor' [0x0c]) at acpi0 not configured
CPU4 (ACPI Object Type 'Processor' [0x0c]) at acpi0 not configured
CPU5 (ACPI Object Type 'Processor' [0x0c]) at acpi0 not configured
CPU6 (ACPI Object Type 'Processor' [0x0c]) at acpi0 not configured
CPU7 (ACPI Object Type 'Processor' [0x0c]) at acpi0 not configured
CPU8 (ACPI Object Type 'Processor' [0x0c]) at acpi0 not configured
CPU9 (ACPI Object Type 'Processor' [0x0c]) at acpi0 not configured
CPUA (ACPI Object Type 'Processor' [0x0c]) at acpi0 not configured
CPUB (ACPI Object Type 'Processor' [0x0c]) at acpi0 not configured
CPUC (ACPI Object Type 'Processor' [0x0c]) at acpi0 not configured
CPUD (ACPI Object Type 'Processor' [0x0c]) at acpi0 not configured
CPUE (ACPI Object Type 'Processor' [0x0c]) at acpi0 not configured
CPUF (ACPI Object Type 'Processor' [0x0c]) at acpi0 not configured
CPUG (ACPI Object Type 'Processor' [0x0c]) at acpi0 not configured
CP17 (ACPI Object Type 'Processor' [0x0c]) at acpi0 not configured
CP18 (ACPI Object Type 'Processor' [0x0c]) at acpi0 not configured
CP19 (ACPI Object Type 'Processor' [0x0c]) at acpi0 not configured
CP20 (ACPI Object Type 'Processor' [0x0c]) at acpi0 not configured
CP21 (ACPI Object Type 'Processor' [0x0c]) at acpi0 not configured
CP22 (ACPI Object Type 'Processor' [0x0c]) at acpi0 not configured
CP23 (ACPI Object Type 'Processor' [0x0c]) at acpi0 not configured
CP24 (ACPI Object Type 'Processor' [0x0c]) at acpi0 not configured
WHEA (PNP0C33) at acpi0 not configured
PMI0 (ACPI000D) at acpi0 not configured
SPK (PNP0C01) at acpi0 not configured
attimer1 at acpi0 (TMR, PNP0100): io 0x40-0x5f irq 0
COMA (PNP0501) at acpi0 not configured
MBIO (PNP0C01) at acpi0 not configured
NIPM (IPI0001) at acpi0 not configured
PEHB (PNP0C02) at acpi0 not configured
hpet0 at acpi0 (HPET, PNP0103-0): mem 0xfed00000-0xfed003ff
timecounter: Timecounter "hpet0" frequency 14318179 Hz quality 2000
VTD (PNP0C02) at acpi0 not configured
ipmi0 at mainbus0
pci0 at mainbus0 bus 0: configuration mode 1
pci0: i/o space, memory space enabled, rd/line, rd/mult, wr/inv ok
pchb0 at pci0 dev 0 function 0: vendor 0x8086 product 0x3406 (rev. 0x13)
ppb0 at pci0 dev 1 function 0: vendor 0x8086 product 0x3408 (rev. 0x13)
ppb0: unsupported PCI Express version
pci1 at ppb0 bus 1
pci1: i/o space, memory space enabled, rd/line, wr/inv ok
bnx0 at pci1 dev 0 function 0: Broadcom NetXtreme II BCM5709 1000Base-SX
bnx0: Ethernet address a4:ba:db:4e:a6:40
bnx0: interrupting at ioapic1 pin 4
brgphy0 at bnx0 phy 2: BCM5709S 1000/2500baseSX PHY, rev. 0
brgphy0: 1000baseSX-FDX, auto
bnx1 at pci1 dev 0 function 1: Broadcom NetXtreme II BCM5709 1000Base-SX
bnx1: Ethernet address a4:ba:db:4e:a6:42
bnx1: interrupting at ioapic1 pin 16
brgphy1 at bnx1 phy 2: BCM5709S 1000/2500baseSX PHY, rev. 0
brgphy1: 1000baseSX-FDX, auto
ppb1 at pci0 dev 3 function 0: vendor 0x8086 product 0x340a (rev. 0x13)
ppb1: unsupported PCI Express version
pci2 at ppb1 bus 2
pci2: i/o space, memory space enabled, rd/line, wr/inv ok
bnx2 at pci2 dev 0 function 0: Broadcom NetXtreme II BCM5709 1000Base-SX
bnx2: Ethernet address a4:ba:db:4e:a6:a8
bnx2: interrupting at ioapic1 pin 0
brgphy2 at bnx2 phy 2: BCM5709S 1000/2500baseSX PHY, rev. 0
brgphy2: 1000baseSX-FDX, auto
bnx3 at pci2 dev 0 function 1: Broadcom NetXtreme II BCM5709 1000Base-SX
bnx3: Ethernet address a4:ba:db:4e:a6:aa
bnx3: interrupting at ioapic1 pin 10
brgphy3 at bnx3 phy 2: BCM5709S 1000/2500baseSX PHY, rev. 0
brgphy3: 1000baseSX-FDX, auto
ppb2 at pci0 dev 4 function 0: vendor 0x8086 product 0x340b (rev. 0x13)
ppb2: unsupported PCI Express version
pci3 at ppb2 bus 4
pci3: i/o space, memory space enabled, rd/line, wr/inv ok
ppb3 at pci0 dev 5 function 0: vendor 0x8086 product 0x340c (rev. 0x13)
ppb3: unsupported PCI Express version
pci4 at ppb3 bus 5
pci4: i/o space, memory space enabled, rd/line, wr/inv ok
ppb4 at pci0 dev 7 function 0: vendor 0x8086 product 0x340e (rev. 0x13)
ppb4: unsupported PCI Express version
pci5 at ppb4 bus 6
pci5: i/o space, memory space enabled, rd/line, wr/inv ok
vendor 0x10df product 0xf100 (Fiber Channel serial bus, revision 0x03) at pci5 
dev 0 function 0 not configured
vendor 0x10df product 0xf100 (Fiber Channel serial bus, revision 0x03) at pci5 
dev 0 function 1 not configured
ppb5 at pci0 dev 9 function 0: vendor 0x8086 product 0x3410 (rev. 0x13)
ppb5: unsupported PCI Express version
pci6 at ppb5 bus 7
pci6: i/o space, memory space enabled, rd/line, wr/inv ok
bnx4 at pci6 dev 0 function 0: Broadcom NetXtreme II BCM5709 1000Base-SX
bnx4: Ethernet address a4:ba:db:4e:a6:48
bnx4: interrupting at ioapic1 pin 8
brgphy4 at bnx4 phy 2: BCM5709S 1000/2500baseSX PHY, rev. 0
brgphy4: 1000baseSX-FDX, auto
bnx5 at pci6 dev 0 function 1: Broadcom NetXtreme II BCM5709 1000Base-SX
bnx5: Ethernet address a4:ba:db:4e:a6:4a
bnx5: interrupting at ioapic1 pin 18
brgphy5 at bnx5 phy 2: BCM5709S 1000/2500baseSX PHY, rev. 0
brgphy5: 1000baseSX-FDX, auto
ppb6 at pci0 dev 10 function 0: vendor 0x8086 product 0x3411 (rev. 0x13)
ppb6: unsupported PCI Express version
pci7 at ppb6 bus 8
pci7: i/o space, memory space enabled, rd/line, wr/inv ok
vendor 0x8086 product 0x342e (interrupt system, revision 0x13) at pci0 dev 20 
function 0 not configured
vendor 0x8086 product 0x3422 (interrupt system, revision 0x13) at pci0 dev 20 
function 1 not configured
vendor 0x8086 product 0x3423 (interrupt system, revision 0x13) at pci0 dev 20 
function 2 not configured
uhci0 at pci0 dev 26 function 0: vendor 0x8086 product 0x2937 (rev. 0x02)
uhci0: interrupting at ioapic0 pin 17
usb0 at uhci0: USB revision 1.0
uhci1 at pci0 dev 26 function 1: vendor 0x8086 product 0x2938 (rev. 0x02)
uhci1: interrupting at ioapic0 pin 18
usb1 at uhci1: USB revision 1.0
ehci0 at pci0 dev 26 function 7: vendor 0x8086 product 0x293c (rev. 0x02)
ehci0: interrupting at ioapic0 pin 19
ehci0: BIOS has given up ownership
ehci0: EHCI version 1.0
ehci0: companion controllers, 2 ports each: uhci0 uhci1
usb2 at ehci0: USB revision 2.0
ppb7 at pci0 dev 28 function 0: vendor 0x8086 product 0x2940 (rev. 0x02)
pci8 at ppb7 bus 3
pci8: i/o space, memory space enabled, rd/line, wr/inv ok
vendor 0x1000 product 0x0072 (SAS mass storage, revision 0x02) at pci8 dev 0 
function 0 not configured
uhci2 at pci0 dev 29 function 0: vendor 0x8086 product 0x2934 (rev. 0x02)
uhci2: interrupting at ioapic0 pin 21
usb3 at uhci2: USB revision 1.0
uhci3 at pci0 dev 29 function 1: vendor 0x8086 product 0x2935 (rev. 0x02)
uhci3: interrupting at ioapic0 pin 20
usb4 at uhci3: USB revision 1.0
uhci4 at pci0 dev 29 function 2: vendor 0x8086 product 0x2936 (rev. 0x02)
uhci4: interrupting at ioapic0 pin 21
usb5 at uhci4: USB revision 1.0
ehci1 at pci0 dev 29 function 7: vendor 0x8086 product 0x293a (rev. 0x02)
ehci1: interrupting at ioapic0 pin 21
ehci1: EHCI version 1.0
ehci1: companion controllers, 2 ports each: uhci2 uhci3 uhci4
usb6 at ehci1: USB revision 2.0
ppb8 at pci0 dev 30 function 0: vendor 0x8086 product 0x244e (rev. 0x92)
pci9 at ppb8 bus 9
pci9: i/o space, memory space enabled
vga0 at pci9 dev 3 function 0: vendor 0x102b product 0x0532 (rev. 0x0a)
wsdisplay0 at vga0 kbdmux 1: console (80x25, vt100 emulation)
wsmux1: connecting to wsdisplay0
drm at vga0 not configured
ichlpcib0 at pci0 dev 31 function 0: vendor 0x8086 product 0x2918 (rev. 0x02)
timecounter: Timecounter "ichlpcib0" frequency 3579545 Hz quality 1000
ichlpcib0: 24-bit timer
ichlpcib0: TCO (watchdog) timer configured.
isa0 at ichlpcib0
com0 at isa0 port 0x3f8-0x3ff irq 4: ns16550a, working fifo
pckbc0 at isa0 port 0x60-0x64
pckbc: cmd word write error
pcppi0 at isa0 port 0x61
midi0 at pcppi0: PC speaker
sysbeep0 at pcppi0
attimer1: attached to pcppi0
timecounter: Timecounter "clockinterrupt" frequency 100 Hz quality 0
uhub0 at usb0: vendor 0x8086 UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
uhub1 at usb3: vendor 0x8086 UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub1: 2 ports with 2 removable, self powered
uhub2 at usb1: vendor 0x8086 UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub2: 2 ports with 2 removable, self powered
uhub3 at usb6: vendor 0x8086 EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
uhub3: 6 ports with 6 removable, self powered
uhub4 at usb2: vendor 0x8086 EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
uhub4: 4 ports with 4 removable, self powered
uhub5 at usb5: vendor 0x8086 UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub5: 2 ports with 2 removable, self powered
uhub6 at usb4: vendor 0x8086 UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub6: 2 ports with 2 removable, self powered
umass0 at uhub3 port 3 configuration 1 interface 0
umass0: American Megatrends Inc. Composite Device, rev 2.00/1.00, addr 2
umass0: using SCSI over Bulk-Only
scsibus0 at umass0: 2 targets, 1 lun per target
umass1 at uhub3 port 3 configuration 1 interface 1
sd0 at scsibus0 target 0 lun 0: <iDRAC, LCDRIVE, 1.00> disk removable
umass1: American Megatrends Inc. Composite Device, rev 2.00/1.00, addr 2
umass1: using SCSI over Bulk-Only
scsibus1 at umass1: 2 targets, 1 lun per target
umass2 at uhub3 port 3 configuration 1 interface 2
umass2: American Megatrends Inc. Composite Device, rev 2.00/1.00, addr 2
umass2: using SCSI over Bulk-Only
scsibus2 at umass2: 2 targets, 1 lun per target
sd0: drive offline
sd0(umass0:0:0:0):  Check Condition on CDB: 0x00 00 00 00 00 00
    SENSE KEY:  Not Ready
     ASC/ASCQ:  Medium Not Present

sd0: unable to open device, error = 19
cd0 at scsibus1 target 0 lun 0: <iDRAC, Virtual CDROM, 1.00> cdrom removable
sd1 at scsibus2 target 0 lun 0: <iDRAC, Virtual Floppy, 1.00> disk removable
sd1: drive offline
sd1(umass2:0:0:0):  Check Condition on CDB: 0x00 00 00 00 00 00
    SENSE KEY:  Not Ready
     ASC/ASCQ:  Medium Not Present

sd1: unable to open device, error = 19
uhidev0 at uhub1 port 2 configuration 1 interface 0
uhidev0: American Megatrends Inc. Virtual Keyboard and Mouse, rev 1.10/1.00, 
addr 2, iclass 3/1
ukbd0 at uhidev0
wskbd0 at ukbd0 mux 1
wskbd0: connecting to wsdisplay0
uhidev1 at uhub1 port 2 configuration 1 interface 1
uhidev1: American Megatrends Inc. Virtual Keyboard and Mouse, rev 1.10/1.00, 
addr 2, iclass 3/1
ums0 at uhidev1: 3 buttons and Z dir
wsmouse0 at ums0 mux 0
umass3 at uhub3 port 5 configuration 1 interface 0
umass3: Generic Mass Storage Device, rev 2.00/1.05, addr 3
umass3: using SCSI over Bulk-Only
scsibus3 at umass3: 2 targets, 1 lun per target
sd2 at scsibus3 target 0 lun 0: <Single, Flash Reader, 1.00> disk removable
uhidev2 at uhub6 port 2 configuration 1 interface 0
uhidev2: Avocent Avocent KVM, rev 1.10/1.00, addr 2, iclass 3/1
ukbd1 at uhidev2
sd2: fabricating a geometry
sd2: 954 MB, 954 cyl, 64 head, 32 sec, 512 bytes/sect x 1953792 sectors
sd2: fabricating a geometry
Kernelized RAIDframe activated
pad0: outputs: 44100Hz, 16-bit, stereo
audio0 at pad0: half duplex, playback, capture
sd0(umass0:0:0:0):  Check Condition on CDB: 0x00 00 00 00 00 00
    SENSE KEY:  Not Ready
     ASC/ASCQ:  Medium Not Present

sd1(umass2:0:0:0):  Check Condition on CDB: 0x00 00 00 00 00 00
    SENSE KEY:  Not Ready
     ASC/ASCQ:  Medium Not Present

sd0(umass0:0:0:0):  Check Condition on CDB: 0x00 00 00 00 00 00
    SENSE KEY:  Not Ready
     ASC/ASCQ:  Medium Not Present

sd1(umass2:0:0:0):  Check Condition on CDB: 0x00 00 00 00 00 00
    SENSE KEY:  Not Ready
     ASC/ASCQ:  Medium Not Present

boot device: <unknown>
md0: internal 5000 KB image area
root on md0a dumps on md0b
root file system type: ffs
warning: no /dev/console
wskbd1 at ukbd1 mux 1
wskbd1: connecting to wsdisplay0
uhidev3 at uhub6 port 2 configuration 1 interface 1
uhidev3: Avocent Avocent KVM, rev 1.10/1.00, addr 2, iclass 3/1
uhidev3: 3 report ids
ums1 at uhidev3 reportid 1: 5 buttons and Z dir
wsmouse1 at ums1 mux 0
uhid0 at uhidev3 reportid 2: input=2, output=0, feature=0
uhid1 at uhidev3 reportid 3: input=1, output=0, feature=0
ipmi0: version 2.0 interface KCS iobase 0xca8/8 spacing 4