--fUYQa+Pmc3FrFX/N
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

On Tue, Feb 07, 2006 at 08:57:36PM -0800, Jonathan Stone wrote:
>=20
> With any of a half-dozen multi-core amd64 nforce4 motherboards, from 3
> or 4 different vendors, and NetBSD-3.0_RC3 through 3-stable, I haven't
> been able t get a stable system with the hardware (nforce4 or add-in)
> I need.  My experience is that NetBSD just plain doesn't work properly
> with nforce4 and multiple CPUs.

I've had a bad experience to the contrary. (described below)

> To be fair, if one carefully uses only a subset of the nforce4
> functionality with multiple CPU cores (either dual-core CPU or two
> single-core CPUs in a dual-socket-940 board), you *can* find stable
> subsets; but in my experience it's not worth trying.

Sorta.
=20
> In particular, anytime I start an X11 server, I get a double-fault, or
> with ddb configured into my kernel, a spontaenous reboot (triple
> fault?).  I've only gotten X servers to work with NetBSD+nforce4 if I
> disable "APIC mode" in the BIOS; and the socket-939 BIOSes I've seen
> do not allow one to disable APIC mode in SMP configs.
>=20
> Ditto for various builtin nforce4 hardware, or other add-in cards.
> OTOH, I'd be very glad to hear others' success stories with
> nforce4+SMP+NetBSD; even more so if I could reproduce them.

http://mail-index.netbsd.org/port-amd64/2005/12/29/0001.html
http://mail-index.netbsd.org/port-amd64/2005/12/30/0001.html
http://mail-index.netbsd.org/port-amd64/2005/12/30/0003.html
http://mail-index.netbsd.org/port-amd64/2006/01/03/0003.html
http://mail-index.netbsd.org/port-amd64/2006/01/04/0001.html
http://mail-index.netbsd.org/port-amd64/2006/01/08/0006.html

current state:

NetBSD 3.0 (DOLOMITE) #1: Tue Jan 10 14:14:43 CST 2006
	root@dolomite.xxxxx.xxxxxxx.edu:/usr/src/sys/arch/amd64/compile/DOLOMITE
total memory =3D 3455 MB
avail memory =3D 3305 MB
mainbus0 (root)
mainbus0: Intel MP Specification (Version 1.4) (OEM00000 PROD00000000)
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Dual Core AMD Opteron(tm) Processor 170   , 2009.37 MHz
cpu0: features: f7dbfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR>
cpu0: features: f7dbfbff<PGE,MCA,CMOV,PAT,PSE36,MPC,NOX,MMXX,MMX>
cpu0: features: f7dbfbff<FXSR,SSE,SSE2,B28,LONG,3DNOW2,3DNOW>
cpu0: I-cache 64 KB 64B/line 2-way, D-cache 64 KB 64B/line 2-way
cpu0: L2 cache 1 MB 64B/line 16-way
cpu0: ITLB 32 4 KB entries fully associative, 8 4 MB entries fully associat=
ive
cpu0: DTLB 32 4 KB entries fully associative, 8 4 MB entries fully associat=
ive
cpu0: calibrating local timer
cpu0: apic clock running at 200 MHz
cpu0: 16 page colors
cpu1 at mainbus0: apid 1 (application processor)
cpu1: starting
cpu1: Dual Core AMD Opteron(tm) Processor 170   , 2009.26 MHz
cpu1: features: f7dbfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR>
cpu1: features: f7dbfbff<PGE,MCA,CMOV,PAT,PSE36,MPC,NOX,MMXX,MMX>
cpu1: features: f7dbfbff<FXSR,SSE,SSE2,B28,LONG,3DNOW2,3DNOW>
cpu1: I-cache 64 KB 64B/line 2-way, D-cache 64 KB 64B/line 2-way
cpu1: L2 cache 1 MB 64B/line 16-way
cpu1: ITLB 32 4 KB entries fully associative, 8 4 MB entries fully associat=
ive
cpu1: DTLB 32 4 KB entries fully associative, 8 4 MB entries fully associat=
ive
mpbios: bus 0 is type PCI  =20
mpbios: bus 1 is type PCI  =20
mpbios: bus 2 is type PCI  =20
mpbios: bus 3 is type PCI  =20
mpbios: bus 4 is type PCI  =20
mpbios: bus 5 is type PCI  =20
mpbios: bus 6 is type ISA  =20
ioapic0 at mainbus0 apid 2 (I/O APIC)
ioapic0: pa 0xfec00000, version 11, 24 pins
ioapic0: misconfigured as apic 0
ioapic0: remapped to apic 2
acpi0 at mainbus0
acpi0: using Intel ACPI CA subsystem version 20040211
acpi0: X/RSDT: OemId <Nvidia,AWRDACPI,42302e31>, AslId <AWRD,00000000>
acpi0: SCI interrupting at int 9
acpi0: fixed-feature power button present
ACPI Object Type 'Processor' (0x0c) at acpi0 not configured
ACPI Object Type 'Processor' (0x0c) at acpi0 not configured
PNP0C02 [Plug and Play motherboard register resources] at acpi0 not configu=
red
PNP0C0C [ACPI power button device] at acpi0 not configured
PNP0A08 at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C02 [Plug and Play motherboard register resources] at acpi0 not configu=
red
PNP0000 [AT Interrupt Controller] at acpi0 not configured
PNP0200 [AT DMA Controller] at acpi0 not configured
PNP0100 [AT Timer] at acpi0 not configured
PNP0B00 [AT Real-Time Clock] at acpi0 not configured
PNP0800 [AT-style speaker sound] at acpi0 not configured
PNP0C04 [Math Coprocessor] at acpi0 not configured
PNP0700 [PC standard floppy disk controller] at acpi0 not configured
PNP0303 [IBM Enhanced (101/102-key, PS/2 mouse support)] at acpi0 not confi=
gured
PNP0C02 [Plug and Play motherboard register resources] at acpi0 not configu=
red
PNP0C01 [System Board] at acpi0 not configured
PNP0C0B [ACPI Fan] at acpi0 not configured
ACPI Object Type 'Thermal' (0x0d) at acpi0 not configured
pci0 at mainbus0 bus 0: configuration mode 1
pci0: i/o space, memory space enabled, rd/line, rd/mult, wr/inv ok
Nvidia product 0x005e (miscellaneous memory, revision 0xa3) at pci0 dev 0 f=
unction 0 not configured
pcib0 at pci0 dev 1 function 0
pcib0: Nvidia product 0x0050 (rev. 0xa3)
Nvidia nForce4 SMBus (SMBus serial bus, revision 0xa2) at pci0 dev 1 functi=
on 1 not configured
ohci0 at pci0 dev 2 function 0: Nvidia product 0x005a (rev. 0xa2)
ohci0: interrupting at ioapic0 pin 4 (irq 4)
ohci0: OHCI version 1.0, legacy support
usb0 at ohci0: USB revision 1.0
uhub0 at usb0
uhub0: Nvidia OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 10 ports with 10 removable, self powered
Nvidia product 0x005b (USB serial bus, interface 0x20, revision 0xa3) at pc=
i0 dev 2 function 1 not configured
auich0 at pci0 dev 4 function 0: nForce4 AC-97 Audio
auich0: interrupting at ioapic0 pin 12 (irq 12)
auich0: ac97: Avance Logic ALC850 codec; no 3D stereo
auich0: ac97: ext id 9c6<AC97_23,LDAC,SDAC,CDAC,SPDIF,DRA>
viaide0 at pci0 dev 6 function 0
viaide0: NVIDIA nForce4 IDE Controller (rev. 0xa2)
viaide0: bus-master DMA support present
viaide0: primary channel configured to compatibility mode
viaide0: primary channel ignored (disabled)
viaide0: secondary channel configured to compatibility mode
viaide0: secondary channel interrupting at ioapic0 pin 15 (irq 15)
atabus0 at viaide0 channel 1
viaide1 at pci0 dev 8 function 0
viaide1: NVIDIA nForce4 Serial ATA Controller (rev. 0xa3)
viaide1: bus-master DMA support present
viaide1: primary channel wired to native-PCI mode
pci_intr_map: bus 0 dev 8 func 0 pin 1; line 11
pci_intr_map: no MP mapping found
viaide1: using irq 11 for native-PCI interrupt
atabus1 at viaide1 channel 0
viaide1: secondary channel wired to native-PCI mode
atabus2 at viaide1 channel 1
ppb0 at pci0 dev 9 function 0: Nvidia product 0x005c (rev. 0xa2)
pci1 at ppb0 bus 1
pci1: i/o space, memory space enabled
rtk0 at pci1 dev 6 function 0: Realtek 8139 10/100BaseTX
rtk0: interrupting at ioapic0 pin 10 (irq 10)
rtk0: Ethernet address 00:50:bf:75:00:89
ukphy0 at rtk0 phy 7: Generic IEEE 802.3u media interface
ukphy0: OUI 0x000000, model 0x0000, rev. 0
ukphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
VIA Technologies VT6306 IEEE 1394 Host Controller (Firewire serial bus, int=
erface 0x10, revision 0x80) at pci1 dev 9 function 0 not configured
Nvidia product 0x0057 (miscellaneous bridge, revision 0xa3) at pci0 dev 10 =
function 0 not configured
ppb1 at pci0 dev 11 function 0: Nvidia product 0x005d (rev. 0xa3)
pci2 at ppb1 bus 2
pci2: i/o space, memory space enabled, rd/line, wr/inv ok
ppb2 at pci0 dev 12 function 0: Nvidia product 0x005d (rev. 0xa3)
pci3 at ppb2 bus 3
pci3: i/o space, memory space enabled, rd/line, wr/inv ok
ppb3 at pci0 dev 13 function 0: Nvidia product 0x005d (rev. 0xa3)
pci4 at ppb3 bus 4
pci4: i/o space, memory space enabled, rd/line, wr/inv ok
ppb4 at pci0 dev 14 function 0: Nvidia product 0x005d (rev. 0xa3)
pci5 at ppb4 bus 5
pci5: i/o space, memory space enabled, rd/line, wr/inv ok
vga0 at pci5 dev 0 function 0: Nvidia product 0x0140 (rev. 0xa2)
vga0: WARNING: ignoring 64-bit BAR @ 0x14
vga0: WARNING: ignoring 64-bit BAR @ 0x1c
wsdisplay0 at vga0 kbdmux 1: console (80x25, vt100 emulation)
wsmux1: connecting to wsdisplay0
pchb0 at pci0 dev 24 function 0
pchb0: Advanced Micro Devices AMD64 HyperTransport configuration (rev. 0x00)
pchb1 at pci0 dev 24 function 1
pchb1: Advanced Micro Devices AMD64 Address Map configuration (rev. 0x00)
pchb2 at pci0 dev 24 function 2
pchb2: Advanced Micro Devices AMD64 DRAM configuration (rev. 0x00)
pchb3 at pci0 dev 24 function 3
pchb3: Advanced Micro Devices AMD64 Miscellaneous configuration (rev. 0x00)
isa0 at pcib0
pckbc0 at isa0 port 0x60-0x64
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
midi0 at pcppi0: PC speaker
sysbeep0 at pcppi0
fdc0 at isa0 port 0x3f0-0x3f7 irq 6 drq 2
ioapic0: enabling
audio0 at auich0: full duplex, independent
fd0 at fdc0 drive 0: 1.44MB, 80 cyl, 2 head, 18 sec
Kernelized RAIDframe activated
atapibus0 at atabus0: 2 targets
cd0 at atapibus0 drive 0: <LITE-ON DVDRW SHW-160P6S, , PS01> cdrom removable
cd0: 32-bit data port
cd0: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 4 (Ultra/66)
cd0(viaide0:1:0): using PIO mode 4, Ultra-DMA mode 4 (Ultra/66) (using DMA)
uhidev0 at uhub0 port 1 configuration 1 interface 0
uhidev0: Adomax  Sem. USB Mouse, rev 1.00/4.90, addr 2, iclass 3/1
ums0 at uhidev0: 3 buttons and Z dir.
wsmouse0 at ums0 mux 0
wd0 at atabus1 drive 0: <ST3250823AS>
wd0: drive supports 16-sector PIO transfers, LBA48 addressing
wd0: 232 GB, 484521 cyl, 16 head, 63 sec, 512 bytes/sect x 488397168 sectors
wd0: 32-bit data port
wd0: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 6 (Ultra/133)
wd0(viaide1:0:0): using PIO mode 4, Ultra-DMA mode 6 (Ultra/133) (using DMA)
boot device: wd0
root on wd0a dumps on wd0b
root file system type: ffs
cpu1: CPU 1 running
wsdisplay0: screen 1 added (80x25, vt100 emulation)
wsdisplay0: screen 2 added (80x25, vt100 emulation)
wsdisplay0: screen 3 added (80x25, vt100 emulation)
wsdisplay0: screen 4 added (80x25, vt100 emulation)

kernel:
--- GENERIC     2005-09-15 18:33:43.000000000 -0500
+++ DOLOMITE.UP 2006-01-10 14:09:07.000000000 -0600
@@ -199,7 +199,7 @@
 # allocate a number of virtual screens at autoconfiguration time
 #options       WSDISPLAY_DEFAULTSCREENS=3D4
 # use a large software cursor that doesn't blink
-options        PCDISPLAY_SOFTCURSOR
+#options       PCDISPLAY_SOFTCURSOR
 # modify the screen type of the console; defaults to "80x25"
 #options       VGA_CONSOLE_SCREENTYPE=3D"\"80x24\""
 # work around a hardware bug that loaded fonts don't work; found on ATI ca=
rds
@@ -224,10 +224,10 @@
=20
 #acpi0 at mainbus0
=20
-#acpi0                 at mainbus0
+acpi0          at mainbus0
 #options       MPACPI
 #options       MPACPI_SCANPCI          # MPBIOS configures PCI roots
-#options       ACPI_PCI_FIXUP          # PCI interrupt routing via ACPI
+options        ACPI_PCI_FIXUP          # PCI interrupt routing via ACPI
 #options       ACPI_ACTIVATE_DEV       # If set, activate inactive devices
 #options       ACPICA_PEDANTIC         # force strict conformance to the S=
pec.
 #options       ACPI_DISABLE_ON_POWEROFF        # disable acpi on power off
@@ -816,7 +816,7 @@
 pseudo-device  gre             2       # generic L3 over IP tunnel
 pseudo-device  gif             4       # IPv[46] over IPv[46] tunnel (RFC1=
933)
 #pseudo-device faith           1       # IPv[46] tcp relay translation i/f
-#pseudo-device stf             1       # 6to4 IPv6 over IPv4 encapsulation
+pseudo-device  stf             1       # 6to4 IPv6 over IPv4 encapsulation
 pseudo-device  vlan                    # IEEE 802.1q encapsulation
 pseudo-device  bridge                  # simple inter-network bridging
 #options       BRIDGE_IPF              # bridge uses IP/IPv6 pfil hooks too

--- GENERIC.MP  2003-04-26 13:39:34.000000000 -0500
+++ DOLOMITE    2005-09-26 17:50:12.000000000 -0500
@@ -1,6 +1,6 @@
 #      $NetBSD: GENERIC.MP,v 1.1 2003/04/26 18:39:34 fvdl Exp $
=20
-include "arch/amd64/conf/GENERIC"
+include "arch/amd64/conf/DOLOMITE.UP"
=20
 options        MULTIPROCESSOR
 options        COM_MPLOCK



The USB2 doesn't configure in 3.0 (though it does in -current).  The RAM
is forced to clock at DDR266 (though both ends claim support for faster).
The box currently has been up for 2+ weeks.  I believe I've still got
some unneeded (and problematic) [PS]ATA controllers disabled in the BIOS.
Also the lpt and com ports are BIOS disabled, though that may be unneeded.
The on-board nVidia GbE doesn't work in amd64 and I've not wanted to
install a "int" mode environment to test sysutils/nvnet.  I've also not
tested the Firewire, and I don't think 3.0 even has working 1394 support.

The PCI-E x16 Geforce FX 6600 works fine (to the extent the nv driver can)
in X.org (I haven't bothered to test XFree86).

Even if I could have a amd64 box at home, I'm not sure I'd want one
due to these various difficulties.

	Jonathan Kollasch

--fUYQa+Pmc3FrFX/N
Content-Type: application/pgp-signature
Content-Disposition: inline

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.2 (NetBSD)

iD8DBQFD7BHSOjx1ye3hmokRAl6NAJ0VRKrTBPVOuYLJRX9XaBZXSo8SwQCfXANL
mai62nUvn160+xdnIW0N1yk=
=k4me
-----END PGP SIGNATURE-----

--fUYQa+Pmc3FrFX/N--