On Wed, Jan 10, 2007 at 10:38:20AM -0800, Jason Thorpe wrote:
>On Jan 9, 2007, at 11:27 AM, George Georgalis wrote:
>>
>>Reliability, NetBSD compatibility (ongoing) and the usual apply.
>>Price is not too important but it should be reasonable, eg I'm
>>expecting 200 - $550.
>
>That's pretty cheap for a FC interface card.  Luckily, you have an  
>option in that price range -- the Apple Fibre Channel PCI-X card ($499):

at the moment I have a Qlogic 2422 4GB fibre HBA
(one channel) and an (Apple) LSI Logic FC929X FC
2GB 2 channel HBA, using isp and mpt respectively;
both are in 133 Mhz PCI-X slots on an amd64 running
3.1; the 2422 has fibre to port 0 of an external
disk enclosure and the FC929X has copper to port 1
on the same enclosure.

The kernel has a patch to support the Qlogic 2422
with ISP, which will be checked in to netbsd soon.

The problem is, the enclosure is configured to make
LUNs available on both channel 0 and 1, but I see no
disk media. I'm trying to fdisk /dev/sd0; ld0 and
wd1 and getting device not configured.

The vendor is confident the enclosure is exporting
the LUNs.  Am I accessing them incorrectly?  The
dmesg is below (with ISP debugging on), what could
be wrong?

// George


NetBSD 3.1_STABLE (SAW2) #6: Thu May 10 10:15:39 EDT 2007
	root@saw2:/usr/obj/sys/arch/amd64/compile/SAW2
total memory = 16383 MB
avail memory = 15718 MB
mainbus0 (root)
mainbus0: Intel MP Specification (Version 1.1) (nVidia   MCP55       )
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Dual-Core AMD Opteron(tm) Processor 2216 HE, 2412.51 MHz
cpu0: features: ffdbfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR>
cpu0: features: ffdbfbff<PGE,MCA,CMOV,PAT,PSE36,MPC,NOX,MMXX,MMX>
cpu0: features: ffdbfbff<FXSR,SSE,SSE2,B27,B28,LONG,3DNOW2,3DNOW>
cpu0: I-cache 64 KB 64B/line 2-way, D-cache 64 KB 64B/line 2-way
cpu0: L2 cache 1 MB 64B/line 16-way
cpu0: ITLB 32 4 KB entries fully associative, 8 4 MB entries fully associative
cpu0: DTLB 32 4 KB entries fully associative, 8 4 MB entries fully associative
cpu0: calibrating local timer
cpu0: apic clock running at 201 MHz
cpu0: 16 page colors
cpu1 at mainbus0: apid 1 (application processor)
cpu1: starting
cpu1: Dual-Core AMD Opteron(tm) Processor 2216 HE, 2412.37 MHz
cpu1: features: ffdbfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR>
cpu1: features: ffdbfbff<PGE,MCA,CMOV,PAT,PSE36,MPC,NOX,MMXX,MMX>
cpu1: features: ffdbfbff<FXSR,SSE,SSE2,B27,B28,LONG,3DNOW2,3DNOW>
cpu1: I-cache 64 KB 64B/line 2-way, D-cache 64 KB 64B/line 2-way
cpu1: L2 cache 1 MB 64B/line 16-way
cpu1: ITLB 32 4 KB entries fully associative, 8 4 MB entries fully associative
cpu1: DTLB 32 4 KB entries fully associative, 8 4 MB entries fully associative
cpu2 at mainbus0: apid 2 (application processor)
cpu2: starting
cpu2: Dual-Core AMD Opteron(tm) Processor 2216 HE, 2412.37 MHz
cpu2: features: ffdbfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR>
cpu2: features: ffdbfbff<PGE,MCA,CMOV,PAT,PSE36,MPC,NOX,MMXX,MMX>
cpu2: features: ffdbfbff<FXSR,SSE,SSE2,B27,B28,LONG,3DNOW2,3DNOW>
cpu2: I-cache 64 KB 64B/line 2-way, D-cache 64 KB 64B/line 2-way
cpu2: L2 cache 1 MB 64B/line 16-way
cpu2: ITLB 32 4 KB entries fully associative, 8 4 MB entries fully associative
cpu2: DTLB 32 4 KB entries fully associative, 8 4 MB entries fully associative
cpu3 at mainbus0: apid 3 (application processor)
cpu3: starting
cpu3: Dual-Core AMD Opteron(tm) Processor 2216 HE, 2412.37 MHz
cpu3: features: ffdbfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR>
cpu3: features: ffdbfbff<PGE,MCA,CMOV,PAT,PSE36,MPC,NOX,MMXX,MMX>
cpu3: features: ffdbfbff<FXSR,SSE,SSE2,B27,B28,LONG,3DNOW2,3DNOW>
cpu3: I-cache 64 KB 64B/line 2-way, D-cache 64 KB 64B/line 2-way
cpu3: L2 cache 1 MB 64B/line 16-way
cpu3: ITLB 32 4 KB entries fully associative, 8 4 MB entries fully associative
cpu3: DTLB 32 4 KB entries fully associative, 8 4 MB entries fully associative
mpbios: bus 0 is type PCI   
mpbios: bus 1 is type PCI   
mpbios: bus 2 is type PCI   
mpbios: bus 3 is type PCI   
mpbios: bus 4 is type PCI   
mpbios: bus 5 is type PCI   
mpbios: bus 6 is type PCI   
mpbios: bus 7 is type PCI   
mpbios: bus 8 is type PCI   
mpbios: bus 9 is type PCI   
mpbios: bus 10 is type ISA   
ioapic0 at mainbus0 apid 4 (I/O APIC)
ioapic0: pa 0xfec00000, version 11, 24 pins
acpi0 at mainbus0
acpi0: using Intel ACPI CA subsystem version 20040211
acpi0: X/RSDT: OemId <A M I ,OEMRSDT ,11000628>, AslId <MSFT,00000097>
acpi0: SCI interrupting at int 9
acpi0: fixed-feature power button present
ACPI Object Type 'Processor' (0x0c) at acpi0 not configured
ACPI Object Type 'Processor' (0x0c) at acpi0 not configured
ACPI Object Type 'Processor' (0x0c) at acpi0 not configured
ACPI Object Type 'Processor' (0x0c) at acpi0 not configured
PNP0A03 [PCI Bus] at acpi0 not configured
PNP0000 [AT Interrupt Controller] at acpi0 not configured
PNP0200 [AT DMA Controller] at acpi0 not configured
PNP0100 [AT Timer] at acpi0 not configured
PNP0B00 [AT Real-Time Clock] at acpi0 not configured
PNP0800 [AT-style speaker sound] at acpi0 not configured
PNP0C04 [Math Coprocessor] at acpi0 not configured
com2 at acpi0 (PNP0501-1)
com2: io 0x3f8-0x3ff irq 4
com2: ns16550a, working fifo
com3 at acpi0 (PNP0501-2)
com3: io 0x2f8-0x2ff irq 3
com3: ns16550a, working fifo
PNP0700 [PC standard floppy disk controller] at acpi0 not configured
PNP0C02 [Plug and Play motherboard register resources] at acpi0 not configured
PNP0C02 [Plug and Play motherboard register resources] at acpi0 not configured
PNP0303 [IBM Enhanced (101/102-key, PS/2 mouse support)] at acpi0 not configured
PNP0F03 [Microsoft PS/2-style Mouse] at acpi0 not configured
PNP0C02 [Plug and Play motherboard register resources] at acpi0 not configured
PNP0C02 [Plug and Play motherboard register resources] at acpi0 not configured
PNP0C01 [System Board] at acpi0 not configured
PNP0C0C [ACPI power button device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
PNP0C0F [PCI interrupt link device] at acpi0 not configured
pci0 at mainbus0 bus 0: configuration mode 1
pci0: i/o space, memory space enabled, rd/line, rd/mult, wr/inv ok
NVIDIA product 0x0369 (RAM memory, revision 0xa2) at pci0 dev 0 function 0 not configured
pcib0 at pci0 dev 1 function 0
pcib0: NVIDIA product 0x0364 (rev. 0xa3)
NVIDIA MCP55 SMBus (SMBus serial bus, revision 0xa3) at pci0 dev 1 function 1 not configured
NVIDIA product 0x036a (RAM memory, revision 0xa3) at pci0 dev 1 function 2 not configured
ohci0 at pci0 dev 2 function 0: NVIDIA product 0x036c (rev. 0xa1)
ohci0: interrupting at ioapic0 pin 7 (irq 7)
ohci0: OHCI version 1.0, legacy support
usb0 at ohci0: USB revision 1.0
uhub0 at usb0
uhub0: NVIDIA OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 10 ports with 10 removable, self powered
NVIDIA product 0x036d (USB serial bus, interface 0x20, revision 0xa2) at pci0 dev 2 function 1 not configured
pciide0 at pci0 dev 4 function 0
pciide0: NVIDIA MCP55 IDE (rev. 0xa1)
pciide0: bus-master DMA support present, but unused (no driver support)
pciide0: primary channel configured to compatibility mode
pciide0: primary channel interrupting at ioapic0 pin 14 (irq 14)
atabus0 at pciide0 channel 0
pciide0: secondary channel configured to compatibility mode
pciide0: secondary channel ignored (not responding; disabled or no drives?)
pciide1 at pci0 dev 5 function 0
pciide1: NVIDIA MCP55 SATA (rev. 0xa3)
pciide1: bus-master DMA support present, but unused (no driver support)
pciide1: primary channel wired to native-PCI mode
pciide1: using ioapic0 pin 11 (irq 11) for native-PCI interrupt
atabus1 at pciide1 channel 0
pciide1: secondary channel wired to native-PCI mode
atabus2 at pciide1 channel 1
pciide2 at pci0 dev 5 function 1
pciide2: NVIDIA MCP55 SATA (rev. 0xa3)
pciide2: bus-master DMA support present, but unused (no driver support)
pciide2: primary channel wired to native-PCI mode
pciide2: using ioapic0 pin 5 (irq 5) for native-PCI interrupt
atabus3 at pciide2 channel 0
pciide2: secondary channel wired to native-PCI mode
atabus4 at pciide2 channel 1
pciide3 at pci0 dev 5 function 2
pciide3: NVIDIA MCP55 SATA (rev. 0xa3)
pciide3: bus-master DMA support present, but unused (no driver support)
pciide3: primary channel wired to native-PCI mode
pciide3: using ioapic0 pin 10 (irq 10) for native-PCI interrupt
atabus5 at pciide3 channel 0
pciide3: secondary channel wired to native-PCI mode
atabus6 at pciide3 channel 1
ppb0 at pci0 dev 6 function 0: NVIDIA product 0x0370 (rev. 0xa2)
pci1 at ppb0 bus 1
pci1: i/o space, memory space enabled
vga0 at pci1 dev 5 function 0: ATI Technologies product 0x515e (rev. 0x02)
wsdisplay0 at vga0 kbdmux 1: console (80x25, vt100 emulation)
wsmux1: connecting to wsdisplay0
nfe0 at pci0 dev 8 function 0: ioapic0 pin 10 (irq 10), address 00:30:48:7a:13:c6
ukphy0 at nfe0 phy 2: Generic IEEE 802.3u media interface
ukphy0: OUI 0x000ac2, model 0x000b, rev. 1
ukphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
nfe1 at pci0 dev 9 function 0: ioapic0 pin 11 (irq 11), address 00:30:48:7a:13:c7
ukphy1 at nfe1 phy 3: Generic IEEE 802.3u media interface
ukphy1: OUI 0x000ac2, model 0x000b, rev. 1
ukphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
ppb1 at pci0 dev 10 function 0: NVIDIA product 0x0376 (rev. 0xa3)
pci2 at ppb1 bus 2
pci2: i/o space, memory space enabled, rd/line, wr/inv ok
ppb2 at pci2 dev 0 function 0: NEC product 0x0125 (rev. 0x07)
pci3 at ppb2 bus 3
pci3: i/o space, memory space enabled, rd/line, wr/inv ok
mpt0 at pci3 dev 4 function 0: LSI Logic FC929X FC Adapter
mpt0: interrupting at ioapic0 pin 5 (irq 5)
mpt0: Port 0: Link state Failed
mpt0: External Bus Reset
mpt0: Port 0: FC Link Event: LIP(f7,25) (Loop Initialization)
mpt0: 	Device 25 doesn't like FC performance
mpt0: Port 0: Link state Active
mpt0: Rescan Port 0
scsibus0 at mpt0: 256 targets, 8 luns per target
mpt1 at pci3 dev 4 function 1: LSI Logic FC929X FC Adapter
mpt1: interrupting at ioapic0 pin 10 (irq 10)
scsibus1 at mpt1: 256 targets, 8 luns per target
isp0 at pci3 dev 6 function 0
isp0: interrupting at ioapic0 pin 10 (irq 10)
isp0: Board Type 2422, Chip Revision 0x2, loaded F/W Revision 4.0.20
isp0: 2K Logins Supported
isp0: Last F/W revision was 4.0.18
isp0: 4096 max I/O command limit set
isp0: line 1209: markportdb
scsibus2 at isp0: 512 targets, 8 luns per target
ppb3 at pci2 dev 0 function 1: NEC product 0x0125 (rev. 0x07)
pci4 at ppb3 bus 4
pci4: no spaces enabled!
ppb4 at pci0 dev 11 function 0: NVIDIA product 0x0374 (rev. 0xa3)
pci5 at ppb4 bus 5
pci5: no spaces enabled!
ppb5 at pci0 dev 12 function 0: NVIDIA product 0x0374 (rev. 0xa3)
pci6 at ppb5 bus 6
pci6: no spaces enabled!
ppb6 at pci0 dev 13 function 0: NVIDIA product 0x0378 (rev. 0xa3)
pci7 at ppb6 bus 7
pci7: no spaces enabled!
ppb7 at pci0 dev 14 function 0: NVIDIA product 0x0375 (rev. 0xa3)
pci8 at ppb7 bus 8
pci8: i/o space, memory space enabled, rd/line, wr/inv ok
wm0 at pci8 dev 0 function 0: Intel i82572EI 1000baseT Ethernet, rev. 6
wm0: interrupting at ioapic0 pin 5 (irq 5)
wm0: PCI-Express bus
wm0: 65536 word (16 address bits) SPI EEPROM
wm0: Ethernet address 00:15:17:1d:c2:be
igphy0 at wm0 phy 1: Intel IGP01E1000 Gigabit PHY, rev. 0
igphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
ppb8 at pci0 dev 15 function 0: NVIDIA product 0x0377 (rev. 0xa3)
pci9 at ppb8 bus 9
pci9: no spaces enabled!
pchb0 at pci0 dev 24 function 0
pchb0: Advanced Micro Devices AMD64 HyperTransport configuration (rev. 0x00)
pchb1 at pci0 dev 24 function 1
pchb1: Advanced Micro Devices AMD64 Address Map configuration (rev. 0x00)
pchb2 at pci0 dev 24 function 2
pchb2: Advanced Micro Devices AMD64 DRAM configuration (rev. 0x00)
pchb3 at pci0 dev 24 function 3
pchb3: Advanced Micro Devices AMD64 Miscellaneous configuration (rev. 0x00)
pchb4 at pci0 dev 25 function 0
pchb4: Advanced Micro Devices AMD64 HyperTransport configuration (rev. 0x00)
pchb5 at pci0 dev 25 function 1
pchb5: Advanced Micro Devices AMD64 Address Map configuration (rev. 0x00)
pchb6 at pci0 dev 25 function 2
pchb6: Advanced Micro Devices AMD64 DRAM configuration (rev. 0x00)
pchb7 at pci0 dev 25 function 3
pchb7: Advanced Micro Devices AMD64 Miscellaneous configuration (rev. 0x00)
isa0 at pcib0
pckbc0 at isa0 port 0x60-0x64
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pms0 at pckbc0 (aux slot)
pckbc0: using irq 12 for aux slot
wsmouse0 at pms0 mux 0
pcppi0 at isa0 port 0x61
midi0 at pcppi0: PC speaker
sysbeep0 at pcppi0
ioapic0: enabling
isp0: line 5348: markportdb
isp0: LOOP Reset Received
isp0: line 5286: markportdb
isp0: LIP Received
isp0: line 5322: markportdb
isp0: Loop UP
isp0: line 5360: markportdb
isp0: Port Database Changed
Kernelized RAIDframe activated
atapibus0 at atabus0: 2 targets
scsibus0: waiting 2 seconds for devices to settle...
scsibus1: waiting 2 seconds for devices to settle...
isp0: checking FC state
isp0: FC Link Test Entry
isp0: line 2467: markportdb
scsibus2: waiting 2 seconds for devices to settle...
cd0 at atapibus0 drive 1: <Optiarc CD-RW CRX880A, , KX07> cdrom removable
isp0: Firmware State <Config Wait->Ready>
isp0: 4Gb link speed/s
isp0: HBA PortID 0x0000ef N-Port Handle 0, Connection Topology 'Private Loop'
isp0: HBA WWNN 0x200000e08b9cdcf6 HBA WWPN 0x210000e08b9cdcf6
isp0: FC Link Test Complete
isp0: FC scan loop 0..125
cd0: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 2 (Ultra/33)
isp0: FC Scan Fabric
isp0: FC Scan Fabric Done (no fabric)
isp0: Synchronizing PDBs
isp0: FC state OK
isp0: THAW QUEUES @ LINE 983
isp0: THAW QUEUES @ LINE 996
isp0: sleep time 0
wd0 at atabus1 drive 0: <WDC WD740ADFD-00NLR1>
wd0: drive supports 16-sector PIO transfers, LBA48 addressing
wd0: 70911 MB, 144073 cyl, 16 head, 63 sec, 512 bytes/sect x 145226112 sectors
wd0: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 6 (Ultra/133)
wd1 at atabus2 drive 0: <WDC WD740ADFD-00NLR1>
wd1: drive supports 16-sector PIO transfers, LBA48 addressing
wd1: 70911 MB, 144073 cyl, 16 head, 63 sec, 512 bytes/sect x 145226112 sectors
wd1: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 6 (Ultra/133)
boot device: wd0
root on wd0a dumps on wd0b
root file system type: ffs
cpu1: CPU 1 running
cpu2: CPU 2 running
cpu3: CPU 3 running
wsdisplay0: screen 1 added (80x25, vt100 emulation)
wsdisplay0: screen 2 added (80x25, vt100 emulation)
wsdisplay0: screen 3 added (80x25, vt100 emulation)
wsdisplay0: screen 4 added (80x25, vt100 emulation)



>
>http://store.apple.com/1-800-MY-APPLE/WebObjects/AppleStore.woa/6544001/wo/fJ1BHZyWHpaq2RGbGQT0MxYgP6V/1.0.21.1.0.8.25.7.11.0.3
>
>The cards are compatible with LSI MPT-Fusion, so they should work with  
>NetBSD.
>
>-- thorpej
>

-- 
George Georgalis, information systems scientist <IXOYE><