kern/56266: bge0 inoperable on Dell R740

To: kern-bug-people%netbsd.org@localhost,gnats-admin%netbsd.org@localhost,netbsd-bugs%netbsd.org@localhost
Subject: kern/56266: bge0 inoperable on Dell R740
From: kardel%netbsd.org@localhost
Date: Mon, 21 Jun 2021 11:50:00 +0000 (UTC)
>Number:         56266
>Category:       kern
>Synopsis:       bge0 inoperable on Dell R740
>Confidential:   no
>Severity:       critical
>Priority:       high
>Responsible:    kern-bug-people
>State:          open
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Mon Jun 21 11:50:00 +0000 2021
>Originator:     Frank Kardel
>Release:        NetBSD 9.99.84/9.2_STABLE
>Organization:
>Environment:
	
	
System: NetBSD Andromeda 8.99.24 NetBSD 8.99.24 (GENERIC) #3: Sun Aug 12 09:09:59 CEST 2018 kardel%pip.kardel.name@localhost:/src/NetBSD/act/src/obj.amd64/sys/arch/amd64/compile/GENERIC amd64
Architecture: x86_64
Machine: amd64
>Description:
	On a Dell R740 the interfaces bge0,1 are detected in the INSTALL kernel.

bge0: flags=0x8802<BROADCAST,SIMPLEX,MULTICAST> mtu 1500
        capabilities=0x3f80<TSO4,IP4CSUM_Rx,IP4CSUM_Tx,TCP4CSUM_Rx,TCP4CSUM_Tx>
        capabilities=0x3f80<UDP4CSUM_Rx,UDP4CSUM_Tx>
        enabled=0
        ec_capabilities=0x7<VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU>
        ec_enabled=0x2<VLAN_HWTAGGING>
        address: 00:0a:f7:xx:xx:xx
        media: Ethernet autoselect (none)
        status: no carrier
bge1: flags=0x8802<BROADCAST,SIMPLEX,MULTICAST> mtu 1500
        capabilities=0x3f80<TSO4,IP4CSUM_Rx,IP4CSUM_Tx,TCP4CSUM_Rx,TCP4CSUM_Tx>
        capabilities=0x3f80<UDP4CSUM_Rx,UDP4CSUM_Tx>
        enabled=0
        ec_capabilities=0x7<VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU>
        ec_enabled=0x2<VLAN_HWTAGGING>
        address: 00:0a:f7:xx:xx:xy
        media: Ethernet autoselect (100baseTX full-duplex)
        status: active

though both interfaces have a link to a 1GbE switch port bge0 lists no carrier and
bge1 negotiates only 100baseTX.
The installer(dhcpcd) is not able to obtain IP addresses from/for bge0. Manual
configuration of bge0 also does not lead to paket traffic. bge1 can be made
the receive and transmit pakets at 100Mb)

The kernels are netbooted via PXE/UEFI thus bge0 does work for the boot.

dmesg output for NetBSD 9.99.84 (INSTALL) #0: Thu Jun 10 07:48:00 UTC 2021.
(full output available on request)

> boot
15623688+5651784+2736824 [695713]=0x18aa630
[   1.0000000] NetBSD 9.99.84 (INSTALL) #0: Thu Jun 10 07:48:00 UTC 2021
[   1.0000000]  mkrepro%mkrepro.NetBSD.org@localhost:/usr/src/sys/arch/amd64/compile/INSTALL
[   1.0000000] total memory = 127 GB
[   1.0000000] avail memory = 123 GB
[   1.0000030] efi: systbl at pa 6c3cef20
[   1.0000030] mainbus0 (root)
i...
[   1.0588141] ppb0 at pci0 dev 28 function 0: Intel C620 PCIe Root Port (rev. 0xf8)
[   1.0588141] ppb0: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x2 @ 8.0GT/s
[   1.0588141] ppb0: link is x2 @ 5.0GT/s
[   1.0588141] pci1 at ppb0 bus 1
[   1.0588141] bge0 at pci1 dev 0 function 0: Broadcom BCM5720 Gigabit Ethernet
[   1.0588141] bge0: APE firmware NCSI 1.4.14.0
[   1.0588141] bge0: interrupting at msix3 vec 0
[   1.0588141] bge0: HW config 002b1194, 00006014, 0006aa38, 00000000 0000000c
[   1.0588141] bge0: ASIC BCM5720 A0 (0x5720000), Ethernet address 00:0a:f7:b9:22:94
[   1.0588141] brgphy0 at bge0 phy 1: BCM5720C 1000BASE-T media interface, rev. 0
[   1.0588141] brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
[   1.0588141] bge1 at pci1 dev 0 function 1: Broadcom BCM5720 Gigabit Ethernet
[   1.0588141] bge1: APE firmware NCSI 1.4.14.0
[   1.0588141] bge1: interrupting at msix4 vec 0
[   1.0588141] bge1: HW config 002b1194, 00006014, 0006aa38, 00000000 0000000c
[   1.0588141] bge1: ASIC BCM5720 A0 (0x5720000), Ethernet address 00:0a:f7:b9:22:95
[   1.0588141] brgphy1 at bge1 phy 2: BCM5720C 1000BASE-T media interface, rev. 0
[   1.0588141] brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
...
[   1.0588141] Broadcom BCM57416 NetXtreme-E Ethernet (ethernet network) at pci5 dev 0 function 0 not configured
[   1.0588141] Broadcom BCM57416 NetXtreme-E Ethernet (ethernet network, revision 0x01) at pci5 dev 0 function 1 not configured
### net yet supported in NetBSD
....
[   1.0588141] pci6 at mainbus0 bus 100
[   1.0588141] ppb4 at pci6 dev 0 function 0: Intel product 2030 (rev. 0x04)
[   1.0588141] ppb4: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x8 @ 8.0GT/s
[   1.0588141] pci7 at ppb4 bus 101
[   1.0588141] nvme0 at pci7 dev 0 function 0: Samsung Electronics (3rd vendor ID) NVMe SSD Controller 172Xa/172Xb (rev. 0x01)
[   1.0588141] nvme0: NVMe 1.2
[   1.0588141] nvme0: for admin queue interrupting at msix5 vec 0
[   1.0588141] nvme0: Dell Express Flash PM1725a 1.6TB AIC, firmware 1.0.3, serial S39WNA0J701058
[   1.0588141] nvme0: for io queue 1 interrupting at msix5 vec 1 affinity to cpu0
[   1.0588141] nvme0: for io queue 2 interrupting at msix5 vec 2 affinity to cpu1
[   1.0588141] nvme0: for io queue 3 interrupting at msix5 vec 3 affinity to cpu2
[   1.0588141] nvme0: for io queue 4 interrupting at msix5 vec 4 affinity to cpu3
[   1.0588141] nvme0: for io queue 5 interrupting at msix5 vec 5 affinity to cpu4
[   1.0588141] nvme0: for io queue 6 interrupting at msix5 vec 6 affinity to cpu5
[   1.0588141] nvme0: for io queue 7 interrupting at msix5 vec 7 affinity to cpu6
[   1.0588141] nvme0: for io queue 8 interrupting at msix5 vec 8 affinity to cpu7
[   1.0588141] nvme0: for io queue 9 interrupting at msix5 vec 9 affinity to cpu8
[   1.0588141] nvme0: for io queue 10 interrupting at msix5 vec 10 affinity to cpu9
[   1.0588141] nvme0: for io queue 11 interrupting at msix5 vec 11 affinity to cpu10
[   1.0588141] nvme0: for io queue 12 interrupting at msix5 vec 12 affinity to cpu11
[   1.0588141] ld0 at nvme0 nsid 1
[   1.0588141] ld0: 1490 GB, 194561 cyl, 255 head, 63 sec, 512 bytes/sect x 3125627568 sectors
[   1.0588141] ppb5 at pci6 dev 2 function 0: Intel product 2032 (rev. 0x04)
[   1.0588141] ppb5: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x8 @ 8.0GT/s
[   1.0588141] pci8 at ppb5 bus 102
[   1.0588141] mfii0 at pci8 dev 0 function 0: "PERC H330 Mini", firmware 25.5.3.0005
[   1.0588141] mfii0: interrupting at ioapic3 pin 2
[   1.0588141] scsibus0 at mfii0: 32 targets, 8 luns per target
...
[   1.4812313] ACPI Error: AE_NO_MEMORY, uhub0 at usb0while evaluating GPE method [_L6C] (20210331/evgpe-600)
[   1.4887892] : NetBSD (0x0000) xHCI root hub (0x0000), class 9/0, rev 3.00/1.00, addr 0
[   1.4959406] uhub1 at usb1: NetBSD (0x0000) xHCI root hub (0x0000), class 9/0, rev 2.00/1.00, addr 0
[   1.5059406] scsibus0: waiting 2 seconds for devices to settle...
[   1.5059406] mfii0: physical disk inserted id 32 enclosure 32
[   1.5159404] mfii0: physical disk inserted id 0 enclosure 32
[   1.5159404] dk0 at ld0: "primary", 3125624832 blocks at 2048, type: ntfs
[   1.5259405] mfii0: physical disk inserted id 1 enclosure 32
[   1.5359400] mfii0: physical disk inserted id 2 enclosure 32
[   1.5359400] mfii0: physical disk inserted id 3 enclosure 32
[   1.5459400] mfii0: physical disk inserted id 4 enclosure 32
[   1.5459400] mfii0: physical disk inserted id 5 enclosure 32
[   1.6059398] ahcisata1 port 7: device present, speed: 1.5Gb/s
[   3.1359140] atapibus0 at atabus13: 1 targets
[   3.1359140] uhub2 at uhub1 port 14: vendor 1604 (0x1604) product 10c0 (0x10c0), class 9/0, rev 2.00/0.00, addr 1
[   3.1478890] uhub2: single transaction translator
[   3.1601085] cd0 at atapibus0 drive 0: <HL-DT-ST DVD-ROM DU90N, KZSH6RF4815, D3C0> cdrom removable
[   3.5059079] sd0 at scsibus0 target 0 lun 0: <DELL, PERC H330 Mini, 4.27> disk fixed
[   3.5161322] sd0: fabricating a geometry
[   3.5161322] sd0: 446 GB, 457344 cyl, 64 head, 32 sec, 512 bytes/sect x 936640512 sectors
[   3.5267321] sd0: fabricating a geometry
[   3.5368717] dk1 at sd0: "054852d5-6bc3-4f40-bffa-90edabab0cd6", 262144 blocks at 2048, type: msdos
[   3.5469664] dk2 at sd0: "708b1663-c596-4e81-aa15-7b707fc31553", 669376512 blocks at 264192, type: ffs
[   3.5561538] dk3 at sd0: "75a109c0-2882-4103-90a6-d1aac8e155b1", 266999775 blocks at 669640704, type: swap
[   3.5561538] sd0: tagged queueing
[   4.5658900] uhub3 at uhub2 port 1: vendor 1604 (0x1604) product 10c0 (0x10c0), class 9/0, rev 2.00/0.00, addr 2
[   4.5764468] uhub3: single transaction translator
[   5.9958659] uhidev0 at uhub3 port 1 configuration 1 interface 0
[   5.9958659] uhidev0: Avocent (0x0624) Keyboard/Mouse Function (0x0249), rev 2.00/0.00, addr 3, iclass 3/1
[   6.0158654] ukbd0 at uhidev0
[   6.4258587] wskbd0 at ukbd0 mux 1
[   6.4258587] uhidev1 at uhub3 port 1 configuration 1 interface 1
[   6.4258587] uhidev1: Avocent (0x0624) Keyboard/Mouse Function (0x0249), rev 2.00/0.00, addr 3, iclass 3/1
[   6.4458582] ums0 at uhidev1: 3 buttons and Z dir
[   6.4458582] wsmouse0 at ums0 mux 0
[   7.1058471] uhub4 at uhub2 port 4: vendor 1604 (0x1604) product 10c0 (0x10c0), class 9/0, rev 2.00/0.00, addr 4
[   7.1163978] uhub4: single transaction translator
[   7.8658342] findroot: netboot interface not found.
[   7.8758341] findroot: netboot interface not found.
[   7.8758341] boot device: <unknown>
[   7.8858339] root on md0a dumps on md0b
[   7.8858339] root file system type: ffs
[   7.8858339] kern.module.path=/stand/amd64/9.99.84/modules
Created tmpfs /dev (1818624 byte, 3520 inodes)
erase ^?, werase ^W, kill ^U, intr ^C

	Disabling ACPI results in bge0/1 not being configured to to interrupt setup issues.
	Needless to say the Linux from 2017 works flawlessly on the platform.

>How-To-Repeat:
	Attempt to boot an install / cdrom image on a Dell R740. Observe bge0 being inoperable.
>Fix:
	-

>Unformatted:
Prev by Date: port-arm/56264: diagnostic assertion "l->l_stat == LSONPROC" failed on RPI3
Next by Date: PR/56257 CVS commit: [netbsd-9] src/external/bsd/libarchive/dist
Previous by Thread: port-arm/56264: diagnostic assertion "l->l_stat == LSONPROC" failed on RPI3
Next by Thread: PR/56257 CVS commit: [netbsd-9] src/external/bsd/libarchive/dist
Indexes:
Home | Main Index | Thread Index | Old Index