Subject: Weird net behaviour with Netra t1 105 and 20010821 snapshot
To: None <port-sparc64@NetBSD.org>
From: Maxime Henrion <mux@qualys.com>
List: port-sparc64
Date: 09/24/2001 17:40:54
	Hello,


I just installed NetBSD/sparc64 on my Netra t1 105 and it exhibits a
very strange behaviour when trying to use the network which works
perfectly under Solaris 8.

My PC box (under FreeBSD) is 10.0.0.1 and the Sun one is 10.0.0.2.  Both
machines can't ping the other one.  If I sniff on the FreeBSD box when
trying to ping it from the Sun one :

17:25:48.673790 arp who-has 10.0.0.1 tell 10.0.0.2
17:25:48.673836 arp reply 10.0.0.1 is-at 0:50:4:e8:89:e3
17:25:49.680673 arp who-has 10.0.0.1 tell 10.0.0.2
17:25:49.680714 arp reply 10.0.0.1 is-at 0:50:4:e8:89:e3
17:25:50.680701 arp who-has 10.0.0.1 tell 10.0.0.2
17:25:50.680741 arp reply 10.0.0.1 is-at 0:50:4:e8:89:e3
17:25:51.680755 arp who-has 10.0.0.1 tell 10.0.0.2
17:25:51.680792 arp reply 10.0.0.1 is-at 0:50:4:e8:89:e3
17:25:52.680778 arp who-has 10.0.0.1 tell 10.0.0.2
17:25:52.680817 arp reply 10.0.0.1 is-at 0:50:4:e8:89:e3

The Sun box apparently never gets the arp reply since :

netra# arp -a
? (10.0.0.1) at (incomplete) on hme0

Ok, now it's starting to be scary :-)
On the FreeBSD box, if I try to ping the Sun one :

17:30:50.835752 arp who-has 10.0.0.2 tell 10.0.0.1
17:30:50.836006 arp reply 10.0.0.2 is-at 8:0:20:f9:8c:7a
17:30:50.836044 10.0.0.1 > 10.0.0.2: icmp: echo request
17:30:51.845828 10.0.0.1 > 10.0.0.2: icmp: echo request

It got the arp reply from the Sun box but it never gets anything else.

Now the worse part :

After several minutes of thinking, I'm trying again to ping the FreeBSD
box from the Sun one and it doesn't give me a host is down error
message, it's sending the pings but doesn't receive anything.  So I look
at the arp cache :

netra# arp -a
? (10.0.0.1) at 00:50:04:e8:89:e3 on hme0

I don't know how, but now it got the arp reply from the FreeBSD box.  A
look at the sniffer shows that I now receive the ping requests from the
Sun box and answers to them but as I already said, the Sun box doesn't
get anything back.

17:33:16.637694 10.0.0.2 > 10.0.0.1: icmp: echo request
17:33:16.637768 10.0.0.1 > 10.0.0.2: icmp: echo reply
17:33:17.637732 10.0.0.2 > 10.0.0.1: icmp: echo request
17:33:17.637807 10.0.0.1 > 10.0.0.2: icmp: echo reply

I'm quite confused and don't know at all what could be the problem since
I can ping any machine with Solaris 8.  Any help would be greatly
appreciated !

Thanks,
Maxime Henrion

Description of the machine :

Netra t1 (UltraSPARC-IIi 440MHz), No Keyboard
OpenBoot 3.10.25 ME, 1024 MB memory installed, Serial #16354426.
Ethernet address 8:0:20:f9:8c:7a, Host ID: 80f98c7a.

dmesg :

Copyright (c) 1996, 1997, 1998, 1999, 2000, 2001
    The NetBSD Foundation, Inc.  All rights reserved.
Copyright (c) 1982, 1986, 1989, 1991, 1993
    The Regents of the University of California.  All rights reserved.

NetBSD 1.5X (GENERIC) #1: Wed Aug 22 22:58:29 EST 2001
    mrg@powerofseven.eterna.com.au:/orb/a/obj.sparc64/usr/src/sys/arch/sparc64/compile/GENERIC
total memory = 1024 MB
avail memory = 937 MB
using 6566 buffers containing 52528 KB of memory
bootpath: /pci@1f,0/pci@1,1/scsi@2,0/disk@0,0
mainbus0 (root): SUNW,UltraSPARC-IIi-cEngine
cpu0 at mainbus0: SUNW,UltraSPARC-IIi @ 440.023 MHz, version 0 FPU
cpu0: physical 4K instruction (32 b/l), 4K data (32 b/l), 2048K external (64 b/l)
psycho0 at mainbus0 addr 0xfffc0000
SUNW,sabre: impl 0, version 0: ign 7c0 bus range 0 to 3; PCI bus 0
intr_establish: intr reused 7c0
DVMA map: c0000000 to e0000000
pci0 at psycho0
pci0: i/o space, memory space enabled
ppb0 at pci0 dev 1 function 1: Sun Microsystems Simba PCI bridge (rev. 0x13)
pci1 at ppb0 bus 1
pci1: i/o space, memory space enabled
ebus0 at pci1 dev 1 function 0
ebus0: Sun Microsystems PCIO Ebus2, revision 0x01
auxio0 at ebus0 addr 726000-726003, 728000-728003, 72a000-72a003, 72c000-72c003, 72f000-72f003
power at ebus0 addr 724000-724003 ipl 37 not configured
SUNW,pll at ebus0 addr 504000-504002 not configured
com0 at ebus0 addr 3803f8-3803ff ipl 28: ns16550a, working fifo
com0: console
com1 at ebus0 addr 3602f8-3602ff ipl 20: ns16550a, working fifo
lpt0 at ebus0 addr 340278-340287, 30015c-30015d, 700000-70000f ipl 34
fdthree at ebus0 addr 3203f0-3203f7, 706000-70600f, 720000-720003 ipl 39 not configured
clock0 at ebus0 addr 0-1fff: mk48t59: hostid 80f98c7a
flashprom at ebus0 addr 0-fffff not configured
watchdog at ebus0 addr 200000-20003f ipl 4 not configured
display7seg at ebus0 addr 200040-200040 not configured
beeper at ebus0 addr 722000-722003 not configured
flashprom at ebus0 addr 400000-5fffff not configured
flashprom at ebus0 addr 800000-9fffff not configured
i2c at ebus0 addr 600000-600003 ipl 40 not configured
i2c at ebus0 addr 100000-100003 ipl 27 not configured
SUNW,lom at ebus0 addr 400000-400063 not configured
hme0 at pci1 dev 1 function 1: address 08:00:20:f9:8c:7a
ukphy0 at hme0 phy 0: Generic IEEE 802.3u media interface
ukphy0: OUI 0x0006b8, model 0x000c, rev. 1
ukphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
ukphy1 at hme0 phy 1: Generic IEEE 802.3u media interface
ukphy1: OUI 0x0006b8, model 0x000c, rev. 1
ukphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
OF_mapintr failed
hme0: using ivec 3021 for interrupt
siop0 at pci1 dev 2 function 0: Symbios Logic 53c875 (ultra-wide scsi)
siop0: using on-board RAM
OF_mapintr failed
siop0: interrupting at ivec 20
scsibus0 at siop0: 16 targets, 8 luns per target
pci_conf_read: bogus pcitag 11800
ppb1 at pci0 dev 1 function 0: Sun Microsystems Simba PCI bridge (rev. 0x13)
pci2 at ppb1 bus 2
pci2: i/o space, memory space enabled
ppb2 at pci2 dev 1 function 0: Digital Equipment DECchip 21150 PCI-PCI Bridge (rev. 0x06)
pci3 at ppb2 bus 3
pci3: i/o space, memory space enabled
pciide0 at pci3 dev 14 function 0: CMD Technology PCI0646 (rev. 0x03)
pciide0: bus-master DMA support present
pciide0: primary channel configured to native-PCI mode
OF_mapintr failed
intr_establish: intr reused 7c0
pciide0: using ivec 1800 for native-PCI interrupt
pciide0: secondary channel configured to native-PCI mode
atapibus0 at pciide0 channel 1: 2 targets
cd0 at atapibus0 drive 0: <TOSHIBA CD-ROM XM-7002Bc, , 1110> type 5 cdrom removable
cd0: drive supports PIO mode 4, DMA mode 2, Ultra-DMA mode 2 (Ultra/33)
cd0(pciide0:1:0): using PIO mode 4, DMA mode 2 (using DMA data transfers)
pcons at mainbus0 not configured
No counter-timer -- using %tick at 440MHz as system clock.
Using %tick -- intr in 4400237 cycles...done.
scsibus0: waiting 2 seconds for devices to settle...
siop0: alloc newcdb at PHY addr 0xc00cc000
sd0 at scsibus0 target 0 lun 0: <FUJITSU, MAJ3182M SUN18G, 0804> SCSI2 0/direct fixed
sd0: 17274 MB, 7508 cyl, 19 head, 248 sec, 512 bytes/sect x 35378533 sectors
sd0: sync (50.0ns offset 16), 16-bit (40.000MB/s) transfers, tagged queueing
sd1 at scsibus0 target 1 lun 0: <FUJITSU, MAJ3182M SUN18G, 0804> SCSI2 0/direct fixed
sd1: 17274 MB, 7508 cyl, 19 head, 248 sec, 512 bytes/sect x 35378533 sectors
sd1: sync (50.0ns offset 16), 16-bit (40.000MB/s) transfers, tagged queueing
raidattach: Asked for 4 units
Kernelized RAIDframe activated
root device: sd0a
dump device (default sd0b):
file system (default generic):
root on sd0a dumps on sd0b
mountroot: trying msdos...
mountroot: trying cd9660...
mountroot: trying lfs...
mountroot: trying nfs...
mountroot: trying ffs...
root file system type: ffs
init: copying out path `/sbin/init' 11