OK, I finally had some more time to try netbooting my 8500.  First, has
*anybody* gotten a x500 series machine to netboot?  Below is the
openfirmware output and below that is the tcpdump analysis.

A brief summary is that bootp works correctly most of the time (maybe once
in ten it fails), it then correctly tftp's the bootloader, then tries to
nfs mount my diskless server, but fails for some reason, then does in fact
try using tftp to get the kernel but doesn't send a file name for the
kernel and that fails.

Yes, my nfs server is set up correctly (I can mount the kernel directory
from another machine), and for this experiment, I even removed
/etc/hosts.deny.

I tried
<ftp://ftp.netbsd.org/pub/NetBSD/arch/macppc/snapshot/20000205/binary/kernel/ofw
boot.xcf>
as well as one privately sent to me by Miles Nordin.  They both behave the
same way.

I'd appreciate any suggestions.  Thanks for the suggestions so far,

  -- MW

0 >
Open Firmware, 1.0.5
To continue booting the MacOS type:
BYE<return>
To continue booting from the default boot device type:
BOOT<return>
 ok
0 > boot enet file: 128.84.235.137,/boot.netbsdloading XCOFF
tsize=CB10 dsize=14D8 bsize=1608 entry=6C0000
SECTIONS:
.text    006C0000 006C0000 0000CB10 000000E0
.data    006CD000 006CD000 000014D8 0000CBF0
.bss     006CE4D8 006CE4D8 00001608 00000000
loading .text, done..
loading .data, done..
clearing .bss, done..

>> NetBSD/macppc OpenFirmware Boot, Revision 1.2
>> (root@majic, Mon Feb 14 04:20:56 PST 2000)
file: 128.84.235.137,
TFTP timeout
TFTP timeout
TFTP timeout

===============================================================
reboot the machine and change the bootloader
===============================================================

Open Firmware, 1.0.5
To continue booting the MacOS type:
BYE<return>
To continue booting from the default boot device type:
BOOT<return>
 ok
0 > boot enet file: 128.84.235.137,/boot.netbsdloading XCOFF
tsize=CB30 dsize=14DC bsize=1608 entry=6C0000
SECTIONS:
.text    006C0000 006C0000 0000CB30 000000E0
.data    006CD000 006CD000 000014DC 0000CC10
.bss     006CE4E0 006CE4E0 00001608 00000000
loading .text, done..
loading .data, done..
clearing .bss, done..

>> NetBSD/macppc OpenFirmware Boot, Revision 1.2
>> (tsubai@moeko, Sun Feb  6 23:24:18 JST 2000)
file: 128.84.235.137,
TFTP timeout
TFTP timeout

===============================================================
Here's the tcpdump output (I excised all of the DNS requests):
===============================================================

01:00:15.535960 0.0.0.0.1234 > 0.0.0.0.bootps: (request) xid:0x6b49 secs:27
[|bootp]
01:00:15.536352 0.0.0.0.1234 > 0.0.0.0.bootps: (request) xid:0x6b49 secs:27
[|bootp]
01:00:15.710672 FATMAC.EE.CORNELL.EDU.bootps >
DARKPLAIN.EE.CORNELL.EDU.bootpc: xid:0x6ae7 secs:27
Y:DARKPLAIN.EE.CORNELL.EDU S:FATMAC.EE.CORNELL.EDU [|bootp]
01:00:15.712448 0.0.0.0.1234 > 0.0.0.0.bootps: (request) xid:0x6bfa secs:27
[|bootp]
01:00:16.020724 FATMAC.EE.CORNELL.EDU.bootps >
DARKPLAIN.EE.CORNELL.EDU.bootpc: xid:0x6b49 secs:27
Y:DARKPLAIN.EE.CORNELL.EDU S:FATMAC.EE.CORNELL.EDU [|bootp]
01:00:16.022520 0.0.0.0.1234 > 0.0.0.0.bootps: (request) xid:0x6d30 secs:27
[|bootp]
01:00:16.293108 FATMAC.EE.CORNELL.EDU.bootps >
DARKPLAIN.EE.CORNELL.EDU.bootpc: xid:0x6b49 secs:27
Y:DARKPLAIN.EE.CORNELL.EDU S:FATMAC.EE.CORNELL.EDU [|bootp]
01:00:16.294904 0.0.0.0.1234 > 0.0.0.0.bootps: (request) xid:0x6e40 secs:28
[|bootp]
01:00:16.564176 FATMAC.EE.CORNELL.EDU.bootps >
DARKPLAIN.EE.CORNELL.EDU.bootpc: xid:0x6bfa secs:27
Y:DARKPLAIN.EE.CORNELL.EDU S:FATMAC.EE.CORNELL.EDU [|bootp]
01:00:16.565980 0.0.0.0.1234 > 0.0.0.0.bootps: (request) xid:0x6f4f secs:28
[|bootp]
01:00:16.836668 FATMAC.EE.CORNELL.EDU.bootps >
DARKPLAIN.EE.CORNELL.EDU.bootpc: xid:0x6d30 secs:27
Y:DARKPLAIN.EE.CORNELL.EDU S:FATMAC.EE.CORNELL.EDU [|bootp]
01:00:16.838452 0.0.0.0.1234 > 0.0.0.0.bootps: (request) xid:0x7060 secs:28
[|bootp]
01:00:16.916476 0.0.0.0.1234 > 0.0.0.0.bootps: (request) xid:0x70ae secs:28
[|bootp]
01:00:17.131548 FATMAC.EE.CORNELL.EDU.bootps >
DARKPLAIN.EE.CORNELL.EDU.bootpc: xid:0x6e40 secs:28
Y:DARKPLAIN.EE.CORNELL.EDU S:FATMAC.EE.CORNELL.EDU [|bootp]
01:00:17.133348 0.0.0.0.1234 > 0.0.0.0.bootps: (request) xid:0x7186 secs:29
[|bootp]
01:00:17.403096 FATMAC.EE.CORNELL.EDU.bootps >
DARKPLAIN.EE.CORNELL.EDU.bootpc: xid:0x6f4f secs:28
Y:DARKPLAIN.EE.CORNELL.EDU S:FATMAC.EE.CORNELL.EDU [|bootp]
01:00:17.674940 FATMAC.EE.CORNELL.EDU.bootps >
DARKPLAIN.EE.CORNELL.EDU.bootpc: xid:0x7060 secs:28
Y:DARKPLAIN.EE.CORNELL.EDU S:FATMAC.EE.CORNELL.EDU [|bootp]
01:00:17.956760 FATMAC.EE.CORNELL.EDU.bootps >
DARKPLAIN.EE.CORNELL.EDU.bootpc: xid:0x70ae secs:28
Y:DARKPLAIN.EE.CORNELL.EDU S:FATMAC.EE.CORNELL.EDU [|bootp]
01:00:18.228060 FATMAC.EE.CORNELL.EDU.bootps >
DARKPLAIN.EE.CORNELL.EDU.bootpc: xid:0x7186 secs:29
Y:DARKPLAIN.EE.CORNELL.EDU S:FATMAC.EE.CORNELL.EDU [|bootp]
01:00:20.544720 0.0.0.0.1234 > 0.0.0.0.bootps: (request) xid:0x7eda secs:32
[|bootp]
01:00:20.706232 0.0.0.0.1234 > 0.0.0.0.bootps: (request) xid:0x7f7b secs:32
[|bootp]
01:00:20.816160 FATMAC.EE.CORNELL.EDU.bootps >
DARKPLAIN.EE.CORNELL.EDU.bootpc: xid:0x7eda secs:32
Y:DARKPLAIN.EE.CORNELL.EDU S:FATMAC.EE.CORNELL.EDU [|bootp]
01:00:20.817964 0.0.0.0.1234 > 0.0.0.0.bootps: (request) xid:0x7feb secs:32
[|bootp]
01:00:21.103792 FATMAC.EE.CORNELL.EDU.bootps >
DARKPLAIN.EE.CORNELL.EDU.bootpc: xid:0x7f7b secs:32
Y:DARKPLAIN.EE.CORNELL.EDU S:FATMAC.EE.CORNELL.EDU [|bootp]
01:00:21.105588 0.0.0.0.1234 > 0.0.0.0.bootps: (request) xid:0x810b secs:33
[|bootp]
01:00:21.375332 FATMAC.EE.CORNELL.EDU.bootps >
DARKPLAIN.EE.CORNELL.EDU.bootpc: xid:0x7feb secs:32
Y:DARKPLAIN.EE.CORNELL.EDU S:FATMAC.EE.CORNELL.EDU [|bootp]
01:00:21.377108 0.0.0.0.1234 > 0.0.0.0.bootps: (request) xid:0x821a secs:33
[|bootp]
01:00:21.647596 FATMAC.EE.CORNELL.EDU.bootps >
DARKPLAIN.EE.CORNELL.EDU.bootpc: xid:0x810b secs:33
Y:DARKPLAIN.EE.CORNELL.EDU S:FATMAC.EE.CORNELL.EDU [|bootp]
01:00:21.649384 0.0.0.0.1234 > 0.0.0.0.bootps: (request) xid:0x832a secs:33
[|bootp]
01:00:21.918592 FATMAC.EE.CORNELL.EDU.bootps >
DARKPLAIN.EE.CORNELL.EDU.bootpc: xid:0x821a secs:33
Y:DARKPLAIN.EE.CORNELL.EDU S:FATMAC.EE.CORNELL.EDU [|bootp]
01:00:21.920372 0.0.0.0.1234 > 0.0.0.0.bootps: (request) xid:0x8439 secs:33
[|bootp]
01:00:22.200268 FATMAC.EE.CORNELL.EDU.bootps >
DARKPLAIN.EE.CORNELL.EDU.bootpc: xid:0x832a secs:33
Y:DARKPLAIN.EE.CORNELL.EDU S:FATMAC.EE.CORNELL.EDU [|bootp]
01:00:22.202056 0.0.0.0.1234 > 0.0.0.0.bootps: (request) xid:0x8553 secs:34
[|bootp]
01:00:22.471340 FATMAC.EE.CORNELL.EDU.bootps >
DARKPLAIN.EE.CORNELL.EDU.bootpc: xid:0x8439 secs:33
Y:DARKPLAIN.EE.CORNELL.EDU S:FATMAC.EE.CORNELL.EDU [|bootp]
01:00:22.473168 0.0.0.0.1234 > 0.0.0.0.bootps: (request) xid:0x8662 secs:34
[|bootp]
01:00:22.743960 FATMAC.EE.CORNELL.EDU.bootps >
DARKPLAIN.EE.CORNELL.EDU.bootpc: xid:0x8553 secs:34
Y:DARKPLAIN.EE.CORNELL.EDU S:FATMAC.EE.CORNELL.EDU [|bootp]
01:00:22.745740 0.0.0.0.1234 > 0.0.0.0.bootps: (request) xid:0x8773 secs:34
[|bootp]
01:00:23.020700 FATMAC.EE.CORNELL.EDU.bootps >
DARKPLAIN.EE.CORNELL.EDU.bootpc: xid:0x8662 secs:34
Y:DARKPLAIN.EE.CORNELL.EDU S:FATMAC.EE.CORNELL.EDU [|bootp]
01:00:23.291748 FATMAC.EE.CORNELL.EDU.bootps >
DARKPLAIN.EE.CORNELL.EDU.bootpc: xid:0x8773 secs:34
Y:DARKPLAIN.EE.CORNELL.EDU S:FATMAC.EE.CORNELL.EDU [|bootp]
01:00:25.381956 0.0.0.0.1234 > 0.0.0.0.bootps: (request) xid:0x91bf secs:37
[|bootp]
01:00:25.652628 FATMAC.EE.CORNELL.EDU.bootps >
DARKPLAIN.EE.CORNELL.EDU.bootpc: xid:0x91bf secs:37
Y:DARKPLAIN.EE.CORNELL.EDU S:FATMAC.EE.CORNELL.EDU [|bootp]
01:00:25.654676 DARKPLAIN.EE.CORNELL.EDU.4105 > FATMAC.EE.CORNELL.EDU.tftp:
22 RRQ "/boot.netbsd"
01:00:25.856644 FATMAC.EE.CORNELL.EDU.59126 >
DARKPLAIN.EE.CORNELL.EDU.4105: udp 516
01:00:25.858144 DARKPLAIN.EE.CORNELL.EDU.4105 >
FATMAC.EE.CORNELL.EDU.59126: udp 4
01:00:25.858952 FATMAC.EE.CORNELL.EDU.59126 >
DARKPLAIN.EE.CORNELL.EDU.4105: udp 516
01:00:25.860348 DARKPLAIN.EE.CORNELL.EDU.4105 >
FATMAC.EE.CORNELL.EDU.59126: udp 4
01:00:25.861064 FATMAC.EE.CORNELL.EDU.59126 >
DARKPLAIN.EE.CORNELL.EDU.4105: udp 516
01:00:25.862448 DARKPLAIN.EE.CORNELL.EDU.4105 >
FATMAC.EE.CORNELL.EDU.59126: udp 4
01:00:25.863164 FATMAC.EE.CORNELL.EDU.59126 >
DARKPLAIN.EE.CORNELL.EDU.4105: udp 516
01:00:25.864548 DARKPLAIN.EE.CORNELL.EDU.4105 >
FATMAC.EE.CORNELL.EDU.59126: udp 4
01:00:25.865260 FATMAC.EE.CORNELL.EDU.59126 >
DARKPLAIN.EE.CORNELL.EDU.4105: udp 516
01:00:25.866644 DARKPLAIN.EE.CORNELL.EDU.4105 >
FATMAC.EE.CORNELL.EDU.59126: udp 4
01:00:25.867352 FATMAC.EE.CORNELL.EDU.59126 >
DARKPLAIN.EE.CORNELL.EDU.4105: udp 516
01:00:25.868736 DARKPLAIN.EE.CORNELL.EDU.4105 >
FATMAC.EE.CORNELL.EDU.59126: udp 4
01:00:25.869444 FATMAC.EE.CORNELL.EDU.59126 >
DARKPLAIN.EE.CORNELL.EDU.4105: udp 516
01:00:25.870852 DARKPLAIN.EE.CORNELL.EDU.4105 >
FATMAC.EE.CORNELL.EDU.59126: udp 4
01:00:25.871560 FATMAC.EE.CORNELL.EDU.59126 >
DARKPLAIN.EE.CORNELL.EDU.4105: udp 516
01:00:25.872944 DARKPLAIN.EE.CORNELL.EDU.4105 >
FATMAC.EE.CORNELL.EDU.59126: udp 4
01:00:25.873652 FATMAC.EE.CORNELL.EDU.59126 >
DARKPLAIN.EE.CORNELL.EDU.4105: udp 516
01:00:25.875044 DARKPLAIN.EE.CORNELL.EDU.4105 >
FATMAC.EE.CORNELL.EDU.59126: udp 4
01:00:25.875756 FATMAC.EE.CORNELL.EDU.59126 >
DARKPLAIN.EE.CORNELL.EDU.4105: udp 516
01:00:25.877144 DARKPLAIN.EE.CORNELL.EDU.4105 >
FATMAC.EE.CORNELL.EDU.59126: udp 4
01:00:25.877848 FATMAC.EE.CORNELL.EDU.59126 >
DARKPLAIN.EE.CORNELL.EDU.4105: udp 516

===============================================================
repeats another ~100 times
===============================================================

01:00:26.216184 DARKPLAIN.EE.CORNELL.EDU.4105 >
FATMAC.EE.CORNELL.EDU.59126: udp 4
01:00:26.216924 FATMAC.EE.CORNELL.EDU.59126 >
DARKPLAIN.EE.CORNELL.EDU.4105: udp 240
01:00:26.217880 DARKPLAIN.EE.CORNELL.EDU.4105 >
FATMAC.EE.CORNELL.EDU.59126: udp 4
01:00:26.222980 DARKPLAIN.EE.CORNELL.EDU.4105 >
FATMAC.EE.CORNELL.EDU.59126: udp 4
01:00:26.223260 FATMAC.EE.CORNELL.EDU > DARKPLAIN.EE.CORNELL.EDU: icmp:
FATMAC.EE.CORNELL.EDU udp port 59126 unreachable
01:00:26.240716 DARKPLAIN.EE.CORNELL.EDU.4105 > FATMAC.EE.CORNELL.EDU.tftp:
10 RRQ ""
01:00:26.438924 FATMAC.EE.CORNELL.EDU.59120 >
DARKPLAIN.EE.CORNELL.EDU.4105: udp 19
01:00:31.241640 DARKPLAIN.EE.CORNELL.EDU.4106 > FATMAC.EE.CORNELL.EDU.tftp:
10 RRQ ""
01:00:31.460736 FATMAC.EE.CORNELL.EDU.59105 >
DARKPLAIN.EE.CORNELL.EDU.4106: udp 19
01:00:36.242744 DARKPLAIN.EE.CORNELL.EDU.4107 > FATMAC.EE.CORNELL.EDU.tftp:
10 RRQ ""