I noticed some sort of mmap problem a while back playing with a G4 digital
audio.

Don't know if this will help you, but try booting into MacOS (9.x), set the
resolution the way you want it there, then restart (not a power cycle) into
netbsd.

There was some suspicious looking "assume it's a PC" code, but my attempts
to debug it failed.