Re: ffsv2 corruption on netbsd 9.0_STABLE amd64

[Paul Ripke <stix%stix.id.au@localhost>]

On Mon, Aug 10, 2020 at 08:58:25AM +1000, Paul Ripke wrote:
> On Mon, Aug 19, 2019 at 11:26:19AM +1000, Paul Ripke wrote:
> > Ok, so not quite -current, but I haven't seen one of these since
> > switching from ipf to npf... in my daily cron email, I was greeted
> > with signs of corruption:
> > 
> > ksh$ ls -l /home/netbsd/current/obj.evbarm/home/netbsd/current/src/sys/modules/wsbell
> > ls: wsbell.kmod.map: No such file or directory
> > ls: wsbell_tramp.S: Bad file descriptor
> > 
> > Maybe I should start running with a debug kernel to track this down.
> > 
> > Maybe I should also resurrect some fsdb patches to better dump out these
> > inodes.
> > 
> > Any other ideas? 186 days uptime, raid0 looks good, no other signs of
> > corruption.
> 
> Time passes, and now on NetBSD-9.0:
> 
> NetBSD slave 9.0_STABLE NetBSD 9.0_STABLE (SLAVE) #2: Thu Jul 23 10:33:30 AEST 2020  stix@slave:/home/netbsd/netbsd-9/obj.amd64/home/netbsd/netbsd-9/src/sys/arch/amd64/compile/SLAVE amd64
> 
> find: /home/netbsd/current/obj.amd64/home/netbsd/current/src/sys/rump/fs/lib/libext2fs/ext2fs_balloc.po: No such file or directory
> find: /home/netbsd/current/obj.amd64/home/netbsd/current/src/sys/rump/fs/lib/libext2fs/ext2fs_vnops.pico: Bad file descriptor
> 
> Directory hasn't been modified since ~May, so the only updates are
> likely to be atime touches by backups, /etc/security, etc.

From an fsdb with extra debugging, the corrupt inodes are:

fsdb (inum: 2)> inode 47491584
command `inode 47491584
'
inode 47491584 filesystem offset 195720176
current inode 47491584: unallocated inode
current inode: unallocated
I=47491584 MODE=20 SIZE=109062957568
        MTIME=Jun  2 17:06:40 1970 [33620224 nsec, 0000000000c8c800 raw]
        CTIME=May 27 13:24:48      [839516160 nsec, 00c8c8002e070000 raw]
        ATIME=            neg      [294 nsec, 3305000000000000 raw]
OWNUID=13158400 GRP=wheel LINKCNT=12033 FLAGS=0xfd6400 BLKCNT=0x2c64640032040000 GEN=0x0
fsdb (inum: 47491584)> inode 47491585
command `inode 47491585
'
inode 47491585 filesystem offset 195720176
current inode 47491585: unallocated inode
current inode: unallocated
I=47491585 MODE=0 SIZE=0
        MTIME=Jan  1 10:00:00 1970 [0 nsec, 0000000000000000 raw]
        CTIME=Jan  1 10:00:00 1970 [0 nsec, 0000000000000000 raw]
        ATIME=Jan  1 10:00:00 1970 [0 nsec, 0000000000000000 raw]
OWNER=root GRP=wheel LINKCNT=0 FLAGS=0x0 BLKCNT=0x0 GEN=0x0

-- 
Paul Ripke
"Great minds discuss ideas, average minds discuss events, small minds
 discuss people."
-- Disputed: Often attributed to Eleanor Roosevelt. 1948.