port-mips/57280: Octeon boot fails (kernel: bus error (load or store) trap)

[denis%ovsienko.info@localhost]

>Number:         57280
>Category:       port-mips
>Synopsis:       Octeon boot fails (kernel: bus error (load or store) trap)
>Confidential:   no
>Severity:       critical
>Priority:       medium
>Responsible:    port-mips-maintainer
>State:          open
>Class:          sw-bug
>Submitter-Id:   net
>Arrival-Date:   Tue Mar 21 18:40:00 +0000 2023
>Originator:     Denis Ovsienko
>Release:        NetBSD 10 beta
>Organization:
>Environment:
EdgeRouter 4
>Description:
reading netbsd
7481080 bytes read in 217 ms (32.9 MiB/s)
reading netbsd.md5
** Unable to read file netbsd.md5 **
Allocating memory for ELF segment: addr: 0xffffffff80200000 (adjusted to: 0x200000), size 0x63b980
## Loading big-endian Linux kernel with entry point: 0xffffffff80200000 ...
Bootloader: Done loading app on coremask:
 0xf
Starting cores:
 0xf
[   1.0000000] MIPS32/64 params: cpu arch: 256
[   1.0000000] MIPS32/64 params: TLB entries: 256
[   1.0000000] MIPS32/64 params: Icache: line=128, total=79872, ways=39, sets=16, colors=0
[   1.0000000] MIPS32/64 params: Dcache: line=128, total=32768, ways=32, sets=8, colors=0
[   1.0000000] MIPS32/64 params: SDcache: line=128, total=1048576, ways=8, sets=1024, colors=16
[   1.0000000]   Dcache is coherent
[   1.0000000] u-boot bootmem desc @ 0x6c108 version 3.0
[   1.0000000] phys segment: 0x100000 @ 0x100000
[   1.0000000] adding 0x100000 @ 0x100000 to freelist 0
[   1.0000000] phys segment: 0xf574000 @ 0x83c000
[   1.0000000] adding 0xf574000 @ 0x83c000 to freelist 0
[   1.0000000] phys segment: 0xe000 @ 0xfdb4000
[   1.0000000] adding 0xe000 @ 0xfdb4000 to freelist 0
[   1.0000000] phys segment: 0x2f0 @ 0xffb6000 (short)
[   1.0000000] phys segment: 0x80 @ 0xffd6000 (short)
[   1.0000000] phys segment: 0x60 @ 0xfff6000 (short)
[   1.0000000] phys segment: 0x2effe000 @ 0x20000000
[   1.0000000] adding 0x2effe000 @ 0x20000000 to freelist 0
[   1.0000000] phys segment: 0x1080 @ 0x4f000000 (short)
[   1.0000000] Copyright (c) 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003,
[   1.0000000]     2004, 2005, 2006, 2007, 2008, 2009, 2010, 2011, 2012, 2013,
[   1.0000000]     2014, 2015, 2016, 2017, 2018, 2019, 2020, 2021, 2022, 2023
[   1.0000000]     The NetBSD Foundation, Inc.  All rights reserved.
[   1.0000000] Copyright (c) 1982, 1986, 1989, 1991, 1993
[   1.0000000]     The Regents of the University of California.  All rights reserved.

[   1.0000000] NetBSD 10.0_BETA (OCTEON) #0: Mon Mar 20 17:25:14 UTC 2023
[   1.0000000]  mkrepro%mkrepro.NetBSD.org@localhost:/usr/src/sys/arch/evbmips/compile/OCTEON
[   1.0000000] Cavium Octeon CN7130-1000
[   1.0000000] total memory = 1024 MB
[   1.0000000] avail memory = 982 MB
[   1.0000000] mainbus0 (root)
[   1.0000000] cpunode0 at mainbus0: 4 cores, crypto+kasumi, 64bit-mul, unaligned-access ok
[   1.0000000] cpu0 at cpunode0 core 0: 1000.00MHz
[   1.0000000] cpu0: Cavium CN7130-1000 (0xd9602) Rev. 2 with built-in FPU
[   1.0000000] cpu0: 256 TLB entries, 512TB (49-bit) VAs, 512TB (49-bit) PAs, 256MB max page size
[   1.0000000] cpu0: 78KB/128B 39-way set-associative L1 instruction cache
[   1.0000000] cpu0: 32KB/128B 32-way set-associative write-through coherent L1 data cache
[   1.0000000] cpu0: 1024KB/128B 8-way set-associative write-back L2 unified cache
[   1.0000000] cpu1 at cpunode0 core 1: disabled (uniprocessor kernel)
[   1.0000000] cpu2 at cpunode0 core 2: disabled (uniprocessor kernel)
[   1.0000000] cpu3 at cpunode0 core 3: disabled (uniprocessor kernel)
[   1.0000000] wdog0 at cpunode0: default period is 4 seconds
[   1.0000000] iobus0 at mainbus0
[   1.0000000] iobus0: initializing POW
[   1.0000000] iobus0: initializing FPA
[   1.0000000] octrnm0 at iobus0 address 0x0001180040000000
[   1.0000000] pid 0(system): trap: cpu0, bus error (load or store) in kernel mode
[   1.0000000] status=0xa3, cause=0x1c, epc=0xffffffff80210568, vaddr=0xc0000000001fe000
[   1.0000000] tf=0x980000000fdb7870 ksp=0x980000000fdb79b0 ra=0xffffffff80210540 ppl=0x98000000
[   1.0000000] kernel: bus error (load or store) trap
Stopped in pid 0.0 (system) at  netbsd:octrnm_attach+0xf8:      ld      a2,0(v0)

db> trace
0x980000000fdb79b0: octrnm_attach+0xf8 (0xffffffff808102c8,0x9001180040000000,0,
0xfffffeb2a7fa0000) ra 0xffffffff804b908c sz 32
0x980000000fdb79d0: config_attach_internal+0x1d4 (0xffffffff808102c8,0x900118004
0000000,0,0xfffffeb2a7fa0000) ra 0xffffffff804b933c sz 80
0x980000000fdb7a20: config_found+0x144 (0xffffffff808102c8,0x9001180040000000,0,
0xfffffeb2a7fa0000) ra 0xffffffff8020d148 sz 112
0x980000000fdb7a90: iobus_attach+0x198 (0xffffffff808102c8,0x9001180040000000,0,
0xfffffeb2a7fa0000) ra 0xffffffff804b908c sz 192
0x980000000fdb7b50: config_attach_internal+0x1d4 (0xffffffff808102c8,0x900118004
0000000,0,0xfffffeb2a7fa0000) ra 0xffffffff804b933c sz 80
0x980000000fdb7ba0: config_found+0x144 (0xffffffff808102c8,0x9001180040000000,0,
0xfffffeb2a7fa0000) ra 0xffffffff80206668 sz 112
0x980000000fdb7c10: mainbus_attach+0x120 (0xffffffff808102c8,0x9001180040000000,
0,0xfffffeb2a7fa0000) ra 0xffffffff804b908c sz 336
0x980000000fdb7d60: config_attach_internal+0x1d4 (0xffffffff808102c8,0x900118004
0000000,0,0xfffffeb2a7fa0000) ra 0xffffffff804b952c sz 80
0x980000000fdb7db0: config_rootfound+0x54 (0xffffffff808102c8,0,0,0xfffffeb2a7fa
0000) ra 0xffffffff802004b8 sz 80
0x980000000fdb7e00: cpu_configure+0x28 (0xffffffff808102c8,0,0,0xfffffeb2a7fa000
0) ra 0xffffffff80617428 sz 16
0x980000000fdb7e10: main+0x3f8 (0xffffffff808102c8,0,0,0xfffffeb2a7fa0000) ra 0x
ffffffff802000d4 sz 144
0x980000000fdb7ea0: kernel_text+0xd4 (0xffffffff808102c8,0,0,0xfffffeb2a7fa0000)
 ra 0 sz 0
User-level: pid 0.0
db> 

>How-To-Repeat:
1. Write https://nycdn.netbsd.org/pub/NetBSD-daily/netbsd-10/202303210730Z/evbmips-mips64eb/binary/gzimg/octeon.img.gz to USB storage.
2. Boot EdgeRouter 4 from the USB storage, FAT partition 1, file "netbsd".
3. Observe the crash very soon.

Serial console access can be provided if necessary.
>Fix: