arm64 boot hangs on Oracle Cloud Ampere (VM.Standard.A1.Flex)

To: port-arm%netbsd.org@localhost
Subject: arm64 boot hangs on Oracle Cloud Ampere (VM.Standard.A1.Flex)
From: Štěpán Němec <stepnem%smrk.net@localhost>
Date: Wed, 16 Nov 2022 23:55:25 +0100

  Hello,

encouraged by the recent post[1] I'm trying to get NetBSD running on a
(free) OCI VM. Unable to import a custom image (not possible on the Free
Tier), I tried a method that I've had some success with on amd64 VMs,
i.e., overwrite the root partition on a stock VM (Ubuntu Minimal
aarch64) and booting that, with a serial console connection, i.e.
(pseudoshell in the stock VM):

cd $ramdisk_with_enough_space
wget $image_url_below
gunzip ...
dd if=arm64.img of=/dev/sda ...

[then reboot the VM]

Unfortunately, the boot gets stuck after a few seconds (serial console
output attached), the console doesn't seem to react to any keyboard
input at that point, either.

That's with

https://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/202211160510Z/evbarm-aarch64/binary/gzimg/arm64.img.gz

Previously I also tried the same with

http://nycdn.netbsd.org/pub/NetBSD-daily/netbsd-9/202211120320Z/evbarm-aarch64/binary/gzimg/arm64.img.gz

which IIRC got a bit further, but didn't complete the boot sequence,
either; OTOH, unlike with the HEAD image, it was still possible at that
point to start ddb or reboot (i.e., the console continued to respond to
keyboard input).

Comparing with Jared's dmesg[2] I'm wondering whether I'm just missing
something obvious, or what would be necessary to get this simple
"installation" method to work.

I'd appreciate any advice.

  Štěpán

[1] https://blog.netbsd.org/tnf/entry/netbsd_arm_on_oracle_cloud
[2] https://dmesgd.nycbug.org/index.cgi?do=view&id=6731

  \\-__,------,___.
   \\        __,---`  NetBSD/evbarm efiboot (arm64)
    \\       `---,_.  Revision 2.13 (Tue Nov 15 22:17:53 UTC 2022)
     \\-,_____,.---`
      \\
       \\
        \\

Press return to boot now, any other key for boot prompt
booting netbsd - starting in 0 seconds.
> boot
8495856+3654728+4170336+1742928 [585452+1178328+705764]=0x15ff470
GOP: PixelBltOnly pixel format not supported
GOP: PixelBltOnly pixel format not supported
[   1.0000000] Copyright (c) 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005,
[   1.0000000]     2006, 2007, 2008, 2009, 2010, 2011, 2012, 2013, 2014, 2015, 2016, 2017,
[   1.0000000]     2018, 2019, 2020, 2021, 2022
[   1.0000000]     The NetBSD Foundation, Inc.  All rights reserved.
[   1.0000000] Copyright (c) 1982, 1986, 1989, 1991, 1993
[   1.0000000]     The Regents of the University of California.  All rights reserved.

[   1.0000000] NetBSD 9.99.106 (GENERIC64) #0: Tue Nov 15 22:17:53 UTC 2022
[   1.0000000]  mkrepro%mkrepro.NetBSD.org@localhost:/usr/src/sys/arch/evbarm/compile/GENERIC64
[   1.0000000] total memory = 6117 MB
[   1.0000000] avail memory = 5897 MB
[   1.0000000] armfdt0 (root)
[   1.0000000] armfdt0: using EFI runtime services for RTC
[   1.0000000] simplebus0 at armfdt0: QEMU KVM Virtual Machine
[   1.0000000] simplebus1 at simplebus0
[   1.0000000] acpifdt0 at simplebus0
[   1.0000000] acpifdt0: SMBIOS rev. 3.0.0 @ 0x1bbec0000
[   1.0000000] ACPI: RSDP 0x00000001B85C0018 000024 (v02 BOCHS )
[   1.0000000] ACPI: XSDT 0x00000001B85CFE98 00005C (v01 BOCHS  BXPCFACP 00000001      01000013)
[   1.0000000] ACPI: FACP 0x00000001B85CFA98 00010C (v05 BOCHS  BXPCFACP 00000001 BXPC 00000001)
[   1.0000000] ACPI: DSDT 0x00000001B85C7518 001560 (v02 BOCHS  BXPCDSDT 00000001 BXPC 00000001)
[   1.0000000] ACPI: APIC 0x00000001B85CFC18 0000B4 (v03 BOCHS  BXPCAPIC 00000001 BXPC 00000001)
[   1.0000000] ACPI: GTDT 0x00000001B85CFD18 000060 (v02 BOCHS  BXPCGTDT 00000001 BXPC 00000001)
[   1.0000000] ACPI: MCFG 0x00000001B85CFE18 00003C (v01 BOCHS  BXPCMCFG 00000001 BXPC 00000001)
[   1.0000000] ACPI: SPCR 0x00000001B85CFF98 000050 (v02 BOCHS  BXPCSPCR 00000001 BXPC 00000001)
[   1.0000000] ACPI: IORT 0x00000001B85CD898 00007C (v00 BOCHS  BXPCIORT 00000001 BXPC 00000001)
[   1.0000000] ACPI: BGRT 0x00000001B85CE818 000038 (v01 INTEL  EDK2     00000002      01000013)
[   1.0000000] ACPI: 1 ACPI AML tables successfully acquired and loaded
[   1.0000000] acpi0 at acpifdt0: Intel ACPICA 20220331
[   1.0000000] cpu0 at acpi0: Arm Neoverse N1 r3p1 (v8.2-A+), id 0x0
[   1.0000000] cpu0: package 0, core 0, smt 0
[   1.0000000] gicvthree0 at acpi0: GICv3
[   1.0000000] gicvthree0: ITS #0 at 0x8080000
[   1.0000000] gicvthree0: ITS [#0] Devices table @ 0x4cff0000/0x80000, Cacheable WA WB, Inner shareable
[   1.0000000] gicvthree0: ITS [#1] Collections table @ 0x4d070000/0x10000, Cacheable WA WB, Inner shareable
[   1.0000000] gtmr0 at acpi0: irq 27
[   1.0000000] armgtmr0 at gtmr0: Generic Timer (25000 kHz, virtual)
[   1.0000040] C000 (ACPI0007) at acpi0 not configured
[   1.0000040] plcom0 at acpi0 (COM0, ARMH0011-0): mem 0x9000000-0x9000fff irq 33
[   1.0000040] plcom0: console
[   1.0000040] FLS0 (LNRO0015) at acpi0 not configured
[   1.0000040] FLS1 (LNRO0015) at acpi0 not configured
[   1.0000040] qemufwcfg0 at acpi0 (FWCF, QEMU0002): mem 0x9020000-0x9020017
[   1.0000040] virtio0 at acpi0 (VR00, LNRO0005-0): mem 0xa000000-0xa0001ff irq 48
[   1.0000040] virtio1 at acpi0 (VR01, LNRO0005-1): mem 0xa000200-0xa0003ff irq 49
[   1.0000040] virtio2 at acpi0 (VR02, LNRO0005-2): mem 0xa000400-0xa0005ff irq 50
[   1.0000040] virtio3 at acpi0 (VR03, LNRO0005-3): mem 0xa000600-0xa0007ff irq 51
[   1.0000040] virtio4 at acpi0 (VR04, LNRO0005-4): mem 0xa000800-0xa0009ff irq 52
[   1.0000040] virtio5 at acpi0 (VR05, LNRO0005-5): mem 0xa000a00-0xa000bff irq 53
[   1.0000040] virtio6 at acpi0 (VR06, LNRO0005-6): mem 0xa000c00-0xa000dff irq 54
[   1.0000040] virtio7 at acpi0 (VR07, LNRO0005-7): mem 0xa000e00-0xa000fff irq 55
[   1.0000040] virtio8 at acpi0 (VR08, LNRO0005-8): mem 0xa001000-0xa0011ff irq 56
[   1.0000040] virtio9 at acpi0 (VR09, LNRO0005-9): mem 0xa001200-0xa0013ff irq 57
[   1.0000040] virtio10 at acpi0 (VR10, LNRO0005-10): mem 0xa001400-0xa0015ff irq 58
[   1.0000040] virtio11 at acpi0 (VR11, LNRO0005-11): mem 0xa001600-0xa0017ff irq 59
[   1.0000040] virtio12 at acpi0 (VR12, LNRO0005-12): mem 0xa001800-0xa0019ff irq 60
[   1.0000040] virtio13 at acpi0 (VR13, LNRO0005-13): mem 0xa001a00-0xa001bff irq 61
[   1.0000040] virtio14 at acpi0 (VR14, LNRO0005-14): mem 0xa001c00-0xa001dff irq 62
[   1.0000040] virtio15 at acpi0 (VR15, LNRO0005-15): mem 0xa001e00-0xa001fff irq 63
[   1.0000040] virtio16 at acpi0 (VR16, LNRO0005-16): mem 0xa002000-0xa0021ff irq 64
[   1.0000040] virtio17 at acpi0 (VR17, LNRO0005-17): mem 0xa002200-0xa0023ff irq 65
[   1.0000040] virtio18 at acpi0 (VR18, LNRO0005-18): mem 0xa002400-0xa0025ff irq 66
[   1.0000040] virtio19 at acpi0 (VR19, LNRO0005-19): mem 0xa002600-0xa0027ff irq 67
[   1.0000040] virtio20 at acpi0 (VR20, LNRO0005-20): mem 0xa002800-0xa0029ff irq 68
[   1.0000040] virtio21 at acpi0 (VR21, LNRO0005-21): mem 0xa002a00-0xa002bff irq 69
[   1.0000040] virtio22 at acpi0 (VR22, LNRO0005-22): mem 0xa002c00-0xa002dff irq 70
[   1.0000040] virtio23 at acpi0 (VR23, LNRO0005-23): mem 0xa002e00-0xa002fff irq 71
[   1.0000040] virtio24 at acpi0 (VR24, LNRO0005-24): mem 0xa003000-0xa0031ff irq 72
[   1.0000040] virtio25 at acpi0 (VR25, LNRO0005-25): mem 0xa003200-0xa0033ff irq 73
[   1.0000040] virtio26 at acpi0 (VR26, LNRO0005-26): mem 0xa003400-0xa0035ff irq 74
[   1.0000040] virtio27 at acpi0 (VR27, LNRO0005-27): mem 0xa003600-0xa0037ff irq 75
[   1.0000040] virtio28 at acpi0 (VR28, LNRO0005-28): mem 0xa003800-0xa0039ff irq 76
[   1.0000040] virtio29 at acpi0 (VR29, LNRO0005-29): mem 0xa003a00-0xa003bff irq 77
[   1.0000040] virtio30 at acpi0 (VR30, LNRO0005-30): mem 0xa003c00-0xa003dff irq 78
[   1.0000040] virtio31 at acpi0 (VR31, LNRO0005-31): mem 0xa003e00-0xa003fff irq 79
[   1.0000040] acpipchb0 at acpi0 (PCI0, PNP0A08-0): PCI Express Host Bridge
[   1.0000040] pci0 at acpipchb0 bus 0
[   1.0000040] vendor 1b36 product 0008 (host bridge) at pci0 dev 0 function 0 not configured
[   1.0000040] virtio32 at pci0 dev 1 function 0
[   1.0000040] virtio32: Unknown device (id 16, rev. 0x01)
[   1.0000040] virtio32: no matching child driver; not configured
[   1.0000040] xhci0 at pci0 dev 2 function 0: vendor 1b36 product 000d (rev. 0x01)
[   1.0000040] xhci0: interrupting at irq 8192 (MSI-X vec 0)
[   1.0000040] xhci0: xHCI version 0.0 not known to be supported
[   1.0000040] usb0 at xhci0: USB revision 3.0
[   1.0000040] usb1 at xhci0: USB revision 2.0
[   1.0000040] virtio33 at pci0 dev 3 function 0
[   1.0000040] virtio33: network device (id 1, rev. 0x01)
[   1.0000040] vioif0 at virtio33: features: 0x130870020<V1,EVENT_IDX,INDIRECT_DESC,CTRL_MAC,CTRL_RX,CTRL_VQ,STATUS,MAC>
[   1.0000040] vioif0: Ethernet address 00:00:17:02:62:91
[   1.0000040] virtio33: config interrupting at irq 8193 (MSI-X vec 0)
[   1.0000040] virtio33: queues interrupting at irq 8194 (MSI-X vec 1)
[   1.0000040] ppb0 at pci0 dev 16 function 0: vendor 1b36 product 000c (rev. 0x00)
[   1.0000040] ppb0: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x32 @ 16.0GT/s
[   1.0000040] pci1 at ppb0 bus 1
[   1.0000040] ppb1 at pci0 dev 16 function 1: vendor 1b36 product 000c (rev. 0x00)
[   1.0000040] ppb1: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x32 @ 16.0GT/s
[   1.0000040] pci2 at ppb1 bus 2
[   1.0000040] ppb2 at pci0 dev 16 function 2: vendor 1b36 product 000c (rev. 0x00)
[   1.0000040] ppb2: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x32 @ 16.0GT/s
[   1.0000040] pci3 at ppb2 bus 3
[   1.0000040] ppb3 at pci0 dev 16 function 3: vendor 1b36 product 000c (rev. 0x00)
[   1.0000040] ppb3: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x32 @ 16.0GT/s
[   1.0000040] pci4 at ppb3 bus 4
[   1.0000040] ppb4 at pci0 dev 16 function 4: vendor 1b36 product 000c (rev. 0x00)
[   1.0000040] ppb4: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x32 @ 16.0GT/s
[   1.0000040] pci5 at ppb4 bus 5
[   1.0000040] ppb5 at pci0 dev 16 function 5: vendor 1b36 product 000c (rev. 0x00)
[   1.0000040] ppb5: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x32 @ 16.0GT/s
[   1.0000040] pci6 at ppb5 bus 6
[   1.0000040] ppb6 at pci0 dev 16 function 6: vendor 1b36 product 000c (rev. 0x00)
[   1.0000040] ppb6: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x32 @ 16.0GT/s
[   1.0000040] pci7 at ppb6 bus 7
[   1.0000040] ppb7 at pci0 dev 16 function 7: vendor 1b36 product 000c (rev. 0x00)
[   1.0000040] ppb7: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x32 @ 16.0GT/s
[   1.0000040] pci8 at ppb7 bus 8
[   1.0000040] ppb8 at pci0 dev 17 function 0: vendor 1b36 product 000c (rev. 0x00)
[   1.0000040] ppb8: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x32 @ 16.0GT/s
[   1.0000040] pci9 at ppb8 bus 9
[   1.0000040] ppb9 at pci0 dev 17 function 1: vendor 1b36 product 000c (rev. 0x00)
[   1.0000040] ppb9: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x32 @ 16.0GT/s
[   1.0000040] pci10 at ppb9 bus 10
[   1.0000040] ppb10 at pci0 dev 17 function 2: vendor 1b36 product 000c (rev. 0x00)
[   1.0000040] ppb10: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x32 @ 16.0GT/s
[   1.0000040] pci11 at ppb10 bus 11
[   1.0000040] ppb11 at pci0 dev 17 function 3: vendor 1b36 product 000c (rev. 0x00)
[   1.0000040] ppb11: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x32 @ 16.0GT/s
[   1.0000040] pci12 at ppb11 bus 12
[   1.0000040] ppb12 at pci0 dev 17 function 4: vendor 1b36 product 000c (rev. 0x00)
[   1.0000040] ppb12: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x32 @ 16.0GT/s
[   1.0000040] pci13 at ppb12 bus 13
[   1.0000040] ppb13 at pci0 dev 17 function 5: vendor 1b36 product 000c (rev. 0x00)
[   1.0000040] ppb13: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x32 @ 16.0GT/s
[   1.0000040] pci14 at ppb13 bus 14
[   1.0000040] ppb14 at pci0 dev 17 function 6: vendor 1b36 product 000c (rev. 0x00)
[   1.0000040] ppb14: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x32 @ 16.0GT/s
[   1.0000040] pci15 at ppb14 bus 15
[   1.0000040] ppb15 at pci0 dev 17 function 7: vendor 1b36 product 000c (rev. 0x00)
[   1.0000040] ppb15: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x32 @ 16.0GT/s
[   1.0000040] pci16 at ppb15 bus 16
[   1.0000040] ppb16 at pci0 dev 18 function 0: vendor 1b36 product 000c (rev. 0x00)
[   1.0000040] ppb16: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x32 @ 16.0GT/s
[   1.0000040] pci17 at ppb16 bus 17
[   1.0000040] ppb17 at pci0 dev 18 function 1: vendor 1b36 product 000c (rev. 0x00)
[   1.0000040] ppb17: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x32 @ 16.0GT/s
[   1.0000040] pci18 at ppb17 bus 18
[   1.0000040] ppb18 at pci0 dev 18 function 2: vendor 1b36 product 000c (rev. 0x00)
[   1.0000040] ppb18: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x32 @ 16.0GT/s
[   1.0000040] pci19 at ppb18 bus 19
[   1.0000040] ppb19 at pci0 dev 18 function 3: vendor 1b36 product 000c (rev. 0x00)
[   1.0000040] ppb19: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x32 @ 16.0GT/s
[   1.0000040] pci20 at ppb19 bus 20
[   1.0000040] ppb20 at pci0 dev 18 function 4: vendor 1b36 product 000c (rev. 0x00)
[   1.0000040] ppb20: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x32 @ 16.0GT/s
[   1.0000040] pci21 at ppb20 bus 21
[   1.0000040] ppb21 at pci0 dev 18 function 5: vendor 1b36 product 000c (rev. 0x00)
[   1.0000040] ppb21: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x32 @ 16.0GT/s
[   1.0000040] pci22 at ppb21 bus 22
[   1.0000040] ppb22 at pci0 dev 18 function 6: vendor 1b36 product 000c (rev. 0x00)
[   1.0000040] ppb22: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x32 @ 16.0GT/s
[   1.0000040] pci23 at ppb22 bus 23
[   1.0000040] ppb23 at pci0 dev 18 function 7: vendor 1b36 product 000c (rev. 0x00)
[   1.0000040] ppb23: PCI Express capability version 2 <Root Port of PCI-E Root Complex> x32 @ 16.0GT/s
[   1.0000040] ppb23: link is x1 @ 2.5GT/s
[   1.0000040] pci24 at ppb23 bus 24
[   1.0000040] virtio34 at pci24 dev 0 function 0
[   1.0000040] virtio34: SCSI device (id 8, rev. 0x01)
[   1.0000040] vioscsi0 at virtio34: features: 0x110000000<V1,INDIRECT_DESC>
[   1.0000040] vioscsi0: cmd_per_lun 128 qsize 128 seg_max 126 max_target 255 max_lun 16383
[   1.0000040] virtio34: config interrupting at irq 8195 (MSI-X vec 0)
[   1.0000040] virtio34: queues interrupting at irq 8196 (MSI-X vec 1)
[   1.0000040] scsibus0 at vioscsi0: 256 targets, 16384 luns per target
[   1.0000040] acpiged0 at acpi0 (GED, ACPI0013-GED): irq 41
[   1.0000040] acpibut0 at acpi0 (PWRB, PNP0C0C-0): ACPI Power Button
[   1.0000040] uhub0 at usb0: NetBSD (0x0000) xHCI root hub (0x0000), class 9/0, rev 3.00/1.00, addr 0
[   1.1974294] uhub1 at usb1: NetBSD (0x0000) xHCI root hub (0x0000), class 9/0, rev 2.00/1.00, addr 0
[   1.2027949] cpu0: PMU interrupting on irq 23
[   1.2177106] WARNING: system needs entropy for security; see entropy(7)
[   6.6035661] uhub1: device problem, disabling port 1
[  12.0091296] uhub1: device problem, disabling port 2
[  17.4148019] uhub1: device problem, disabling port 3

Follow-Ups:
- Re: arm64 boot hangs on Oracle Cloud Ampere (VM.Standard.A1.Flex)
  - From: Christof Meerwald

Prev by Date: Re: can not download IMAP messages with isync/mbsync
Next by Date: Timing issues with USB attached storage
Previous by Thread: Re: can not download IMAP messages with isync/mbsync
Next by Thread: Re: arm64 boot hangs on Oracle Cloud Ampere (VM.Standard.A1.Flex)
Indexes:

Home | Main Index | Thread Index | Old Index