Xen 4.18.4_20241221nb0 panic (Was: Re: EFI and Xen)

To: Manuel Bouyer <bouyer%antioche.eu.org@localhost>
Subject: Xen 4.18.4_20241221nb0 panic (Was: Re: EFI and Xen)
From: Chuck Zmudzinski <frchuckz%gmail.com@localhost>
Date: Fri, 23 May 2025 16:13:01 -0400
On 5/14/2025 3:15 AM, Manuel Bouyer wrote:
> On Tue, May 13, 2025 at 10:59:13PM -0400, Chuck Zmudzinski wrote:
>> So, is netbsd/xen supposed to work with UEFI booting, or are there issues? I saw this commit which I thought might have enabled support for booting netbsd/xen on UEFI-only systems back in 2019:
> 
> snip
> 
> I have a server using EFI with Xen and NetBSD dom0. I use the NetBSD boot
> loader with:
> menu=Boot Xen PV:load /netbsd console=pc root=dk1; multiboot /xen-debug.gz dom0_mem=8192M console=com1,vga com1=115200,8n1 conring_size=4096k sync_console
> 
> If you have a serial console it may be worth a try, to get more messages.
> There are also Xen options to help debug this kind of issue (like:
> don't give the VGA console to dom0, delay before reboot and so on).
> If Xen keeps the VGA console, use console=com0 for NetBSD so that
> it sends it boot messages to Xen.
> 

I needed to acquire a PCI serial card to get some useful messages because the motherboard does not have a built-in serial port.

It appears Xen 4.18.4_20241221nb0 from pkgsrc crashes on my box before the NetBSD dom0 starts:

-------- snip ------
(XEN) Xen call trace:
(XEN)    [<ffff82d040261a00>] R intel_iommu_enable_eim+0/0xe0
(XEN)    [<ffff82d040268ac4>] S iommu_enable_x2apic+0x24/0x70
(XEN)    [<ffff82d0403f579d>] S x2apic_bsp_setup+0x12d/0x220
(XEN)    [<ffff82d0403ff0e4>] S __start_xen+0x1af4/0x2620
(XEN)    [<ffff82d040204434>] S __high_start+0x94/0xa0
(XEN) 
(XEN) 
(XEN) ****************************************
(XEN) Panic on CPU 0:
(XEN) CONTROL-FLOW PROTECTION FAULT: #CP[0003] endbranch
(XEN) ****************************************
(XEN) 
(XEN) Reboot in five seconds...
(XEN) Resetting with ACPI MEMORY or I/O RESET_REG.
-------- end messages ------

Please note only the pkgsrc version of Xen crashes. I can boot Xen with no problems using Xen packaged by Fedora, AlmaLinux, etc. on this box.

It looks like some problem with intel_iommu but I could be wrong. Any ideas?

Thanks,

Chuck Zmudzinski

P.S. For more context, here is the entire message that was captured on the Xen serial console:

(XEN) Xen version 4.18.4_20241221nb0 (pbulk@) (gcc (nb3 20231008) 10.5.0) debug=n Fri Feb 21 20:52:05 UTC 2025
(XEN) Latest ChangeSet: 
(XEN) build-id: 86da5662d97aee8a456f3dd00ee0e5d275767dcc
(XEN) Bootloader: NetBSD/x86 EFI Boot (x64), Revision 1.2 (Mon Dec 16 13:08:11 UTC 2024) (from NetBSD 10.1)
(XEN) Command line: dom0_mem=2G com2=9600,8n1,0x40c0,16,1:0.0 console=com2 pv-l1tf=false
(XEN) Xen image load base address: 0x4c600000
(XEN) Video information:
(XEN)  VGA is graphics mode 1920x1080, 32 bpp
(XEN) Disc information:
(XEN)  Found 0 MBR signatures
(XEN)  Found 3 EDD information structures
(XEN) CPU Vendor: Intel, Family 6 (0x6), Model 191 (0xbf), Stepping 2 (raw 000b06f2)
(XEN) Enabling Supervisor Shadow Stacks
(XEN) Enabling Indirect Branch Tracking
(XEN)   - IBT disabled in UEFI Runtime Services
(XEN) EFI RAM map:
(XEN)  [0000000000000000, 000000000009dfff] (usable)
(XEN)  [000000000009e000, 000000000009efff] (reserved)
(XEN)  [000000000009f000, 000000000009ffff] (usable)
(XEN)  [00000000000a0000, 00000000000fffff] (reserved)
(XEN)  [0000000000100000, 0000000060f9cfff] (usable)
(XEN)  [0000000060f9d000, 000000006409cfff] (reserved)
(XEN)  [000000006409d000, 0000000064ba3fff] (ACPI data)
(XEN)  [0000000064ba4000, 0000000064ccffff] (ACPI NVS)
(XEN)  [0000000064cd0000, 0000000065ffefff] (reserved)
(XEN)  [0000000065fff000, 0000000065ffffff] (usable)
(XEN)  [0000000066000000, 0000000069ffffff] (reserved)
(XEN)  [000000006a600000, 000000006a7fffff] (reserved)
(XEN)  [000000006b000000, 00000000707fffff] (reserved)
(XEN)  [00000000c0000000, 00000000cfffffff] (reserved)
(XEN)  [00000000fe000000, 00000000fe010fff] (reserved)
(XEN)  [00000000fec00000, 00000000fec00fff] (reserved)
(XEN)  [00000000fed00000, 00000000fed00fff] (reserved)
(XEN)  [00000000fed20000, 00000000fed7ffff] (reserved)
(XEN)  [00000000fee00000, 00000000fee00fff] (reserved)
(XEN)  [00000000ff000000, 00000000ffffffff] (reserved)
(XEN)  [0000000100000000, 000000088f7fffff] (usable)
(XEN) BSP microcode revision: 0x0000002e
(XEN) ACPI: RSDP 64C2C014, 0024 (r2 ALASKA)
(XEN) ACPI: XSDT 64C2B728, 00EC (r1 ALASKA   A M I   1072009 AMI   1000013)
(XEN) ACPI: FACP 64BA1000, 0114 (r6 ALASKA   A M I   1072009 AMI   1000013)
(XEN) ACPI: DSDT 64B18000, 88B1F (r2 ALASKA   A M I         1 INTL 20200717)
(XEN) ACPI: FACS 64CCF000, 0040
(XEN) ACPI: FIDT 64B17000, 009C (r1 ALASKA    A M I        1 AMI     10013)
(XEN) ACPI: SSDT 64BA3000, 038C (r2 PmaxDv Pmax_Dev        1 INTL 20200717)
(XEN) ACPI: SSDT 64B11000, 5D34 (r2 CpuRef  CpuSsdt     3000 INTL 20200717)
(XEN) ACPI: AAFT 64BA2000, 0306 (r1 ALASKA OEMAAFT         1 MSFT       97)
(XEN) ACPI: SSDT 64B0E000, 2A81 (r2 SaSsdt  SaSsdt      3000 INTL 20200717)
(XEN) ACPI: SSDT 64B0A000, 334F (r2 INTEL  IgfxSsdt     3000 INTL 20200717)
(XEN) ACPI: HPET 64B09000, 0038 (r1 ALASKA   A M I   1072009 AMI   1000013)
(XEN) ACPI: APIC 64B08000, 01DC (r5 ALASKA   A M I   1072009 AMI   1000013)
(XEN) ACPI: MCFG 64B07000, 003C (r1 ALASKA   A M I   1072009 AMI   1000013)
(XEN) ACPI: NHLT 64B06000, 002D (r0 ALASKA   A M I   1072009 AMI   1000013)
(XEN) ACPI: LPIT 64B05000, 00CC (r1 ALASKA   A M I   1072009 AMI   1000013)
(XEN) ACPI: SSDT 64AFA000, 92F4 (r2 ALASKA TbtTypeC        0 INTL 20200717)
(XEN) ACPI: DBGP 64AF9000, 0034 (r1 ALASKA   A M I   1072009 AMI   1000013)
(XEN) ACPI: DBG2 64AF8000, 0054 (r0 ALASKA   A M I   1072009 AMI   1000013)
(XEN) ACPI: SSDT 64AF6000, 190A (r2 ALASKA UsbCTabl     1000 INTL 20200717)
(XEN) ACPI: DMAR 64AF5000, 0088 (r1 INTEL  EDK2            2       1000013)
(XEN) ACPI: FPDT 64AF4000, 0044 (r1 ALASKA   A M I   1072009 AMI   1000013)
(XEN) ACPI: SSDT 64AF2000, 1480 (r2  INTEL xh_rps14        0 INTL 20200717)
(XEN) ACPI: SSDT 64AEE000, 3AEA (r2 SocGpe  SocGpe      3000 INTL 20200717)
(XEN) ACPI: SSDT 64AEA000, 39DA (r2 SocCmn  SocCmn      3000 INTL 20200717)
(XEN) ACPI: TPM2 64AE8000, 004C (r4 ALASKA   A M I         1 AMI         0)
(XEN) ACPI: BGRT 64AE9000, 0038 (r1 ALASKA   A M I         1 AMI     10013)
(XEN) ACPI: PHAT 64AE7000, 083C (r1 ALASKA   A M I         5 MSFT  100000D)
(XEN) ACPI: WSMT 64B04000, 0028 (r1 ALASKA   A M I         1 AMI     10013)
(XEN) System RAM: 32519MB (33299700kB)
(XEN) No NUMA configuration found
(XEN) Faking a node at 0000000000000000-000000088f800000
(XEN) Domain heap initialised
(XEN) SMBIOS 3.5 present.
(XEN) Using APIC driver default
(XEN) ACPI: PM-Timer IO Port: 0x1808 (24 bits)
(XEN) ACPI: v5 SLEEP INFO: control[0:0], status[0:0]
(XEN) ACPI: SLEEP INFO: pm1x_cnt[1:1804,1:0], pm1x_evt[1:1800,1:0]
(XEN) ACPI: 32/64X FACS address mismatch in FADT - 64ccf000/0000000000000000, using 32
(XEN) ACPI:             wakeup_vec[64ccf00c], vec_size[20]
(XEN) Overriding APIC driver with bigsmp
(XEN) ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-119
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
(XEN) ACPI: HPET id: 0x8086a201 base: 0xfed00000
(XEN) PCI: MCFG configuration 0: base c0000000 segment 0000 buses 00 - ff
(XEN) PCI: MCFG area at c0000000 reserved in E820
(XEN) PCI: Using MCFG for segment 0000 bus 00-ff
(XEN) ACPI: BGRT: invalidating v1 image at 0x58d6d018
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) SMP: Allowing 20 CPUs (0 hotplug CPUs)
(XEN) IRQ limits: 120 GSI, 4040 MSI/MSI-X
(XEN) ----[ Xen-4.18.4_20241221nb0  x86_64  debug=n  Not tainted ]----
(XEN) CPU:    0
(XEN) RIP:    e008:[<ffff82d040261a00>] intel_iommu_enable_eim+0/0xe0
(XEN) RFLAGS: 0000000000010086   CONTEXT: hypervisor
(XEN) rax: ffff82d04041f5b0   rbx: 0000000000000001   rcx: 0000000000000000
(XEN) rdx: ffff82d040261a00   rsi: ffff82d040418760   rdi: ffff82d040365e80
(XEN) rbp: ffff83081f34ffe0   rsp: ffff82d040417d58   r8:  ffff83081f34fa50
(XEN) r9:  0000000000000000   r10: ffff82d0403a26f0   r11: 000000000000000a
(XEN) r12: 0000000000000002   r13: ffff82d04046dd80   r14: 0000000000000014
(XEN) r15: 0000000000000013   cr0: 0000000080050033   cr4: 00000000008000a0
(XEN) cr3: 000000004ca79000   cr2: 0000000000000000
(XEN) fsb: 0000000000000000   gsb: 0000000000000000   gss: 0000000000000000
(XEN) ds: 0000   es: 0000   fs: 0000   gs: 0000   ss: 0000   cs: e008
(XEN) Xen code around <ffff82d040261a00> (intel_iommu_enable_eim):
(XEN)  24 ee ff ff 90 90 90 90 <41> 54 55 53 83 3d 55 5a 32 00 02 0f 86 ad 00 00
(XEN) Xen stack trace from rsp=ffff82d040417d58:
(XEN)    ffff82d040268ac4 ffff82d0403f579d 000000000000003e 0000000000000014
(XEN)    0000000000000002 ffff82d0403ff0e4 0000000000000013 ffff83081f358000
(XEN)    00000000001fe000 ffff83000009cf80 ffff83000009cfb0 ffffffff00000014
(XEN)    ffff82d04044dfac ffff83000009ced0 ffff83000009cf80 0000000000200000
(XEN)    0000000060e00000 0000000000000000 000000000082f35a 00000000604a4000
(XEN)    00000000604a4000 00000000604a4fff ffff82d040417ef8 000000000088f800
(XEN)    ffff83000009cf80 007fffff01000000 0000000000600000 00000000005ae820
(XEN)    ffff82d040417e48 ffff05d0403e5ab4 0000000000000002 ffff82d04047f000
(XEN)    ffff82d04057d000 0000000800000000 000000010000006e 0000000000000003
(XEN)    00000000000002f8 001fe2180088f600 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 000000005af15770 000000000009e000
(XEN)    000000004c9e4601 000000005892a000 000000004c9e47e0 ffff82d040204434
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN)    0000000000000000 0000e01000000000 0000000000000000 0000000000000000
(XEN) Xen call trace:
(XEN)    [<ffff82d040261a00>] R intel_iommu_enable_eim+0/0xe0
(XEN)    [<ffff82d040268ac4>] S iommu_enable_x2apic+0x24/0x70
(XEN)    [<ffff82d0403f579d>] S x2apic_bsp_setup+0x12d/0x220
(XEN)    [<ffff82d0403ff0e4>] S __start_xen+0x1af4/0x2620
(XEN)    [<ffff82d040204434>] S __high_start+0x94/0xa0
(XEN) 
(XEN) 
(XEN) ****************************************
(XEN) Panic on CPU 0:
(XEN) CONTROL-FLOW PROTECTION FAULT: #CP[0003] endbranch
(XEN) ****************************************
(XEN) 
(XEN) Reboot in five seconds...
(XEN) Resetting with ACPI MEMORY or I/O RESET_REG.
Follow-Ups:
- Re: Xen 4.18.4_20241221nb0 panic (Was: Re: EFI and Xen)
  - From: Manuel Bouyer
References:
- EFI and Xen
  - From: César Catrián C.
- Re: EFI and Xen
  - From: Chuck Zmudzinski
- Re: EFI and Xen
  - From: Manuel Bouyer
- Re: EFI and Xen
  - From: Chuck Zmudzinski
Prev by Date: Re: Writing to root-window
Next by Date: Re: Xen 4.18.4_20241221nb0 panic (Was: Re: EFI and Xen)
Previous by Thread: Re: EFI and Xen
Next by Thread: Re: Xen 4.18.4_20241221nb0 panic (Was: Re: EFI and Xen)
Indexes:
Home | Main Index | Thread Index | Old Index