Linux on NVMM

[Jared McNeill <jmcneill%invisible.ca@localhost>]

Hi folks --

Trying to get NVMM going on NetBSD 9.0 today, trying to get a 64-bit Linux 
VM going on an AMD host.

So far I've only had success booting CentOS 7, but it is too old to run 
the application I want to use. The rest all hang shortly after loading the 
kernel. What I've tried:

 - CentOS 8
 - Fedora 29
 - Fedora 31
 - Debian 10.1
 - Ubuntu 18.04 LTS

They all seem to hang around the same spot, this is all I see on the 
console:

starscream$ sh -x start.sh
+ '[' -f /etc/shrc ']'
+ . /etc/shrc
+ SMP=4
+ MEM=2048
+ CDROM=CentOS-8-x86_64-1905-boot.iso
+ qemu-system-x86_64 -accel nvmm -smp 4 -m 2048 -net nic -net tap,ifname=tap0,script=no -vnc ':1' -hda hda.img -cdrom CentOS-8-x86_64-1905-boot.iso
WARNING: Image format was not specified for 'hda.img' and probing guessed raw.
         Automatically detecting the format is dangerous for raw images, write operations on block 0 will be restricted.
         Specify the 'raw' format explicitly to remove the restrictions.
NetBSD Virtual Machine Monitor accelerator is operational
qemu-system-x86_64: NVMM: Unexpected RDMSR 0xc0011005, ignored
qemu-system-x86_64: NVMM: Unexpected WRMSR 0xc0011005 
[val=0x40000000000000], ignored
qemu-system-x86_64: NVMM: Unexpected RDMSR 0xc0011005, ignored
qemu-system-x86_64: NVMM: Unexpected RDMSR 0xc0010112, ignored
qemu-system-x86_64: NVMM: Unexpected RDMSR 0xc0010015, ignored
qemu-system-x86_64: NVMM: Unexpected RDMSR 0xc001100c, ignored
qemu-system-x86_64: NVMM: Unexpected RDMSR 0xc0011020, ignored
qemu-system-x86_64: NVMM: Unexpected RDMSR 0xc0010010, ignored


The host is:

starscream$ uname -a
NetBSD starscream.invisible.ca 9.0_BETA NetBSD 9.0_BETA (GENERIC) #0: Thu Nov 14 15:42:47 UTC 2019  mkrepro%mkrepro.NetBSD.org@localhost:/usr/src/sys/arch/amd64/compile/GENERIC amd64
starscream$ pkg_info | grep qemu
qemu-nvmm-4.1.0     CPU emulator using dynamic translation
starscream$ cpuctl identify 0
Cannot bind to target CPU.  Output may not accurately describe the target.
Run as root to allow binding.

cpu0: highest basic info 0000000d
cpu0: highest extended info 8000001e
cpu0: "AMD Opteron(tm) X3421 APU                      "
cpu0: AMD Family 15h (686-class), 2096.15 MHz
cpu0: family 0x15 model 0x60 stepping 0x1 (id 0x660f01)
cpu0: features 0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE>
cpu0: features 0x178bfbff<MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
cpu0: features1 0x7ed8320b<SSE3,PCLMULQDQ,MONITOR,SSSE3,FMA,CX16,SSE41,SSE42>
cpu0: features1 0x7ed8320b<MOVBE,POPCNT,AES,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
cpu0: features2 0x2fd3fbff<SYSCALL/SYSRET,NOX,MMXX,MMX,FXSR,FFXSR,P1GB,RDTSCP>
cpu0: features2 0x2fd3fbff<LONG>
cpu0: features3 0x2fabbfff<LAHF,CMPLEGACY,SVM,EAPIC,ALTMOVCR0,LZCNT,SSE4A>
cpu0: features3 0x2fabbfff<MISALIGNSSE,3DNOWPREFETCH,OSVW,IBS,XOP,SKINIT,WDT>
cpu0: features3 0x2fabbfff<LWP,FMA4,TCE,NodeID,TBM,PCExtC,PCExtNB,StrmPM,DBExt>
cpu0: features3 0x2fabbfff<PerfTsc,MWAITX>
cpu0: features5 0x1a9<FSGSBASE,BMI1,AVX2,SMEP,BMI2>
cpu0: xsave features 0x7<x87,SSE,AVX>
cpu0: xsave instructions 0x1<XSAVEOPT>
cpu0: xsave area size: current 832, maximum 960, xgetbv enabled
cpu0: enabled xsave 0x7<x87,SSE,AVX>
cpu0: I-cache 96KB 64B/line 3-way, D-cache 32KB 64B/line 8-way
cpu0: L2 cache 1MB 64B/line 16-way
cpu0: ITLB 48 4KB entries fully associative, 24 2MB entries fully associative
cpu0: DTLB 64 4KB entries fully associative, 64 2MB entries fully associative
cpu0: L2 ITLB 512 4KB entries 4-way, 1024 2MB entries 8-way
cpu0: L2 DTLB 1024 4KB entries 8-way, 1024 2MB entries 8-way
cpu0: L1 1GB page ITLB 24 1GB entries fully associative
cpu0: L1 1GB page DTLB 64 1GB entries fully associative
cpu0: L2 1GB page ITLB 1024 1GB entries 8-way
cpu0: L2 1GB page DTLB 1024 1GB entries 8-way
cpu0: Initial APIC ID 1
cpu0: Cluster/Package ID 0
cpu0: Core ID 1
cpu0: SMT ID 0
cpu0: MONITOR/MWAIT extensions 0x3<EMX,IBE>
cpu0: monitor-line size 64
cpu0: DSPM-eax 0x4<ARAT>
cpu0: DSPM-ecx 0x1<HWF>
cpu0: SEF highest subleaf 00000000
cpu0: AMD Power Management features: 0x37d9<TS,TTP,HTC,100,HWP,TSC,CPB,EffFreq,PROCPR,CONNSTBY>
cpu0: AMD Extended features 0x1000<IBPB>
cpu0: SVM Rev. 1
cpu0: SVM NASID 32768
cpu0: SVM features 0x13cff<NP,LbrVirt,SVML,NRIPS,TSCRate,VMCBCleanBits>
cpu0: SVM features 0x13cff<FlushByASID,DecodeAssist,PauseFilter,B11>
cpu0: SVM features 0x13cff<PFThreshold,AVIC,VGIF>
cpu0: UCode version: 0x600611a


Any ideas / magic kernel command-line parameters to try?

Thanks!
Jared