At Wed, 22 Apr 2015 12:24:28 -0700, "Greg A. Woods" <woods%planix.ca@localhost> wrote: Subject: Re: xen-4.5 and NetBSD/amd64-7.99.5 can't start netbsd-5-XEN3PAE_DOMU > > After I reboot the whole server I will try booting a XEN3PAE kernel from > the official NetBSD builds, and possibly try with less guest memory too. > (and definitely take out the "on_crash=coredump-restart" setting!!!) Sorry, false alarm! Good i386-32bit NetBSD kernels will boot in Xen-4.5 on x86_64 systems. It is definitely a problem with the XEN3PAE_DOMU kernel I built, though there is also an issue with trying to give it too much memory. Initially I tried the stock kernel with 'memory = 4000', but the domU failed to start. However after I changed this to 'maxmem = 2000' everything worked. Seems like the "PAE" part isn't quite doing its part :-) So, I'll try checking out what I've changed and building some more test kernels. Hopefully I can find something wrong with how my kernel is built. Anyway here's a diff of the output between creating one with a working stock kernel, and the kernel I built. From what I can see everything goes OK until it gets to the part where the kernel output should appear: (FYI, my kernel is bigger because it has a bigger MD root.... A non-Xen version of that same INSTALL kernel works fine on real i386 hardware, and in VirtualBox.) 19:18 [16] $ diff tmp/xen-i386-ok tmp/xen-i386-crash 1c1 < 19:11 [1.763] # xl -vvv create -c /usr/pkg/etc/xen/nbtest.conf --- > 19:11 [1.766] # xl -vvv create -c /usr/pkg/etc/xen/nbtest.conf 8,10c8,10 < libxl: debug: libxl_dom.c:533:libxl__build_pv: pv kernel mapped 0 path /netbsd-5.2.3-i386-INSTALL_XEN3PAE_DOMU < domainbuilder: detail: xc_dom_kernel_file: filename="/netbsd-5.2.3-i386-INSTALL_XEN3PAE_DOMU" < domainbuilder: detail: xc_dom_malloc_filemap : 9073 kB --- > libxl: debug: libxl_dom.c:533:libxl__build_pv: pv kernel mapped 0 path /netbsd-5.2_STABLE-i386-INSTALL_XEN3PAE_DOMU > domainbuilder: detail: xc_dom_kernel_file: filename="/netbsd-5.2_STABLE-i386-INSTALL_XEN3PAE_DOMU" > domainbuilder: detail: xc_dom_malloc_filemap : 16463 kB 15,17c15,17 < xc: detail: elf_parse_binary: phdr: paddr=0xc0100000 memsz=0x35cb18 < xc: detail: elf_parse_binary: phdr: paddr=0xc045db40 memsz=0x570294 < xc: detail: elf_parse_binary: memory: 0xc0100000 -> 0xc09cddd4 --- > xc: detail: elf_parse_binary: phdr: paddr=0xc0100000 memsz=0x35e3f8 > xc: detail: elf_parse_binary: phdr: paddr=0xc045f400 memsz=0x819d4 > xc: detail: elf_parse_binary: memory: 0xc0100000 -> 0xc04e0dd4 33c33 < xc: detail: virt_kend = 0xc0a38a6c --- > xc: detail: virt_kend = 0xc0544f34 36,39c36,39 < domainbuilder: detail: xc_dom_load_elf_symtab/parse: bsd_symtab_start=c0a38a6c, kernel.end=0xc0a38a6c -- symtab=0xc0a38a70, maxaddr=0xc0a38f04 < domainbuilder: detail: xc_dom_load_elf_symtab: h=26 symtab, size=0x36050, maxaddr=0xc0a6ef54 < domainbuilder: detail: xc_dom_load_elf_symtab: h=27 strtab, size=0x3464f, maxaddr=0xc0aa35a4 < domainbuilder: detail: xc_dom_parse_elf_kernel: xen-3.0-x86_32p: 0xc0100000 -> 0xc0aa35a4 --- > domainbuilder: detail: xc_dom_load_elf_symtab/parse: bsd_symtab_start=c0544f34, kernel.end=0xc0544f34 -- symtab=0xc0544f38, maxaddr=0xc054528c > domainbuilder: detail: xc_dom_load_elf_symtab: h=18 symtab, size=0x32720, maxaddr=0xc05779ac > domainbuilder: detail: xc_dom_load_elf_symtab: h=19 strtab, size=0x315ef, maxaddr=0xc05a8f9c > domainbuilder: detail: xc_dom_parse_elf_kernel: xen-3.0-x86_32p: 0xc0100000 -> 0xc05a8f9c 46,60c46,60 < domainbuilder: detail: xc_dom_alloc_segment: kernel : 0xc0100000 -> 0xc0aa4000 (pfn 0x0 + 0x9a4 pages) < domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x0+0x9a4 at 0x7f7ff315c000 < xc: detail: elf_load_binary: phdr 0 at 0x7f7ff315c000 -> 0x7f7ff34b8b18 < xc: detail: elf_load_binary: phdr 1 at 0x7f7ff34b9b40 -> 0x7f7ff39ac384 < xc: detail: elf_load_bsdsyms: shdr 25 at 0x7f7ff47948c6 -> 0x7f7ff3a2a26c < xc: detail: elf_load_bsdsyms: shdr 26 at 0x7f7ff4794e88 -> 0x7f7ff3a2a3cc < xc: detail: elf_load_bsdsyms: shdr 27 at 0x7f7ff47caed8 -> 0x7f7ff3a6041c < domainbuilder: detail: xc_dom_load_elf_symtab/load: bsd_symtab_start=c0a38a6c, kernel.end=0xc0aa4000 -- symtab=0xc0a38a70, maxaddr=0xc0a38f04 < domainbuilder: detail: xc_dom_load_elf_symtab: h=26 symtab, size=0x36050, maxaddr=0xc0a6ef54 < domainbuilder: detail: xc_dom_load_elf_symtab: h=27 strtab, size=0x3464f, maxaddr=0xc0aa35a4 < domainbuilder: detail: xc_dom_alloc_segment: phys2mach : 0xc0aa4000 -> 0xc0c98000 (pfn 0x9a4 + 0x1f4 pages) < domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x9a4+0x1f4 at 0x7f7ff6e0c000 < domainbuilder: detail: xc_dom_alloc_page : start info : 0xc0c98000 (pfn 0xb98) < domainbuilder: detail: xc_dom_alloc_page : xenstore : 0xc0c99000 (pfn 0xb99) < domainbuilder: detail: xc_dom_alloc_page : console : 0xc0c9a000 (pfn 0xb9a) --- > domainbuilder: detail: xc_dom_alloc_segment: kernel : 0xc0100000 -> 0xc05a9000 (pfn 0x0 + 0x4a9 pages) > domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x0+0x4a9 at 0x7f7ff2e57000 > xc: detail: elf_load_binary: phdr 0 at 0x7f7ff2e57000 -> 0x7f7ff31b53f8 > xc: detail: elf_load_binary: phdr 1 at 0x7f7ff31b6400 -> 0x7f7ff31c2ac4 > xc: detail: elf_load_bsdsyms: shdr 17 at 0x7f7ff3b6d66b -> 0x7f7ff323812c > xc: detail: elf_load_bsdsyms: shdr 18 at 0x7f7ff3b6da84 -> 0x7f7ff3238224 > xc: detail: elf_load_bsdsyms: shdr 19 at 0x7f7ff3ba01a4 -> 0x7f7ff326a944 > domainbuilder: detail: xc_dom_load_elf_symtab/load: bsd_symtab_start=c0544f34, kernel.end=0xc05a9000 -- symtab=0xc0544f38, maxaddr=0xc054528c > domainbuilder: detail: xc_dom_load_elf_symtab: h=18 symtab, size=0x32720, maxaddr=0xc05779ac > domainbuilder: detail: xc_dom_load_elf_symtab: h=19 strtab, size=0x315ef, maxaddr=0xc05a8f9c > domainbuilder: detail: xc_dom_alloc_segment: phys2mach : 0xc05a9000 -> 0xc079d000 (pfn 0x4a9 + 0x1f4 pages) > domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x4a9+0x1f4 at 0x7f7ff6e0c000 > domainbuilder: detail: xc_dom_alloc_page : start info : 0xc079d000 (pfn 0x69d) > domainbuilder: detail: xc_dom_alloc_page : xenstore : 0xc079e000 (pfn 0x69e) > domainbuilder: detail: xc_dom_alloc_page : console : 0xc079f000 (pfn 0x69f) 63,68c63,68 < domainbuilder: detail: nr_page_tables: 0x00000000001fffff/21: 0x00000000c0000000 -> 0x00000000c0ffffff, 8 table(s) < domainbuilder: detail: xc_dom_alloc_segment: page tables : 0xc0c9b000 -> 0xc0ca5000 (pfn 0xb9b + 0xa pages) < domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0xb9b+0xa at 0x7f7ff7fd4000 < domainbuilder: detail: xc_dom_alloc_page : boot stack : 0xc0ca5000 (pfn 0xba5) < domainbuilder: detail: xc_dom_build_image : virt_alloc_end : 0xc0ca6000 < domainbuilder: detail: xc_dom_build_image : virt_pgtab_end : 0xc1000000 --- > domainbuilder: detail: nr_page_tables: 0x00000000001fffff/21: 0x00000000c0000000 -> 0x00000000c0bfffff, 6 table(s) > domainbuilder: detail: xc_dom_alloc_segment: page tables : 0xc07a0000 -> 0xc07a8000 (pfn 0x6a0 + 0x8 pages) > domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x6a0+0x8 at 0x7f7ff7fd6000 > domainbuilder: detail: xc_dom_alloc_page : boot stack : 0xc07a8000 (pfn 0x6a8) > domainbuilder: detail: xc_dom_build_image : virt_alloc_end : 0xc07a9000 > domainbuilder: detail: xc_dom_build_image : virt_pgtab_end : 0xc0c00000 77,79c77,79 < domainbuilder: detail: clear_page: pfn 0xb9a, mfn 0x481ba5 < domainbuilder: detail: clear_page: pfn 0xb99, mfn 0x481ba6 < domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0xb98+0x1 at 0x7f7ff7fd3000 --- > domainbuilder: detail: clear_page: pfn 0x69f, mfn 0x4820a0 > domainbuilder: detail: clear_page: pfn 0x69e, mfn 0x4820a1 > domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x69d+0x1 at 0x7f7ff7fd5000 83c83 < domainbuilder: detail: malloc : 4073 kB --- > domainbuilder: detail: malloc : 4043 kB 86,87c86,87 < domainbuilder: detail: file mmap : 9073 kB < domainbuilder: detail: domU mmap : 11916 kB --- > domainbuilder: detail: file mmap : 16463 kB > domainbuilder: detail: domU mmap : 6808 kB 91,92c91,92 < domainbuilder: detail: vcpu_x86_32: cr3: pfn 0xb9b mfn 0x481ba4 < domainbuilder: detail: launch_vm: called, ctxt=0x7f7ff7b4d004 --- > domainbuilder: detail: vcpu_x86_32: cr3: pfn 0x6a0 mfn 0x48209f > domainbuilder: detail: launch_vm: called, ctxt=0x7f7ff7b45004 94c94 < libxl: debug: libxl_event.c:577:libxl__ev_xswatch_register: watch w=0x7f7ff7b37528 wpath=/local/domain/0/backend/vif/9/0/state token=3/0: register slotnum=3 --- > libxl: debug: libxl_event.c:577:libxl__ev_xswatch_register: watch w=0x7f7ff7b37528 wpath=/local/domain/0/backend/vif/10/0/state token=3/0: register slotnum=3 96,98c96,98 < libxl: debug: libxl_event.c:514:watchfd_callback: watch w=0x7f7ff7b37528 wpath=/local/domain/0/backend/vif/9/0/state token=3/0: event epath=/local/domain/0/backend/vif/9/0/state < libxl: debug: libxl_event.c:830:devstate_watch_callback: backend /local/domain/0/backend/vif/9/0/state wanted state 2 ok < libxl: debug: libxl_event.c:615:libxl__ev_xswatch_deregister: watch w=0x7f7ff7b37528 wpath=/local/domain/0/backend/vif/9/0/state token=3/0: deregister slotnum=3 --- > libxl: debug: libxl_event.c:514:watchfd_callback: watch w=0x7f7ff7b37528 wpath=/local/domain/0/backend/vif/10/0/state token=3/0: event epath=/local/domain/0/backend/vif/10/0/state > libxl: debug: libxl_event.c:830:devstate_watch_callback: backend /local/domain/0/backend/vif/10/0/state wanted state 2 ok > libxl: debug: libxl_event.c:615:libxl__ev_xswatch_deregister: watch w=0x7f7ff7b37528 wpath=/local/domain/0/backend/vif/10/0/state token=3/0: deregister slotnum=3 100,102c100,102 < libxl: debug: libxl_device.c:1028:device_hotplug: calling hotplug script: /usr/pkg/etc/xen/scripts/vif-bridge /local/domain/0/backend/vif/9/0 < libxl: debug: libxl_aoutils.c:513:libxl__async_exec_start: forking to execute: /usr/pkg/etc/xen/scripts/vif-bridge /local/domain/0/backend/vif/9/0 < libxl: debug: libxl_event.c:483:watchfd_callback: watch epath=/local/domain/0/backend/vif/9/0/state token=3/0: empty slot --- > libxl: debug: libxl_device.c:1028:device_hotplug: calling hotplug script: /usr/pkg/etc/xen/scripts/vif-bridge /local/domain/0/backend/vif/10/0 > libxl: debug: libxl_aoutils.c:513:libxl__async_exec_start: forking to execute: /usr/pkg/etc/xen/scripts/vif-bridge /local/domain/0/backend/vif/10/0 > libxl: debug: libxl_event.c:483:watchfd_callback: watch epath=/local/domain/0/backend/vif/10/0/state token=3/0: empty slot 105c105 < libxl: debug: libxl_event.c:1945:libxl__ao_progress_report: ao 0x7f7ff7b26080: progress report: callback queued aop=0x7f7ff7b24bf0 --- > libxl: debug: libxl_event.c:1945:libxl__ao_progress_report: ao 0x7f7ff7b26080: progress report: callback queued aop=0x7f7ff7b24e30 107c107 < libxl: debug: libxl_event.c:1334:egc_run_callbacks: ao 0x7f7ff7b26080: progress report: callback aop=0x7f7ff7b24bf0 --- > libxl: debug: libxl_event.c:1334:egc_run_callbacks: ao 0x7f7ff7b26080: progress report: callback aop=0x7f7ff7b24e30 109,132c109,112 < Loaded initial symtab at 0xc09cddd8, strtab at 0xc0a0441c, # entries 12976 < Copyright (c) 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005, < 2006, 2007, 2008, 2009, 2010 < The NetBSD Foundation, Inc. All rights reserved. < Copyright (c) 1982, 1986, 1989, 1991, 1993 < The Regents of the University of California. All rights reserved. < < NetBSD 5.2.3 (INSTALL_XEN3PAE_DOMU) #0: Sat Nov 15 21:36:21 UTC 2014 < builds%b44.netbsd.org@localhost:/home/builds/ab/netbsd-5-2-3-RELEASE/i386/201411152021Z-obj/home/source/ab/netbsd-5-2-3-RELEASE/src/sys/arch/i386/compile/INSTALL_XEN3PAE_DOMU < total memory = 2000 MB < avail memory = 1951 MB < mainbus0 (root) < hypervisor0 at mainbus0: Xen version 4.5.0 < vcpu0 at hypervisor0: Intel 686-class, 2826MHz, id 0x10676 < xenbus0 at hypervisor0: Xen Virtual Bus Interface < xencons0 at hypervisor0: Xen Virtual Console Driver < xencons0: using event channel 2 < npx0 at hypervisor0: using exception 16 < xenbus: can't get state for device/suspend/event-channel (2) < xennet0 at xenbus0 id 0: Xen Virtual Network Interface < xennet0: MAC address 00:16:3e:1d:82:f9 < Kernelized RAIDframe activated < boot device: <unknown> < root device (default md0a): xc: debug: hypercall buffer: total allocations:195 total releases:195 --- > libxl: error: libxl_dom.c:36:libxl__domain_type: unable to get domain type for domid=10 > xl: unable to exec console client: No such file or directory > libxl: error: libxl_exec.c:118:libxl_report_child_exitstatus: console child [3419] exited with error status 1 > xc: debug: hypercall buffer: total allocations:195 total releases:195 136,137c116 < 19:11 [1.764] # xl destroy nbtest < 19:11 [1.765] # --- > 19:11 [1.767] # -- Greg A. Woods Planix, Inc. <woods%planix.com@localhost> +1 250 762-7675 http://www.planix.com/
Attachment:
pgpROArhZn4Ac.pgp
Description: PGP signature