====== Running PV grub from within domU ====== Tested with Debian Jessie in both dom0 and domU With information from here \\ http://www.hellion.org.uk/blog/posts/debian-pvgrub2/ With Jessie, install grub-xen-host in your domain 0 and grub-xen in your PV guests then in your guest configuration, depending on whether you want a 32- or 64-bit PV guest write either: kernel = "/usr/lib/grub-xen/grub-i386-xen.bin" or kernel = "/usr/lib/grub-xen/grub-x86_64-xen.bin" (instead of bootloader = ... or other kernel = ..., also omit ramdisk = ... and any command line related stuff (e.g. root = ..., extra = ..., cmdline = ... ) and your guests will boot using Grub 2, much like on native. Seems to be unstable with i386 bigbang:/etc/xen# xl create -c /etc/xen/pbx Parsing config from /etc/xen/pbx libxl: error: libxl_dom.c:35:libxl__domain_type: unable to get domain type for domid=137 Unable to attach console libxl: error: libxl_exec.c:118:libxl_report_child_exitstatus: console child [0] exited with error status 1 bigbang:/etc/xen# xl create -c /etc/xen/pbx Parsing config from /etc/xen/pbx libxl: error: libxl_dom.c:35:libxl__domain_type: unable to get domain type for domid=138 Unable to attach console libxl: error: libxl_exec.c:118:libxl_report_child_exitstatus: console child [0] exited with error status 1 bigbang:/etc/xen# xl create -c /etc/xen/pbx And suddenly it works.. A workaround for this seems to be removing /boot/xen/* as then it is not possible to chainload the domU grub and the grub that was loaded from dom0 reads grub.cfg and finishes the boot (now working all the time..) A drawback is then of course that you are stuck with the functionality that resides in the dom0 grub version bigbang:/etc/xen# xl -vvv create /etc/xen/pbx Parsing config from /etc/xen/pbx libxl: debug: libxl_create.c:1342:do_domain_create: ao 0x72a8b0: create: how=(nil) callback=(nil) poller=0x728c60 libxl: verbose: libxl_create.c:134:libxl__domain_build_info_setdefault: qemu-xen is unavailable, use qemu-xen-traditional instead: No such file or directory libxl: debug: libxl_device.c:251:libxl__device_disk_set_backend: Disk vdev=xvda spec.backend=unknown libxl: debug: libxl_device.c:286:libxl__device_disk_set_backend: Disk vdev=xvda, using backend phy libxl: debug: libxl_device.c:251:libxl__device_disk_set_backend: Disk vdev=xvdb spec.backend=unknown libxl: debug: libxl_device.c:286:libxl__device_disk_set_backend: Disk vdev=xvdb, using backend phy libxl: debug: libxl_create.c:797:initiate_domain_create: running bootloader libxl: debug: libxl_bootloader.c:327:libxl__bootloader_run: no bootloader configured, using user supplied kernel libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x72ac98: deregister unregistered domainbuilder: detail: xc_dom_allocate: cmdline="", features="(null)" libxl: debug: libxl_dom.c:357:libxl__build_pv: pv kernel mapped 0 path /usr/lib/grub-xen/grub-i386-xen.bin domainbuilder: detail: xc_dom_kernel_file: filename="/usr/lib/grub-xen/grub-i386-xen.bin" domainbuilder: detail: xc_dom_malloc_filemap : 1444 kB domainbuilder: detail: xc_dom_boot_xen_init: ver 4.4, caps xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64 domainbuilder: detail: xc_dom_parse_image: called domainbuilder: detail: xc_dom_find_loader: trying multiboot-binary loader ... domainbuilder: detail: loader probe failed domainbuilder: detail: xc_dom_find_loader: trying Linux bzImage loader ... domainbuilder: detail: xc_dom_probe_bzimage_kernel: kernel is not a bzImage domainbuilder: detail: loader probe failed domainbuilder: detail: xc_dom_find_loader: trying ELF-generic loader ... domainbuilder: detail: loader probe OK xc: detail: elf_parse_binary: phdr: paddr=0x0 memsz=0x415774 xc: detail: elf_parse_binary: phdr: paddr=0x415778 memsz=0x15d4ac xc: detail: elf_parse_binary: memory: 0x0 -> 0x572c24 xc: detail: elf_xen_parse_note: GUEST_OS = "GRUB" xc: detail: elf_xen_parse_note: LOADER = "generic" xc: detail: elf_xen_parse_note: XEN_VERSION = "xen-3.0" xc: detail: elf_xen_parse_note: ENTRY = 0x0 xc: detail: elf_xen_parse_note: VIRT_BASE = 0x0 xc: detail: elf_xen_parse_note: PAE_MODE = "yes" xc: detail: elf_xen_addr_calc_check: ELF_PADDR_OFFSET unset, using 0x0 xc: detail: elf_xen_addr_calc_check: addresses: xc: detail: virt_base = 0x0 xc: detail: elf_paddr_offset = 0x0 xc: detail: virt_offset = 0x0 xc: detail: virt_kstart = 0x0 xc: detail: virt_kend = 0x572c24 xc: detail: virt_entry = 0x0 xc: detail: p2m_base = 0xffffffffffffffff domainbuilder: detail: xc_dom_parse_elf_kernel: xen-3.0-x86_32p: 0x0 -> 0x572c24 domainbuilder: detail: xc_dom_mem_init: mem 128 MB, pages 0x8000 pages, 4k each domainbuilder: detail: xc_dom_mem_init: 0x8000 pages domainbuilder: detail: xc_dom_boot_mem_init: called domainbuilder: detail: x86_compat: guest xen-3.0-x86_32p, address size 32 domainbuilder: detail: xc_dom_malloc : 256 kB domainbuilder: detail: xc_dom_build_image: called domainbuilder: detail: xc_dom_alloc_segment: kernel : 0x0 -> 0x573000 (pfn 0x0 + 0x573 pages) domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x0+0x573 at 0x7f9d278e9000 xc: detail: elf_load_binary: phdr 0 at 0x7f9d278e9000 -> 0x7f9d278f3dc7 xc: detail: elf_load_binary: phdr 2 at 0x7f9d27cfe778 -> 0x7f9d27e5bc24 domainbuilder: detail: xc_dom_alloc_segment: phys2mach : 0x573000 -> 0x593000 (pfn 0x573 + 0x20 pages) domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x573+0x20 at 0x7f9d29b90000 domainbuilder: detail: xc_dom_alloc_page : start info : 0x593000 (pfn 0x593) domainbuilder: detail: xc_dom_alloc_page : xenstore : 0x594000 (pfn 0x594) domainbuilder: detail: xc_dom_alloc_page : console : 0x595000 (pfn 0x595) domainbuilder: detail: nr_page_tables: 0x00000000ffffffff/32: 0x0000000000000000 -> 0x00000000ffffffff, 1 table(s) domainbuilder: detail: nr_page_tables: 0x000000003fffffff/30: 0x0000000000000000 -> 0x000000003fffffff, 1 table(s) domainbuilder: detail: nr_page_tables: 0x00000000001fffff/21: 0x0000000000000000 -> 0x00000000007fffff, 4 table(s) domainbuilder: detail: count_pgtables: PAE: extra l2 page table for l3#3 domainbuilder: detail: xc_dom_alloc_segment: page tables : 0x596000 -> 0x59d000 (pfn 0x596 + 0x7 pages) domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x596+0x7 at 0x7f9d29b89000 domainbuilder: detail: xc_dom_alloc_page : boot stack : 0x59d000 (pfn 0x59d) domainbuilder: detail: xc_dom_build_image : virt_alloc_end : 0x59e000 domainbuilder: detail: xc_dom_build_image : virt_pgtab_end : 0x800000 domainbuilder: detail: xc_dom_boot_image: called domainbuilder: detail: arch_setup_bootearly: doing nothing domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-3.0-x86_64 domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-3.0-x86_32p <= matches domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_32 domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_32p domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_64 domainbuilder: detail: xc_dom_update_guest_p2m: dst 32bit, pages 0x8000 domainbuilder: detail: setup_pgtables_x86_32_pae: PAE: extra l2 page table for l3#3 domainbuilder: detail: clear_page: pfn 0x595, mfn 0x2c9f2b domainbuilder: detail: clear_page: pfn 0x594, mfn 0x2c9f2c domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x593+0x1 at 0x7f9d29d63000 domainbuilder: detail: start_info_x86_32: called domainbuilder: detail: domain builder memory footprint domainbuilder: detail: allocated domainbuilder: detail: malloc : 292 kB domainbuilder: detail: anon mmap : 0 bytes domainbuilder: detail: mapped domainbuilder: detail: file mmap : 1444 kB domainbuilder: detail: domU mmap : 5740 kB domainbuilder: detail: arch_setup_bootlate: shared_info: pfn 0x0, mfn 0xcf8e6 domainbuilder: detail: shared_info_x86_32: called domainbuilder: detail: vcpu_x86_32: called domainbuilder: detail: vcpu_x86_32: cr3: pfn 0x596 mfn 0x2c9f2a domainbuilder: detail: launch_vm: called, ctxt=0x7f9d29d64004 domainbuilder: detail: xc_dom_release: called libxl: debug: libxl_device.c:251:libxl__device_disk_set_backend: Disk vdev=xvda spec.backend=phy libxl: debug: libxl_event.c:570:libxl__ev_xswatch_register: watch w=0x72c2f8 wpath=/local/domain/0/backend/vbd/140/51712/state token=3/0: register slotnum=3 libxl: debug: libxl_device.c:251:libxl__device_disk_set_backend: Disk vdev=xvdb spec.backend=phy libxl: debug: libxl_event.c:570:libxl__ev_xswatch_register: watch w=0x72d328 wpath=/local/domain/0/backend/vbd/140/51728/state token=2/1: register slotnum=2 libxl: debug: libxl_create.c:1356:do_domain_create: ao 0x72a8b0: inprogress: poller=0x728c60, flags=i libxl: debug: libxl_event.c:514:watchfd_callback: watch w=0x72c2f8 wpath=/local/domain/0/backend/vbd/140/51712/state token=3/0: event epath=/local/domain/0/backend/vbd/140/51712/state libxl: debug: libxl_event.c:653:devstate_watch_callback: backend /local/domain/0/backend/vbd/140/51712/state wanted state 2 ok libxl: debug: libxl_event.c:606:libxl__ev_xswatch_deregister: watch w=0x72c2f8 wpath=/local/domain/0/backend/vbd/140/51712/state token=3/0: deregister slotnum=3 libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x72c2f8: deregister unregistered libxl: debug: libxl_device.c:1023:device_hotplug: calling hotplug script: /etc/xen/scripts/block add libxl: debug: libxl_event.c:483:watchfd_callback: watch epath=/local/domain/0/backend/vbd/140/51712/state token=3/0: empty slot libxl: debug: libxl_event.c:514:watchfd_callback: watch w=0x72d328 wpath=/local/domain/0/backend/vbd/140/51728/state token=2/1: event epath=/local/domain/0/backend/vbd/140/51728/state libxl: debug: libxl_event.c:653:devstate_watch_callback: backend /local/domain/0/backend/vbd/140/51728/state wanted state 2 ok libxl: debug: libxl_event.c:606:libxl__ev_xswatch_deregister: watch w=0x72d328 wpath=/local/domain/0/backend/vbd/140/51728/state token=2/1: deregister slotnum=2 libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x72d328: deregister unregistered libxl: debug: libxl_device.c:1023:device_hotplug: calling hotplug script: /etc/xen/scripts/block add libxl: debug: libxl_event.c:483:watchfd_callback: watch epath=/local/domain/0/backend/vbd/140/51728/state token=2/1: empty slot libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x72c380: deregister unregistered libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x72c380: deregister unregistered libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x72d3b0: deregister unregistered libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x72d3b0: deregister unregistered libxl: debug: libxl_event.c:570:libxl__ev_xswatch_register: watch w=0x72f2f8 wpath=/local/domain/0/backend/vif/140/0/state token=2/2: register slotnum=2 libxl: debug: libxl_event.c:514:watchfd_callback: watch w=0x72f2f8 wpath=/local/domain/0/backend/vif/140/0/state token=2/2: event epath=/local/domain/0/backend/vif/140/0/state libxl: debug: libxl_event.c:657:devstate_watch_callback: backend /local/domain/0/backend/vif/140/0/state wanted state 2 still waiting state 1 libxl: debug: libxl_event.c:514:watchfd_callback: watch w=0x72f2f8 wpath=/local/domain/0/backend/vif/140/0/state token=2/2: event epath=/local/domain/0/backend/vif/140/0/state libxl: debug: libxl_event.c:653:devstate_watch_callback: backend /local/domain/0/backend/vif/140/0/state wanted state 2 ok libxl: debug: libxl_event.c:606:libxl__ev_xswatch_deregister: watch w=0x72f2f8 wpath=/local/domain/0/backend/vif/140/0/state token=2/2: deregister slotnum=2 libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x72f2f8: deregister unregistered libxl: debug: libxl_device.c:1023:device_hotplug: calling hotplug script: /etc/xen/scripts/vif-bridge online libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x72f380: deregister unregistered libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x72f380: deregister unregistered libxl: debug: libxl_event.c:1761:libxl__ao_progress_report: ao 0x72a8b0: progress report: ignored libxl: debug: libxl_event.c:1591:libxl__ao_complete: ao 0x72a8b0: complete, rc=0 libxl: debug: libxl_event.c:1563:libxl__ao__destroy: ao 0x72a8b0: destroy xc: debug: hypercall buffer: total allocations:224 total releases:224 xc: debug: hypercall buffer: current allocations:0 maximum allocations:3 xc: debug: hypercall buffer: cache current size:2 xc: debug: hypercall buffer: cache hits:217 misses:2 toobig:5 bigbang:/etc/xen# xl list Name ID Mem VCPUs State Time(s) Domain-0 0 488 1 r----- 32160.9 matrix 1 1024 2 -b---- 34228.8 squid 118 768 2 -b---- 25.6 xenfw1 126 256 1 -b---- 20.5 apache 127 384 1 -b---- 14.4 monitor 130 384 1 -b---- 26.7 bigbang:/etc/xen# xl list bigbang:/etc/xen# xl -vvv create /etc/xen/pbx Parsing config from /etc/xen/pbx libxl: debug: libxl_create.c:1342:do_domain_create: ao 0x1d9b8b0: create: how=(nil) callback=(nil) poller=0x1d99c60 libxl: verbose: libxl_create.c:134:libxl__domain_build_info_setdefault: qemu-xen is unavailable, use qemu-xen-traditional instead: No such file or directory libxl: debug: libxl_device.c:251:libxl__device_disk_set_backend: Disk vdev=xvda spec.backend=unknown libxl: debug: libxl_device.c:286:libxl__device_disk_set_backend: Disk vdev=xvda, using backend phy libxl: debug: libxl_device.c:251:libxl__device_disk_set_backend: Disk vdev=xvdb spec.backend=unknown libxl: debug: libxl_device.c:286:libxl__device_disk_set_backend: Disk vdev=xvdb, using backend phy libxl: debug: libxl_create.c:797:initiate_domain_create: running bootloader libxl: debug: libxl_bootloader.c:327:libxl__bootloader_run: no bootloader configured, using user supplied kernel libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x1d9bc98: deregister unregistered domainbuilder: detail: xc_dom_allocate: cmdline="", features="(null)" libxl: debug: libxl_dom.c:357:libxl__build_pv: pv kernel mapped 0 path /usr/lib/grub-xen/grub-i386-xen.bin domainbuilder: detail: xc_dom_kernel_file: filename="/usr/lib/grub-xen/grub-i386-xen.bin" domainbuilder: detail: xc_dom_malloc_filemap : 1444 kB domainbuilder: detail: xc_dom_boot_xen_init: ver 4.4, caps xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64 domainbuilder: detail: xc_dom_parse_image: called domainbuilder: detail: xc_dom_find_loader: trying multiboot-binary loader ... domainbuilder: detail: loader probe failed domainbuilder: detail: xc_dom_find_loader: trying Linux bzImage loader ... domainbuilder: detail: xc_dom_probe_bzimage_kernel: kernel is not a bzImage domainbuilder: detail: loader probe failed domainbuilder: detail: xc_dom_find_loader: trying ELF-generic loader ... domainbuilder: detail: loader probe OK xc: detail: elf_parse_binary: phdr: paddr=0x0 memsz=0x415774 xc: detail: elf_parse_binary: phdr: paddr=0x415778 memsz=0x15d4ac xc: detail: elf_parse_binary: memory: 0x0 -> 0x572c24 xc: detail: elf_xen_parse_note: GUEST_OS = "GRUB" xc: detail: elf_xen_parse_note: LOADER = "generic" xc: detail: elf_xen_parse_note: XEN_VERSION = "xen-3.0" xc: detail: elf_xen_parse_note: ENTRY = 0x0 xc: detail: elf_xen_parse_note: VIRT_BASE = 0x0 xc: detail: elf_xen_parse_note: PAE_MODE = "yes" xc: detail: elf_xen_addr_calc_check: ELF_PADDR_OFFSET unset, using 0x0 xc: detail: elf_xen_addr_calc_check: addresses: xc: detail: virt_base = 0x0 xc: detail: elf_paddr_offset = 0x0 xc: detail: virt_offset = 0x0 xc: detail: virt_kstart = 0x0 xc: detail: virt_kend = 0x572c24 xc: detail: virt_entry = 0x0 xc: detail: p2m_base = 0xffffffffffffffff domainbuilder: detail: xc_dom_parse_elf_kernel: xen-3.0-x86_32p: 0x0 -> 0x572c24 domainbuilder: detail: xc_dom_mem_init: mem 128 MB, pages 0x8000 pages, 4k each domainbuilder: detail: xc_dom_mem_init: 0x8000 pages domainbuilder: detail: xc_dom_boot_mem_init: called domainbuilder: detail: x86_compat: guest xen-3.0-x86_32p, address size 32 domainbuilder: detail: xc_dom_malloc : 256 kB domainbuilder: detail: xc_dom_build_image: called domainbuilder: detail: xc_dom_alloc_segment: kernel : 0x0 -> 0x573000 (pfn 0x0 + 0x573 pages) domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x0+0x573 at 0x7f0caa16a000 xc: detail: elf_load_binary: phdr 0 at 0x7f0caa16a000 -> 0x7f0caa174dc7 xc: detail: elf_load_binary: phdr 2 at 0x7f0caa57f778 -> 0x7f0caa6dcc24 domainbuilder: detail: xc_dom_alloc_segment: phys2mach : 0x573000 -> 0x593000 (pfn 0x573 + 0x20 pages) domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x573+0x20 at 0x7f0cac411000 domainbuilder: detail: xc_dom_alloc_page : start info : 0x593000 (pfn 0x593) domainbuilder: detail: xc_dom_alloc_page : xenstore : 0x594000 (pfn 0x594) domainbuilder: detail: xc_dom_alloc_page : console : 0x595000 (pfn 0x595) domainbuilder: detail: nr_page_tables: 0x00000000ffffffff/32: 0x0000000000000000 -> 0x00000000ffffffff, 1 table(s) domainbuilder: detail: nr_page_tables: 0x000000003fffffff/30: 0x0000000000000000 -> 0x000000003fffffff, 1 table(s) domainbuilder: detail: nr_page_tables: 0x00000000001fffff/21: 0x0000000000000000 -> 0x00000000007fffff, 4 table(s) domainbuilder: detail: count_pgtables: PAE: extra l2 page table for l3#3 domainbuilder: detail: xc_dom_alloc_segment: page tables : 0x596000 -> 0x59d000 (pfn 0x596 + 0x7 pages) domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x596+0x7 at 0x7f0cac40a000 domainbuilder: detail: xc_dom_alloc_page : boot stack : 0x59d000 (pfn 0x59d) domainbuilder: detail: xc_dom_build_image : virt_alloc_end : 0x59e000 domainbuilder: detail: xc_dom_build_image : virt_pgtab_end : 0x800000 domainbuilder: detail: xc_dom_boot_image: called domainbuilder: detail: arch_setup_bootearly: doing nothing domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-3.0-x86_64 domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-3.0-x86_32p <= matches domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_32 domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_32p domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_64 domainbuilder: detail: xc_dom_update_guest_p2m: dst 32bit, pages 0x8000 domainbuilder: detail: setup_pgtables_x86_32_pae: PAE: extra l2 page table for l3#3 domainbuilder: detail: clear_page: pfn 0x595, mfn 0x31743b domainbuilder: detail: clear_page: pfn 0x594, mfn 0x31743c domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x593+0x1 at 0x7f0cac5e4000 domainbuilder: detail: start_info_x86_32: called domainbuilder: detail: domain builder memory footprint domainbuilder: detail: allocated domainbuilder: detail: malloc : 292 kB domainbuilder: detail: anon mmap : 0 bytes domainbuilder: detail: mapped domainbuilder: detail: file mmap : 1444 kB domainbuilder: detail: domU mmap : 5740 kB domainbuilder: detail: arch_setup_bootlate: shared_info: pfn 0x0, mfn 0xcf8e9 domainbuilder: detail: shared_info_x86_32: called domainbuilder: detail: vcpu_x86_32: called domainbuilder: detail: vcpu_x86_32: cr3: pfn 0x596 mfn 0x31743a domainbuilder: detail: launch_vm: called, ctxt=0x7f0cac5e5004 domainbuilder: detail: xc_dom_release: called libxl: debug: libxl_device.c:251:libxl__device_disk_set_backend: Disk vdev=xvda spec.backend=phy libxl: debug: libxl_event.c:570:libxl__ev_xswatch_register: watch w=0x1d9d2f8 wpath=/local/domain/0/backend/vbd/141/51712/state token=3/0: register slotnum=3 libxl: debug: libxl_device.c:251:libxl__device_disk_set_backend: Disk vdev=xvdb spec.backend=phy libxl: debug: libxl_event.c:570:libxl__ev_xswatch_register: watch w=0x1d9e328 wpath=/local/domain/0/backend/vbd/141/51728/state token=2/1: register slotnum=2 libxl: debug: libxl_create.c:1356:do_domain_create: ao 0x1d9b8b0: inprogress: poller=0x1d99c60, flags=i libxl: debug: libxl_event.c:514:watchfd_callback: watch w=0x1d9d2f8 wpath=/local/domain/0/backend/vbd/141/51712/state token=3/0: event epath=/local/domain/0/backend/vbd/141/51712/state libxl: debug: libxl_event.c:653:devstate_watch_callback: backend /local/domain/0/backend/vbd/141/51712/state wanted state 2 ok libxl: debug: libxl_event.c:606:libxl__ev_xswatch_deregister: watch w=0x1d9d2f8 wpath=/local/domain/0/backend/vbd/141/51712/state token=3/0: deregister slotnum=3 libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x1d9d2f8: deregister unregistered libxl: debug: libxl_device.c:1023:device_hotplug: calling hotplug script: /etc/xen/scripts/block add libxl: debug: libxl_event.c:483:watchfd_callback: watch epath=/local/domain/0/backend/vbd/141/51712/state token=3/0: empty slot libxl: debug: libxl_event.c:514:watchfd_callback: watch w=0x1d9e328 wpath=/local/domain/0/backend/vbd/141/51728/state token=2/1: event epath=/local/domain/0/backend/vbd/141/51728/state libxl: debug: libxl_event.c:653:devstate_watch_callback: backend /local/domain/0/backend/vbd/141/51728/state wanted state 2 ok libxl: debug: libxl_event.c:606:libxl__ev_xswatch_deregister: watch w=0x1d9e328 wpath=/local/domain/0/backend/vbd/141/51728/state token=2/1: deregister slotnum=2 libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x1d9e328: deregister unregistered libxl: debug: libxl_device.c:1023:device_hotplug: calling hotplug script: /etc/xen/scripts/block add libxl: debug: libxl_event.c:483:watchfd_callback: watch epath=/local/domain/0/backend/vbd/141/51728/state token=2/1: empty slot libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x1d9d380: deregister unregistered libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x1d9d380: deregister unregistered libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x1d9e3b0: deregister unregistered libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x1d9e3b0: deregister unregistered libxl: debug: libxl_event.c:570:libxl__ev_xswatch_register: watch w=0x1da02f8 wpath=/local/domain/0/backend/vif/141/0/state token=2/2: register slotnum=2 libxl: debug: libxl_event.c:514:watchfd_callback: watch w=0x1da02f8 wpath=/local/domain/0/backend/vif/141/0/state token=2/2: event epath=/local/domain/0/backend/vif/141/0/state libxl: debug: libxl_event.c:657:devstate_watch_callback: backend /local/domain/0/backend/vif/141/0/state wanted state 2 still waiting state 1 libxl: debug: libxl_event.c:514:watchfd_callback: watch w=0x1da02f8 wpath=/local/domain/0/backend/vif/141/0/state token=2/2: event epath=/local/domain/0/backend/vif/141/0/state libxl: debug: libxl_event.c:653:devstate_watch_callback: backend /local/domain/0/backend/vif/141/0/state wanted state 2 ok libxl: debug: libxl_event.c:606:libxl__ev_xswatch_deregister: watch w=0x1da02f8 wpath=/local/domain/0/backend/vif/141/0/state token=2/2: deregister slotnum=2 libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x1da02f8: deregister unregistered libxl: debug: libxl_device.c:1023:device_hotplug: calling hotplug script: /etc/xen/scripts/vif-bridge online libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x1da0380: deregister unregistered libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x1da0380: deregister unregistered libxl: debug: libxl_event.c:1761:libxl__ao_progress_report: ao 0x1d9b8b0: progress report: ignored libxl: debug: libxl_event.c:1591:libxl__ao_complete: ao 0x1d9b8b0: complete, rc=0 libxl: debug: libxl_event.c:1563:libxl__ao__destroy: ao 0x1d9b8b0: destroy xc: debug: hypercall buffer: total allocations:224 total releases:224 xc: debug: hypercall buffer: current allocations:0 maximum allocations:3 xc: debug: hypercall buffer: cache current size:2 xc: debug: hypercall buffer: cache hits:217 misses:2 toobig:5 bigbang:/etc/xen# xl list Name ID Mem VCPUs State Time(s) Domain-0 0 488 1 r----- 32162.0 matrix 1 1024 2 -b---- 34229.3 squid 118 768 2 -b---- 25.7 xenfw1 126 256 1 -b---- 20.8 apache 127 384 1 -b---- 14.6 monitor 130 384 1 -b---- 28.6 pbx 141 128 1 r----- 1.8 bigbang:/etc/xen# xl list (XEN) d140:v0: unhandled page fault (ec=0010) (XEN) Pagetable walk from 0000000000000000: (XEN) L4[0x000] = 0000000327e28027 000000000000043c (XEN) L3[0x000] = 00000002c1b6f027 000000000000043d (XEN) L2[0x000] = 00000003150f5023 0000000000000441 (XEN) L1[0x000] = 0000000000000000 ffffffffffffffff (XEN) domain_crash_sync called from entry.S: fault at ffff82d08021feb0 compat_create_bounce_frame+0xc6/0xde (XEN) Domain 140 (vcpu#0) crashed on cpu#3: (XEN) ----[ Xen-4.4.1 x86_64 debug=n Not tainted ]---- (XEN) CPU: 3 (XEN) RIP: e019:[<0000000000000000>] (XEN) RFLAGS: 0000000000000246 EM: 1 CONTEXT: pv guest (XEN) rax: 0000000000000000 rbx: 0000000000000000 rcx: 0000000000000000 (XEN) rdx: 0000000000000000 rsi: 0000000000439000 rdi: 0000000000800000 (XEN) rbp: 000000000000000a rsp: 0000000000545ff0 r8: 0000000000000000 (XEN) r9: 0000000000000000 r10: ffff83031d464000 r11: ffff83031d464000 (XEN) r12: 00047e9fc6135fb2 r13: ffff82d080300800 r14: ffff82d0802ea940 (XEN) r15: ffff8300cf8f0000 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) cr3: 0000000317d44000 cr2: 0000000000000000 (XEN) ds: e021 es: e021 fs: e021 gs: e021 ss: e021 cs: e019 (XEN) Guest stack trace from esp=00545ff0: (XEN) 00000010 00000000 0001e019 00010046 0000fae9 b9cb8900 0000000a 038bd231 (XEN) fffffce8 85c389ff d7840fc0 e8000000 fffffffc fffffce8 0004a3ff 3f830000 (XEN) a11f7400 00000004 fffffce8 535252ff 00001668 fffce800 fce8ffff 83ffffff (XEN) 7f8310c4 68740008 fffffce8 e04589ff e8e45589 fffffffc 1be0452b fa83e455 (XEN) 3d577700 000003e7 158b5077 00000000 0474d285 d2ffc031 0000358b d2310000 (XEN) 1774f685 85184e8b 890c74c9 f089dc55 558bd1ff 8bc209dc 85e5eb36 800578d2 (XEN) 467503e2 fffffce8 1bf883ff 3aeba575 0003e8b8 fffce800 0f4bffff ffff5d85 (XEN) 003f83ff 04a12074 e8000000 fffffffc 006a5050 00001668 fffce800 fce8ffff (XEN) 83ffffff c03110c4 01b805eb 8d000000 5e5bf465 55c35d5f ec83e589 0000680c (XEN) 23680000 68000000 0000004b 00bac931 b8000000 0000001d fffffce8 0000a3ff (XEN) c9580000 e58955c3 000000a1 fce95d00 00ffffff 0000005d 00000076 00000000 (XEN) 00000065 00000000 00000000 00000078 00000069 00000000 00000086 00000000 (XEN) 00000000 00000000 00000000 00000000 00000000 00000000 00000000 20656e6f (XEN) 75677261 746e656d 70786520 65746365 64250064 20202020 656c7300 57007065 (XEN) 20746961 20726f66 70732061 66696365 20646569 626d756e 6f207265 65732066 (XEN) 646e6f63 4e002e73 45424d55 464f5f52 4345535f 53444e4f 72657600 65736f62 (XEN) 72655600 65736f62 756f6320 6f64746e 002e6e77 65746e69 70757272 6c626974 (XEN) 6c410065 20776f6c 69206f74 7265746e 74707572 74697720 53452068 00002e43 (XEN) 4543494c 3d45534e 764c5047 00002b33 6d726f6e 73006c61 7065656c 732e0000 (XEN) 61746d79 732e0062 61747274 732e0062 72747368 00626174 6c65722e 7865742e (XEN) traps.c:2514:d141 Domain attempted WRMSR 00000000c0010004 from 0x0000000000000000 to 0x000000000000ffff.