====== Running PV grub from within domU ======
Tested with Debian Jessie in both dom0 and domU
With information from here \\
http://www.hellion.org.uk/blog/posts/debian-pvgrub2/
With Jessie, install grub-xen-host in your domain 0 and grub-xen in your PV guests then in your guest configuration, depending on whether you want a 32- or 64-bit PV guest write either:
kernel = "/usr/lib/grub-xen/grub-i386-xen.bin"
or
kernel = "/usr/lib/grub-xen/grub-x86_64-xen.bin"
(instead of bootloader = ... or other kernel = ..., also omit ramdisk = ... and any command line related stuff (e.g. root = ..., extra = ..., cmdline = ... ) and your guests will boot using Grub 2, much like on native.
Seems to be unstable with i386
bigbang:/etc/xen# xl create -c /etc/xen/pbx
Parsing config from /etc/xen/pbx
libxl: error: libxl_dom.c:35:libxl__domain_type: unable to get domain type for domid=137
Unable to attach console
libxl: error: libxl_exec.c:118:libxl_report_child_exitstatus: console child [0] exited with error status 1
bigbang:/etc/xen# xl create -c /etc/xen/pbx
Parsing config from /etc/xen/pbx
libxl: error: libxl_dom.c:35:libxl__domain_type: unable to get domain type for domid=138
Unable to attach console
libxl: error: libxl_exec.c:118:libxl_report_child_exitstatus: console child [0] exited with error status 1
bigbang:/etc/xen# xl create -c /etc/xen/pbx
And suddenly it works..
A workaround for this seems to be removing /boot/xen/* as then it is not possible to chainload the domU grub
and the grub that was loaded from dom0 reads grub.cfg and finishes the boot (now working all the time..)
A drawback is then of course that you are stuck with the functionality that resides in the dom0 grub version
bigbang:/etc/xen# xl -vvv create /etc/xen/pbx
Parsing config from /etc/xen/pbx
libxl: debug: libxl_create.c:1342:do_domain_create: ao 0x72a8b0: create: how=(nil) callback=(nil) poller=0x728c60
libxl: verbose: libxl_create.c:134:libxl__domain_build_info_setdefault: qemu-xen is unavailable, use qemu-xen-traditional instead: No such file or directory
libxl: debug: libxl_device.c:251:libxl__device_disk_set_backend: Disk vdev=xvda spec.backend=unknown
libxl: debug: libxl_device.c:286:libxl__device_disk_set_backend: Disk vdev=xvda, using backend phy
libxl: debug: libxl_device.c:251:libxl__device_disk_set_backend: Disk vdev=xvdb spec.backend=unknown
libxl: debug: libxl_device.c:286:libxl__device_disk_set_backend: Disk vdev=xvdb, using backend phy
libxl: debug: libxl_create.c:797:initiate_domain_create: running bootloader
libxl: debug: libxl_bootloader.c:327:libxl__bootloader_run: no bootloader configured, using user supplied kernel
libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x72ac98: deregister unregistered
domainbuilder: detail: xc_dom_allocate: cmdline="", features="(null)"
libxl: debug: libxl_dom.c:357:libxl__build_pv: pv kernel mapped 0 path /usr/lib/grub-xen/grub-i386-xen.bin
domainbuilder: detail: xc_dom_kernel_file: filename="/usr/lib/grub-xen/grub-i386-xen.bin"
domainbuilder: detail: xc_dom_malloc_filemap : 1444 kB
domainbuilder: detail: xc_dom_boot_xen_init: ver 4.4, caps xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64
domainbuilder: detail: xc_dom_parse_image: called
domainbuilder: detail: xc_dom_find_loader: trying multiboot-binary loader ...
domainbuilder: detail: loader probe failed
domainbuilder: detail: xc_dom_find_loader: trying Linux bzImage loader ...
domainbuilder: detail: xc_dom_probe_bzimage_kernel: kernel is not a bzImage
domainbuilder: detail: loader probe failed
domainbuilder: detail: xc_dom_find_loader: trying ELF-generic loader ...
domainbuilder: detail: loader probe OK
xc: detail: elf_parse_binary: phdr: paddr=0x0 memsz=0x415774
xc: detail: elf_parse_binary: phdr: paddr=0x415778 memsz=0x15d4ac
xc: detail: elf_parse_binary: memory: 0x0 -> 0x572c24
xc: detail: elf_xen_parse_note: GUEST_OS = "GRUB"
xc: detail: elf_xen_parse_note: LOADER = "generic"
xc: detail: elf_xen_parse_note: XEN_VERSION = "xen-3.0"
xc: detail: elf_xen_parse_note: ENTRY = 0x0
xc: detail: elf_xen_parse_note: VIRT_BASE = 0x0
xc: detail: elf_xen_parse_note: PAE_MODE = "yes"
xc: detail: elf_xen_addr_calc_check: ELF_PADDR_OFFSET unset, using 0x0
xc: detail: elf_xen_addr_calc_check: addresses:
xc: detail: virt_base = 0x0
xc: detail: elf_paddr_offset = 0x0
xc: detail: virt_offset = 0x0
xc: detail: virt_kstart = 0x0
xc: detail: virt_kend = 0x572c24
xc: detail: virt_entry = 0x0
xc: detail: p2m_base = 0xffffffffffffffff
domainbuilder: detail: xc_dom_parse_elf_kernel: xen-3.0-x86_32p: 0x0 -> 0x572c24
domainbuilder: detail: xc_dom_mem_init: mem 128 MB, pages 0x8000 pages, 4k each
domainbuilder: detail: xc_dom_mem_init: 0x8000 pages
domainbuilder: detail: xc_dom_boot_mem_init: called
domainbuilder: detail: x86_compat: guest xen-3.0-x86_32p, address size 32
domainbuilder: detail: xc_dom_malloc : 256 kB
domainbuilder: detail: xc_dom_build_image: called
domainbuilder: detail: xc_dom_alloc_segment: kernel : 0x0 -> 0x573000 (pfn 0x0 + 0x573 pages)
domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x0+0x573 at 0x7f9d278e9000
xc: detail: elf_load_binary: phdr 0 at 0x7f9d278e9000 -> 0x7f9d278f3dc7
xc: detail: elf_load_binary: phdr 2 at 0x7f9d27cfe778 -> 0x7f9d27e5bc24
domainbuilder: detail: xc_dom_alloc_segment: phys2mach : 0x573000 -> 0x593000 (pfn 0x573 + 0x20 pages)
domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x573+0x20 at 0x7f9d29b90000
domainbuilder: detail: xc_dom_alloc_page : start info : 0x593000 (pfn 0x593)
domainbuilder: detail: xc_dom_alloc_page : xenstore : 0x594000 (pfn 0x594)
domainbuilder: detail: xc_dom_alloc_page : console : 0x595000 (pfn 0x595)
domainbuilder: detail: nr_page_tables: 0x00000000ffffffff/32: 0x0000000000000000 -> 0x00000000ffffffff, 1 table(s)
domainbuilder: detail: nr_page_tables: 0x000000003fffffff/30: 0x0000000000000000 -> 0x000000003fffffff, 1 table(s)
domainbuilder: detail: nr_page_tables: 0x00000000001fffff/21: 0x0000000000000000 -> 0x00000000007fffff, 4 table(s)
domainbuilder: detail: count_pgtables: PAE: extra l2 page table for l3#3
domainbuilder: detail: xc_dom_alloc_segment: page tables : 0x596000 -> 0x59d000 (pfn 0x596 + 0x7 pages)
domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x596+0x7 at 0x7f9d29b89000
domainbuilder: detail: xc_dom_alloc_page : boot stack : 0x59d000 (pfn 0x59d)
domainbuilder: detail: xc_dom_build_image : virt_alloc_end : 0x59e000
domainbuilder: detail: xc_dom_build_image : virt_pgtab_end : 0x800000
domainbuilder: detail: xc_dom_boot_image: called
domainbuilder: detail: arch_setup_bootearly: doing nothing
domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-3.0-x86_64
domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-3.0-x86_32p <= matches
domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_32
domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_32p
domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_64
domainbuilder: detail: xc_dom_update_guest_p2m: dst 32bit, pages 0x8000
domainbuilder: detail: setup_pgtables_x86_32_pae: PAE: extra l2 page table for l3#3
domainbuilder: detail: clear_page: pfn 0x595, mfn 0x2c9f2b
domainbuilder: detail: clear_page: pfn 0x594, mfn 0x2c9f2c
domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x593+0x1 at 0x7f9d29d63000
domainbuilder: detail: start_info_x86_32: called
domainbuilder: detail: domain builder memory footprint
domainbuilder: detail: allocated
domainbuilder: detail: malloc : 292 kB
domainbuilder: detail: anon mmap : 0 bytes
domainbuilder: detail: mapped
domainbuilder: detail: file mmap : 1444 kB
domainbuilder: detail: domU mmap : 5740 kB
domainbuilder: detail: arch_setup_bootlate: shared_info: pfn 0x0, mfn 0xcf8e6
domainbuilder: detail: shared_info_x86_32: called
domainbuilder: detail: vcpu_x86_32: called
domainbuilder: detail: vcpu_x86_32: cr3: pfn 0x596 mfn 0x2c9f2a
domainbuilder: detail: launch_vm: called, ctxt=0x7f9d29d64004
domainbuilder: detail: xc_dom_release: called
libxl: debug: libxl_device.c:251:libxl__device_disk_set_backend: Disk vdev=xvda spec.backend=phy
libxl: debug: libxl_event.c:570:libxl__ev_xswatch_register: watch w=0x72c2f8 wpath=/local/domain/0/backend/vbd/140/51712/state token=3/0: register slotnum=3
libxl: debug: libxl_device.c:251:libxl__device_disk_set_backend: Disk vdev=xvdb spec.backend=phy
libxl: debug: libxl_event.c:570:libxl__ev_xswatch_register: watch w=0x72d328 wpath=/local/domain/0/backend/vbd/140/51728/state token=2/1: register slotnum=2
libxl: debug: libxl_create.c:1356:do_domain_create: ao 0x72a8b0: inprogress: poller=0x728c60, flags=i
libxl: debug: libxl_event.c:514:watchfd_callback: watch w=0x72c2f8 wpath=/local/domain/0/backend/vbd/140/51712/state token=3/0: event epath=/local/domain/0/backend/vbd/140/51712/state
libxl: debug: libxl_event.c:653:devstate_watch_callback: backend /local/domain/0/backend/vbd/140/51712/state wanted state 2 ok
libxl: debug: libxl_event.c:606:libxl__ev_xswatch_deregister: watch w=0x72c2f8 wpath=/local/domain/0/backend/vbd/140/51712/state token=3/0: deregister slotnum=3
libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x72c2f8: deregister unregistered
libxl: debug: libxl_device.c:1023:device_hotplug: calling hotplug script: /etc/xen/scripts/block add
libxl: debug: libxl_event.c:483:watchfd_callback: watch epath=/local/domain/0/backend/vbd/140/51712/state token=3/0: empty slot
libxl: debug: libxl_event.c:514:watchfd_callback: watch w=0x72d328 wpath=/local/domain/0/backend/vbd/140/51728/state token=2/1: event epath=/local/domain/0/backend/vbd/140/51728/state
libxl: debug: libxl_event.c:653:devstate_watch_callback: backend /local/domain/0/backend/vbd/140/51728/state wanted state 2 ok
libxl: debug: libxl_event.c:606:libxl__ev_xswatch_deregister: watch w=0x72d328 wpath=/local/domain/0/backend/vbd/140/51728/state token=2/1: deregister slotnum=2
libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x72d328: deregister unregistered
libxl: debug: libxl_device.c:1023:device_hotplug: calling hotplug script: /etc/xen/scripts/block add
libxl: debug: libxl_event.c:483:watchfd_callback: watch epath=/local/domain/0/backend/vbd/140/51728/state token=2/1: empty slot
libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x72c380: deregister unregistered
libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x72c380: deregister unregistered
libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x72d3b0: deregister unregistered
libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x72d3b0: deregister unregistered
libxl: debug: libxl_event.c:570:libxl__ev_xswatch_register: watch w=0x72f2f8 wpath=/local/domain/0/backend/vif/140/0/state token=2/2: register slotnum=2
libxl: debug: libxl_event.c:514:watchfd_callback: watch w=0x72f2f8 wpath=/local/domain/0/backend/vif/140/0/state token=2/2: event epath=/local/domain/0/backend/vif/140/0/state
libxl: debug: libxl_event.c:657:devstate_watch_callback: backend /local/domain/0/backend/vif/140/0/state wanted state 2 still waiting state 1
libxl: debug: libxl_event.c:514:watchfd_callback: watch w=0x72f2f8 wpath=/local/domain/0/backend/vif/140/0/state token=2/2: event epath=/local/domain/0/backend/vif/140/0/state
libxl: debug: libxl_event.c:653:devstate_watch_callback: backend /local/domain/0/backend/vif/140/0/state wanted state 2 ok
libxl: debug: libxl_event.c:606:libxl__ev_xswatch_deregister: watch w=0x72f2f8 wpath=/local/domain/0/backend/vif/140/0/state token=2/2: deregister slotnum=2
libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x72f2f8: deregister unregistered
libxl: debug: libxl_device.c:1023:device_hotplug: calling hotplug script: /etc/xen/scripts/vif-bridge online
libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x72f380: deregister unregistered
libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x72f380: deregister unregistered
libxl: debug: libxl_event.c:1761:libxl__ao_progress_report: ao 0x72a8b0: progress report: ignored
libxl: debug: libxl_event.c:1591:libxl__ao_complete: ao 0x72a8b0: complete, rc=0
libxl: debug: libxl_event.c:1563:libxl__ao__destroy: ao 0x72a8b0: destroy
xc: debug: hypercall buffer: total allocations:224 total releases:224
xc: debug: hypercall buffer: current allocations:0 maximum allocations:3
xc: debug: hypercall buffer: cache current size:2
xc: debug: hypercall buffer: cache hits:217 misses:2 toobig:5
bigbang:/etc/xen# xl list
Name ID Mem VCPUs State Time(s)
Domain-0 0 488 1 r----- 32160.9
matrix 1 1024 2 -b---- 34228.8
squid 118 768 2 -b---- 25.6
xenfw1 126 256 1 -b---- 20.5
apache 127 384 1 -b---- 14.4
monitor 130 384 1 -b---- 26.7
bigbang:/etc/xen# xl list
bigbang:/etc/xen# xl -vvv create /etc/xen/pbx
Parsing config from /etc/xen/pbx
libxl: debug: libxl_create.c:1342:do_domain_create: ao 0x1d9b8b0: create: how=(nil) callback=(nil) poller=0x1d99c60
libxl: verbose: libxl_create.c:134:libxl__domain_build_info_setdefault: qemu-xen is unavailable, use qemu-xen-traditional instead: No such file or directory
libxl: debug: libxl_device.c:251:libxl__device_disk_set_backend: Disk vdev=xvda spec.backend=unknown
libxl: debug: libxl_device.c:286:libxl__device_disk_set_backend: Disk vdev=xvda, using backend phy
libxl: debug: libxl_device.c:251:libxl__device_disk_set_backend: Disk vdev=xvdb spec.backend=unknown
libxl: debug: libxl_device.c:286:libxl__device_disk_set_backend: Disk vdev=xvdb, using backend phy
libxl: debug: libxl_create.c:797:initiate_domain_create: running bootloader
libxl: debug: libxl_bootloader.c:327:libxl__bootloader_run: no bootloader configured, using user supplied kernel
libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x1d9bc98: deregister unregistered
domainbuilder: detail: xc_dom_allocate: cmdline="", features="(null)"
libxl: debug: libxl_dom.c:357:libxl__build_pv: pv kernel mapped 0 path /usr/lib/grub-xen/grub-i386-xen.bin
domainbuilder: detail: xc_dom_kernel_file: filename="/usr/lib/grub-xen/grub-i386-xen.bin"
domainbuilder: detail: xc_dom_malloc_filemap : 1444 kB
domainbuilder: detail: xc_dom_boot_xen_init: ver 4.4, caps xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64
domainbuilder: detail: xc_dom_parse_image: called
domainbuilder: detail: xc_dom_find_loader: trying multiboot-binary loader ...
domainbuilder: detail: loader probe failed
domainbuilder: detail: xc_dom_find_loader: trying Linux bzImage loader ...
domainbuilder: detail: xc_dom_probe_bzimage_kernel: kernel is not a bzImage
domainbuilder: detail: loader probe failed
domainbuilder: detail: xc_dom_find_loader: trying ELF-generic loader ...
domainbuilder: detail: loader probe OK
xc: detail: elf_parse_binary: phdr: paddr=0x0 memsz=0x415774
xc: detail: elf_parse_binary: phdr: paddr=0x415778 memsz=0x15d4ac
xc: detail: elf_parse_binary: memory: 0x0 -> 0x572c24
xc: detail: elf_xen_parse_note: GUEST_OS = "GRUB"
xc: detail: elf_xen_parse_note: LOADER = "generic"
xc: detail: elf_xen_parse_note: XEN_VERSION = "xen-3.0"
xc: detail: elf_xen_parse_note: ENTRY = 0x0
xc: detail: elf_xen_parse_note: VIRT_BASE = 0x0
xc: detail: elf_xen_parse_note: PAE_MODE = "yes"
xc: detail: elf_xen_addr_calc_check: ELF_PADDR_OFFSET unset, using 0x0
xc: detail: elf_xen_addr_calc_check: addresses:
xc: detail: virt_base = 0x0
xc: detail: elf_paddr_offset = 0x0
xc: detail: virt_offset = 0x0
xc: detail: virt_kstart = 0x0
xc: detail: virt_kend = 0x572c24
xc: detail: virt_entry = 0x0
xc: detail: p2m_base = 0xffffffffffffffff
domainbuilder: detail: xc_dom_parse_elf_kernel: xen-3.0-x86_32p: 0x0 -> 0x572c24
domainbuilder: detail: xc_dom_mem_init: mem 128 MB, pages 0x8000 pages, 4k each
domainbuilder: detail: xc_dom_mem_init: 0x8000 pages
domainbuilder: detail: xc_dom_boot_mem_init: called
domainbuilder: detail: x86_compat: guest xen-3.0-x86_32p, address size 32
domainbuilder: detail: xc_dom_malloc : 256 kB
domainbuilder: detail: xc_dom_build_image: called
domainbuilder: detail: xc_dom_alloc_segment: kernel : 0x0 -> 0x573000 (pfn 0x0 + 0x573 pages)
domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x0+0x573 at 0x7f0caa16a000
xc: detail: elf_load_binary: phdr 0 at 0x7f0caa16a000 -> 0x7f0caa174dc7
xc: detail: elf_load_binary: phdr 2 at 0x7f0caa57f778 -> 0x7f0caa6dcc24
domainbuilder: detail: xc_dom_alloc_segment: phys2mach : 0x573000 -> 0x593000 (pfn 0x573 + 0x20 pages)
domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x573+0x20 at 0x7f0cac411000
domainbuilder: detail: xc_dom_alloc_page : start info : 0x593000 (pfn 0x593)
domainbuilder: detail: xc_dom_alloc_page : xenstore : 0x594000 (pfn 0x594)
domainbuilder: detail: xc_dom_alloc_page : console : 0x595000 (pfn 0x595)
domainbuilder: detail: nr_page_tables: 0x00000000ffffffff/32: 0x0000000000000000 -> 0x00000000ffffffff, 1 table(s)
domainbuilder: detail: nr_page_tables: 0x000000003fffffff/30: 0x0000000000000000 -> 0x000000003fffffff, 1 table(s)
domainbuilder: detail: nr_page_tables: 0x00000000001fffff/21: 0x0000000000000000 -> 0x00000000007fffff, 4 table(s)
domainbuilder: detail: count_pgtables: PAE: extra l2 page table for l3#3
domainbuilder: detail: xc_dom_alloc_segment: page tables : 0x596000 -> 0x59d000 (pfn 0x596 + 0x7 pages)
domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x596+0x7 at 0x7f0cac40a000
domainbuilder: detail: xc_dom_alloc_page : boot stack : 0x59d000 (pfn 0x59d)
domainbuilder: detail: xc_dom_build_image : virt_alloc_end : 0x59e000
domainbuilder: detail: xc_dom_build_image : virt_pgtab_end : 0x800000
domainbuilder: detail: xc_dom_boot_image: called
domainbuilder: detail: arch_setup_bootearly: doing nothing
domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-3.0-x86_64
domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-3.0-x86_32p <= matches
domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_32
domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_32p
domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_64
domainbuilder: detail: xc_dom_update_guest_p2m: dst 32bit, pages 0x8000
domainbuilder: detail: setup_pgtables_x86_32_pae: PAE: extra l2 page table for l3#3
domainbuilder: detail: clear_page: pfn 0x595, mfn 0x31743b
domainbuilder: detail: clear_page: pfn 0x594, mfn 0x31743c
domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0x593+0x1 at 0x7f0cac5e4000
domainbuilder: detail: start_info_x86_32: called
domainbuilder: detail: domain builder memory footprint
domainbuilder: detail: allocated
domainbuilder: detail: malloc : 292 kB
domainbuilder: detail: anon mmap : 0 bytes
domainbuilder: detail: mapped
domainbuilder: detail: file mmap : 1444 kB
domainbuilder: detail: domU mmap : 5740 kB
domainbuilder: detail: arch_setup_bootlate: shared_info: pfn 0x0, mfn 0xcf8e9
domainbuilder: detail: shared_info_x86_32: called
domainbuilder: detail: vcpu_x86_32: called
domainbuilder: detail: vcpu_x86_32: cr3: pfn 0x596 mfn 0x31743a
domainbuilder: detail: launch_vm: called, ctxt=0x7f0cac5e5004
domainbuilder: detail: xc_dom_release: called
libxl: debug: libxl_device.c:251:libxl__device_disk_set_backend: Disk vdev=xvda spec.backend=phy
libxl: debug: libxl_event.c:570:libxl__ev_xswatch_register: watch w=0x1d9d2f8 wpath=/local/domain/0/backend/vbd/141/51712/state token=3/0: register slotnum=3
libxl: debug: libxl_device.c:251:libxl__device_disk_set_backend: Disk vdev=xvdb spec.backend=phy
libxl: debug: libxl_event.c:570:libxl__ev_xswatch_register: watch w=0x1d9e328 wpath=/local/domain/0/backend/vbd/141/51728/state token=2/1: register slotnum=2
libxl: debug: libxl_create.c:1356:do_domain_create: ao 0x1d9b8b0: inprogress: poller=0x1d99c60, flags=i
libxl: debug: libxl_event.c:514:watchfd_callback: watch w=0x1d9d2f8 wpath=/local/domain/0/backend/vbd/141/51712/state token=3/0: event epath=/local/domain/0/backend/vbd/141/51712/state
libxl: debug: libxl_event.c:653:devstate_watch_callback: backend /local/domain/0/backend/vbd/141/51712/state wanted state 2 ok
libxl: debug: libxl_event.c:606:libxl__ev_xswatch_deregister: watch w=0x1d9d2f8 wpath=/local/domain/0/backend/vbd/141/51712/state token=3/0: deregister slotnum=3
libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x1d9d2f8: deregister unregistered
libxl: debug: libxl_device.c:1023:device_hotplug: calling hotplug script: /etc/xen/scripts/block add
libxl: debug: libxl_event.c:483:watchfd_callback: watch epath=/local/domain/0/backend/vbd/141/51712/state token=3/0: empty slot
libxl: debug: libxl_event.c:514:watchfd_callback: watch w=0x1d9e328 wpath=/local/domain/0/backend/vbd/141/51728/state token=2/1: event epath=/local/domain/0/backend/vbd/141/51728/state
libxl: debug: libxl_event.c:653:devstate_watch_callback: backend /local/domain/0/backend/vbd/141/51728/state wanted state 2 ok
libxl: debug: libxl_event.c:606:libxl__ev_xswatch_deregister: watch w=0x1d9e328 wpath=/local/domain/0/backend/vbd/141/51728/state token=2/1: deregister slotnum=2
libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x1d9e328: deregister unregistered
libxl: debug: libxl_device.c:1023:device_hotplug: calling hotplug script: /etc/xen/scripts/block add
libxl: debug: libxl_event.c:483:watchfd_callback: watch epath=/local/domain/0/backend/vbd/141/51728/state token=2/1: empty slot
libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x1d9d380: deregister unregistered
libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x1d9d380: deregister unregistered
libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x1d9e3b0: deregister unregistered
libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x1d9e3b0: deregister unregistered
libxl: debug: libxl_event.c:570:libxl__ev_xswatch_register: watch w=0x1da02f8 wpath=/local/domain/0/backend/vif/141/0/state token=2/2: register slotnum=2
libxl: debug: libxl_event.c:514:watchfd_callback: watch w=0x1da02f8 wpath=/local/domain/0/backend/vif/141/0/state token=2/2: event epath=/local/domain/0/backend/vif/141/0/state
libxl: debug: libxl_event.c:657:devstate_watch_callback: backend /local/domain/0/backend/vif/141/0/state wanted state 2 still waiting state 1
libxl: debug: libxl_event.c:514:watchfd_callback: watch w=0x1da02f8 wpath=/local/domain/0/backend/vif/141/0/state token=2/2: event epath=/local/domain/0/backend/vif/141/0/state
libxl: debug: libxl_event.c:653:devstate_watch_callback: backend /local/domain/0/backend/vif/141/0/state wanted state 2 ok
libxl: debug: libxl_event.c:606:libxl__ev_xswatch_deregister: watch w=0x1da02f8 wpath=/local/domain/0/backend/vif/141/0/state token=2/2: deregister slotnum=2
libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x1da02f8: deregister unregistered
libxl: debug: libxl_device.c:1023:device_hotplug: calling hotplug script: /etc/xen/scripts/vif-bridge online
libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x1da0380: deregister unregistered
libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=0x1da0380: deregister unregistered
libxl: debug: libxl_event.c:1761:libxl__ao_progress_report: ao 0x1d9b8b0: progress report: ignored
libxl: debug: libxl_event.c:1591:libxl__ao_complete: ao 0x1d9b8b0: complete, rc=0
libxl: debug: libxl_event.c:1563:libxl__ao__destroy: ao 0x1d9b8b0: destroy
xc: debug: hypercall buffer: total allocations:224 total releases:224
xc: debug: hypercall buffer: current allocations:0 maximum allocations:3
xc: debug: hypercall buffer: cache current size:2
xc: debug: hypercall buffer: cache hits:217 misses:2 toobig:5
bigbang:/etc/xen# xl list
Name ID Mem VCPUs State Time(s)
Domain-0 0 488 1 r----- 32162.0
matrix 1 1024 2 -b---- 34229.3
squid 118 768 2 -b---- 25.7
xenfw1 126 256 1 -b---- 20.8
apache 127 384 1 -b---- 14.6
monitor 130 384 1 -b---- 28.6
pbx 141 128 1 r----- 1.8
bigbang:/etc/xen# xl list
(XEN) d140:v0: unhandled page fault (ec=0010)
(XEN) Pagetable walk from 0000000000000000:
(XEN) L4[0x000] = 0000000327e28027 000000000000043c
(XEN) L3[0x000] = 00000002c1b6f027 000000000000043d
(XEN) L2[0x000] = 00000003150f5023 0000000000000441
(XEN) L1[0x000] = 0000000000000000 ffffffffffffffff
(XEN) domain_crash_sync called from entry.S: fault at ffff82d08021feb0 compat_create_bounce_frame+0xc6/0xde
(XEN) Domain 140 (vcpu#0) crashed on cpu#3:
(XEN) ----[ Xen-4.4.1 x86_64 debug=n Not tainted ]----
(XEN) CPU: 3
(XEN) RIP: e019:[<0000000000000000>]
(XEN) RFLAGS: 0000000000000246 EM: 1 CONTEXT: pv guest
(XEN) rax: 0000000000000000 rbx: 0000000000000000 rcx: 0000000000000000
(XEN) rdx: 0000000000000000 rsi: 0000000000439000 rdi: 0000000000800000
(XEN) rbp: 000000000000000a rsp: 0000000000545ff0 r8: 0000000000000000
(XEN) r9: 0000000000000000 r10: ffff83031d464000 r11: ffff83031d464000
(XEN) r12: 00047e9fc6135fb2 r13: ffff82d080300800 r14: ffff82d0802ea940
(XEN) r15: ffff8300cf8f0000 cr0: 000000008005003b cr4: 00000000000006f0
(XEN) cr3: 0000000317d44000 cr2: 0000000000000000
(XEN) ds: e021 es: e021 fs: e021 gs: e021 ss: e021 cs: e019
(XEN) Guest stack trace from esp=00545ff0:
(XEN) 00000010 00000000 0001e019 00010046 0000fae9 b9cb8900 0000000a 038bd231
(XEN) fffffce8 85c389ff d7840fc0 e8000000 fffffffc fffffce8 0004a3ff 3f830000
(XEN) a11f7400 00000004 fffffce8 535252ff 00001668 fffce800 fce8ffff 83ffffff
(XEN) 7f8310c4 68740008 fffffce8 e04589ff e8e45589 fffffffc 1be0452b fa83e455
(XEN) 3d577700 000003e7 158b5077 00000000 0474d285 d2ffc031 0000358b d2310000
(XEN) 1774f685 85184e8b 890c74c9 f089dc55 558bd1ff 8bc209dc 85e5eb36 800578d2
(XEN) 467503e2 fffffce8 1bf883ff 3aeba575 0003e8b8 fffce800 0f4bffff ffff5d85
(XEN) 003f83ff 04a12074 e8000000 fffffffc 006a5050 00001668 fffce800 fce8ffff
(XEN) 83ffffff c03110c4 01b805eb 8d000000 5e5bf465 55c35d5f ec83e589 0000680c
(XEN) 23680000 68000000 0000004b 00bac931 b8000000 0000001d fffffce8 0000a3ff
(XEN) c9580000 e58955c3 000000a1 fce95d00 00ffffff 0000005d 00000076 00000000
(XEN) 00000065 00000000 00000000 00000078 00000069 00000000 00000086 00000000
(XEN) 00000000 00000000 00000000 00000000 00000000 00000000 00000000 20656e6f
(XEN) 75677261 746e656d 70786520 65746365 64250064 20202020 656c7300 57007065
(XEN) 20746961 20726f66 70732061 66696365 20646569 626d756e 6f207265 65732066
(XEN) 646e6f63 4e002e73 45424d55 464f5f52 4345535f 53444e4f 72657600 65736f62
(XEN) 72655600 65736f62 756f6320 6f64746e 002e6e77 65746e69 70757272 6c626974
(XEN) 6c410065 20776f6c 69206f74 7265746e 74707572 74697720 53452068 00002e43
(XEN) 4543494c 3d45534e 764c5047 00002b33 6d726f6e 73006c61 7065656c 732e0000
(XEN) 61746d79 732e0062 61747274 732e0062 72747368 00626174 6c65722e 7865742e
(XEN) traps.c:2514:d141 Domain attempted WRMSR 00000000c0010004 from 0x0000000000000000 to 0x000000000000ffff.