Note: This is a public test instance of Red Hat Bugzilla. The data contained within is a snapshot of the live data so any changes you make will not be reflected in the production Bugzilla. Email is disabled so feel free to test any aspect of the site that you want. File any problems you find or give feedback at bugzilla.redhat.com.

Bug 1758903

Summary: virt-customize fails to customize images with latest update
Product: [Fedora] Fedora Reporter: David Hill <dhill>
Component: libguestfsAssignee: Richard W.M. Jones <rjones>
Status: CLOSED DUPLICATE QA Contact: Fedora Extras Quality Assurance <extras-qa>
Severity: urgent Docs Contact:
Priority: urgent    
Version: rawhideCC: rjones
Target Milestone: ---   
Target Release: ---   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2019-10-06 18:37:40 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
virt-customize.log none

Description David Hill 2019-10-06 17:19:11 UTC
Description of problem:
[    1.226499] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS ?-20190727_073836-buildvm-ppc64le-16.ppc.fedoraproject.org-3.fc31 04/01/2014
[    1.226499] Call Trace:
[    1.226499]  dump_stack+0x85/0xc0
[    1.226499]  ___might_sleep.cold+0xb3/0xc3
[    1.226499]  exit_signals+0x30/0x2e0
[    1.226499]  do_exit+0xbc/0xce0
[    1.226499]  ? ksys_mount+0x7e/0xc0
[    1.226499]  rewind_stack_do_exit+0x17/0x20
[    1.411822] note: init[1] exited with preempt_count 2
[    1.413763] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000009
[    1.414658] Kernel Offset: 0x5000000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)
[    1.414658] Rebooting in 1 seconds..
libguestfs: child_cleanup: 0x5629687e9fe0: child process died
libguestfs: trace: launch = -1 (error)
virt-customize: error: libguestfs error: guestfs_launch failed, see earlier 
error messages


Version-Release number of selected component (if applicable):
libguestfs-tools-c-1.41.4-1.fc32.x86_64

How reproducible:
Always

Steps to Reproduce:
1. Update to libguestfs-tools-c-1.41.4-1.fc32.x86_64
2. Try customizing a VM
3.

Actual results:
kernel panic in the guest

Expected results:
no kernel panics

Additional info:

Comment 1 David Hill 2019-10-06 17:22:37 UTC
[    1.248707] CPU: 0 PID: 1 Comm: init Not tainted 5.4.0-0.rc1.git1.1.fc32.x86_64 #1
[    1.248707] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS ?-20190727_073836-buildvm-ppc64le-16.ppc.fedoraproject.org-3.fc31 04/01/2014
[    1.248707] RIP: 0010:mem_cgroup_track_foreign_dirty_slowpath+0x50/0x1c0
[    1.248707] Code: 60 89 c0 48 0f a3 05 4f 28 5c 01 0f 82 2f 01 00 00 49 8b 45 00 48 89 e9 31 db be ff ff ff ff 48 8b 38 49 8d 84 24 88 0e 00 00 <48> 39 78 e8 74 5a 48 8b 50 f8 48 39 ca 79 0e 44 8b 00 41 83 f8 01
[    1.248707] RSP: 0018:ffffb2c58000bc28 EFLAGS: 00010046
[    1.248707] RAX: 0000000000000e88 RBX: 0000000000000000 RCX: 00000000fffb6f7d
[    1.248707] RDX: 0000000000000003 RSI: 00000000ffffffff RDI: 0000000000000002
[    1.248707] RBP: 00000000fffb6f7d R08: 0000000000000000 R09: 0000000000000001
[    1.248707] R10: 0000000000000001 R11: 0000000000000001 R12: 0000000000000000
[    1.248707] R13: ffff9214ec71b078 R14: ffff9214ee428418 R15: 0000000000000000
[    1.248707] FS:  00007ffc2059bf40(0000) GS:ffff9214ef000000(0000) knlGS:0000000000000000
[    1.248707] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    1.248707] CR2: 0000000000000e70 CR3: 000000002c4fa001 CR4: 0000000000160ef0
[    1.248707] Call Trace:
[    1.248707]  __set_page_dirty+0x3a/0xf0
[    1.248707]  mark_buffer_dirty+0x131/0x1b0
[    1.248707]  ext4_commit_super+0x1c3/0x2d0
[    1.248707]  ext4_setup_super+0x127/0x1d0
[    1.248707]  ext4_fill_super+0x1fd1/0x3a50
[    1.248707]  ? snprintf+0x49/0x60
[    1.248707]  ? mount_bdev+0x17e/0x1b0
[    1.248707]  ? ext4_calculate_overhead+0x4a0/0x4a0
[    1.248707]  mount_bdev+0x17e/0x1b0
[    1.248707]  ? ext4_calculate_overhead+0x4a0/0x4a0
[    1.248707]  legacy_get_tree+0x30/0x50
[    1.248707]  vfs_get_tree+0x28/0xc0
[    1.248707]  do_mount+0x7f7/0xaf0
[    1.248707]  ksys_mount+0x7e/0xc0
[    1.248707]  __x64_sys_mount+0x21/0x30
[    1.248707]  do_syscall_64+0x5c/0xa0
[    1.248707]  entry_SYSCALL_64_after_hwframe+0x49/0xbe
[    1.248707] RIP: 0033:0x402418

Comment 2 David Hill 2019-10-06 17:29:29 UTC
Created attachment 1622949 [details]
virt-customize.log

Comment 3 David Hill 2019-10-06 17:43:50 UTC
I get the same behavior with this command:
/usr/bin/virt-sysprep -v -x -a /var/lib/jenkins/VMs/undercloud-0-rhosp13.qcow2

Is supermin the problem ?

Comment 4 Richard W.M. Jones 2019-10-06 17:48:51 UTC
It's probably this kernel bug:
https://bugzilla.redhat.com/show_bug.cgi?id=1758413

(Setting bug priority has no effect except to make everyone annoyed)

Comment 5 David Hill 2019-10-06 18:28:37 UTC
I can confirm you that reverting to a 5.3.2 kernel solves this problem ...

Comment 6 Richard W.M. Jones 2019-10-06 18:37:40 UTC
Thanks for testing this.  I will mark this bug as duplicate of
the other one.

*** This bug has been marked as a duplicate of bug 1758413 ***