KVM - User contributions [en]

KVM-Autotest/TODO

2010-10-23T13:32:33Z

Mgoldish:

= KVM-Autotest TODO list =

== raw idea ==

* more vhost_net test
* Add Multi-guests transfer test
* transfer test between guest(s) and extra boxs
* add more whql tests (virtio_net,virtio_blk)

== general ==

'''Note:''' This session is for major, multi-person items. We'll update the status weekly based on the status of the subtasks attributed to persons.

* Libvirt integration - Will hold on this work item for the next couple of months due to resource constraints.

== lmr ==

=== TODO ===

* Multi host migration - priority increased

* Research how to trigger jobs based on events rather than using the web interface setting recurrent jobs
* Set up a qemu-block job, with kwolf's qemu-block tree
* Set up a vhost job, with the upstream job (mst's trees for kernel and userspace)
* Add a BLOCKED status on the autotest database, that tells the user that some feature testing was left out due to a problem on its dependencies.
* Eventually get rid of all dependency on slirp/userspace networking to do any feature testing, since it is not a supported feature. Slipstreaming the kickstart in the install CD is a possibility, and it ends up being simpler than configuring an internal network thing for testing.
* Make it possible to install virtio nw driver under windows xp/2003 guests without having to resort to the msi installer

=== Done ===

* Send code to retrieve host kernels based on koji/brew tags upstream
* Resolved UUID mount point check problem
* QMP suite integrated upstream
* Wrote code to retrieve kernels based on koji/brew tags

== mgoldish ==

* Make WHQL tests run on our internal server
* Enable "guest-load" for a VMs before/while tests are running (e.g. migration of a VM, while a movie is playing on it)
** This may just be a matter of moving useful code from tests to kvm_test_utils.py to make it reusable
* Post-commit review of new network patches (committed on Oct 7 2010)
* Use more exceptions in utility functions:
** Add convenience functions to kvm_subprocess.py to make running shell commands shorter
** Add convenience functions to the VM class
* Refactor _get_command_output() and friends in kvm_monitor.py and add cmd_raw(), cmd_obj() and cmd_qmp() as required by Luiz Capitulino's test suite
* Use select() instead of sleep() in kvm_monitor.py
* Simplify migration code if possible (in kvm_vm.py and kvm_test_utils.py)
* Fix VM.get_ifname() somehow (uses self.vnc_port -- bad)

== akong ==

* Report problem with multiple NICs and MAC address tracking
* Using dnsmasq in unattended_install to replace userspace network with private bridge
* Bonding test
* Add a new test: check if guest transmits packets when link is up/down

== yolkfull ==

* Run netperf test between two guests
* Migration with/without workload(dbench,lmbench etc)
* Verify SMBIOS/DMI data (UUID, for example)
* Disk serial number (for IDE, SCSI, VirtIO drives)

== Beijing QE ==

* pxe boot * net types
* Further migration
* Multiple nics
* multiple disks
* Test block device cancellation path using device mapper to generate errors ( after we had a crash in de_write_dma_cb)
* Extend pci_assignable to support other PCI devices (USB, video cards, TV card etc)
* Different CPU flags support
* Passthrough the perf keys of run_autotest to autotest server
* Register the virtual machine into autotest server and run benchmark through autotest server

== Bugs ==

* Please open bugs on the [[http://autotest.kernel.org/newticket autotest defect tracking system]]

KVM-Autotest/TODO

2010-10-18T11:43:19Z

Mgoldish:

= KVM-Autotest TODO list =

== raw idea ==

* more vhost_net test
* Add Multi-guests transfer test
* transfer test between guest(s) and extra boxs
* add more whql tests (virtio_net,virtio_blk)

== general ==

'''Note:''' This session is for major, multi-person items. We'll update the status weekly based on the status of the subtasks attributed to persons.

* Libvirt integration - Will hold on this work item for the next couple of months due to resource constraints.

== lmr ==

=== TODO ===

* Multi host migration - priority increased

* Send code to retrieve host kernels based on koji/brew tags upstream
* Research how to trigger jobs based on events rather than using the web interface setting recurrent jobs
* Set up a qemu-block job, with kwolf's qemu-block tree
* Set up a vhost job, with the upstream job (mst's trees for kernel and userspace)
* Add a BLOCKED status on the autotest database, that tells the user that some feature testing was left out due to a problem on its dependencies.
* Eventually get rid of all dependency on slirp/userspace networking to do any feature testing, since it is not a supported feature. Slipstreaming the kickstart in the install CD is a possibility, and it ends up being simpler than configuring an internal network thing for testing.
* Make it possible to install virtio nw driver under windows xp/2003 guests without having to resort to the msi installer

=== Done ===

* Write code to retrieve kernels based on koji/brew tags
* Set up new autotest server
* Resolved autotest bugs that prevented proper kernel build/install functionality for Fedora/newer RHEL systems:
http://patchwork.test.kernel.org/patch/2630/
http://patchwork.test.kernel.org/patch/2631/
http://patchwork.test.kernel.org/patch/2632/
http://patchwork.test.kernel.org/patch/2640/
http://patchwork.test.kernel.org/patch/2634/
http://patchwork.test.kernel.org/patch/2635/

Now the host kernel install control file patch is fully functional:
http://patchwork.test.kernel.org/patch/2641/

* Made cache=off the default for KVM autotest tests:
http://patchwork.test.kernel.org/patch/2642/
* Removed boot=on when booting virtio images:
http://patchwork.test.kernel.org/patch/2643/

* Applied network patchset (Yay!)

== mgoldish ==

* Make WHQL tests run on our internal server
* Enable "guest-load" for a VMs before/while tests are running (e.g. migration of a VM, while a movie is playing on it)
** This may just be a matter of moving useful code from tests to kvm_test_utils.py to make it reusable
* Post-commit review of new network patches (committed on Oct 7 2010)
* Use more exceptions in utility functions:
** Add convenience functions to kvm_subprocess.py to make running shell commands shorter
** Add convenience functions to the VM class
* Refactor _get_command_output() and friends in kvm_monitor.py and add cmd_raw(), cmd_obj() and cmd_qmp() as required by Luiz Capitulino's test suite

== akong ==

* Report problem with multiple NICs and MAC address tracking
* Using dnsmasq in unattended_install to replace userspace network with private bridge
* Bonding test
* Add a new test: check if guest transmits packets when link is up/down

== yolkfull ==

* Run netperf test between two guests
* Migration with/without workload(dbench,lmbench etc)
* Verify SMBIOS/DMI data (UUID, for example)
* Disk serial number (for IDE, SCSI, VirtIO drives)

== Beijing QE ==

* pxe boot * net types
* Further migration
* Multiple nics
* multiple disks
* Test block device cancellation path using device mapper to generate errors ( after we had a crash in de_write_dma_cb)
* Extend pci_assignable to support other PCI devices (USB, video cards, TV card etc)
* Different CPU flags support
* Passthrough the perf keys of run_autotest to autotest server
* Register the virtual machine into autotest server and run benchmark through autotest server

== Bugs ==

* Please open bugs on the [[http://autotest.kernel.org/newticket autotest defect tracking system]]

KVM-Autotest/TODO

2010-10-07T13:06:23Z

Mgoldish:

= KVM-Autotest TODO list =

== raw idea ==

* Autotest support for executing tests in parallel
* more vhost_net test
* Add Multi-guests transfer test
* transfer test between guest(s) and extra boxs

== general ==

'''Note:''' This session is for major, multi-person items. We'll update the status weekly based on the status of the subtasks attributed to persons.

* Libvirt integration - Will hold on this work item for the next couple of months due to resource constraints.

== lmr ==

=== TODO ===

* Make cache=off the default for guest images
* Multi host migration
* Add a BLOCKED status on the autotest database, that tells the user that some feature testing was left out due to a problem on its dependencies.
* Eventually get rid of all dependency on slirp/userspace networking to do any feature testing, since it is not a supported feature. Slipstreaming the kickstart in the install CD is a possibility, and it ends up being simpler than configuring an internal network thing for testing.
* Make it possible to install virtio nw driver under windows xp/2003 guests without having to resort to the msi installer

=== Partially done/ Blocked ===

* Include support for host kernel install on the KVM default control file - Using autotest standard API to get it done
** needs to resolve bugs in boottool to full functionality

=== Done ===

* Apply network patchset (Yay!)

== mgoldish ==

* Make WHQL tests run on our internal server
* Enable "guest-load" for a VMs before/while tests are running (e.g. migration of a VM, while a movie is playing on it)
** This may just be a matter of moving useful code from tests to kvm_test_utils.py to make it reusable
* Post-commit review of new network patches (committed on Oct 7 2010)
* Use more exceptions in utility functions:
** Add convenience functions to kvm_subprocess.py to make running shell commands shorter
** Add convenience functions to the VM class

=== Very old, possibly no longer relevant ===

* Add docstrings to all functions that still lack them, including the ones in stepmaker.py, stepeditor.py and kvm_tests.py
* Rename all Windows ISOs currently used to their official MSDN names
* Fill the sections "Working with step files" and "Step file creation tips" in the wiki

== akong ==

* Using dnsmasq in unattended_install to replace userspace network with private bridge
* Bonding test
* Add a new test: check if guest transmits packets when link is up/down

== Beijing QE ==

* pxe boot * net types
* Further migration
* Multiple nics
* multiple disks
* Test block device cancellation path using device mapper to generate errors ( after we had a crash in de_write_dma_cb)
* Extend pci_assignable to support other PCI devices (USB, video cards, TV card etc)
* Different CPU flags support
* Passthrough the perf keys of run_autotest to autotest server
* Register the virtual machine into autotest server and run benchmark through autotest server
(yolkfull)
* Run netperf test between two guests
* Migration with/without workload(dbench,lmbench etc)
* Verify SMBIOS/DMI data (UUID, for example)
* Disk serial number (for IDE, SCSI, VirtIO drives)

== Bugs ==

* Please open bugs on the [[http://autotest.kernel.org/newticket autotest defect tracking system]]

KVM-Autotest/TODO

2010-10-07T13:05:50Z

Mgoldish:

= KVM-Autotest TODO list =

== raw idea ==

* Autotest support for executing tests in parallel
* more vhost_net test
* Add Multi-guests transfer test
* transfer test between guest(s) and extra boxs

== general ==

'''Note:''' This session is for major, multi-person items. We'll update the status weekly based on the status of the subtasks attributed to persons.

* Libvirt integration - Will hold on this work item for the next couple of months due to resource constraints.

== lmr ==

=== TODO ===

* Make cache=off the default for guest images
* Multi host migration
* Add a BLOCKED status on the autotest database, that tells the user that some feature testing was left out due to a problem on its dependencies.
* Eventually get rid of all dependency on slirp/userspace networking to do any feature testing, since it is not a supported feature. Slipstreaming the kickstart in the install CD is a possibility, and it ends up being simpler than configuring an internal network thing for testing.
* Make it possible to install virtio nw driver under windows xp/2003 guests without having to resort to the msi installer

=== Partially done/ Blocked ===

* Include support for host kernel install on the KVM default control file - Using autotest standard API to get it done
** needs to resolve bugs in boottool to full functionality

=== Done ===

* Apply network patchset (Yay!)

== mgoldish ==

* Make WHQL tests run on our internal server
* Enable "guest-load" for a VMs before/while tests are running (e.g. migration of a VM, while a movie is playing on it)
** This may just be a matter of moving useful code from tests to kvm_test_utils.py to make it reusable
* Post-commit review of new network patches (committed on Oct 10 2010)
* Use more exceptions in utility functions:
** Add convenience functions to kvm_subprocess.py to make running shell commands shorter
** Add convenience functions to the VM class

=== Very old, possibly no longer relevant ===

* Add docstrings to all functions that still lack them, including the ones in stepmaker.py, stepeditor.py and kvm_tests.py
* Rename all Windows ISOs currently used to their official MSDN names
* Fill the sections "Working with step files" and "Step file creation tips" in the wiki

== akong ==

* Using dnsmasq in unattended_install to replace userspace network with private bridge
* Bonding test
* Add a new test: check if guest transmits packets when link is up/down

== Beijing QE ==

* pxe boot * net types
* Further migration
* Multiple nics
* multiple disks
* Test block device cancellation path using device mapper to generate errors ( after we had a crash in de_write_dma_cb)
* Extend pci_assignable to support other PCI devices (USB, video cards, TV card etc)
* Different CPU flags support
* Passthrough the perf keys of run_autotest to autotest server
* Register the virtual machine into autotest server and run benchmark through autotest server
(yolkfull)
* Run netperf test between two guests
* Migration with/without workload(dbench,lmbench etc)
* Verify SMBIOS/DMI data (UUID, for example)
* Disk serial number (for IDE, SCSI, VirtIO drives)

== Bugs ==

* Please open bugs on the [[http://autotest.kernel.org/newticket autotest defect tracking system]]

KVM-Autotest/TODO

2009-08-14T00:14:27Z

Mgoldish: Mark a few items done

= KVM-Autotest To-Do list =

== Framework ==

* <s>Verify MD5 sum of ISO image before starting a VM</s> [Michael] [DONE]
* <s>Enable multiple user controlled port redirections (with -redir)</s> [Michael] [DONE]
* <s>Implement functions to translate VM ports and addresses (e.g. VM.get_port(), VM.get_address())</s> [Michael] [DONE]
* <s>Support TAP networking with a user specified MAC address for each NIC</s> [Michael] [DONE]
* <s>Add <tt>display</tt> parameter to enable user control of the QEMU display method (VNC/SDL/nographic)</s> [Michael] [DONE]
* <s>Implement VM.clone() -- to be used by tests that need to add new VMs by themselves</s> [Michael] [DONE]
* kickstart installation support
* kvm-autotest auto resolve qemu-kvm backtraces
* <s>Make sure ppm_utils.image_crop() handles bad input properly</s> [Michael] [DONE]
* <s>Enable tests to modify a VM's params (while it's down)</s> [Michael] [DONE]
* <s>Make tests shorter by using small utility functions that fail a test and display a failure message</s> [Michael] [DONE]
* <s>Improve the stepmaker data naming system (e.g. name PPM files according to their MD5 sums)</s> [Michael] [DONE]
* Redirect guest monitor to serial and capture guest error messages written to console. Log the errors and also scan for specific problems (e.g. oops)
* Support an "expected to fail" param (at least in our html report)
* Log a gdb-backtrace for tests (executables) which generate a core dump file.
* Enable "guest-load" for a VMs before/while tests are running (e.g. migration of a VM, while a movie is playing on it) [Michael]
* Add support for kvm-trace.
* Fail upon indentation/white-space problems in the configuration file
* Add a way to shutdown the VMs when the whole job completes (compared to doing nothing or shutting-down after every test) [Michael]
* <s>Implement <tt>include</tt> functionality in the config file parser</s> [Michael] [DONE]
* <s>Implement kvm_spawn.get_command_status_output() to make sending SSH commands easier</s> [Michael] [DONE]
* <s>Config file parser: enable selective modification of parameters based on regular expressions, e.g. mem.* ?= 256</s> [Michael] [DONE]
* <s>Support running user specified pre-job, post-job, pre-test and post-test scripts</s> [Michael] [DONE]
* <s>Make Step Editor accept a filename command line argument</s> [Michael] [DONE]
* <s>When running step files, detect frozen (stuck) guests even in the presence of a blinking cursor</s> [Michael] [DONE]
* Support running tests in parallel with multiple queues for each host [Michael]
* <s>Automatically convert PPM images in debug dirs to PNG format to save space</s> [Michael] [DONE]
* <s>Automatically assign a UUID to a VM (use the '-uuid' QEMU parameter). Once assigned, should be used in all dependent tests.</s> [jasowang] [DONE]
* <s>Automatically assign a MAC address to a NIC. Once assigned, should be used in all dependent tests.</s> [jasowang] [DONE]
* <s>Allow run_bg to track a child process's stdin and stderr even after the parent process has exited; achieved by merging run_bg with kvm_spawn</s> [Michael] [DONE]

== Tests ==

* Find out how to use Autotest's netperf test with guests [Yolkfull]
* If needed, write a netperf/iperf test [jasowang] [NEEDS MORE WORK]
* <s>Write a time drift test (pic/apic/pm_timer)</s> [Michael] [DONE]
* <s>Write a test which adds VMs until one of them becomes unresponsive, and records the maximum number of VMs successfully started</s> [Yolkfull] [ALREADY DONE]
* cpu hotplug [Glauber]
* pci net hot plug [Yolkfull]
* pci block hot plug [Yolkfull]
* <s>s3 hibernation</s> [Gleb] [DONE]
* <s>tap networking</s> [jasowang] [DONE]
* pxe boot * net types [jasowang]
* qcow1, qcow2, vmdk, vhd
* qcow2 internal snapshots
* <s>Run autotest tests inside Linux guest</s> [Michael] [ALREADY DONE]
* Further migration [jasowang]
* Multiple nics [jasowang]
* multiple disks
* ksm [jasowang, jzupka, ldoktor]
* -vga stg, nographics
* kvm unit-tests
* Add unattended guest installations (using kickstart or answer-files) [jasowang]
* kvm_install -- keep src and build directories under <kvm_autotest_root> instead of under kvm_runtest_2.
* Stable tsc test - http://people.redhat.com/mingo/time-warp-test/MINI-HOWTO
* Guest installation with pv-block device/driver (for both windows and Linux)
* savevm test [jasowang]
* Guests with large page support [jzupka, ldoktor]
* Verify SMBIOS/DMI data (UUID, for example) [Yolkfull]
* Disk serial number (for IDE, SCSI, VirtIO drives) [Yolkfull]
* Test block device cancellation path using device mapper to generate errors ( after we had a crash in de_write_dma_cb)

== Misc ==

* <s>Goal -- get accepted into upstream autotest</s> [DONE]
* Add docstrings to all functions that still lack them, including the ones in stepmaker.py, stepeditor.py and kvm_tests.py [Michael]
* <s>Add module headers and docstrings</s> [Michael] [DONE]
* Document the setupssh.iso and setuptelnet.iso creation procedures in the wiki
* Rename all Windows ISOs currently used to their official MSDN names
* <s>Move Windows-setup iso images into the windows directory.</s> [DONE]
* Share all the stepmaker data somehow so other people can debug stepfiles
* Fill the sections "Working with step files" and "Step file creation tips" in the wiki [Michael]
* <s>Document the kvm_install test in the "Tests" section of the wiki</s>

== Bugs ==

* <s>Step Maker/Step Editor: fix the GDK MemoryError problem (do not pass gtk.gdk.pixbuf_new_from_data() a 0x0 pixmap even if a ppm file contains one)</s> [DONE]