KVM-Autotest/TODO: Difference between revisions

From KVM
(Added PPM->PNG conversion item)
m (Add categories)
 
(141 intermediate revisions by 16 users not shown)
Line 1: Line 1:
= KVM-Autotest To-Do list =
= KVM-Autotest TODO list - DEPRECATED =


== Framework ==
KVM autotest is the set of kvm tests implemented on top of the [http://autotest.github.com/ autotest] framework. The current documentation can be seen on the [https://github.com/autotest/autotest/wiki/KVMAutotest autotest wiki], please refer to it. We'll port the remaining items to the autotest issue tracker.


* <s>Verify MD5 sum of ISO image before starting a VM</s> [Michael] [DONE]
== Pradeep ==
* <s>Enable multiple user controlled port redirections (with -redir)</s> [Michael] [DONE]
* <s>Implement functions to translate VM ports and addresses (e.g. VM.get_port(), VM.get_address())</s> [Michael] [DONE]
* Support TAP networking with a user specified MAC address for each NIC [Michael]
* <s>Add <tt>display</tt> parameter to enable user control of the QEMU display method (VNC/SDL/nographic)</s> [Michael] [DONE]
* Implement VM.clone() -- to be used by tests that need to add new VMs by themselves [Michael]
* kickstart installation support
* kvm-autotest auto resolve qemu-kvm backtraces
* <s>Make sure ppm_utils.image_crop() handles bad input properly</s> [Michael] [DONE]
* Enable tests to modify a VM's params (while it's down) [Michael]
* Make tests shorter by using small utility functions that fail a test and display a failure message [Michael]
* <s>Improve the stepmaker data naming system (e.g. name PPM files according to their MD5 sums)</s> [Michael] [DONE]
* Redirect guest monitor to serial and capture guest error messages written to console. Log the errors and also scan for specific problems (e.g. oops)
* Support an "expected to fail" param (at least in our html report)
* Log a gdb-backtrace for tests (executables) which generate a core dump file.
* Enable "guest-load" for a VMs before/while tests are running (e.g. migration of a VM, while a movie is playing on it) [Michael]
* Add support for kvm-trace.
* Fail upon indentation/white-space problems in the configuration file
* Add a way to shutdown the VMs when the whole job completes (compared to doing nothing or shuting-down after every test). [Michael]
* <s>Implement <tt>include</tt> functionality in the config file parser</s> [Michael] [DONE]
* <s>Implement kvm_spawn.get_command_status_output() to make sending SSH commands easier</s> [Michael] [DONE]
* Config file parser: enable selective modification of parameters based on regular expressions, e.g. mem.* ?= 256 [Michael]
* Support running user specified pre-job, post-job, pre-test and post-test scripts [Michael]
* <s>Make Step Editor accept a filename command line argument</s> [Michael] [DONE]
* <s>When running step files, detect frozen (stuck) guests even in the presence of a blinking cursor</s> [Michael] [DONE]
* Support running tests in parallel with multiple queues for each host [Michael]
* Automatically convert PPM images in debug dirs to PNG format to save space [Michael]


* SLES support - 
** Owner - Onkar n Mahajan (currently working)
** Expected delivery to community -


== Tests ==
* virtio-blk disk serial # test (extend physical_resource_check test)
** Owner -
** Expected delivery to community-


* Find out how to use Autotest's netperf test with guests
* enhance virtio-blk hotplug test
* If needed, write a netperf/iperf test
** virsh based attach-disk/detach disk
* Write a time drift test (pic/apic/pm_timer)
** enumerate cloud scenarios (live add, reboot after, shutdown, etc.)
* Write a test which adds VMs until one of them becomes unresponsive, and records the maximum number of VMs successfully started.
** migration after live add
* cpu hotplug [Glauber]
** Owner -
* pci net hot plug [Glauber]
** Expected delivery to community- 1-Oct-2011
* pci block hot plug [Glauber]
* <s>s3 hibernation</s> [Gleb] [DONE]
* tap networking
* pxe boot * net types
* qcow1, qcow2, vmdk, vhd
* qcow2 internal snapshots
* <s>Run autotest tests inside Linux guest</s> [Michael] [ALREADY DONE]
* Further migration
* Multiple nics
* ksm
* -vga stg, nographics
* kvm unit-tests
* Add unattended guest installations (using kickstart or answer-files)
* kvm_install -- keep src and build directories under <kvm_autotest_root> instead of under kvm_runtest_2.
* Stable tsc test - http://people.redhat.com/mingo/time-warp-test/MINI-HOWTO
* Guest installation with pv-block device/driver (for both windows and Linux)
* savevm test


* Add use QED image format during tests.
** Owner -
** Expected delivery to community- 1-Dec-2011


== Misc ==
* virsh stream.
** Owner -
** Expected delivery to community-


* Goal -- get accepted into upstream autotest
* pci-multi function testing (>32 virtio devices, disk and network)
* Add docstrings to all functions that still lack them, including the ones in stepmaker.py, stepeditor.py and kvm_tests.py [Michael]
** test out max number of virtio blk and nic devices
* Add module headers and docstrings [Michael]
** Owner -
* Document the setupssh.iso and setuptelnet.iso creation procedures in the wiki
** Expected delivery to community-
* Rename all Windows ISOs currently used to their official MSDN names
* <s>Move Windows-setup iso images into the windows directory.</s> [DONE]
* Share all the stepmaker data somehow so other people can debug stepfiles
* Fill the sections "Working with step files" and "Step file creation tips" in the wiki [Michael]
* Document the kvm_install test in the "Tests" section of the wiki


* virtfs patch inclusion to autotest.
** Owner -
** Expected delivery to community-


== Bugs ==
* Windows support (ping, file_transfer, ... network tests needs to be added)
** Owner -
** Expected delivery to community-


* <s>Step Maker/Step Editor: fix the GDK MemoryError problem (do not pass gtk.gdk.pixbuf_new_from_data() a 0x0 pixmap even if a ppm file contains one)</s> [DONE]
* Svirt - sVirt is a community effort aimed at integrating Mandatory Access Control (MAC) security and Linux-based virtualization (KVM, lguest et al).  
** Owner - Onkar N Mahajan (currently working)
** Expected delivery to community-
 
* "Migration + other task with parallel "
** Owner -
** Expected delivery to community-
 
* Network rate limiting
** Owner -
** Expected delivery to community-
 
* Fix old autoetst patches/bugs
** Owner -
** Expected delivery to community-
 
* Include libvirt_cim in autotest
** Owner -
** Expected delivery to community-
 
* Power Support
** Owner - IBM
** Expected Delivery to the community - Oct. 2011
 
[[Category:Docs]][[Category:Historical]][[Category:Testing]][[Category:Redirects]]

Latest revision as of 16:11, 16 May 2015

KVM-Autotest TODO list - DEPRECATED

KVM autotest is the set of kvm tests implemented on top of the autotest framework. The current documentation can be seen on the autotest wiki, please refer to it. We'll port the remaining items to the autotest issue tracker.

Pradeep

  • SLES support -
    • Owner - Onkar n Mahajan (currently working)
    • Expected delivery to community -
  • virtio-blk disk serial # test (extend physical_resource_check test)
    • Owner -
    • Expected delivery to community-
  • enhance virtio-blk hotplug test
    • virsh based attach-disk/detach disk
    • enumerate cloud scenarios (live add, reboot after, shutdown, etc.)
    • migration after live add
    • Owner -
    • Expected delivery to community- 1-Oct-2011
  • Add use QED image format during tests.
    • Owner -
    • Expected delivery to community- 1-Dec-2011
  • virsh stream.
    • Owner -
    • Expected delivery to community-
  • pci-multi function testing (>32 virtio devices, disk and network)
    • test out max number of virtio blk and nic devices
    • Owner -
    • Expected delivery to community-
  • virtfs patch inclusion to autotest.
    • Owner -
    • Expected delivery to community-
  • Windows support (ping, file_transfer, ... network tests needs to be added)
    • Owner -
    • Expected delivery to community-
  • Svirt - sVirt is a community effort aimed at integrating Mandatory Access Control (MAC) security and Linux-based virtualization (KVM, lguest et al).
    • Owner - Onkar N Mahajan (currently working)
    • Expected delivery to community-
  • "Migration + other task with parallel "
    • Owner -
    • Expected delivery to community-
  • Network rate limiting
    • Owner -
    • Expected delivery to community-
  • Fix old autoetst patches/bugs
    • Owner -
    • Expected delivery to community-
  • Include libvirt_cim in autotest
    • Owner -
    • Expected delivery to community-
  • Power Support
    • Owner - IBM
    • Expected Delivery to the community - Oct. 2011
Retrieved from "https://linux-kvm.org/index.php?title=KVM-Autotest/TODO&oldid=173292"