KVM-Autotest/TODO: Difference between revisions

From KVM
No edit summary
m (Add categories)
 
(30 intermediate revisions by 7 users not shown)
Line 1: Line 1:
= KVM-Autotest TODO list =
= KVM-Autotest TODO list - DEPRECATED =


== raw idea ==
KVM autotest is the set of kvm tests implemented on top of the [http://autotest.github.com/ autotest] framework. The current documentation can be seen on the [https://github.com/autotest/autotest/wiki/KVMAutotest autotest wiki], please refer to it. We'll port the remaining items to the autotest issue tracker.


* more vhost_net test
== Pradeep ==
* Add Multi-guests transfer test
* transfer test between guest(s) and extra boxs
* add more whql tests (virtio_net,virtio_blk)


== general ==
* SLES support - 
** Owner - Onkar n Mahajan (currently working)
** Expected delivery to community -


'''Note:''' This session is for major, multi-person items. We'll update the status weekly based on the status of the subtasks attributed to persons.
* virtio-blk disk serial # test (extend physical_resource_check test)
** Owner -
** Expected delivery to community-


== lmr ==
* enhance virtio-blk hotplug test
** virsh based attach-disk/detach disk
** enumerate cloud scenarios (live add, reboot after, shutdown, etc.)
** migration after live add
** Owner -
** Expected delivery to community- 1-Oct-2011


=== TODO ===
* Add use QED image format during tests.
** Owner -
** Expected delivery to community- 1-Dec-2011


* Generate autotest API documentation with tools such as doxygen
* virsh stream.
* Hotplug tests during migration
** Owner -
* Work on setting up the conmux server for our internal test grid
** Expected delivery to community-
* Research how to trigger jobs based on events rather than using the web interface setting recurrent jobs
* Set up a qemu-block job, with kwolf's qemu-block tree
* Set up a vhost job, with the upstream job (mst's trees for kernel and userspace)
* Add a BLOCKED status on the autotest database, that tells the user that some feature testing was left out due to a problem on its dependencies.
* Eventually get rid of all dependency on slirp/userspace networking to do any feature testing, since it is not a supported feature. Slipstreaming the kickstart in the install CD is a possibility, and it ends up being simpler than configuring an internal network thing for testing.
* Make it possible to install virtio nw driver under windows xp/2003 guests without having to resort to the msi installer


=== Done ===
* pci-multi function testing (>32 virtio devices, disk and network)
** test out max number of virtio blk and nic devices
** Owner -
** Expected delivery to community-


* Infrastructure for testing different vm storage backends: file/lvm/iSCSI - Done by Beijing team
* virtfs patch inclusion to autotest.  
* Made some internal patches appropriate for upstream
** Owner -
* Copy kvm-autotest@redhat.com on the email list of results
** Expected delivery to community-
* Send code to retrieve host kernels based on koji/brew tags upstream
* Resolved UUID mount point check problem
* QMP suite integrated upstream
* Wrote code to retrieve kernels based on koji/brew tags


== mgoldish ==
* Windows support (ping, file_transfer, ... network tests needs to be added)
** Owner -
** Expected delivery to community-


* Make WHQL tests run on our internal server
* Svirt - sVirt is a community effort aimed at integrating Mandatory Access Control (MAC) security and Linux-based virtualization (KVM, lguest et al).
* Enable "guest-load" for a VMs before/while tests are running (e.g. migration of a VM, while a movie is playing on it)
** Owner - Onkar N Mahajan (currently working)
** This may just be a matter of moving useful code from tests to kvm_test_utils.py to make it reusable
** Expected delivery to community-


=== done ===
* "Migration + other task with parallel "
** Owner -
** Expected delivery to community-


* Post-commit review of new network patches (committed on Oct 7 2010)
* Network rate limiting
* Use more exceptions in utility functions:
** Owner -
** Add convenience functions to kvm_subprocess.py to make running shell commands shorter
** Expected delivery to community-
** Add convenience functions to the VM class
* Refactor _get_command_output() and friends in kvm_monitor.py and add cmd_raw(), cmd_obj() and cmd_qmp() as required by Luiz Capitulino's test suite
* Use select() instead of sleep() in kvm_monitor.py
* Simplify migration code if possible (in kvm_vm.py and kvm_test_utils.py)
* Fix VM.get_ifname() somehow (uses self.vnc_port -- bad)


== akong ==
* Fix old autoetst patches/bugs
** Owner -
** Expected delivery to community-


* Include libvirt_cim in autotest
** Owner -
** Expected delivery to community-


* push redhat internal kvm subtests(more than 18) to upstream
* Power Support
''trans_hugepage_defrag.py trans_hugepage.py trans_hugepage_swapping.py hdparm.py cpuflags.py multi_disk.py nmi_watchdog.py qmp_command.py qmp_event_notification.py cdrom.py fillup_disk.py floppy.py format_disk.py lvm.py  usb.py ... ''[doing..]
** Owner - IBM
stop_continue.py[review..]
** Expected Delivery to the community - Oct. 2011
image_copy.py module_probe.py[done]


* Using dnsmasq in unattended_install to replace userspace network with private bridge [sent v2]
[[Category:Docs]][[Category:Historical]][[Category:Testing]][[Category:Redirects]]
* Add a new test: check if guest transmits packets when link is up/down [done]
* Report problem with multiple NICs and MAC address tracking [problem fixed]
* review and test michael's whql patchsets, give feedback to michael [done]
* Bonding test [done]
 
== jason ==
 
* Tests in parallel with migration (reboot/unattended installation/file transfer/ autotest client tests / guest_script,autoit? / memtest86+(steps?)), need modifications to framework?
* Refactor the network cmdline generation, using peer when possible and vlan for elder qemu-kvm
* Port network tests into windows
* Profiler of pidstat
* guest->guest guest->host netperf support
* More readable test result of netperf
 
=== done ===
* Migration to exec test suggested by mst
* Clean the Migration tests: mainly for exec and add offline support
* Write a 'cli' wrapper to make autotest handy/easier for developers
* Refactor hotplug test using qdev and netdev_del/drive_del
 
 
== yolkfull ==
 
* Run netperf test between two guests
* Migration with/without workload(dbench,lmbench etc)
* Verify SMBIOS/DMI data (UUID, for example)
* Disk serial number (for IDE, SCSI, VirtIO drives)
 
== Beijing QE ==
 
* pxe boot * net types
* Further migration
* Multiple nics
* multiple disks
* Test block device cancellation path using device mapper to generate errors ( after we had a crash in de_write_dma_cb)
* Extend pci_assignable to support other PCI devices (USB, video cards, TV card etc)
* Different CPU flags support
* Passthrough the perf keys of run_autotest to autotest server
* Register the virtual machine into autotest server and run benchmark through autotest server
 
== Cleber ==
 
 
=== done ===
 
* Look and fix the block_hotplug test upstream
* Integrate Brew/Koji messaging with automatic job submission - done with messagebusd plugin
* Create initscripts for the scheduller daemon (monitor_db_babysitter) - done with effort by autoqa project
* Revisit job parameterization to ease job submission - done with simple templating, cartesian config override and site extension
 
== Bugs ==
 
* Please open bugs on the [[http://autotest.kernel.org/newticket autotest defect tracking system]]

Latest revision as of 16:11, 16 May 2015

KVM-Autotest TODO list - DEPRECATED

KVM autotest is the set of kvm tests implemented on top of the autotest framework. The current documentation can be seen on the autotest wiki, please refer to it. We'll port the remaining items to the autotest issue tracker.

Pradeep

  • SLES support -
    • Owner - Onkar n Mahajan (currently working)
    • Expected delivery to community -
  • virtio-blk disk serial # test (extend physical_resource_check test)
    • Owner -
    • Expected delivery to community-
  • enhance virtio-blk hotplug test
    • virsh based attach-disk/detach disk
    • enumerate cloud scenarios (live add, reboot after, shutdown, etc.)
    • migration after live add
    • Owner -
    • Expected delivery to community- 1-Oct-2011
  • Add use QED image format during tests.
    • Owner -
    • Expected delivery to community- 1-Dec-2011
  • virsh stream.
    • Owner -
    • Expected delivery to community-
  • pci-multi function testing (>32 virtio devices, disk and network)
    • test out max number of virtio blk and nic devices
    • Owner -
    • Expected delivery to community-
  • virtfs patch inclusion to autotest.
    • Owner -
    • Expected delivery to community-
  • Windows support (ping, file_transfer, ... network tests needs to be added)
    • Owner -
    • Expected delivery to community-
  • Svirt - sVirt is a community effort aimed at integrating Mandatory Access Control (MAC) security and Linux-based virtualization (KVM, lguest et al).
    • Owner - Onkar N Mahajan (currently working)
    • Expected delivery to community-
  • "Migration + other task with parallel "
    • Owner -
    • Expected delivery to community-
  • Network rate limiting
    • Owner -
    • Expected delivery to community-
  • Fix old autoetst patches/bugs
    • Owner -
    • Expected delivery to community-
  • Include libvirt_cim in autotest
    • Owner -
    • Expected delivery to community-
  • Power Support
    • Owner - IBM
    • Expected Delivery to the community - Oct. 2011
Retrieved from "https://linux-kvm.org/index.php?title=KVM-Autotest/TODO&oldid=173292"