VMchannel Requirements: Difference between revisions

From KVM
(Add notes on testing)
(Update link to test-virtserial.git, remove TODO section - we don't need this anymore)
 
(20 intermediate revisions by 3 users not shown)
Line 68: Line 68:
*** [http://git.fedorahosted.org/git/?p=fence-agents.git;a=tree;f=fence/agents/xvm fence_xvm] -> tracks migrations, but requires multicast between guest/host; distributed key recommended but not required
*** [http://git.fedorahosted.org/git/?p=fence-agents.git;a=tree;f=fence/agents/xvm fence_xvm] -> tracks migrations, but requires multicast between guest/host; distributed key recommended but not required
** Using VMChannel-Serial, the requirement of guest-host can be avoided
** Using VMChannel-Serial, the requirement of guest-host can be avoided
*** [http://fence-virt.git.sourceforge.net fence-virt] has a plugin which uses serial VMchannel to tunnel through to the host.
** Key distribution of any sort can be avoided, making this easier to configure than existing solutions
** Key distribution of any sort can be avoided, making this easier to configure than existing solutions


Line 75: Line 76:


<pre>
<pre>
-device virtio-serial-pci \
-device virtio-serial \
-device virtserialport,chardev=...,name=org.linux-kvm.port.0 \
-device virtserialport,chardev=...,name=org.linux-kvm.port.0 \
-device virtserialport,chardev=...,name=org.linux-kvm.port.1,cache_buffers=0 \
-device virtserialport,chardev=...,name=org.linux-kvm.port.1
-device virtserialport,chardev=...,name=org.linux-kvm.port.2,byte_limit=1048576
</pre>
</pre>


This creates three ports. The guest sees them as:
This creates two ports. The guest sees them as:


<pre>
<pre>
/dev/vcon1
/dev/vport0p1
/dev/vcon2
/dev/vport0p2
/dev/vcon3
</pre>
</pre>


The ports are assigned some properties:
The ports are assigned some properties:
* cache_buffers: default 1. This property specifies whether ports retain data received when the char device is closed on the guest or when the qemu chardev connection is closed on the host.
* byte_limit, guest_byte_limit: These properties specify the max. number of bytes that can be cached before no more data is pushed out. This is to prevent OOM conditions from happening inside the host or the guest.
* name: This property puts the string in the guest's sysfs entries for it to be found by udev rules to create symlinks to the actual device. This is useful for guest applications discovering the ports of their interest. For example,
* name: This property puts the string in the guest's sysfs entries for it to be found by udev rules to create symlinks to the actual device. This is useful for guest applications discovering the ports of their interest. For example,


<pre>
<pre>
$ cat /sys/class/virtio-console/vcon1/name
$ cat /sys/class/virtio-ports/vport0p1/name
org.linux-kvm.port.0
org.linux-kvm.port.0
$
$
</pre>
</pre>
A simple udev rule can create a symlink to the actual device from this name. The rule for creating these symlinks has been included in udev-151. If you have an older version of udev, you can do this locally by creating a new file in <code>/etc/udev/rules.d</code>, eg, <code>90-virtio-ports</code> and put the following code in it:
<pre>
KERNEL=="vport*", SYMLINK+="virtio-ports/$ATTR{name}"
</pre>
In the above example, a symlink, <code>/dev/virtio-ports/org.linux-kvm.port.0</code> will be created that points to <code>/dev/vport0p1</code>
To create console ports, use:
<pre>
-device virtio-serial \
-device virtconsole,chardev=...,name=console.0
</pre>
You can then spawn a tty on this console port from the guest:
<pre>
# agetty /dev/hvc0 9600 vt100
</pre>
Multiple console ports can be specified on the command line and they will be available as /dev/hvc0, /dev/hvc1...
<br />
== Code ==
The code for the qemu device has been merged in qemu upstream sources on 20 Jan 2010, starting from commit 98b19252cf1bd97c54bc4613f3537c5ec0aae263. The feature will be available in the next major QEMU release after 0.12.
The corresponding kernel driver will be available in the Linux kernel 2.6.35 release.


<br />
<br />
Line 106: Line 131:
A repository containing test code is put up at
A repository containing test code is put up at


http://fedorapeople.org/gitweb?p=amitshah/public_git/test-virtserial.git
http://fedorapeople.org/cgit/amitshah/public_git/test-virtserial.git/


This repo contains manual as well as automated testsuites that can be run to verify the functionality. The test-virtserial.c file also documents the various options and the ways in which they can be tested.
This repo contains manual as well as automated testsuites that can be run to verify the functionality. The test-virtserial.c file also documents the various options and the ways in which they can be tested.
See also the Fedora 13 Feature Page for more information: https://fedoraproject.org/wiki/Features/VirtioSerial#How_To_Test
<br />
== API ==
The [[virtio-serial API]] page has information on the API exposed by Linux as well as Windows guests for application programmers to use the channel.

Latest revision as of 13:28, 4 February 2013

Requirements

  • We want an interface between the guest and the host
  • The channel is to be used for simple communication, like sharing of the clipboard between the user desktop and the guest desktop
    • For relatively low rate of data transfer -- a few MB/s
    • Events to be delivered to the guest, like 'shutdown', 'reboot', 'logoff'
    • Queries to the guest, like 'which users are logged in'
  • Survive live migration
  • Support for multiple agents (consumers of the data) on the guest
  • Multiple channels could be opened at the same time
  • In multi-channels case, one blocked channel shouldn't block communication between others (or one channel shouldn't hog all the bandwidth)
  • Stable ABI (for future upgrades)
  • Channel addressing
    • An agent in the guest should be able to find the channel it's interested in
  • Dynamic channel creation
  • Security
    • No threats to the host
    • Unprivileged user should be able to use the channel
  • Should work out of the box, without any configuration necessary on the part of the guest
  • Notifications of channels being added / removed (hotplugging)
  • Notifications on connection / disconnection on guest as well as host side
  • An API inside qemu to communicate with agents in the guest


History

A few reasons why the obvious solutions do not work:

  • via the fully emulated serial device.
    • performance (exit per byte)
    • scalability - only 4 serial ports per guest
    • accessed by root only in the guest
  • via TCP/IP network sockets
    • The guest may not have networking enabled
    • The guest firewall may block access to the host IPs
    • Windows can't bind sockets to specific ethernet interfaces


Use Cases

  • Guest - Host clipboard copy/paste operations
    • By a VMM or via an internal API within qemu
  • libguestfs (offline usage)
    • For poking inside a guest to fetch the list of installed apps, etc.
  • Online usage
    • Locking desktop session when vnc session is closed
  • Cluster I/O Fencing aka STONITH
    • Current models require networking between guest/host
      • fence_virsh, xen0 -> ssh to defined host and to perform fencing; no migration tracking; requires ssh key distribution to work.
      • fence_xvm -> tracks migrations, but requires multicast between guest/host; distributed key recommended but not required
    • Using VMChannel-Serial, the requirement of guest-host can be avoided
      • fence-virt has a plugin which uses serial VMchannel to tunnel through to the host.
    • Key distribution of any sort can be avoided, making this easier to configure than existing solutions


Invocation

The virtio-console code is extended to spawn multiple serial ports inside the guest. Creating the serial ports on the host looks like this:

-device virtio-serial \
-device virtserialport,chardev=...,name=org.linux-kvm.port.0 \
-device virtserialport,chardev=...,name=org.linux-kvm.port.1

This creates two ports. The guest sees them as:

/dev/vport0p1
/dev/vport0p2

The ports are assigned some properties:

  • name: This property puts the string in the guest's sysfs entries for it to be found by udev rules to create symlinks to the actual device. This is useful for guest applications discovering the ports of their interest. For example,
$ cat /sys/class/virtio-ports/vport0p1/name
org.linux-kvm.port.0
$

A simple udev rule can create a symlink to the actual device from this name. The rule for creating these symlinks has been included in udev-151. If you have an older version of udev, you can do this locally by creating a new file in /etc/udev/rules.d, eg, 90-virtio-ports and put the following code in it:

KERNEL=="vport*", SYMLINK+="virtio-ports/$ATTR{name}"

In the above example, a symlink, /dev/virtio-ports/org.linux-kvm.port.0 will be created that points to /dev/vport0p1


To create console ports, use:

-device virtio-serial \
-device virtconsole,chardev=...,name=console.0

You can then spawn a tty on this console port from the guest:

# agetty /dev/hvc0 9600 vt100

Multiple console ports can be specified on the command line and they will be available as /dev/hvc0, /dev/hvc1...


Code

The code for the qemu device has been merged in qemu upstream sources on 20 Jan 2010, starting from commit 98b19252cf1bd97c54bc4613f3537c5ec0aae263. The feature will be available in the next major QEMU release after 0.12.

The corresponding kernel driver will be available in the Linux kernel 2.6.35 release.


Testing

A repository containing test code is put up at

http://fedorapeople.org/cgit/amitshah/public_git/test-virtserial.git/

This repo contains manual as well as automated testsuites that can be run to verify the functionality. The test-virtserial.c file also documents the various options and the ways in which they can be tested.

See also the Fedora 13 Feature Page for more information: https://fedoraproject.org/wiki/Features/VirtioSerial#How_To_Test


API

The virtio-serial API page has information on the API exposed by Linux as well as Windows guests for application programmers to use the channel.