summary refs log tree commit diff
diff options
context:
space:
mode:
authorAlyssa Ross <hi@alyssa.is>2020-01-27 17:14:08 +0000
committerAlyssa Ross <hi@alyssa.is>2020-02-11 16:40:29 +0000
commit67b361d284a8cc94780f5797b4369df78a8278ac (patch)
treeaaccbdbb7fa0d704d43fb3a2681afcf33aeb582d
parentca5027323db6316ba242d98ddedd26350b06346e (diff)
downloadcrosvm-67b361d284a8cc94780f5797b4369df78a8278ac.tar
crosvm-67b361d284a8cc94780f5797b4369df78a8278ac.tar.gz
crosvm-67b361d284a8cc94780f5797b4369df78a8278ac.tar.bz2
crosvm-67b361d284a8cc94780f5797b4369df78a8278ac.tar.lz
crosvm-67b361d284a8cc94780f5797b4369df78a8278ac.tar.xz
crosvm-67b361d284a8cc94780f5797b4369df78a8278ac.tar.zst
crosvm-67b361d284a8cc94780f5797b4369df78a8278ac.zip
docs: make Markdown source more readable
Wrap long lines; use incrementing numbers in ordered lists rather than
making every item "1.".
-rw-r--r--CONTRIBUTING.md32
-rw-r--r--README.md3
-rw-r--r--docs/architecture.md238
3 files changed, 228 insertions, 45 deletions
diff --git a/CONTRIBUTING.md b/CONTRIBUTING.md
index 63ed15d..8889318 100644
--- a/CONTRIBUTING.md
+++ b/CONTRIBUTING.md
@@ -1,6 +1,8 @@
 ## Intro
 
-This article goes into detail about multiple areas of interest to contributors, which includes reviewers, developers, and integrators who each share an interest in guiding crosvm's direction.
+This article goes into detail about multiple areas of interest to contributors,
+which includes reviewers, developers, and integrators who each share an interest
+in guiding crosvm's direction.
 
 ## Guidelines
 
@@ -9,32 +11,48 @@ The following is high level guidance for producing contributions to crosvm.
 - Prefer mechanism to policy.
 - Use existing protocols when they are adequate, such as virtio.
 - Prefer security over code re-use and speed of development.
-- Only the version of Rust in use by the Chrome OS toolchain is supported. This is ordinarily the stable version of Rust, but can be behind a version for a few weeks.
+- Only the version of Rust in use by the Chrome OS toolchain is supported. This
+  is ordinarily the stable version of Rust, but can be behind a version for a
+  few weeks.
 - Avoid distribution specific code.
 
 ## Code Health
 
 ### Scripts
 
-In the `bin/` directory of the crosvm repository, there is the `clippy` script which lints the Rust code and the `fmt` script which will format the crosvm Rust code inplace. When submitting changes, the `bin/smoke_test` script, which checks Rust format and unit tests, will be run by Kokoro, the internal Google run cloud builder, and the results will be posted to the change. Kokoro is only informational, so if Kokoro rejects a change, it can still be submitted.
+In the `bin/` directory of the crosvm repository, there is the `clippy` script
+which lints the Rust code and the `fmt` script which will format the crosvm Rust
+code inplace. When submitting changes, the `bin/smoke_test` script, which checks
+Rust format and unit tests, will be run by Kokoro, the internal Google run cloud
+builder, and the results will be posted to the change. Kokoro is only
+informational, so if Kokoro rejects a change, it can still be submitted.
 
 ###  Submitting Code
 
 See also, [Chrome OS Contributing Guide](https://chromium.googlesource.com/chromiumos/docs/+/master/contributing.md)
 
-When a change is approved, verified, and added to the [commit queue](https://chromium.googlesource.com/chromiumos/docs/+/master/contributing.md#send-your-changes-to-the-commit-queue), crosvm will be built and the unit tests (with some exceptions) will be run by the Chrome OS infrastructure. Only if that passes, will the change be submitted. Failures here will cause the commit queue to reject the change until it is re-added (CQ+2). Unfortunately, it is extremely common for false negatives to cause a change to get rejected, so be ready to re-apply the CQ+2 label if you're the owner of a ready to submit change.
+When a change is approved, verified, and added to the [commit queue](https://chromium.googlesource.com/chromiumos/docs/+/master/contributing.md#send-your-changes-to-the-commit-queue), crosvm will
+be built and the unit tests (with some exceptions) will be run by the Chrome OS
+infrastructure. Only if that passes, will the change be submitted. Failures here
+will cause the commit queue to reject the change until it is re-added
+(CQ+2). Unfortunately, it is extremely common for false negatives to cause a
+change to get rejected, so be ready to re-apply the CQ+2 label if you're the
+owner of a ready to submit change.
 
 ### Style guidelines
 
-To format all code, crosvm defers to rustfmt. In addition, the code adheres to the following rules:
+To format all code, crosvm defers to rustfmt. In addition, the code adheres to
+the following rules:
 
 The `use` statements for each module should be grouped in this order
 
-1.  `std`
+1. `std`
 2. third-party crates
 3. chrome os crates
 4. crosvm crates
 5. `crate`
 
-crosvm uses the [remain](https://github.com/dtolnay/remain) crate to keep error enums sorted, along with the `#[sorted]` attribute to keep their corresponding match statements in the same order.
+crosvm uses the [remain](https://github.com/dtolnay/remain) crate to keep error
+enums sorted, along with the `#[sorted]` attribute to keep their corresponding
+match statements in the same order.
 
diff --git a/README.md b/README.md
index ba85244..921101d 100644
--- a/README.md
+++ b/README.md
@@ -112,7 +112,8 @@ requirements:
 * `virtio-wayland` - The `memfd_create` syscall, introduced in Linux 3.17, and a Wayland compositor.
 * `vsock` - Host Linux kernel with vhost-vsock support, introduced in Linux 4.8.
 * `multiprocess` - Host Linux kernel with seccomp-bpf and Linux namespacing support.
-* `virtio-net` - Host Linux kernel with TUN/TAP support (check for `/dev/net/tun`) and running with `CAP_NET_ADMIN` privileges.
+* `virtio-net` - Host Linux kernel with TUN/TAP support (check for
+  `/dev/net/tun`) and running with `CAP_NET_ADMIN` privileges.
 
 ## Emulated Devices
 
diff --git a/docs/architecture.md b/docs/architecture.md
index ab830b4..381f0e1 100644
--- a/docs/architecture.md
+++ b/docs/architecture.md
@@ -1,4 +1,4 @@
-# Architectural Overview (last edit: January 21, 2020)
+# Architectural Overview
 
 The principle characteristics of crosvm are:
 
@@ -7,76 +7,240 @@ The principle characteristics of crosvm are:
 - Takes full advantage of KVM and low-level Linux syscalls, and so only runs on Linux
 - Written in Rust for security and safety
 
-A typical session of crosvm starts in `main.rs` where command line parsing is done to build up a `Config` structure. The `Config` is used by `run_config` in `linux.rs` to setup and execute a VM. Broken down into rough steps:
+A typical session of crosvm starts in `main.rs` where command line
+parsing is done to build up a `Config` structure. The `Config` is used by
+`run_config` in `linux.rs` to setup and execute a VM. Broken down into
+rough steps:
 
 1. Load the linux kernel from an ELF file.
-1. Create a handful of control sockets used by the virtual devices.
-1. Invoke the architecture specific VM builder `Arch::build_vm` (located in `x86_64/src/lib.rs` or `aarch64/src/lib.rs`).
-1. `Arch::build_vm` will itself invoke the provided `create_devices` function from `linux.rs`
-1. `create_devices` creates every PCI device, including the virtio devices, that were configured in `Config`, along with matching [minijail] configs for each.
-1. `Arch::generate_pci_root`, using a list of every PCI device with optional `Minijail`, will finally jail the PCI devices and construct a `PciRoot` that communicates with them.
-1. Once the VM has been built, it's contained within a `RunnableLinuxVm` object that is used by the VCPUs and control loop to service requests until shutdown.
+2. Create a handful of control sockets used by the virtual devices.
+3. Invoke the architecture specific VM builder `Arch::build_vm` (located
+   in `x86_64/src/lib.rs` or `aarch64/src/lib.rs`).
+4. `Arch::build_vm` will itself invoke the provided `create_devices`
+   function from `linux.rs`
+5. `create_devices` creates every PCI device, including the virtio
+   devices, that were configured in `Config`, along with matching
+   [minijail] configs for each.
+6. `Arch::generate_pci_root`, using a list of every PCI device with
+   optional `Minijail`, will finally jail the PCI devices and construct
+   a `PciRoot` that communicates with them.
+7. Once the VM has been built, it's contained within a `RunnableLinuxVm`
+   object that is used by the VCPUs and control loop to service
+   requests until shutdown.
 
 ## Forking
 
-During the device creation routine, each device will be created and then wrapped in a `ProxyDevice` which will internally `fork` (but not `exec`) and [minijail] the device, while dropping it for the main process. The only interaction that the device is capable of having with the main process is via the proxied trait methods of `BusDevice`, shared memory mappings such as the guest memory, and file descriptors that were specifically whitelisted by that device's security policy. This can lead to some surprising behavior to be aware of such as why some file descriptors which were once valid are now invalid.
+During the device creation routine, each device will be created and
+then wrapped in a `ProxyDevice` which will internally `fork` (but not
+`exec`) and [minijail] the device, while dropping it for the main
+process. The only interaction that the device is capable of having
+with the main process is via the proxied trait methods of `BusDevice`,
+shared memory mappings such as the guest memory, and file descriptors
+that were specifically whitelisted by that device's security
+policy. This can lead to some surprising behavior to be aware of such
+as why some file descriptors which were once valid are now invalid.
 
 ## Sandboxing Policy
 
-Every sandbox is made with [minijail], invoked using the `io_jail` crate in crosvm, and starts with `create_base_minijail` in `linux.rs` which set some very restrictive settings. Linux namespaces and seccomp filters are used extensively. Each seccomp policy can be found under `seccomp/{arch}/{device}.policy` and should start by `@include`-ing the `common_device.policy`. With the exception of architecture specific devices (such as `Pl030` on ARM or `I8042` on x86_64), every device will need a different policy for each supported architecture.
+Every sandbox is made with [minijail], invoked using the `io_jail` crate
+in crosvm, and starts with `create_base_minijail` in `linux.rs` which set
+some very restrictive settings. Linux namespaces and seccomp filters
+are used extensively. Each seccomp policy can be found under
+`seccomp/{arch}/{device}.policy` and should start by `@include`-ing the
+`common_device.policy`. With the exception of architecture specific
+devices (such as `Pl030` on ARM or `I8042` on x86_64), every device will
+need a different policy for each supported architecture.
 
 ## The VM Control Sockets
 
-For the operations that devices need to perform on the global VM state, such as mapping into guest memory address space, there are the vm control sockets. There are a few kinds, split by the type of request and response that the socket will process. This also proves basic security privilege separation in case a device becomes compromised by a malicious guest. For example, a rogue device that is able to allocate MSI routes would not be able to use the same socket to (de)register guest memory. During the device initialization stage, each device that requires some aspect of VM control will have a constructor that requires the corresponding control socket. The control socket will get preserved when the device is sandboxed and and the other side of the socket will be waited on in the main process's control loop.
-
-The socket exposed by crosvm with the `--socket` command line argument is another form of the VM control socket. Because the protocol of the control socket is internal and unstable, the only supported way of using that resulting named unix domain socket is via crosvm command line subcommands such as `crosvm stop`.
+For the operations that devices need to perform on the global VM
+state, such as mapping into guest memory address space, there are the
+vm control sockets. There are a few kinds, split by the type of
+request and response that the socket will process. This also proves
+basic security privilege separation in case a device becomes
+compromised by a malicious guest. For example, a rogue device that is
+able to allocate MSI routes would not be able to use the same socket
+to (de)register guest memory. During the device initialization stage,
+each device that requires some aspect of VM control will have a
+constructor that requires the corresponding control socket. The
+control socket will get preserved when the device is sandboxed and and
+the other side of the socket will be waited on in the main process's
+control loop.
+
+The socket exposed by crosvm with the `--socket` command line argument
+is another form of the VM control socket. Because the protocol of the
+control socket is internal and unstable, the only supported way of
+using that resulting named unix domain socket is via crosvm command
+line subcommands such as `crosvm stop`.
 
 ## GuestMemory
 
-`GuestMemory` and its friends `VolatileMemory`, `VolatileSlice`, `MemoryMapping`, and `SharedMemory`, are common types used throughout crosvm to interact with guest memory. Know which one to use in what place using some guidelines
-
-- `GuestMemory` is for sending around references to all of the guest memory. It can be cloned freely, but the underlying guest memory is always the same. Internally, it's implemented using `MemoryMapping` and `SharedMemory`. Note that `GuestMemory` is mapped into the host address space, but it is non-contiguous. Device memory, such as mapped DMA-Bufs, are not present in `GuestMemory`.
-- `SharedMemory` wraps a `memfd` and can be mapped using `MemoryMapping` to access its data. `SharedMemory` can't be cloned.
-- `VolatileMemory` is a trait that exposes generic access to non-contiguous memory. `GuestMemory` implements this trait. Use this trait for functions that operate on a memory space but don't necessarily need it to be guest memory.
-- `VolatileSlice` is analogous to a Rust slice, but unlike those, a `VolatileSlice` has data that changes asynchronously by all those that reference it. Exclusive mutability and data synchronization are not available when it comes to a `VolatileSlice`. This type is useful for functions that operate on contiguous shared memory, such as a single entry from a scatter gather table, or for safe wrappers around functions which operate on pointers, such as a `read` or `write` syscall.
-- `MemoryMapping` is a safe wrapper around anonymous and file mappings. Access via Rust references is forbidden, but indirect reading and writing is available via `VolatileSlice` and several convenience functions. This type is most useful for mapping memory unrelated to `GuestMemory`.
+`GuestMemory` and its friends `VolatileMemory`, `VolatileSlice`,
+`MemoryMapping`, and `SharedMemory`, are common types used throughout
+crosvm to interact with guest memory. Know which one to use in what
+place using some guidelines
+
+- `GuestMemory` is for sending around references to all of the guest
+  memory. It can be cloned freely, but the underlying guest memory is
+  always the same. Internally, it's implemented using `MemoryMapping`
+  and `SharedMemory`. Note that `GuestMemory` is mapped into the host
+  address space, but it is non-contiguous. Device memory, such as
+  mapped DMA-Bufs, are not present in `GuestMemory`.
+- `SharedMemory` wraps a `memfd` and can be mapped using `MemoryMapping` to
+  access its data. `SharedMemory` can't be cloned.
+- `VolatileMemory` is a trait that exposes generic access to
+  non-contiguous memory. `GuestMemory` implements this trait. Use this
+  trait for functions that operate on a memory space but don't
+  necessarily need it to be guest memory.
+- `VolatileSlice` is analogous to a Rust slice, but unlike those, a
+  `VolatileSlice` has data that changes asynchronously by all those that
+  reference it. Exclusive mutability and data synchronization are not
+  available when it comes to a `VolatileSlice`. This type is useful for
+  functions that operate on contiguous shared memory, such as a single
+  entry from a scatter gather table, or for safe wrappers around
+  functions which operate on pointers, such as a `read` or `write`
+  syscall.
+- `MemoryMapping` is a safe wrapper around anonymous and file
+  mappings. Access via Rust references is forbidden, but indirect
+  reading and writing is available via `VolatileSlice` and several
+  convenience functions. This type is most useful for mapping memory
+  unrelated to `GuestMemory`.
 
 ### Device Model
 
 ### `Bus`/`BusDevice`
 
-The root of the crosvm device model is the `Bus` structure and its friend the `BusDevice` trait. The `Bus` structure is a virtual computer bus used to emulate the memory-mapped I/O bus and also I/O ports for x86 VMs. On a read or write to an address on a VM's bus, the corresponding `Bus` object is queried for a `BusDevice` that occupies that address. `Bus` will then forward the read/write to the `BusDevice`. Because of this behavior, only one `BusDevice` may exist at any given address. However, a `BusDevice` may be placed at more than one address range. Depending on how a `BusDevice` was inserted into the `Bus`, the forwarded read/write will be relative to 0 or to the start of the address range that the `BusDevice` occupies (which would be ambiguous if the `BusDevice` occupied more than one range).
-
-Only the base address of a multi-byte read/write is used to search for a device, so a device implementation should be aware that the last address of a single read/write may be outside its address range. For example, if a `BusDevice` was inserted at base address 0x1000 with a length of 0x40, a 4-byte read by a VCPU at 0x39 would be forwarded to that `BusDevice`.
-
-Each `BusDevice` is reference counted and wrapped in a mutex, so implementations of `BusDevice` need not worry about synchronizing their access across multiple VCPUs and threads. Each VCPU will get a complete copy of the `Bus`, so there is no contention for querying the `Bus` about an address. Once the `BusDevice` is found, the `Bus` will acquire an exclusive lock to the device and forward the VCPU's read/write. The implementation of the `BusDevice` will block execution of the VCPU that invoked it, as well as any other VCPU attempting access, until it returns from its method.
-
-Most devices in crosvm do not implement `BusDevice` directly, but some are examples are `i8042` and `Serial`. With the exception of PCI devices, all devices are inserted by architecture specific code (which may call into the architecture-neutral `arch` crate). A `BusDevice` can be proxied to a sandboxed process using `ProxyDevice`, which will create the second process using a fork, with no exec.
+The root of the crosvm device model is the `Bus` structure and its
+friend the `BusDevice` trait. The `Bus` structure is a virtual computer
+bus used to emulate the memory-mapped I/O bus and also I/O ports for
+x86 VMs. On a read or write to an address on a VM's bus, the
+corresponding `Bus` object is queried for a `BusDevice` that occupies that
+address. `Bus` will then forward the read/write to the
+`BusDevice`. Because of this behavior, only one `BusDevice` may exist at
+any given address. However, a `BusDevice` may be placed at more than one
+address range. Depending on how a `BusDevice` was inserted into the `Bus`,
+the forwarded read/write will be relative to 0 or to the start of the
+address range that the `BusDevice` occupies (which would be ambiguous if
+the `BusDevice` occupied more than one range).
+
+Only the base address of a multi-byte read/write is used to search for
+a device, so a device implementation should be aware that the last
+address of a single read/write may be outside its address range. For
+example, if a `BusDevice` was inserted at base address 0x1000 with a
+length of 0x40, a 4-byte read by a VCPU at 0x39 would be forwarded to
+that `BusDevice`.
+
+Each `BusDevice` is reference counted and wrapped in a mutex, so
+implementations of `BusDevice` need not worry about synchronizing their
+access across multiple VCPUs and threads. Each VCPU will get a
+complete copy of the `Bus`, so there is no contention for querying the
+`Bus` about an address. Once the `BusDevice` is found, the `Bus` will
+acquire an exclusive lock to the device and forward the VCPU's
+read/write. The implementation of the `BusDevice` will block execution
+of the VCPU that invoked it, as well as any other VCPU attempting
+access, until it returns from its method.
+
+Most devices in crosvm do not implement `BusDevice` directly, but some
+are examples are `i8042` and `Serial`. With the exception of PCI devices,
+all devices are inserted by architecture specific code (which may call
+into the architecture-neutral `arch` crate). A `BusDevice` can be proxied
+to a sandboxed process using `ProxyDevice`, which will create the second
+process using a fork, with no exec.
 
 ### `PciConfigIo`/`PciConfigMmio`
 
-In order to use the more complex PCI bus, there are a couple adapters that implement `BusDevice` and call into a `PciRoot` with higher level calls to `config_space_read`/`config_space_write`. The `PciConfigMmio` is a `BusDevice` for insertion into the MMIO `Bus` for ARM devices. For x86_64, `PciConfigIo` is inserted into the I/O port `Bus`. There is only one implementation of `PciRoot` that is used by either of the `PciConfig*` structures. Because these devices are very simple, they have very little code or state. They aren't sandboxed and are run as part of the main process.
+In order to use the more complex PCI bus, there are a couple adapters
+that implement `BusDevice` and call into a `PciRoot` with higher level
+calls to `config_space_read`/`config_space_write`. The `PciConfigMmio` is a
+`BusDevice` for insertion into the MMIO `Bus` for ARM devices. For x86_64,
+`PciConfigIo` is inserted into the I/O port `Bus`. There is only one
+implementation of `PciRoot` that is used by either of the `PciConfig*`
+structures. Because these devices are very simple, they have very
+little code or state. They aren't sandboxed and are run as part of the
+main process.
 
 ### `PciRoot`/`PciDevice`/`VirtioPciDevice`
 
-The `PciRoot`, analogous to `BusDevice` for `Bus`s, contains all the `PciDevice` trait objects. Because of a shortcut (or hack), the `ProxyDevice` only supports jailing `BusDevice` traits. Therefore, `PciRoot` only contains `BusDevice`s, even though they also implement `PciDevice`. In fact, every `PciDevice` also implements `BusDevice` because of a blanket implementation (`impl<T: PciDevice> BusDevice for T { … }`). There are a few PCI related methods in `BusDevice` to allow the `PciRoot` to still communicate with the underlying `PciDevice` (yes, this abstraction is very leaky). Most devices will not implement `PciDevice` directly, instead using the `VirtioPciDevice` implementation for virtio devices, but the xHCI (USB) controller is an example that implements `PciDevice` directly. The `VirtioPciDevice` is an implementation of `PciDevice` that wraps a `VirtioDevice`, which is how the virtio specified PCI transport is adapted to a transport agnostic `VirtioDevice` implementation.
+The `PciRoot`, analogous to `BusDevice` for `Bus`s, contains all the
+`PciDevice` trait objects. Because of a shortcut (or hack), the
+`ProxyDevice` only supports jailing `BusDevice` traits. Therefore, `PciRoot`
+only contains `BusDevice`s, even though they also implement
+`PciDevice`. In fact, every `PciDevice` also implements `BusDevice` because
+of a blanket implementation (`impl<T: PciDevice> BusDevice for T { …
+}`). There are a few PCI related methods in `BusDevice` to allow the
+`PciRoot` to still communicate with the underlying `PciDevice` (yes, this
+abstraction is very leaky). Most devices will not implement `PciDevice`
+directly, instead using the `VirtioPciDevice` implementation for virtio
+devices, but the xHCI (USB) controller is an example that implements
+`PciDevice` directly. The `VirtioPciDevice` is an implementation of
+`PciDevice` that wraps a `VirtioDevice`, which is how the virtio specified
+PCI transport is adapted to a transport agnostic `VirtioDevice`
+implementation.
 
 ### `VirtioDevice`
 
-The `VirtioDevice` is the most widely implemented trait among the device traits. Each of the different virtio devices (block, rng, net, etc.) implement this trait directly and they follow a similar pattern. Most of the trait methods are easily filled in with basic information about the specific device, but `activate` will be the heart of the implementation. It's called by the virtio transport after the guest's driver has indicated the device has been configured and is ready to run. The virtio device implementation will receive the run time related resources (`GuestMemory`, `Interrupt`, etc.) for processing virtio queues and associated interrupts via the arguments to `activate`, but `activate` can't spend its time actually processing the queues. A VCPU will be blocked as long as `activate` is running. Every device uses `activate` to launch a worker thread that takes ownership of run time resources to do the actual processing. There is some subtlety in dealing with virtio queues, so the smart thing to do is copy a simpler device and adapt it, such as the rng device (`rng.rs`).
+The `VirtioDevice` is the most widely implemented trait among the device
+traits. Each of the different virtio devices (block, rng, net, etc.)
+implement this trait directly and they follow a similar pattern. Most
+of the trait methods are easily filled in with basic information about
+the specific device, but `activate` will be the heart of the
+implementation. It's called by the virtio transport after the guest's
+driver has indicated the device has been configured and is ready to
+run. The virtio device implementation will receive the run time
+related resources (`GuestMemory`, `Interrupt`, etc.) for processing virtio
+queues and associated interrupts via the arguments to `activate`, but
+`activate` can't spend its time actually processing the queues. A VCPU
+will be blocked as long as `activate` is running. Every device uses
+`activate` to launch a worker thread that takes ownership of run time
+resources to do the actual processing. There is some subtlety in
+dealing with virtio queues, so the smart thing to do is copy a simpler
+device and adapt it, such as the rng device (`rng.rs`).
 
 ## Communication Framework
 
-Because of the multi-process nature of crosvm, communication is done over several IPC primitives. The common ones are shared memory pages, unix sockets, anonymous pipes, and various other file descriptor variants (DMA-buf, eventfd, etc.). Standard methods (`read`/`write`) of using these primitives may be used, but crosvm has developed some helpers which should be used where applicable.
+Because of the multi-process nature of crosvm, communication is done
+over several IPC primitives. The common ones are shared memory pages,
+unix sockets, anonymous pipes, and various other file descriptor
+variants (DMA-buf, eventfd, etc.). Standard methods (`read`/`write`) of
+using these primitives may be used, but crosvm has developed some
+helpers which should be used where applicable.
 
 ### `PollContext`/`EpollContext`
 
-Most threads in crosvm will have a wait loop using a `PollContext`, which is a wrapper around Linux's `epoll` primitive for selecting over file descriptors. `EpollContext` is very similar but has slightly fewer features, but is usable by multiple threads at once. In either case, each FD is added to the context along with an associated token, whose type is the type parameter of `PollContext`. This token must be convertible to and from a `u64`, which is a limitation imposed by how `epoll` works. There is a custom derive `#[derive(PollToken)]` which can be applied to an `enum` declaration that makes it easy to use your own enum in a `PollContext`.
-
-Note that the limitations of `PollContext` are the same as the limitations of `epoll`. The same FD can not be inserted more than once, and the FD will be automatically removed if the process runs out of references to that FD. A `dup`/`fork` call will increment that reference count, so closing the original FD will not actually remove it from the `PollContext`. It is possible to receive tokens from `PollContext` for an FD that was closed because of a race condition in which an event was registered in the background before the `close` happened. Best practice is to remove an FD before closing it so that events associated with it can be reliably eliminated.
+Most threads in crosvm will have a wait loop using a `PollContext`,
+which is a wrapper around Linux's `epoll` primitive for selecting over
+file descriptors. `EpollContext` is very similar but has slightly fewer
+features, but is usable by multiple threads at once. In either case,
+each FD is added to the context along with an associated token, whose
+type is the type parameter of `PollContext`. This token must be
+convertible to and from a `u64`, which is a limitation imposed by how
+`epoll` works. There is a custom derive `#[derive(PollToken)]` which can
+be applied to an `enum` declaration that makes it easy to use your own
+enum in a `PollContext`.
+
+Note that the limitations of `PollContext` are the same as the
+limitations of `epoll`. The same FD can not be inserted more than once,
+and the FD will be automatically removed if the process runs out of
+references to that FD. A `dup`/`fork` call will increment that reference
+count, so closing the original FD will not actually remove it from the
+`PollContext`. It is possible to receive tokens from `PollContext` for an
+FD that was closed because of a race condition in which an event was
+registered in the background before the `close` happened. Best practice
+is to remove an FD before closing it so that events associated with it
+can be reliably eliminated.
 
 ### MsgSocket
 
-Using raw sockets and pipes to communicate is very inconvenient for rich data types. To help make this easier and less error prone, crosvm has the `msg_socket` crate. Included is a trait for messages encodable on a Unix socket (`MsgOnSocket`), a set of traits for sending and receiving (`MsgSender`/`MsgReceiver`), and implementations of those traits over `UnixSeqpacket` (`MsgSocket`/`Sender`/`Receiver`). To make implementing `MsgOnSocket` very easy, a custom derive for that trait can be utilized with `#[derive(MsgOnSocket)]`. The custom derive will work for enums and structs with nested data, primitive types, and anything that implements `AsRawFd`. However, structures with no fixed upper limit in size, such as `Vec` or `BTreeMap`, are not supported.
-
-[minijail]: https://android.googlesource.com/platform/external/minijail
\ No newline at end of file
+Using raw sockets and pipes to communicate is very inconvenient for
+rich data types. To help make this easier and less error prone, crosvm
+has the `msg_socket` crate. Included is a trait for messages encodable
+on a Unix socket (`MsgOnSocket`), a set of traits for sending and
+receiving (`MsgSender`/`MsgReceiver`), and implementations of those traits
+over `UnixSeqpacket` (`MsgSocket`/`Sender`/`Receiver`). To make implementing
+`MsgOnSocket` very easy, a custom derive for that trait can be utilized
+with `#[derive(MsgOnSocket)]`. The custom derive will work for enums and
+structs with nested data, primitive types, and anything that
+implements `AsRawFd`. However, structures with no fixed upper limit in
+size, such as `Vec` or `BTreeMap`, are not supported.
+
+[minijail]: https://android.googlesource.com/platform/external/minijail