blob: 4d3cc6cf593a716d639f638192662aebbcd2f8fe [file] [log] [blame] [view] [edit]
# Software Delivery README
## Overview
The Software Delivery (SWD) stack is responsible for all updates of runnable
software on a Fuchsia device, including system updates and individual package
updates.
This document serves as a jumping-off point for the SWD codebase, and a
contribution guide.
Before starting, you may wish to read some [documentation][packaging-docs] on
Fuchsia software packaging, or the [long term SWD goals][goals].
### Software Delivery (SWD) Subsystems
![Software Delivery Diagram](doc/overview.png)
### Major Binaries
Updated: June 2021
| Subsystem | Purpose | Location | Language |
|----------------------- |----------------------------------------------------------------------------------------------------|----------------------------------------------|----------|
| pkg-cache | Caches downloaded packages in case they are needed again. | `//src/sys/pkg/bin/pkg-cache` | Rust |
| pkg-resolver | Main entry point for software delivery stack. Coordinates retrieval and installation of packages. | `//src/sys/pkg/bin/pkg-resolver` | Rust |
| omaha-client | Checks for system updates using the Omaha server infrastructure | `//src/sys/pkg/bin/omaha-client` | Rust |
| pkgctl | CLI for pkg-resolver | `//src/sys/pkg/bin/pkgctl` | Rust |
| pkgfs | A filesystem for interacting with packages that are stored on a host. | `//src/sys/pkg/bin/pkgfs/pkgfs` | Go |
| system-ota-test | An end-to-end test of system over the air updates. | `//src/sys/pkg/tests/system-ota-tests` | Go |
| system-update-checker | Does what it says on the tin, checks for system updates! | `//src/sys/pkg/bin/system-update-checker` | Rust |
| system-updater-committer | Component responsible for committing the update. | `//src/sys/pkg/bin/system-update-committer` | Rust |
| system-updater | Actually performs system updates. | `//src/sys/pkg/bin/system-updater` | Rust |
#### Key Dependencies
* [rust-tuf](https://fuchsia.googlesource.com/third_party/rust_crates/mirrors/rust-tuf/)
* [go-tuf](https://fuchsia.googlesource.com/third_party/go-tuf/)
* [hyper](https://github.com/hyperium/hyper)
* [rustls](https://github.com/ctz/rustls).
#### Useful Debugging Tools
* [`fidlcat`](https://fuchsia.dev/fuchsia-src/development/tools/fidl_inspecting):
its `strace`, but for every IPC on the system, not just syscalls.
* [`zxdb`](https://fuchsia.dev/fuchsia-src/development/debugger/debugger_usage):
Fuchsias debugger. Similar usage to `gdb`, and has Unicode support
(emoji!). Doesnt currently work well with golang, but works fine with Rust.
* [Inspect](https://fuchsia.dev/fuchsia-src/development/inspect): Opt-in APIs
for components to expose aspects of their state. Several portions of the SWD
stack implement this, and more to come.
##### IDEs
VS Code seems to work pretty well. Follow the instructions
[here](https://fuchsia.dev/fuchsia-src/development/editors/vscode), including
any language-specific instructions you find relevant; the Rust instructions are
a good place to start.
#### Style Guide
Use the style guide appropriate for the language youre in. The SWD stack is
mostly in Rust and Go, which have strong opinions about style. All commits in
those languages should be formatted with `rustfmt` and `gofmt` respectively, and
most editors/IDEs have a mode in which you can run those commands when you save
a file. Do so!
### Setup
#### Fuchsia Setup
Read the Fuchsia Getting Started guide
[first](https://fuchsia.googlesource.com/fuchsia/+/HEAD/docs/get-started/index.md)
Most of the SWD stack is in the `base` image of fuchsia, so to get a swd stack
working with tests, your build configuration is quite simple:
#### First tests
```sh
Tab 1 > fx set core.x64 --with //bundles:tests && fx build && fx serve
Tab 2 > fx qemu -kN
Tab 3 > fx test pkg-resolver-integration-tests # example of running the pkg-resolver integration tests
```
For further info on fx workflows:
https://fuchsia.dev/fuchsia-src/development/workflows/fx
#### More general tests
If youve successfully run the above, you have a working Fuchsia system with the
software delivery stack working.
You can discover more tests with by running `fx list-packages` on the host.
### Common Workflows
##### Updating a base image to get a new version of pkg-resolver or pkgctl
To update the base of your fuchsia image, you can use `fx ota` if youre
running on hardware which supports OTA. If youre running under QEMU, youll
need to just restart QEMU to get an updated base after a rebuild. Dont worry,
its fast.
##### Pulling down a new version of an external dependency
Youll need to update that dependencys vendored repository in //third_party.
See the
[Rust documentation](/docs/development/languages/rust/third_party.md#steps-to-update-a-third_party-crate)
for examples.
##### Resolve a package and run a contained component
The package resolver is configured by default to resolve `fuchsia.com` to the
local development host. To run a component in a package youve built locally,
you can run something like `fx shell run
fuchsia-pkg://fuchsia.com/<package_name>#meta/<component_name>.cmx`
### FAQs
#### How do I run a hosted package server?
See the instructions on
[running a package repository with pm](https://fuchsia.dev/fuchsia-src/development/idk/documentation/packages)
### More information:
* [OTA Flow](/docs/concepts/packages/ota.md)
* [Package overview](/docs/development/idk/documentation/packages.md)
* [Package updates](/docs/concepts/packages/package_update.md)
* [Package metadata](/docs/concepts/packages/package.md)
* [Package URLs](/docs/concepts/packages/package_url.md)
* [Software updates](/docs/concepts/system/software_update_system.md)
[packaging-docs]: /docs/concepts/packages/package.md
[goals]: /docs/contribute/governance/rfcs/0133_swd_goals.md