Skip to content

Commit 283a7b5

Browse files
committed
projects: add umoci proposal
Signed-off-by: Aleksa Sarai <[email protected]>
1 parent 9fb30af commit 283a7b5

File tree

2 files changed

+189
-0
lines changed

2 files changed

+189
-0
lines changed

README.md

+1
Original file line numberDiff line numberDiff line change
@@ -26,6 +26,7 @@ https://groups.google.com/a/opencontainers.org/forum/#!forum/tob (tob@opencontai
2626
* [Image Format Spec](proposals/image-format)
2727
* [SELinux](proposals/selinux.md)
2828
* [Tools](proposals/tools.md)
29+
* [umoci](proposals/umoci.md)
2930

3031
## Voting
3132

proposals/umoci.md

+188
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,188 @@
1+
# OCI umoci Project Proposal #
2+
3+
## Abstract ##
4+
The need for a "works out of the box" image tool that is supported by OCI has been clear for several years.
5+
umoci was initially developed to fulfil this requirement, and after several years of development and wide-spread production usage, we feel it is time to include it within the OCI.
6+
The following proposal outlines how this would be achieved.
7+
8+
## Background ##
9+
To quote the description of umoci from [the project website][umoci]:
10+
11+
> umoci is a free software tool for manipulating and interacting with container
12+
> images in the standardised Open Container Initiative’s image format. It
13+
> provides one of the most flexible image management toolsets, requiring
14+
> neither a daemon nor any particular filesystem setup. It is already used in a
15+
> variety of different projects and by several companies.
16+
17+
umoci is primarily used as a command-line tool, and can be used to perform fundamental operations on an OCI container image.
18+
An example session looks like
19+
20+
```shell
21+
$ umoci unpack --image opensuse:leap bundle
22+
$ runc run -b bundle ctr
23+
# # make some changes...
24+
$ umoci repack --image opensuse:leap bundle
25+
```
26+
27+
Where `opensuse` is an OCI image layout stored as a directory, and `leap` is a "tag" in the OCI image.
28+
The above session extracted (`umoci unpack`) the image as an OCI OCI Runtime Specification bundle, spawned a container using the bundle (`runc run ...`), and then updated the image to create a new image layer based on any changes made (`umoci repack`).
29+
30+
umoci has a fairly minimal feature set, and was intended from the outset to implement all of the key features which are needed from a reference implementation of the OCI OCI Image Specifications.
31+
The help page for the latest version of `umoci` (`0.4.5` at the time of writing) is provided below:
32+
33+
```
34+
NAME:
35+
umoci - umoci modifies Open Container images
36+
37+
USAGE:
38+
umoci [global options] command [command options] [arguments...]
39+
40+
VERSION:
41+
0.4.5
42+
43+
AUTHOR:
44+
Aleksa Sarai <[email protected]>
45+
46+
COMMANDS:
47+
raw advanced internal image tooling
48+
help, h Shows a list of commands or help for one command
49+
50+
image:
51+
config modifies the image configuration of an OCI image
52+
unpack unpacks a reference into an OCI runtime bundle
53+
repack repacks an OCI runtime bundle into a reference
54+
new creates a blank tagged OCI image
55+
tag creates a new tag in an OCI image
56+
remove, rm removes a tag from an OCI image
57+
stat displays status information of an image manifest
58+
insert insert content into an OCI image
59+
60+
layout:
61+
gc garbage-collects an OCI image's blobs
62+
init create a new OCI layout
63+
list, ls lists the set of tags in an OCI layout
64+
65+
GLOBAL OPTIONS:
66+
--verbose alias for --log=info
67+
--log value set the log level (debug, info, [warn], error, fatal) (default: "warn")
68+
--help, -h show help
69+
--version, -v print the version
70+
```
71+
72+
For a more detailed explanation of umoci, see the [project website's guide][umoci-guide].
73+
74+
[umoci]: https://umo.ci/
75+
[umoci-guide]: https://umo.ci/quick-start/
76+
77+
## Proposal ##
78+
Change the ownership of the existing umoci project from openSUSE:
79+
80+
https://github.com/openSUSE/umoci
81+
82+
And move it inside the `opencontainers` organisation:
83+
84+
https://github.com/opencontainers/umoci
85+
86+
The import paths will correspondingly be "github.com/opencontainers/umoci" (umoci does have some Go API users, but since the project will be renamed -- and GitHub will add a redirect -- there will be no significant downstream impact of the change).
87+
In future we may opt to use vanity imports (such as "umo.ci/cmd/umoci").
88+
89+
The project's domain "umo.ci" will also be transferred to the Linux Foundation so that it can be managed by someone other than the maintainers (though maintainers must maintain the necessary administrative access to maintain the website).
90+
91+
### Initial Maintainers ###
92+
Initial maintainers of the umoci project would be:
93+
94+
* Aleksa Sarai <[email protected]> (@cyphar)
95+
* Tycho Andersen <[email protected]> (@tych0)
96+
* Vincent Batts <[email protected]> (@vbatts)
97+
98+
### Code of Conduct ###
99+
This project would incorporate (by reference) the OCI [Code of Conduct][code-of-conduct].
100+
101+
[code-of-conduct]: https://github.com/opencontainers/org/blob/master/CODE_OF_CONDUCT.md
102+
103+
### Governance and Releases ###
104+
This project would incorporate the Governance and Releases processes from the OCI project template: https://github.com/opencontainers/project-template.
105+
106+
It should be noted that since umoci is not a specification, it is not bound by the ordinary quorum and voting rules for specification release.
107+
As such, new versions will be released as regularly as needed without the need for a quorum vote.
108+
This is to avoid the serious delays in releases encountered within the runc project.
109+
110+
Until there are enough additional maintainers, PRs will be merged with only one maintainer LGTM required.
111+
Maintainers are encouraged to not merge their own PRs immediately (preferably waiting at least 24 to 48 hours to allow another maintainer to review it), but this is not a strict rule.
112+
113+
### Project Communications ###
114+
The proposed project would continue to use existing channels in use by the OCI developer community for communication including:
115+
116+
* GitHub for issues and pull requests.
117+
* The [`[email protected]`][oci-ml] email list.
118+
* The weekly OCI developer community conference call.
119+
* The `#opencontainers` IRC channel on Freenode.
120+
* The [OCI Slack workspace][oci-slack].
121+
* The [OCI Matrix Room][oci-matrix].
122+
123+
[oci-ml]: mailto:[email protected]
124+
[oci-slack]: https://opencontainers.slack.com/
125+
[oci-matrix]: https://matrix.to/#/#opencontainers:matrix.org
126+
127+
### Roadmap ###
128+
umoci still has a fairly ambitious scope of work (much of it outside the scope of the OCI Image Specification), and this work would continue under OCI.
129+
Examples of such work include:
130+
131+
* Security hardening by porting umoci to [libpathrs][libpathrs].
132+
* Re-thinking the method by which images are referenced in the command-line.
133+
* Expanded support for configuring descriptor annotations in arbitrarily-structured OCI metadata trees.
134+
* Committing to a stable Go API and releasing a version 1.0 of the project.
135+
* Experimental design work for a new OCI OCI Image Specification layer format (code-named "OCIv2").
136+
* Hookable execution to allow for custom "storage drivers" to be defined by users (to avoid the maintenance overhead of supporting such drivers within umoci).
137+
This would effectively allow for higher-level tools to implement both image-build caching (by skipping the extraction of layers which are already available) and overlay filesystem support (by injecting `mount(8)` operations between layer extractions).
138+
139+
[libpathrs]: https://github.com/openSUSE/libpathrs
140+
141+
## Frequently Asked Questions (FAQ)
142+
> *Does this proposal change the OCI Charter?*
143+
144+
This proposal does not intend to amend the [OCI Charter][oci-charter].
145+
146+
[oci-charter]: https://github.com/opencontainers/tob/blob/master/CHARTER.md
147+
148+
> *Where does umoci fit into the OCI suite of projects?*
149+
150+
umoci is intended to be a *reference implementation of the OCI OCI Image Specification* as a "works out of the box" image manipulation tool, which provides a minimally abstracted set of operations to avoid users having to implement the OCI OCI Image Specification themselves.
151+
It is intended to fill a similar role to runc within the OCI OCI Runtime Specification -- that is, being a "boring container infrastructure tool" which larger systems can leverage.
152+
153+
Note that this proposal should not be interpreted as being intended to make the OCI prescribe the use of umoci for existing or new projects to use instead of their own OCI OCI Image Specification implementation.
154+
This proposal for umoci's inclusion is intended to make it easier for users who do not wish to implement the OCI Image Specification themselves to have a basic building block they can use for whatever system they are developing.
155+
While umoci is usable on its own, it is expected that the vast majority of umoci's users will be consuming it as part of a larger build system which uses umoci internally to abstract away the specifics of the OCI OCI Image Specification.
156+
157+
> *What about image-tools?*
158+
159+
The original intention of umoci was to be a wrapper around the OCI image-tools and slowly upstream the work.
160+
Unfortunately, in the past 4 years, the image-tools project has not developed at a consistent pace -- and umoci works today and is fairly widely used.
161+
It is far more important that the OCI provide a solid "works out of the box" image manipulation tool, and umoci is (in our view) the best candidate for this role.
162+
163+
In a future proposal, we may decide to sub-tree merge the OCI image-tools project into umoci (and archive the original project) in order to maintain the legacy of the work done by previous contributors and maintainers.
164+
Alternatively we may decide to split out the validation code from the OCI image-tools project and place it inside an OCI conformance project.
165+
However, we believe that these decisions should be considered a separate topic to the question of umoci's inclusion in the OCI.
166+
167+
> *Why bless umoci over other alternative tools?*
168+
169+
umoci is the only OCI image manipulation tool which was designed to be usable as a component to build other image-building tools.
170+
This has proven to be a practical benefit, with several tools ([KIWI][kiwi], [stacker][stacker], and several others) being built on top of umoci.
171+
In addition, umoci has been used by the [LXC project][lxc-oci] to support OCI-based images from *outside* the OCI ecosystem, something that was only reasonable because of umoci's unopinionated stance on images.
172+
umoci has seen production usage for several years as part of the [Open Build Project][obs]'s build system, building container images using [kiwi][kiwi].
173+
174+
[kiwi]: https://osinside.github.io/kiwi/building/build_docker_container.html
175+
[stacker]: https://github.com/anuvu/stacker
176+
[lxc-oci]: https://github.com/lxc/lxc/blob/lxc-4.0.2/templates/lxc-oci.in
177+
[obs]: https://openbuildservice.org/
178+
179+
> *How do we avoid the runc issue with implementation-specific quirks becoming a de-facto standard?*
180+
181+
When developing new features in umoci (which are within the scope of the OCI Image Specification), a strong effort will be made to include those features in the upstream specification.
182+
In addition, any new features that are in the scope of the OCI Image Specification will be marked as strictly experimental and unsupported, to ensure that users do not depend on their stability until the relevant feature (or an equivalent feature) is included in the OCI Image Specification.
183+
The scope of the OCI Image Specification is thankfully smaller than the OCI Runtime Specification, so this should not be as much of a concern as with runc.
184+
However, the maintainers will be mindful of the issue and will make use of their experiences working on runc and the OCI Runtime Specification to avoid this situation occurring with umoci and the OCI Image Specification.
185+
186+
> *Who are the other target users of umoci?*
187+
188+
End-users who want a simple tool to deal with OCI images, and developers of image-building tools that want a tried and tested implementation of the OCI image format.

0 commit comments

Comments
 (0)