As part of the goals of Moby to split the current platform into reusable components and to provide a future vision for the builder component new buildkit proposal was opened with early design draft.
Buildkit is a library providing the core essentials of running a build process using isolated sandboxed commands. It is designed for extensibility and customization. Buildkit supports multiple build declaration formats(frontends) and multiple ways for outputting build results(not just docker images). It doesn't make decisions for a specific worker, snapshot or exporter implementations.
It is designed to help find the most efficient way to process build tasks and intelligently cache them for repeated invocations.
To improve quality and performance, a new proposal was made for switching the dependency interface for current builder package. That should fix the current problems with data leakage and conflicts caused by daemon state cleanup scripts.
@dnephin is in progress of refactoring current builder code to logical areas as a preparation work for updating this interface.
Merged as part of this effort:
Builder.commit()PR for adding long-running session between daemon and cli that enabled advanced features like incremental context send, build credentials from the client, ssh forwarding etc. is looking for initial design review. It is currently open if features implemented on top of it would use a specific transport implementation on the wire or a generic interface(current implementation). @tonistiigi is working on adding persistent cache capabilities that are currently missing from that PR. It also needs to be figured out how the cli split will affect features like this.
Add IMPORT/EXPORT commands to Dockerfile
Add DOCKEROS/DOCKERARCH default ARG to Dockerfile
These proposals have gotten mostly positive feedback for now. We will leave them open for a couple of more weeks and then decide what actions to take in a maintainers meeting. Also, if you are interested in implementing any of them, leave a comment on the specific issues.
docker build --iidfile to capture the ID of the build result
Allow builds from any git remote ref
Build secrets will be brought up again in next maintainer's meeting to evaluate how to move on with this, if any other proposals have changed the objective and if we should wait for swarm secrets to be available first.