Download as PDF, PPTX
Uploaded byDocker, Inc.
A vision of persistence
The document discusses immutable infrastructure and its implementation using containers, particularly through Dotmesh and Linuxkit. It highlights the management of code and data separately, utilizing efficient ZFS snapshots for database compatibility. Additionally, it invites collaboration and contributions from the community to improve the project and addresses various technical considerations.
More Related Content
A vision of persistence
- 1. Luke Marsden @lmarsden Founder& CEO, Dotmesh Justin Cormack @justincormack Engineer, Docker
- 2.
- 3. “In the cloud,we know exactly what we want a server to be, and if we want to change that we simply terminate it and launch a new server with a new AMI. Building with Legos, 2011
- 4.
- 5. v Immutable infrastructure theeasy way
- 6. ● Built fromcontainers, embeds containerd ● Small, fast, secure, cloud native, build in CI ● S million users, as part of Docker Desktop ● Base of a certified Kubernetes build ● amd64, arm64, s390x support
- 7. v Code without datais useless
- 8. ● LinuxKit hasa clean separation between code (read only) and data ● These have different lifecycles ● Different management tooling ● Update OS code while preserving data
- 9. ● Commit asnapshot ● Push for backups ● Clone for copies ● Fork for experiments Sounds great! How can I do that?
- 10.
- 12. ● LinuxKit managesruntime state in immutable way ● Dotmesh moves the data to where it is needed ● Version the data independently from the image ● Infrastructure independent - can do sort of similar things if you use cloud provider APIs but locked in
- 13. ● docker CoWis a poor match for databases ● Databases tend to use a small number of large files ● dotmesh uses zfs ● zfs snapshots are very efficient
- 16. How did thatwork?
- 17. • dotmesh.yml –> •dm-linuxkit binary which launches etcd and then dotmesh (and clones a dot if 'seed' is specified) • onboot vs service
- 18.
- 19. ● github.com/linuxkit/linuxkit ● github.com/dotmesh-io/dotmesh ●github.com/dotmesh-io/dm-linuxkit
- 20. ● Docker CommunitySlack #linuxkit ● Dotmesh Slack http://bit.ly/dotmesh-slack ● Search DockerCon talks for "Dotmesh"
- 21. ● Find moreexcuses to drink beer together ● More reliable on local Mac (qemu and hyperkit both broken in different ways!) ● Make dotmesh work with newest zfs so that it to works on latest kernels (4.14+)
- 22. ● Cherry-pick filesbetween dots in dothub ● ARM support ● /var/lib/docker in a dot ● What would you like to see?
- 23.