Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Papers We Love: Jails and Zones

Papers We Love: Jails and Zones

Slides for my @papers_we_love talk at @paperswelovenyc on February 11, 2016. Video: https://paperswelove.org/2016/video/bryan-cantrill-jails-and-solaris-zones/

Bryan Cantrill

February 12, 2016
Tweet

More Decks by Bryan Cantrill

Other Decks in Technology

Transcript

  1. Papers We Love:
    Jails and Zones
    CTO
    [email protected]
    Bryan Cantrill
    @bcantrill

    View Slide

  2. Papers we love: Jails and Zones
    • Discussing two important papers that form the foundation of
    thinking about OS-based virtualization and containers:
    • Jails: Confining the Omnipotent Root by Poul-Henning Kamp
    and Robert Watson, presented at SANE 2000
    • Solaris Zones: Operating System Support for Consolidating
    Commercial Workloads by Dan Price and Andy Tucker,
    presented at LISA 2004
    • As much as possible, want to let these papers speak for
    themselves — and provoke discussion!

    View Slide

  3. Jails: Problem statement

    View Slide

  4. Jails: Prior work

    View Slide

  5. Jails aside: chroot(2)

    View Slide

  6. Jails: Proposed solution

    View Slide

  7. Jails: Advantages

    View Slide

  8. Jails: jail(2)

    View Slide

  9. Jails: Confining the filesystem

    View Slide

  10. Jails: Confining the network

    View Slide

  11. Jails: Implementation

    View Slide

  12. Jails: Network management complexities

    View Slide

  13. Jails: Filesystem management complexities

    View Slide

  14. Jails: User management complexities

    View Slide

  15. Jails: Unintended consequences

    View Slide

  16. Jails: Networking limitations

    View Slide

  17. Jails: Resource management limitations

    View Slide

  18. Jails: Management limitations

    View Slide

  19. Jails: Epilogue
    • Jails became easier to manage with jls/jps/ezjail/iocage
    • Jails were allowed to have multiple IPv4 addresses
    • Some jail-based resource management was added, including
    CPU binding and
    • System V IPC was virtualized, but remains out-of-tree
    • VIMAGE added exclusive IP stacks to jails, but it remains a build-
    time option and “is considered experimental”

    View Slide

  20. Zones: Problem statement

    View Slide

  21. Zones: Problem statement detail

    View Slide

  22. Zones: Proposed solution

    View Slide

  23. Zones: Block diagram

    View Slide

  24. Zones: Design principles

    View Slide

  25. Zones: Design principles, cont.

    View Slide

  26. Zones: State model

    View Slide

  27. Zones: Configuration

    View Slide

  28. Zones: Installation

    View Slide

  29. Zones: Application environment

    View Slide

  30. Zones: Virtual platform

    View Slide

  31. Zones: Console

    View Slide

  32. Zones: Process model

    View Slide

  33. Zones: Process model, cont.

    View Slide

  34. Zones: IPC

    View Slide

  35. Zones: System V IPC

    View Slide

  36. Zones: Networking

    View Slide

  37. Zones: Filesystem

    View Slide

  38. Zones: Resource management

    View Slide

  39. Zones: Observability and debugging

    View Slide

  40. Zones: Security experience

    View Slide

  41. Zones: Workloads

    View Slide

  42. Zones: Epilogue
    • Crossbow added virtual NICs and exclusive IP stacks — and anti-
    spoof allowed exclusive IP stacks to be deployed safely
    • Resource management became much more complete, adding
    memory capping, CPU capping, I/O throttling
    • ZFS revolutionized zone installation/configuration
    • With introduction of IPS packaging, Solaris got rid of so-called
    “sparse root” zones...
    • ...and Joyent added sparse root zones back to SmartOS (thanks
    to no IPS and no global zone package management)

    View Slide

  43. Zones: Epilogue, cont.
    • Sun added notion of branded zones in 2006, including a nascent
    Linux brand (LX) — and then ripped LX out in 2010
    • LX brand revived by Joyent in 2014 in SmartOS and completed
    (first deployed into production in early 2015)
    • Overlay network support added to SmartOS by Joyent, allowing
    software-defined VXLAN-based networks in non-global zones

    View Slide

  44. Jails and Zones: Conclusions
    • Each of these technologies has served to inspire the other: zones
    was explicitly inspired by jails — and the jails networking work
    has been explicitly inspired by Crossbow
    • These two papers are important because they capture not just the
    what, but the why of their respective works
    • These technologies were both ahead of their time; it’s invaluable
    now to be able to understand their motivations!
    • In the words of the late, great Jim Gray: You need to write more!

    View Slide