Abstractions – Pittsburgh – The Twelve-Factor Container + BONUS

My talk for Abstractions, with bonus material.

Transcript

1. The Twelve-Factor Container
   1 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
   

   View Slide

2. A word about consent…
   Please do:
   Take pictures, tweet, take notes.
   Please don't:
   Record or live stream without my explicit consent.
   2 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
   

   View Slide

3. The Twelve-Factor Container
   • Twitter @caseywest
   • Email casey@geeknest.com
   • Web http://caseywest.com
   3 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
   

   View Slide

4. Thanks, Pivotal
   4 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
   

   View Slide

5. This isn't really a talk
   about containers
   5 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
   

   View Slide

6. This is a talk about
   operational maturity
   6 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
   

   View Slide

7. You must be this tall to
   ride this ride
   7 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
   

   View Slide

8. Audience Participation
   • Containers?
   • Schedulers?
   • Cloud?
   8 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
   

   View Slide

9. Docker
   Docker
   Docker
   Docker
   Docker
   Docker
   Docker
   Docker
   9 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
   

   View Slide

10. The factors
    http://12factor.net
    10 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

11. 1: One codebase
    tracked in revision
    control, many deploys
    11 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

12. Anti-pattern
    Building separate
    images for staging and
    production
    12 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

13. Anti-pattern
    Tags for dev and prod
    13 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

14. Best Practice
    Use the environment
    and/or feature flags
    14 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

15. 2: Explicitly declare and
    isolate dependencies
    15 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

16. 2: Explicitly declare and
    isolate dependencies
    16 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

17. Anti-pattern
    latest
    17 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

18. Best Practice
    Declare version
    numbers of upstream
    dependencies
    18 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

19. Best Practice
    Depend on base images
    for default filesystem
    and runtimes
    19 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

20. 3: Store config in the
    environment
    20 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

21. Anti-pattern
    config.yml
    21 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

22. Anti-pattern
    properties.xml
    22 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

23. Anti-pattern
    Hard-coded feature
    flags
    23 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

24. Best Practice
    This one is literally
    about environment
    variables
    24 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

25. Best Practice
    This one is literally
    about environment
    variables ! ‑
    25 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

26. 4: Treat backing
    services as attached
    resources
    26 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

27. Anti-pattern
    Local disk
    27 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

28. Anti-pattern
    Local disk
    28 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

29. Anti-pattern
    Local disk
    29 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

30. Best Practice
    Connect to network-
    attached services using
    connection info from
    the environment
    30 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

31. 5: Strictly separate
    build and run stages
    31 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

32. Anti-pattern
    Install on deploy
    32 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

33. Best Practice
    Build immutable
    images then run those
    images
    33 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

34. Painfully Obvious Best Practices
    1. Eat when hungry
    2. Sleep when tired
    3. Book Casey West for speaking gigs
    34 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

35. Best Practice
    Respect the lifecycle:
    buid, run, destroy
    35 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

36. 6: Execute the app as
    one or more stateless
    processes
    36 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

37. Best Practice
    Schedule LRPs by
    distributing them
    across a cluster of
    physical hardware
    37 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

38. Anti-pattern
    NFS
    38 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

39. Anti-pattern
    NFS
    Need I say more?
    39 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

40. 7: Export services via
    port binding
    40 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

41. Best Practice
    port = Env.fetch(:PORT)
    41 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

42. Best Practice
    my $port = $ENV{PORT};
    42 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

43. Best Practice
    private String getPort() {
    Map env = System.getenv();
    return env.get("PORT");
    }
    43 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

44. Best Practice
    let port = env::var("PORT").unwrap()
    44 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

45. 8: Scale out via the
    process model
    45 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

46. Best Practice
    Horizontally scale by
    adding instances
    46 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

47. 9: Maximize robustness
    with fast startup and
    graceful shutdown
    47 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

48. 10: Keep development,
    staging, and production
    as similar as possible
    48 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

49. Best Practice
    Run containers in
    development
    49 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

50. 11: Treat logs as event
    streams
    50 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

51. Anti-pattern
    Random log files
    #yolo'd all over the file
    system
    51 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

52. Best Practice
    STDOUT
    STDOUT
    STDOUT
    STDOUT
    52 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

53. 12: Run admin/
    management tasks as
    one-off processes
    53 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

54. Anti-pattern
    Custom containers for
    tasks
    54 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

55. Best Practice
    Reuse application
    images with specific
    entrypoints for tasks
    55 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

56. More factors?
    • API first
    • Secrets management
    • Health metrics
    • Global distribution
    56 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

57. You are now cloud-native
    57 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

58. Repeatability
    Reliability
    Resiliency
    58 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

59. Bonus Material
    59 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

60. The five stages of cloud-
    native
    1. Denial
    2. Anger
    3. Bargaining
    4. Depression
    5. Acceptance
    60 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

61. Have a seat on the couch
    61 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

62. Whatever makes you comfortable
    62 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

63. Now for some basic ground rules
    63 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

64. Rules
    We will talk about your delivery
    pipeline
    64 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

65. Rules
    We will talk about your architecture
    65 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

66. Rules
    We will talk about your automation
    66 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

67. ⏰
    67 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

68. "Deploying my apps to 'the cloud' is
    paintful. Why?"
    68 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

69. Denial
    69 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

70. Denial
    Containers are just like tiny virtual
    machines
    70 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

71. Denial
    We don't need to automate
    continuous delivery
    71 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

72. Anger
    72 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

73. Anger
    Works on my machine
    73 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

74. Anger
    Dev is just #YOLO-ing shit to
    production
    74 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

75. Bargaining
    75 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

76. Bargaining
    We crammed this monolith into a
    container and called it a microservice
    76 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

77. Bargaining
    "Bi-Modal IT"
    77 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

78. Bargaining
    What if we create "microservices"
    that all talk to the same data source?
    78 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

79. Depression
    79 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

80. Depression
    We made 200 microservices and
    forgot to set up jenkins
    80 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

81. Depression
    We have an automated build pipeline
    but release twice a year
    81 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

82. Acceptance
    82 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

83. Acceptance
    All software sucks
    83 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

84. Acceptance
    Respect CAP Theorem
    84 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

85. Acceptance
    Respect Conway's Law
    85 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

86. Acceptance
    Small batch size works for
    replatforming, too
    86 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

87. Acceptance
    Automate everything
    87 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

88. ⏰'s up
    88 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

89. What have we learned?
    89 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

90. Operability is
    1. Microservices Architecture
    2. Devops Culture
    3. Continuous Delivery
    Pick Three
    90 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide

91. @caseywest
    Let's be friends
    !
    91 ! @caseywest #abstractions #containers #realworld #sorrynotsorry
    

    View Slide