Abstractions – Pittsburgh – The Twelve-Factor Container + BONUS

Slide 1

Slide 1 text

The Twelve-Factor Container 1 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 2

Slide 2 text

A word about consent… Please do: Take pictures, tweet, take notes. Please don't: Record or live stream without my explicit consent. 2 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 3

Slide 3 text

The Twelve-Factor Container • Twitter @caseywest • Email [email protected] • Web http://caseywest.com 3 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 4

Slide 4 text

Thanks, Pivotal 4 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 5

Slide 5 text

This isn't really a talk about containers 5 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 6

Slide 6 text

This is a talk about operational maturity 6 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 7

Slide 7 text

You must be this tall to ride this ride 7 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 8

Slide 8 text

Audience Participation • Containers? • Schedulers? • Cloud? 8 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 9

Slide 9 text

Docker Docker Docker Docker Docker Docker Docker Docker 9 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 10

Slide 10 text

The factors http://12factor.net 10 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 11

Slide 11 text

1: One codebase tracked in revision control, many deploys 11 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 12

Slide 12 text

Anti-pattern Building separate images for staging and production 12 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 13

Slide 13 text

Anti-pattern Tags for dev and prod 13 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 14

Slide 14 text

Best Practice Use the environment and/or feature flags 14 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 15

Slide 15 text

2: Explicitly declare and isolate dependencies 15 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 16

Slide 16 text

2: Explicitly declare and isolate dependencies 16 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 17

Slide 17 text

Anti-pattern latest 17 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 18

Slide 18 text

Best Practice Declare version numbers of upstream dependencies 18 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 19

Slide 19 text

Best Practice Depend on base images for default filesystem and runtimes 19 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 20

Slide 20 text

3: Store config in the environment 20 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 21

Slide 21 text

Anti-pattern conﬁg.yml 21 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 22

Slide 22 text

Anti-pattern properties.xml 22 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 23

Slide 23 text

Anti-pattern Hard-coded feature flags 23 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 24

Slide 24 text

Best Practice This one is literally about environment variables 24 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 25

Slide 25 text

Best Practice This one is literally about environment variables ! ‑ 25 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 26

Slide 26 text

4: Treat backing services as attached resources 26 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 27

Slide 27 text

Anti-pattern Local disk 27 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 28

Slide 28 text

Anti-pattern Local disk 28 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 29

Slide 29 text

Anti-pattern Local disk 29 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 30

Slide 30 text

Best Practice Connect to network- attached services using connection info from the environment 30 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 31

Slide 31 text

5: Strictly separate build and run stages 31 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 32

Slide 32 text

Anti-pattern Install on deploy 32 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 33

Slide 33 text

Best Practice Build immutable images then run those images 33 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 34

Slide 34 text

Painfully Obvious Best Practices 1. Eat when hungry 2. Sleep when tired 3. Book Casey West for speaking gigs 34 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 35

Slide 35 text

Best Practice Respect the lifecycle: buid, run, destroy 35 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 36

Slide 36 text

6: Execute the app as one or more stateless processes 36 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 37

Slide 37 text

Best Practice Schedule LRPs by distributing them across a cluster of physical hardware 37 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 38

Slide 38 text

Anti-pattern NFS 38 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 39

Slide 39 text

Anti-pattern NFS Need I say more? 39 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 40

Slide 40 text

7: Export services via port binding 40 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 41

Slide 41 text

Best Practice port = Env.fetch(:PORT) 41 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 42

Slide 42 text

Best Practice my $port = $ENV{PORT}; 42 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 43

Slide 43 text

Best Practice private String getPort() { Map env = System.getenv(); return env.get("PORT"); } 43 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 44

Slide 44 text

Best Practice let port = env::var("PORT").unwrap() 44 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 45

Slide 45 text

8: Scale out via the process model 45 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 46

Slide 46 text

Best Practice Horizontally scale by adding instances 46 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 47

Slide 47 text

9: Maximize robustness with fast startup and graceful shutdown 47 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 48

Slide 48 text

10: Keep development, staging, and production as similar as possible 48 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 49

Slide 49 text

Best Practice Run containers in development 49 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 50

Slide 50 text

11: Treat logs as event streams 50 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 51

Slide 51 text

Anti-pattern Random log files #yolo'd all over the file system 51 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 52

Slide 52 text

Best Practice STDOUT STDOUT STDOUT STDOUT 52 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 53

Slide 53 text

12: Run admin/ management tasks as one-off processes 53 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 54

Slide 54 text

Anti-pattern Custom containers for tasks 54 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 55

Slide 55 text

Best Practice Reuse application images with specific entrypoints for tasks 55 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 56

Slide 56 text

More factors? • API first • Secrets management • Health metrics • Global distribution 56 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 57

Slide 57 text

You are now cloud-native 57 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 58

Slide 58 text

Repeatability Reliability Resiliency 58 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 59

Slide 59 text

Bonus Material 59 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 60

Slide 60 text

The five stages of cloud- native 1. Denial 2. Anger 3. Bargaining 4. Depression 5. Acceptance 60 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 61

Slide 61 text

Have a seat on the couch 61 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 62

Slide 62 text

Whatever makes you comfortable 62 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 63

Slide 63 text

Now for some basic ground rules 63 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 64

Slide 64 text

Rules We will talk about your delivery pipeline 64 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 65

Slide 65 text

Rules We will talk about your architecture 65 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 66

Slide 66 text

Rules We will talk about your automation 66 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 67

Slide 67 text

⏰ 67 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 68

Slide 68 text

"Deploying my apps to 'the cloud' is paintful. Why?" 68 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 69

Slide 69 text

Denial 69 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 70

Slide 70 text

Denial Containers are just like tiny virtual machines 70 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 71

Slide 71 text

Denial We don't need to automate continuous delivery 71 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 72

Slide 72 text

Anger 72 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 73

Slide 73 text

Anger Works on my machine 73 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 74

Slide 74 text

Anger Dev is just #YOLO-ing shit to production 74 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 75

Slide 75 text

Bargaining 75 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 76

Slide 76 text

Bargaining We crammed this monolith into a container and called it a microservice 76 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 77

Slide 77 text

Bargaining "Bi-Modal IT" 77 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 78

Slide 78 text

Bargaining What if we create "microservices" that all talk to the same data source? 78 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 79

Slide 79 text

Depression 79 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 80

Slide 80 text

Depression We made 200 microservices and forgot to set up jenkins 80 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 81

Slide 81 text

Depression We have an automated build pipeline but release twice a year 81 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 82

Slide 82 text

Acceptance 82 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 83

Slide 83 text

Acceptance All software sucks 83 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 84

Slide 84 text

Acceptance Respect CAP Theorem 84 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 85

Slide 85 text

Acceptance Respect Conway's Law 85 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 86

Slide 86 text

Acceptance Small batch size works for replatforming, too 86 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 87

Slide 87 text

Acceptance Automate everything 87 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 88

Slide 88 text

⏰'s up 88 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 89

Slide 89 text

What have we learned? 89 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 90

Slide 90 text

Operability is 1. Microservices Architecture 2. Devops Culture 3. Continuous Delivery Pick Three 90 ! @caseywest #abstractions #containers #realworld #sorrynotsorry

Slide 91

Slide 91 text

@caseywest Let's be friends ! 91 ! @caseywest #abstractions #containers #realworld #sorrynotsorry