Is DevOps Success a Potekmin Village?

Slide 1

Slide 1 text

Is DevOps success a potemkin village? Michael Stahnke Director of Engineering @stahnma

Slide 2

Slide 2 text

“any construction (literal or ﬁgurative) built solely to deceive others into thinking that a situation is better than it really is. “ @stahnma

Slide 3

Slide 3 text

@stahnma

Slide 4

Slide 4 text

@stahnma

Slide 5

Slide 5 text

@stahnma

Slide 6

Slide 6 text

Michael Stahnke Puppet, Inc Director of Engineering @stahnma

Slide 7

Slide 7 text

@stahnma

Slide 8

Slide 8 text

@stahnma

Slide 9

Slide 9 text

Principles @stahnma

Slide 10

Slide 10 text

Devops : the way we work @stahnma

Slide 11

Slide 11 text

Working together @stahnma

Slide 12

Slide 12 text

Devops != CI/CD @stahnma

Slide 13

Slide 13 text

“best” Practices @stahnma

Slide 14

Slide 14 text

Worst Practices @stahnma

Slide 15

Slide 15 text

Things you probably shouldn’t do. @stahnma

Slide 16

Slide 16 text

Anti-patterns @stahnma

Slide 17

Slide 17 text

No content

Slide 18

Slide 18 text

We Ship @stahnma

Slide 19

Slide 19 text

On Premises @stahnma

Slide 20

Slide 20 text

The Update Problem @stahnma

Slide 21

Slide 21 text

The cost of being wrong is high @stahnma

Slide 22

Slide 22 text

@stahnma

Slide 23

Slide 23 text

CULTURE @stahnma

Slide 24

Slide 24 text

@stahnma

Slide 25

Slide 25 text

https://www.ﬂickr.com/photos/openscience/10813661054 @stahnma

Slide 26

Slide 26 text

Hypothesis: This build artifact is shippable @stahnma

Slide 27

Slide 27 text

@stahnma

Slide 28

Slide 28 text

@stahnma

Slide 29

Slide 29 text

@stahnma Classic Layout Dev Ops

Slide 30

Slide 30 text

@stahnma Classic Layout Dev Ops Everybody here thinks they’re a better SysAdmin than you are.

Slide 31

Slide 31 text

@stahnma Classic Layout Dev Ops Back Ofﬁce Finance/ Sales Marketing

Slide 32

Slide 32 text

@stahnma Not a recommendation Dev Ops Also Ops

Slide 33

Slide 33 text

@stahnma Hypocrisy Dev Ops Back Ofﬁce Finance/ Sales Marketing

Slide 34

Slide 34 text

@stahnma A DevOps team Dev Ops DevOps

Slide 35

Slide 35 text

@stahnma A DevOps team Dev Ops DevOps SRE

Slide 36

Slide 36 text

@stahnma 6 YEARS later Dev IT Back Ofﬁce Finance/ Sales Marketing Help Desk Data Center SRE

Slide 37

Slide 37 text

@stahnma A Cross-functional team (in dev)

Slide 38

Slide 38 text

Team Sizes too large @stahnma

Slide 39

Slide 39 text

Multiple Walls

Slide 40

Slide 40 text

We can waterfall in 2 weeks. @stahnma

Slide 41

Slide 41 text

Automation @stahnma

Slide 42

Slide 42 text

Over the wall mentality @stahnma

Slide 43

Slide 43 text

Quality Shifted Right @stahnma

Slide 44

Slide 44 text

Of course CI is red @stahnma

Slide 45

Slide 45 text

Tragedy of the commons for integration @stahnma

Slide 46

Slide 46 text

In Failure We Trust @stahnma

Slide 47

Slide 47 text

Automated a bad process @stahnma

Slide 48

Slide 48 text

https://www.ﬂickr.com/photos/pillarofautumn/13770741955

Slide 49

Slide 49 text

@stahnma

Slide 50

Slide 50 text

@stahnma

Slide 51

Slide 51 text

Jenkins Special Sauce @stahnma

Slide 52

Slide 52 text

A sauce that exits 0 @stahnma

Slide 53

Slide 53 text

Some things were needed too quickly for automation @stahnma

Slide 54

Slide 54 text

What’s in this build? What changed? @stahnma

Slide 55

Slide 55 text

Code Freezes @stahnma

Slide 56

Slide 56 text

Lean @stahnma

Slide 57

Slide 57 text

@stahnma

Slide 58

Slide 58 text

Partially Complete features @stahnma

Slide 59

Slide 59 text

Not always shippable @stahnma

Slide 60

Slide 60 text

AnitPattern: Too much system load @stahnma

Slide 61

Slide 61 text

Measurements @stahnma

Slide 62

Slide 62 text

Unable to respond to feedback, so why try to get any? @stahnma

Slide 63

Slide 63 text

If it moves, capture it @stahnma

Slide 64

Slide 64 text

If it moves, capture it….unless it’s difﬁcult. @stahnma

Slide 65

Slide 65 text

Do nearly nothing with all data @stahnma

Slide 66

Slide 66 text

Sharing @stahnma

Slide 67

Slide 67 text

Complaining is sharing…right? @stahnma

Slide 68

Slide 68 text

Celebrate and share successes @stahnma

Slide 69

Slide 69 text

Ship some great software @stahnma

Slide 70

Slide 70 text

Whole Conferences. The stuff you expect. @stahnma

Slide 71

Slide 71 text

Some Solutions @stahnma

Slide 72

Slide 72 text

If everything starts on the right, you can only shift left. @stahnma

Slide 73

Slide 73 text

Combined QA with Dev @stahnma

Slide 74

Slide 74 text

Deploy releases per sprint (minimally) @stahnma

Slide 75

Slide 75 text

CI has meaning again @stahnma

Slide 76

Slide 76 text

@stahnma

Slide 77

Slide 77 text

Throttle the system @stahnma

Slide 78

Slide 78 text

Feature Toggle Development @stahnma

Slide 79

Slide 79 text

A culture change: This is shippable. @stahnma

Slide 80

Slide 80 text

I know this change-set is good. @stahnma

Slide 81

Slide 81 text

Shipping is learning. @stahnma

Slide 82

Slide 82 text

Modern Issues @stahnma

Slide 83

Slide 83 text

https://www.ﬂickr.com/photos/openscience/10813661054

Slide 84

Slide 84 text

What’s the cost of being wrong? @stahnma

Slide 85

Slide 85 text

AnitPattern: Perf afterwards @stahnma

Slide 86

Slide 86 text

AnitPattern: Too many tests @stahnma

Slide 87

Slide 87 text

AnitPattern: Not the right coverage @stahnma

Slide 88

Slide 88 text

Forming teams around backlogs vs backlogs to teams @stahnma

Slide 89

Slide 89 text

Relearn the same mistakes, but this time with a new language/ toolchain/technology @stahnma