ChatOps at GitHub - Speaker Deck

ChatOps at GitHub

by Jesse Newland

Slide 1

Slide 1 text

at ChatOps GitHub

Slide 2

Slide 2 text

Jesse Newland jnewland

Slide 3

Slide 3 text

at ChatOps GitHub

Slide 4

Slide 4 text

Slide 5

Slide 5 text

No content

Slide 6

Slide 6 text

No content

Slide 7

Slide 7 text

git checkout -b git-gh13 # bump version number git commit -am ‘bump git version’ git push origin git-gh13 # create pull request github/puppet

Slide 8

Slide 8 text

Build #108816 (5fe75932f26ea62cb5fc5e3d0cb302cc2461d11e) of puppet/git-gh13 was successful(421s) github/ [email protected]

Slide 9

Slide 9 text

hubot deploy puppet to production puppet noop git-gh13 fs1 puppet force git-gh13 fs1 graph me -1h @collectd.load(fs1) # merge pull request # ci runs # auto-deploy hubot puppet force production fs graph me -1h @collectd.load(fs*) log me hooks github/github

Slide 10

Slide 10 text

** [out :: REDACTED ] Bootstrapping... ** [out :: REDACTED ] Gem environment up-to-date. ** [out :: REDACTED ] Running librarian-puppet... ** [out :: REDACTED ] Generating puppet environments... ** [out :: REDACTED ] Cleaning up deleted branches... ** [out :: REDACTED ] Done! ** [out :: REDACTED ] Sending 'restart' command ** [out :: REDACTED ] The following watches were affected: ** [out :: REDACTED ] puppetmaster_unicorn ...

Slide 11

Slide 11 text

Slide 12

Slide 12 text

... ** [out :: fs1a.rs.github.com] info: Applying configuration version '8fb1a2716d5f950b836e511471a2bdac3ed27090' ** [out :: fs1a.rs.github.com] notice: /Stage[main]/ Github::Common_packages/Package[git]/ensure: would have changed from '1:1.7.10-1+github12' to '1:1.7.10-1+github13' ...

Slide 13

Slide 13 text

Slide 14

Slide 14 text

** [out :: fs1a.rs.github.com] info: Applying configuration version ** [out :: fs1a.rs.github.com] notice: /Stage[main]/ Github::Common_packages/Package[git]/ensure: ensure changed '1:1.7.10-1+github12' to '1:1.7.10-1+github13' ...

Slide 15

Slide 15 text

Slide 16

Slide 16 text

No content

Slide 17

Slide 17 text

Slide 18

Slide 18 text

[puppet/master] Merge pull request #8406 from github/git-gh13 - Jesse Newland ( github/puppet@567ea48 )

Slide 19

Slide 19 text

Slide 20

Slide 20 text

Build #108817 (5fe75932f26ea62cb5fc5e3d0cb302cc2461d11e) of puppet/master was successful(399s)

Slide 21

Slide 21 text

Slide 22

Slide 22 text

jnewland is deploying puppet/master (863f7ff..567ea48) to production [#37789]

Slide 23

Slide 23 text

Slide 24

Slide 24 text

hubot deploy puppet to production puppet noop git-gh13 fs1 puppet force git-gh13 fs1 graph me -1h @collectd.load(fs*) # merge pull request # ci runs # auto-deploy hubot puppet force production fs graph me -1h @collectd.load(fs*) log me hooks github/github

Slide 25

Slide 25 text

** [out :: fs2a.rs.github.com] info: Applying configuration version '8fb1a2716d5f950b836e511471a2bdac3ed27090' ** [out :: fs7b.rs.github.com] info: Applying configuration version '8fb1a2716d5f950b836e511471a2bdac3ed27090' ** [out :: fs2a.rs.github.com] notice: /Stage[main]/ Github::Common_packages/Package[git]/ensure: ensure changed '1:1.7.10-1+github12' to '1:1.7.10-1+github13' ** [out :: fs7b.rs.github.com] notice: /Stage[main]/ Github::Common_packages/Package[git]/ensure: ensure changed '1:1.7.10-1+github12' to '1:1.7.10-1+github13' ...

Slide 26

Slide 26 text

Slide 27

Slide 27 text

No content

Slide 28

Slide 28 text

Slide 29

Slide 29 text

No content

Slide 30

Slide 30 text

Boom

Slide 31

Slide 31 text

ChatOps

Slide 32

Slide 32 text

 Hubot

Slide 33

Slide 33 text

heaven janky shell graphme Hubot

Slide 34

Slide 34 text

hubot heaven janky shell graphme ALL OF THE APIS

Slide 35

Slide 35 text

Why is this stupid chat bot so important to Ops?

Slide 36

Slide 36 text

Slide 37

Slide 37 text

Everyone sees all of that happen

Slide 38

Slide 38 text

Everyone sees all of that happen on their first day

Slide 39

Slide 39 text

No content

Slide 40

Slide 40 text

hubot ci status github/smoke-perf

Slide 41

Slide 41 text

hubot deploy github/smoke-perf to prod/fe1

Slide 42

Slide 42 text

hubot graph me -10min @app-perf

Slide 43

Slide 43 text

hubot procs unicorn

Slide 44

Slide 44 text

hubot resque critical

Slide 45

Slide 45 text

hubot graph me -10min @collectd.load(fe*)

Slide 46

Slide 46 text

hubot conns fe1

Slide 47

Slide 47 text

hubot log me smoke fe1

Slide 48

Slide 48 text

hubot lbctl disable fe1

Slide 49

Slide 49 text

hubot status yellow Bad deploy. Reverting now.

Slide 50

Slide 50 text

hubot who’s on call

Slide 51

Slide 51 text

hubot pingdom checks

Slide 52

Slide 52 text

hubot upset me

Slide 53

Slide 53 text

hubot deploy github to prod/fe1

Slide 54

Slide 54 text

hubot log me smoke fe1

Slide 55

Slide 55 text

hubot air drum me

Slide 56

Slide 56 text

hubot lbctl enable fe1

Slide 57

Slide 57 text

hubot status green All systems go.

Slide 58

Slide 58 text

hubot whois 4.9.23.22

Slide 59

Slide 59 text

hubot khanify spammers

Slide 60

Slide 60 text

hubot play in the air tonight

Slide 61

Slide 61 text

ChatOps

Slide 62

Slide 62 text

By placing tools directly in the middle of the conversation

Slide 63

Slide 63 text

Everyone is pairing all of the time

Slide 64

Slide 64 text

Teaching by doing

Slide 65

Slide 65 text

This was always my main motivation with hubot - teaching by doing by making things visible. It's an extremely powerful teaching technique - @rtomayko

Slide 66

Slide 66 text

No content

Slide 67

Slide 67 text

Communicate by doing

Slide 68

Slide 68 text

THINGS I HAVEN’T ASKED RECENTLY

Slide 69

Slide 69 text

THINGS I HAVEN’T ASKED RECENTLY how’s that deploy going?

Slide 70

Slide 70 text

THINGS I HAVEN’T ASKED RECENTLY how’s that deploy going? are you deploying that or should i?

Slide 71

Slide 71 text

THINGS I HAVEN’T ASKED RECENTLY how’s that deploy going? are you deploying that or should i? is anyone responding to that nagios alert?

Slide 72

Slide 72 text

THINGS I HAVEN’T ASKED RECENTLY how’s that deploy going? are you deploying that or should i? is anyone responding to that nagios alert? is that branch green?

Slide 73

Slide 73 text

THINGS I HAVEN’T ASKED RECENTLY is that branch green? how’s that deploy going? are you deploying that or should i? is anyone responding to that nagios alert? how does load look?

Slide 74

Slide 74 text

THINGS I HAVEN’T ASKED RECENTLY is that branch green? how’s that deploy going? are you deploying that or should i? is anyone responding to that nagios alert? how does load look? did anyone update the status page?

Slide 75

Slide 75 text

THINGS I HAVEN’T ASKED RECENTLY how’s that deploy going? are you deploying that or should i? is anyone responding to that nagios alert? is that branch green? how does load look? did that deploy finish? did anyone update the status page?

Slide 76

Slide 76 text

No content

Slide 77

Slide 77 text

No content

Slide 78

Slide 78 text

http://www.flickr.com/photos/7997249@N06/6061305639/

Slide 79

Slide 79 text

Hide the ugly

Slide 80

Slide 80 text

No content

Slide 81

Slide 81 text

[nines] hubot opened issue #4263: Nagios (229906) - fs3b/syslog - Tue Sept 25 23:40:18 PDT 2012. github/nines#4263

Slide 82

Slide 82 text

hubot nagios ack fs3b/syslog # fix stuff nagios check fs3b/syslog nagios status fs3b/syslog hubot nagios downtime fs3b/syslog 90 nagios mute fs3b/syslog nagios unmute fs3b/syslog