DevTools at Etsy - Speaker Deck

Slide 1

Slide 1 text

DevTools at Etsy Daniel Schauenberg [email protected] @mrtazz Monday, May 27, 13

Slide 2

Slide 2 text

Monday, May 27, 13

Slide 3

Slide 3 text

Item by FrankelPhotos Monolithic App Monday, May 27, 13

Slide 4

Slide 4 text

40 deploys/day 150 committers Monday, May 27, 13

Slide 5

Slide 5 text

~150 Developers/Designers ~15 Ops Engineers Monday, May 27, 13

Slide 6

Slide 6 text

Monday, May 27, 13

Slide 7

Slide 7 text

Item by JustBeckett Monday, May 27, 13

Slide 8

Slide 8 text

Item by XDcreationz Monday, May 27, 13

Slide 9

Slide 9 text

DevTools • Part of the Infrastructure team • 5 Engineers • SysAdmin and Development background • <3 debugging Monday, May 27, 13

Slide 10

Slide 10 text

Monday, May 27, 13

Slide 11

Slide 11 text

Deployinator Monday, May 27, 13

Slide 12

Slide 12 text

Monday, May 27, 13

Slide 13

Slide 13 text

"Devtools makes this stuff so easy it's almost hilarious, so thank you!" Laurie Denness, 2013 Monday, May 27, 13

Slide 14

Slide 14 text

https://github.com/etsy/deployinator Monday, May 27, 13

Slide 15

Slide 15 text

Developer VMs • KVM • Dev version of full Etsy stack • Chef • DevTools Monday, May 27, 13

Slide 16

Slide 16 text

Jenkins Slaves a.k.a. The Bobs • LXC containers on buildtests • Used for CI and Try • Labels for heavy/any execution • One heavy executor per disk Monday, May 27, 13

Slide 17

Slide 17 text

Monday, May 27, 13

Slide 18

Slide 18 text

DevDB Proxy • Access production data in a safe way • Don't test and develop on outdated data • Don't bring the site down by connecting to a production server with a GUI db client Monday, May 27, 13

Slide 19

Slide 19 text

StatsD/Logster/Graphite deploy lines deploy lines Monday, May 27, 13

Slide 20

Slide 20 text

https://github.com/etsy/statsd https://github.com/etsy/logster https://github.com/etsy/dashboard Monday, May 27, 13

Slide 21

Slide 21 text

Supergrep Monday, May 27, 13

Slide 22

Slide 22 text

https://github.com/etsy/supergrep Monday, May 27, 13

Slide 23

Slide 23 text

Schema Changes • Sharded MySQL Master-Master pairs • Config file to control which sides to use • 4 config pushes • Artisanal shell script Monday, May 27, 13

Slide 24

Slide 24 text

Monday, May 27, 13

Slide 25

Slide 25 text

% review -r dschauenberg Monday, May 27, 13

Slide 26

Slide 26 text

automatically assigned automatically assigned Monday, May 27, 13

Slide 27

Slide 27 text

Monday, May 27, 13

Slide 28

Slide 28 text

The “DevOps” Team Monday, May 27, 13

Slide 29

Slide 29 text

NOPE Monday, May 27, 13

Slide 30

Slide 30 text

Monday, May 27, 13

Slide 31

Slide 31 text

export PATH=$PATH:~/development/DevTools Monday, May 27, 13

Slide 32

Slide 32 text

Summary • Fostering collaboration through tooling • Tools can increase but not force collaboration • Caretaker for tooling • Hug it out Monday, May 27, 13

Slide 33

Slide 33 text

codeascraft.etsy.com www.etsy.com/codeascraft/talks etsy.github.com www.etsy.com/careers Monday, May 27, 13

Slide 34

Slide 34 text

Questions? Monday, May 27, 13

Slide 35

Slide 35 text

DevTools at Etsy Daniel Schauenberg [email protected] @mrtazz Monday, May 27, 13