Slide 1

Slide 1 text

Surviving technology transitions: Adding and removing tools from an existing stack

Slide 2

Slide 2 text

The “steady” state MIXTstudio.etsy.com

Slide 3

Slide 3 text

Melissa Santos | @ansate Maggie Zhou | @zmagg Evaluating Change Have a process. ! ! ! ! It will probably suck at first. MareBearCrafts.etsy.com

Slide 4

Slide 4 text

Melissa Santos | @ansate Maggie Zhou | @zmagg Evaluating Change Enumerate requirements ! and advantages of potential solutions

Slide 5

Slide 5 text

Melissa Santos | @ansate Maggie Zhou | @zmagg Evaluating Change TheFreckledBerry.etsy.com

Slide 6

Slide 6 text

Melissa Santos | @ansate Maggie Zhou | @zmagg Evaluating: Architecture Review CherryOrchardAttic.etsy.com

Slide 7

Slide 7 text

Melissa Santos | @ansate Maggie Zhou | @zmagg Evaluating: Architecture Review EventPipe - a new ETL process for analytics logging, backed by Kafka

Slide 8

Slide 8 text

Melissa Santos | @ansate Maggie Zhou | @zmagg EventPipe Architecture Review •The problem: old architecture was brittle. GET requests, logrotate •Wins: distributed system - near real time metrics into event health, sets us up for streaming analytics later

Slide 9

Slide 9 text

Melissa Santos | @ansate Maggie Zhou | @zmagg Evaluating: Operability Review Understand: •how the system will break •how we will know •how we will react

Slide 10

Slide 10 text

Melissa Santos | @ansate Maggie Zhou | @zmagg Operability Review: Eventpipe

Slide 11

Slide 11 text

Melissa Santos | @ansate Maggie Zhou | @zmagg Operability Review: Eventpipe ! • Scenario: Franz dies on a single beacon box • Scenario: Apache dies on a single beacon box • Scenario: Franz dies on all beacon boxes • Scenario: Franz dies on *most* boxes • Scenario: One Kafka box shuts down cleanly • Scenario: Cut power to one Kafka box • Scenario: Cut power to one chassis (4 Kafka nodes) • Scenario: Most Kafka boxes are unreachable (see how many we can shut down and still stay up) • Scenario: One ZooKeeper dies • Scenario: Two ZooKeepers die

Slide 12

Slide 12 text

Melissa Santos | @ansate Maggie Zhou | @zmagg Comfortable upgrades curlybracketdesign.etsy.com

Slide 13

Slide 13 text

Melissa Santos | @ansate Maggie Zhou | @zmagg Comfortable upgrades Test, test, test! ! How do you gain confidence? !

Slide 14

Slide 14 text

Melissa Santos | @ansate Maggie Zhou | @zmagg Comfortable upgrades Case study: HHVM

Slide 15

Slide 15 text

Melissa Santos | @ansate Maggie Zhou | @zmagg Comfortable upgrades: Testing •benchmarking

Slide 16

Slide 16 text

Melissa Santos | @ansate Maggie Zhou | @zmagg Comfortable upgrades How do you gain confidence? •slow ramp-up •run an a/b experiment •ramp up the things that could go badly by themselves (high traffic pages, unique features)

Slide 17

Slide 17 text

Melissa Santos | @ansate Maggie Zhou | @zmagg Upgrading: HHVM

Slide 18

Slide 18 text

Melissa Santos | @ansate Maggie Zhou | @zmagg Removing old tech StageFortPress.etsy.com

Slide 19

Slide 19 text

Melissa Santos | @ansate Maggie Zhou | @zmagg Removing old tech mygoodbabushka.etsy.com

Slide 20

Slide 20 text

Melissa Santos | @ansate Maggie Zhou | @zmagg Removing old tech SophieLadyDeParis.etsy.com

Slide 21

Slide 21 text

Melissa Santos | @ansate Maggie Zhou | @zmagg Removing old tech a story: Cascading.Jruby

Slide 22

Slide 22 text

Melissa Santos | @ansate Maggie Zhou | @zmagg 1,098 c.jr jobs Removing Cascading.jruby

Slide 23

Slide 23 text

Melissa Santos | @ansate Maggie Zhou | @zmagg Removing Cascading.jruby

Slide 24

Slide 24 text

Melissa Santos | @ansate Maggie Zhou | @zmagg Removing old tech: Celebrate! Celebrate!

Slide 25

Slide 25 text

Melissa Santos | @ansate Maggie Zhou | @zmagg Evaluation Takeaways •It’s ok to choose NOT to do something •But if you do something, you gotta explain what problem it solves (and how) •Process helps people see how you made the decision

Slide 26

Slide 26 text

Melissa Santos | @ansate Maggie Zhou | @zmagg Upgrading Takeaways •testestestestestest •Be clear about what’s different •Publicize and celebrate how it is better!

Slide 27

Slide 27 text

Melissa Santos | @ansate Maggie Zhou | @zmagg Retiring Takeaways •It takes longer than you think it will •It’s gonna hurt •It’s going to feel so good once you’re done

Slide 28

Slide 28 text

Melissa Santos | @ansate Maggie Zhou | @zmagg Thanks! title slide image from TheWoodChopShoppe.etsy.com