Speaker Deck

A Pragmatic Guide to Modernizing Your Big Data Stack

by Andrew Johnson

Published January 8, 2016 in Technology

From Codemash 2016:
The big data ecosystem changes at a rapid pace. It can seem like almost every week there’s a new framework or technology that will solve all your data problems. If you’re starting from scratch, this provides a lot of flexibility in choose tools that will meet your needs — but what if you already have a mature big data stack in production? How do you keep up to date and introduce new tools while not breaking what you already have? This talk will cover Etsy’s journey towards a modern big data stack. We will discuss the choices we made, the reasoning behind those choices, and pitfalls to watch out for. You will leave this talk with new ideas about how to evaluate and select new technologies for your own big data stack.