Accidentally Distributed

Given at NABD Conference with Serge Danzanvilliers. Based on the Devoxx talk, with some twists, and in English (so no jokes, we don't do jokes in English)

Transcript

1. Accidentally Distributed
2. Dramatis Personae Serge Danzanvilliers (beard) @alolcool Yann Schwartz (no beard) @abolibibelot
3. 2009 We got some data
5. 2010 We got mucho data
7. A distributed system is one in which the failure of a computer you didn't even know existed can render your own computer unusable. Leslie Lamport
8. 2012 Wait what’s this data anyway?
12. 2013 Invented Elsewhere
13. Kafka! • Clustered • Failover • Replication • Non texty • Pull model • Streaming
16. (Interlude) The Case of the Missing Minutes
19. Reality has a known theoretical bias
21. Buffers, buffers everywhere • Caches, buffers, batches, queues : everything comes in chunks • Unbounded queues : never-ending tears • Operation triage: lose some data or lose your system
22. TL;DR • Ignorance is not bliss • System entropy always increases • Worse is better until it’s not