Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Accidentally Distributed

Accidentally Distributed

Given at NABD Conference with Serge Danzanvilliers. Based on the Devoxx talk, with some twists, and in English (so no jokes, we don't do jokes in English)

Ab7179cd9980141fd3bd79902fa25147?s=128

Yann Schwartz

May 26, 2016
Tweet

Transcript

  1. Accidentally Distributed

  2. Dramatis Personae Serge Danzanvilliers (beard) @alolcool Yann Schwartz (no beard)

    @abolibibelot
  3. 2009 We got some data

  4. None
  5. 2010 We got mucho data

  6. None
  7. A distributed system is one in which the failure of

    a computer you didn't even know existed can render your own computer unusable. Leslie Lamport
  8. 2012 Wait what’s this data anyway?

  9. None
  10. None
  11. None
  12. 2013 Invented Elsewhere

  13. Kafka! • Clustered • Failover • Replication • Non texty

    • Pull model • Streaming
  14. None
  15. None
  16. (Interlude) The Case of the Missing Minutes

  17. None
  18. None
  19. Reality has a known theoretical bias

  20. None
  21. Buffers, buffers everywhere • Caches, buffers, batches, queues : everything

    comes in chunks • Unbounded queues : never-ending tears • Operation triage: lose some data or lose your system
  22. TL;DR • Ignorance is not bliss • System entropy always

    increases • Worse is better until it’s not