Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Accidentally Distributed

Yann Schwartz
May 26, 2016
Programming
0
160

Accidentally Distributed

Given at NABD Conference with Serge Danzanvilliers. Based on the Devoxx talk, with some twists, and in English (so no jokes, we don't do jokes in English)

Yann Schwartz

May 26, 2016
Tweet

More Decks by Yann Schwartz

See All by Yann Schwartz
Duct-tape streaming at scale
abolibibelot
0
570
CAPtain Obvious
abolibibelot
0
120

Other Decks in Programming

See All in Programming
PHPとAPI Platformで作る本格的なWeb APIアプリケーション（入門編） / phpcon 2024 Intro to API Platform
ttskch
0
170
nekko cloudにおけるProxmox VE利用事例
irumaru
3
430
CSC305 Lecture 26
javiergs
PRO
0
140
htmxって知っていますか？次世代のHTML
hiro_ghap1
0
330
モバイルアプリにおける自動テストの導入戦略
ostk0069
0
110
Symfony Mapper Component
soyuka
2
730
今年一番支援させていただいたのは認証系サービスでした
satoshi256kbyte
1
250
【re:Growth 2024】 Aurora DSQL をちゃんと話します！
maroon1st
0
770
PHPで学ぶプログラミングの教訓 / Lessons in Programming Learned through PHP
nrslib
2
180
HTTP compression in PHP and Symfony apps
dunglas
2
1.7k
フロントエンドのディレクトリ構成どうしてる？　Feature-Sliced Design 導入体験談
osakatechlab
8
4.1k
PHPで作るWebSocketサーバー ~リアクティブなアプリケーションを知るために~ / WebSocket Server in PHP - To know reactive applications
seike460
PRO
2
190

Featured

See All Featured
10 Git Anti Patterns You Should be Aware of
lemiorhan
PRO
656
59k
Scaling GitHub
holman
458
140k
Bootstrapping a Software Product
garrettdimon
PRO
305
110k
How to Think Like a Performance Engineer
csswizardry
22
1.2k
Making the Leap to Tech Lead
cromwellryan
133
9k
4 Signs Your Business is Dying
shpigford
181
21k
The Art of Programming - Codeland 2020
erikaheidi
53
13k
Gamification - CAS2011
davidbonilla
80
5.1k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
169
50k
Fontdeck: Realign not Redesign
paulrobertlloyd
82
5.3k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
127
18k
Building a Modern Day 
E-commerce SEO Strategy
aleyda
38
7k

Transcript

  1. Accidentally Distributed

  2. Dramatis Personae Serge Danzanvilliers (beard) @alolcool Yann Schwartz (no beard)

    @abolibibelot

  3. 2009 We got some data

  4. None

  5. 2010 We got mucho data

  6. None

  7. A distributed system is one in which the failure of

    a computer you didn't even know existed can render your own computer unusable. Leslie Lamport

  8. 2012 Wait what’s this data anyway?

  9. None
  10. None
  11. None

  12. 2013 Invented Elsewhere

  13. Kafka! • Clustered • Failover • Replication • Non texty

    • Pull model • Streaming
  14. None
  15. None

  16. (Interlude) The Case of the Missing Minutes

  17. None
  18. None

  19. Reality has a known theoretical bias

  20. None

  21. Buffers, buffers everywhere • Caches, buffers, batches, queues : everything

    comes in chunks • Unbounded queues : never-ending tears • Operation triage: lose some data or lose your system

  22. TL;DR • Ignorance is not bliss • System entropy always

    increases • Worse is better until it’s not