Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
The Path Towards Simplifying Consistency in Dis...
Search
Caitie McCaffrey
April 24, 2017
Technology
1
360
The Path Towards Simplifying Consistency in Distributed Systems
Caitie McCaffrey
April 24, 2017
Tweet
Share
More Decks by Caitie McCaffrey
See All by Caitie McCaffrey
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
333
22k
Argus Papers We Love
caitiem20
14
1.2k
The Verification of a Distributed System
caitiem20
22
2.3k
We Hear You Like Papers: Eventual Consistency
caitiem20
14
840
The Verification of a Distributed System
caitiem20
12
800
The Verification of a Distributed System
caitiem20
6
800
A Brief History of Distributed Programming: RPC
caitiem20
31
6.7k
Building Scalable Stateful Services
caitiem20
12
1.7k
Papers we Love PDX
caitiem20
2
1.3k
Other Decks in Technology
See All in Technology
社内報はAIにやらせよう / Let AI handle the company newsletter
saka2jp
8
1.4k
AI時代こそ求められる設計力- AWSクラウドデザインパターン3選で信頼性と拡張性を高める-
kenichirokimura
3
290
防災デジタル分野での官民共創の取り組み (2)DIT/CCとD-CERTについて
ditccsugii
0
210
速習AGENTS.md:5分で精度を上げる "3ブロック" テンプレ
ismk
6
910
プロダクトのコードから見るGoによるデザインパターンの実践 #go_night_talk
bengo4com
1
2.4k
from Sakichi Toyoda to Agile
kawaguti
PRO
1
110
Simplifying Cloud Native app testing across environments with Dapr and Microcks
salaboy
0
140
ニッポンの人に知ってもらいたいGISスポット
sakaik
0
110
AWS Control Tower に学ぶ! IAM Identity Center 権限設計の第一歩 / IAM Identity Center with Control Tower
y___u
0
110
OpenAI gpt-oss ファインチューニング入門
kmotohas
2
1.2k
能登半島地震で見えた災害対応の課題と組織変革の重要性
ditccsugii
0
530
三菱電機・ソニーグループ共同の「Agile Japan企業内サテライト」_2025
sony
0
140
Featured
See All Featured
Connecting the Dots Between Site Speed, User Experience & Your Business [WebExpo 2025]
tammyeverts
9
590
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
7
900
Bash Introduction
62gerente
615
210k
A designer walks into a library…
pauljervisheath
209
24k
Bootstrapping a Software Product
garrettdimon
PRO
307
110k
Practical Orchestrator
shlominoach
190
11k
Fireside Chat
paigeccino
40
3.7k
The Language of Interfaces
destraynor
162
25k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
132
19k
Fashionably flexible responsive web design (full day workshop)
malarkey
407
66k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
54
3k
Code Reviewing Like a Champion
maltzj
526
40k
Transcript
The Path Towards Simplifying Consistency in Distributed Systems
Caitie McCaffrey Distributed Systems Engineer caitiem.com @caitie
Distributed Systems Engineer Feral Concurrency Control Programmer Caitie McCaffrey
2015
2015 “Application-level Mechanisms for maintaining database integrity”
Halo 4 Statistics Service Halo 4 Statistics Service Record &
Aggregate Statistics From Every Multiplayer Halo Game a User Plays
Halo 4 Statistics Service
Observability at Twitter Make Dashboards & Alerts Always Available
Cmd Line Tool Viz / Dashboad Alerting Svc Cuckoo-Read Cuckoo-Write
Indexing Svc Relay Svc Twitter Front End Twitter Svc Twitter Statsite Twitter Svc Twitter Svc Scribe Collection Agent HDFS Manhattan Database Public Cloud Observability at Twitter
Notify Users When We Receive Abuse Reports
Notify Users If An Action is Taken
Report Events Stream Modification Events Stream Enrollment Events Stream Listener
Service Daemons Service Executor Service Notification Events Stream Notification Service Manhattan Macaw
Feral Concurrency Control
Service Service Service Monoliths
The Rise of NoSQL
None
Microservices
State of Affairs
Linearizable Sequential Causal Pipelined Random Access Memory Read Your Write
Monotonic Read Monotonic Write Write From Read Consistency Models
None
None
None
None
None
None
Can We Do Better?
Finance & Accounting
VisiCalc 1979
1983 Lotus 123
None
1987 Excel
None
& Standardization Computer Aided Computation
Standardization for Consistency in Distributed Systems
1988
1988 “We believe the form of communication that is needed
is remote procedure call with at- most-once semantics”
1988 “An adequate language must provide a modular, reasonably automatic
method for achieving consistency ”
Branch B Account 789: $250 Branch A Account 123 :
$100 Account 456: $50 SubAction: Deposit (123, 50) Transfer Action SubAction: Withdraw(789, 50) Transfer Deposit Withdraw enter topaction coenter action branchA.Deposit(123, 50) action branchB.Withdraw(789, 50) end end
What about Spanner?
2015
2015 “The biggest barrier…is that consistency mechanisms must integrate across
many stateful services”
Microservices
CRDTs * Stolen from Chris Meiklejohn in practice
CRDTs * Stolen from Chris Meiklejohn in practice
There Is No One Size Fits All Consistency Model
Mixed Consistency Data Stores Manhattan
None
Computer Aided Computation for Consistency in Distributed Systems
2016
Bank Application Bank Account must be > 0 Deposit Money
Withdrawal Money
‘Cause I’m Strong Enough: Reasoning About Consistency Choices in Distributed
Systems
Define Invariants & Actions Deposit Money Withdrawal Money Determine Consistency
Required Bank Account > 0 Eventual Consistency Strong Consistency Code Generation?
& Standardization Computer Aided Computation
Thank you @caitie