Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Jepsen Introduction LT
Search
UENISHI Kota
May 13, 2015
Technology
450
2
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Jepsen Introduction LT
Jepsenの紹介LT
UENISHI Kota
May 13, 2015
Transcript
12 slides
2015/5/13 Dwango Internal Erlang/OTP study group, LT Kota UENISHI /
@kuenishi JEPSEN “CALL ME MAYBE”
“Call Me Maybe” WHAT EVEN IS JEPSEN?
Who plays a song “Call Me Maybe” A NAME OF
A SINGER
That can test many system with replication ALSO, A PARTITION
TOLERANCE TEST TOOL
IT HAS TESTED … • PostgreSQL • Redis (Sentinel, redux)
• MongoDB • Riak • ZooKeeper • NuoDB • Kafka • Cassandra • RabbitMQ • etcd and Consul • Elasticsearch • Aerospike (New!)
AND FOUND DATA LOSS ISSUE OF … • Redis (Sentinel,
redux) • MongoDB • Kafka • Cassandra • RabbitMQ • etcd • Elasticsearch • Aerospike
BOXES AND LINES n1 jepsen n2 n3 n4 n5
is implemented in Clojure TECHNICALLY JEPSEN .. • Emulates network
partition • By cutting network between virtual machines • While Jepsen concurrently continues writing data, • And finally verifies any writes are not lost
WHY PARTITION TOLERANCE IS IMPORTANT AND DIFFICULT?
• In the beginning was the failure and asynchrony •
Replication and Consensus next • Failover and recovery / Membership Change mess things • Implementation and runtime is complexed
• for x=1….n • list = get(x) • write(x, [a,
list]) • get(x) • => [1…n] ͱͳ͍ͬͯΕ linearizable
REFERENCES • C.R.Jepsen “Call Me Maybe” • Jepsen blog post
series • github.com/aphyr/jepsen • Kyle Kingsbury: @aphyr (sometimes NSFW) • “The Network Is Reliable” • https://queue.acm.org/detail.cfm?id=2655736
More Decks by UENISHI Kota
See All by UENISHI Kota
Storage Systems in Preferred Networks
kuenishi
0
120
Metadata Management in Distributed File Systems
kuenishi
2
590
Behind The Scenes: Cloud Native Storage System for AI
kuenishi
2
490
Apache Ozone behind Simulation and AI Industries
kuenishi
0
520
Distributed Deep Learning with Chainer and Hadoop
kuenishi
3
1.4k
A Few Ways to Accelerate Deep Learning
kuenishi
0
1.3k
Introducing Retz
kuenishi
5
1.3k
Introducing Retz and how to develop practical frameworks
kuenishi
3
870
Formalization and Proof of Distributed Systems (ja)
kuenishi
10
6.6k
Other Decks in Technology
See All in Technology
信頼性を犠牲にせず、PR マージからデプロイまで人の介入を完全にゼロにするまでの道のり
knwoop
4
2k
メール到達性を支える、リンク先URLのドメイン評価の扱い方
wind111
0
190
Del vibe coding a un Desarrollo (agéntico) fiable
jcabot
0
200
落とし穴にハマってわかった 開発生産性を測るときに気をつけたいこと
munakata
3
480
設計手法を「道具」として使いこなすために
a_suenami
7
1.6k
20261113_AWS Organizations運用を下支えするCFn StackSetsの柔軟性
dkduppf
0
110
OpenTelemetryで変わった 新時代のCloudWatchメトリクス監視
tsukuboshi
0
480
実測データからサービスの成長余力を測る。負荷シナリオ・テストデータ・限界値の設計
kazatohiei
0
130
CloudTrail を推したい
kazzpapa3
1
160
AWS Client VPNの設定でハマったポイントとその過程での気づき
amarelo_n24
1
430
Kubernetes, Agones, WebRTC, GPU で作る クラウドゲーミング基盤を本番運用に乗せるまで
vivion
0
240
人の努力に頼らないセキュリティをエンジニアリングする在り方 / An approach to engineering security that does not rely on human effort
carta_engineering
0
240
Featured
See All Featured
Collaborative Software Design: How to facilitate domain modelling decisions
baasie
1
390
The Impact of AI in SEO - AI Overviews June 2024 Edition
aleyda
6
1.3k
GitHub's CSS Performance
jonrohan
1033
470k
More Than Pixels: Becoming A User Experience Designer
marktimemedia
3
630
Digital Projects Gone Horribly Wrong (And the UX Pros Who Still Save the Day) - Dean Schuster
uxyall
2
4k
Principles of Awesome APIs and How to Build Them.
keavy
128
18k
Marketing to machines
jonoalderson
1
6k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
9
1.7k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
360
31k
Visual Storytelling: How to be a Superhuman Communicator
reverentgeek
2
750
Marketing Yourself as an Engineer | Alaka | Gurzu
gurzu
0
390
Large-scale JavaScript Application Architecture
addyosmani
516
110k