Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Suuchi - FifthElephant - Talk Outline
Search
Sriram
May 23, 2017
Technology
0
130
Suuchi - FifthElephant - Talk Outline
Sriram
May 23, 2017
Tweet
Share
More Decks by Sriram
See All by Sriram
Why we built a distributed system - DSConf, Pune 2018
brewkode
1
35
Using Monoids for large scale aggregation - Scala.io, Lyon 2017
brewkode
0
48
Suuchi - FifthElephant, Bengaluru 2017
brewkode
0
97
Other Decks in Technology
See All in Technology
AWS CodePipelineでコンテナアプリをデプロイした際に、古いイメージを自動で削除する
smt7174
1
130
[JAWS-UG金沢支部×コンテナ支部合同企画]コンテナとは何か
furuton
3
320
ZOZOTOWNのホーム画面をパーソナライズすることの難しさと裏話を語る
f6wbl6
0
210
Amazon_CloudWatch_ログ異常検出_導入ガイド
tsujiba
4
1.7k
ZOZOTOWNでの推薦システム活用事例の紹介
f6wbl6
0
210
カメラを用いた店内計測におけるオプトインの仕組みの実現 / ai-optin-camera
cyberagentdevelopers
PRO
1
130
AIを駆使したゲーム開発戦略: 新設AI組織の取り組み / sge-ai-strategy
cyberagentdevelopers
PRO
1
140
AWS re:Inventを徹底的に楽しむためのTips / Tips for thoroughly enjoying AWS re:Invent
yuj1osm
1
650
Mini Tokyo 3D × PLATEAU - 公共交通デジタルツインにリアルな風景を
nagix
1
140
Observability を実現するためにアセットを活用しよう(AWS 秋の Observability 祭り ~明日使えるアセット祭り~ )
tsujiba
0
110
一休.comレストランにおけるRustの活用
kymmt90
3
630
Platform Engineering ことはじめ
oracle4engineer
PRO
5
520
Featured
See All Featured
Making the Leap to Tech Lead
cromwellryan
133
8.9k
10 Git Anti Patterns You Should be Aware of
lemiorhan
654
59k
The Pragmatic Product Professional
lauravandoore
31
6.3k
Building a Scalable Design System with Sketch
lauravandoore
459
33k
The Language of Interfaces
destraynor
154
24k
Faster Mobile Websites
deanohume
304
30k
GitHub's CSS Performance
jonrohan
1030
460k
Typedesign – Prime Four
hannesfritz
39
2.4k
Designing the Hi-DPI Web
ddemaree
280
34k
Fashionably flexible responsive web design (full day workshop)
malarkey
404
65k
StorybookのUI Testing Handbookを読んだ
zakiyama
26
5.2k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
31
2.7k
Transcript
Suuchi, toolkit to build distributed systems
About me Sriram @ Indix
About Indix - 840M Products - 1.5B Offers - 50K+
Brands - ~7.5K Categories and counting...
Handling Scale
Layered Scaling
Buck stops with DB Scaling
Essentially - Scaling data systems
rise of KVs Distributed - Replicated - Fault-tolerant - Sorted*
*optional
Distributed Data Stores & Distributed Compute Platforms
Unify them?
Existing Solutions CoProc with HBase
Applications should OWN everything
What if we can “enable” building them?
Distributed System Primitives - Communication - Membership - Routing /
Sharding / Partitioning - Replication - Handling Failure
Communication gRPC
Membership Static | Dynamic Config-Driven | Atomix
Sharding / Partitioning / Routing Consistent Hash Ring, Pluggable
Handling Failures
Replication Sync | Async
Storage* RocksDB | Pluggable * optional
Getting Started - gRPC Service using Protobuf2 - Generate stubs
& implement them - Connect using Suuchi “Server” abstraction
Server Abstraction - Pluggable membership mechanism - Pluggable routing strategy
- Pluggable replication method