Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Suuchi - FifthElephant - Talk Outline
Search
Sriram
May 23, 2017
Technology
0
130
Suuchi - FifthElephant - Talk Outline
Sriram
May 23, 2017
Tweet
Share
More Decks by Sriram
See All by Sriram
Why we built a distributed system - DSConf, Pune 2018
brewkode
1
35
Using Monoids for large scale aggregation - Scala.io, Lyon 2017
brewkode
0
46
Suuchi - FifthElephant, Bengaluru 2017
brewkode
0
96
Other Decks in Technology
See All in Technology
Flutter研修【MIXI 24新卒技術研修】
mixi_engineers
PRO
0
160
AIエージェントを現場に導入する目線とは
masahiro_nishimi
1
1.5k
ACRiルーム最新情報とAMD GPUサーバーのご紹介
anjn
0
150
AI研修【MIXI 24新卒技術研修】
mixi_engineers
PRO
0
130
簡単に始めるSnowflakeの機械学習
nayuts
1
190
20240724_cm_odyssey_hibiyatech
hiashisan
0
110
What if...? 처음부터 다시 LLM 어플리케이션을 개발한다면
huffon
0
1k
OSSコミットしてZennの課題を解決した話
dyoshikawa1993
0
150
AWSでRAGを作る法方
sonoda_mj
1
140
クラウド利用者の「責任」をどう果たす?AWSセキュリティ対策のススメ #AWSSummit
hiashisan
0
270
What is DRE? - Road to SRE NEXT@広島
chanyou0311
3
630
大規模ドラレコデータ収集・機械学習基盤を支える AWS CDK 〜導入・運用事例紹介〜
pemugi
0
110
Featured
See All Featured
A Tale of Four Properties
chriscoyier
155
22k
Unsuck your backbone
ammeep
666
57k
Facilitating Awesome Meetings
lara
46
5.8k
Build The Right Thing And Hit Your Dates
maggiecrowley
28
2.2k
The Cost Of JavaScript in 2023
addyosmani
31
4.7k
KATA
mclloyd
20
13k
Gamification - CAS2011
davidbonilla
78
4.9k
The Pragmatic Product Professional
lauravandoore
29
6.1k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
smashingmag
248
20k
Music & Morning Musume
bryan
43
5.9k
The Invisible Side of Design
smashingmag
294
50k
In The Pink: A Labor of Love
frogandcode
139
22k
Transcript
Suuchi, toolkit to build distributed systems
About me Sriram @ Indix
About Indix - 840M Products - 1.5B Offers - 50K+
Brands - ~7.5K Categories and counting...
Handling Scale
Layered Scaling
Buck stops with DB Scaling
Essentially - Scaling data systems
rise of KVs Distributed - Replicated - Fault-tolerant - Sorted*
*optional
Distributed Data Stores & Distributed Compute Platforms
Unify them?
Existing Solutions CoProc with HBase
Applications should OWN everything
What if we can “enable” building them?
Distributed System Primitives - Communication - Membership - Routing /
Sharding / Partitioning - Replication - Handling Failure
Communication gRPC
Membership Static | Dynamic Config-Driven | Atomix
Sharding / Partitioning / Routing Consistent Hash Ring, Pluggable
Handling Failures
Replication Sync | Async
Storage* RocksDB | Pluggable * optional
Getting Started - gRPC Service using Protobuf2 - Generate stubs
& implement them - Connect using Suuchi “Server” abstraction
Server Abstraction - Pluggable membership mechanism - Pluggable routing strategy
- Pluggable replication method