Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Suuchi - FifthElephant - Talk Outline
Search
Sriram
May 23, 2017
Technology
0
140
Suuchi - FifthElephant - Talk Outline
Sriram
May 23, 2017
Tweet
Share
More Decks by Sriram
See All by Sriram
Why we built a distributed system - DSConf, Pune 2018
brewkode
1
38
Using Monoids for large scale aggregation - Scala.io, Lyon 2017
brewkode
0
67
Suuchi - FifthElephant, Bengaluru 2017
brewkode
0
100
Other Decks in Technology
See All in Technology
手動からの解放!!Strands Agents で実現する総合テスト自動化
ideaws
3
390
生成AIによる情報システムへのインパクト
taka_aki
1
200
Shadow DOMとセキュリティ - 光と影の境界を探る / Shibuya.XSS techtalk #13
masatokinugawa
0
310
スプリントレビューを効果的にするために
miholovesq
9
1.7k
CSPヘッダー導入で実現するWebサイトの多層防御:今すぐ試せる設定例と運用知見
llamakko
1
260
MCPと認可まわりの話 / mcp_and_authorization
convto
2
290
AI工学特論: MLOps・継続的評価
asei
10
2k
AWS表彰プログラムとキャリアについて
naoki_0531
1
140
複数のGemini CLIが同時開発する狂気 - Jujutsuが実現するAIエージェント協調の新世界
gunta
13
3.8k
地域コミュニティへの「感謝」と「恩返し」 / 20250726jawsug-tochigi
kasacchiful
0
100
経験がないことを言い訳にしない、 AI時代の他領域への染み出し方
parayama0625
0
260
私とAWSとの関わりの歩み~意志あるところに道は開けるかも?~
nagisa53
1
130
Featured
See All Featured
Large-scale JavaScript Application Architecture
addyosmani
512
110k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
234
17k
Site-Speed That Sticks
csswizardry
10
720
The Cult of Friendly URLs
andyhume
79
6.5k
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
PRO
21
1.4k
What's in a price? How to price your products and services
michaelherold
246
12k
jQuery: Nuts, Bolts and Bling
dougneiner
63
7.8k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
chriscoyier
507
140k
A Modern Web Designer's Workflow
chriscoyier
695
190k
Stop Working from a Prison Cell
hatefulcrawdad
271
21k
RailsConf 2023
tenderlove
30
1.2k
For a Future-Friendly Web
brad_frost
179
9.8k
Transcript
Suuchi, toolkit to build distributed systems
About me Sriram @ Indix
About Indix - 840M Products - 1.5B Offers - 50K+
Brands - ~7.5K Categories and counting...
Handling Scale
Layered Scaling
Buck stops with DB Scaling
Essentially - Scaling data systems
rise of KVs Distributed - Replicated - Fault-tolerant - Sorted*
*optional
Distributed Data Stores & Distributed Compute Platforms
Unify them?
Existing Solutions CoProc with HBase
Applications should OWN everything
What if we can “enable” building them?
Distributed System Primitives - Communication - Membership - Routing /
Sharding / Partitioning - Replication - Handling Failure
Communication gRPC
Membership Static | Dynamic Config-Driven | Atomix
Sharding / Partitioning / Routing Consistent Hash Ring, Pluggable
Handling Failures
Replication Sync | Async
Storage* RocksDB | Pluggable * optional
Getting Started - gRPC Service using Protobuf2 - Generate stubs
& implement them - Connect using Suuchi “Server” abstraction
Server Abstraction - Pluggable membership mechanism - Pluggable routing strategy
- Pluggable replication method