Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Suuchi - FifthElephant - Talk Outline
Search
Sriram
May 23, 2017
Technology
0
140
Suuchi - FifthElephant - Talk Outline
Sriram
May 23, 2017
Tweet
Share
More Decks by Sriram
See All by Sriram
Why we built a distributed system - DSConf, Pune 2018
brewkode
1
40
Using Monoids for large scale aggregation - Scala.io, Lyon 2017
brewkode
0
68
Suuchi - FifthElephant, Bengaluru 2017
brewkode
0
110
Other Decks in Technology
See All in Technology
事業特性から逆算したインフラ設計
upsider_tech
0
230
意志の力が9割。アニメから学ぶAI時代のこれから。
endohizumi
1
110
データモデリング通り #2オンライン勉強会 ~方法論の話をしよう~
datayokocho
0
190
自治体職員がガバクラの AWS 閉域ネットワークを理解するのにやって良かった個人検証環境
takeda_h
0
310
Delegate authentication and a lot more to Keycloak with OpenID Connect
ahus1
0
240
Amazon Inspector コードセキュリティで手軽に実現するシフトレフト
maimyyym
0
140
AIに目を奪われすぎて、周りの困っている人間が見えなくなっていませんか?
cap120
1
700
[kickflow]20250319_少人数チームでのAutify活用
otouhujej
0
160
PFEM Online Feature Flag @ newmo
shinyaishitobi
1
130
AWS DDoS攻撃防御の最前線
ryutakondo
1
180
LLM時代の検索とコンテキストエンジニアリング
shibuiwilliam
0
130
Amazon GuardDuty での脅威検出:脅威検出の実例から学ぶ
kintotechdev
0
130
Featured
See All Featured
Documentation Writing (for coders)
carmenintech
73
5k
The Invisible Side of Design
smashingmag
301
51k
Building Flexible Design Systems
yeseniaperezcruz
328
39k
BBQ
matthewcrist
89
9.8k
Improving Core Web Vitals using Speculation Rules API
sergeychernyshev
18
1.1k
VelocityConf: Rendering Performance Case Studies
addyosmani
332
24k
How GitHub (no longer) Works
holman
314
140k
The Psychology of Web Performance [Beyond Tellerrand 2023]
tammyeverts
49
3k
Stop Working from a Prison Cell
hatefulcrawdad
271
21k
Measuring & Analyzing Core Web Vitals
bluesmoon
8
560
Put a Button on it: Removing Barriers to Going Fast.
kastner
60
4k
Why You Should Never Use an ORM
jnunemaker
PRO
58
9.5k
Transcript
Suuchi, toolkit to build distributed systems
About me Sriram @ Indix
About Indix - 840M Products - 1.5B Offers - 50K+
Brands - ~7.5K Categories and counting...
Handling Scale
Layered Scaling
Buck stops with DB Scaling
Essentially - Scaling data systems
rise of KVs Distributed - Replicated - Fault-tolerant - Sorted*
*optional
Distributed Data Stores & Distributed Compute Platforms
Unify them?
Existing Solutions CoProc with HBase
Applications should OWN everything
What if we can “enable” building them?
Distributed System Primitives - Communication - Membership - Routing /
Sharding / Partitioning - Replication - Handling Failure
Communication gRPC
Membership Static | Dynamic Config-Driven | Atomix
Sharding / Partitioning / Routing Consistent Hash Ring, Pluggable
Handling Failures
Replication Sync | Async
Storage* RocksDB | Pluggable * optional
Getting Started - gRPC Service using Protobuf2 - Generate stubs
& implement them - Connect using Suuchi “Server” abstraction
Server Abstraction - Pluggable membership mechanism - Pluggable routing strategy
- Pluggable replication method