Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Suuchi - FifthElephant - Talk Outline
Search
Sriram
May 23, 2017
Technology
180
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Suuchi - FifthElephant - Talk Outline
Sriram
May 23, 2017
More Decks by Sriram
See All by Sriram
Why we built a distributed system - DSConf, Pune 2018
brewkode
1
82
Using Monoids for large scale aggregation - Scala.io, Lyon 2017
brewkode
0
110
Suuchi - FifthElephant, Bengaluru 2017
brewkode
0
150
Other Decks in Technology
See All in Technology
Point Cloud as a Foreign Language for Multi-modal Large Language Model
takmin
0
360
Level Up Your CDK DX: 5 Tools I’ve Been Building
gotok365
2
170
プロダクトエンジニアに必要な「いい感じ」に作る能力 〜たくさん作れる時代に、どこまで作るかの決め方〜
jnishime_dresscode
1
470
Oracle AI Databaseデータベース・サービス: BaseDB/ExaDB-Dの可用性
oracle4engineer
PRO
1
1.1k
Contract One Engineering Unit 紹介資料
sansan33
PRO
0
20k
みてねにおけるAI-DLC導入活動とAIドリブン開発の現在地/JAWS-UG AI-DLC #2
isaoshimizu
2
320
[RSJ26] Building a VLA Model Based on Self-Distilled Classification
keio_smilab
PRO
0
170
Backstageでつくるセルフサービスな社内開発基盤
kikunosuke75
1
190
少人数データチームのDevin活用実践事例
runandy16
2
280
サーバー常駐型の 簡易障害調査AI エージェントを作ってみた話
masayoshi
1
510
書籍『生成AIの安全性入門』の入門
wataoka
0
150
Bet AI Day 2026丨AIを「使う」から、AIが「働く」へ ― LayerXが進める「組織AI」の社会実装
layerx
PRO
2
1.5k
Featured
See All Featured
Learning to Love Humans: Emotional Interface Design
aarron
275
41k
Building Applications with DynamoDB
mza
96
7.2k
JAMstack: Web Apps at Ludicrous Speed - All Things Open 2022
reverentgeek
1
590
Public Speaking Without Barfing On Your Shoes - THAT 2023
reverentgeek
1
550
Designing Experiences People Love
moore
143
24k
GitHub's CSS Performance
jonrohan
1033
470k
How to Align SEO within the Product Triangle To Get Buy-In & Support - #RIMC
aleyda
2
1.8k
How Software Deployment tools have changed in the past 20 years
geshan
1
34k
Music & Morning Musume
bryan
47
7.3k
Balancing Empowerment & Direction
lara
6
1.3k
職位にかかわらず全員がリーダーシップを発揮するチーム作り / Building a team where everyone can demonstrate leadership regardless of position
madoxten
69
64k
How to Ace a Technical Interview
jacobian
281
24k
Transcript
Suuchi, toolkit to build distributed systems
About me Sriram @ Indix
About Indix - 840M Products - 1.5B Offers - 50K+
Brands - ~7.5K Categories and counting...
Handling Scale
Layered Scaling
Buck stops with DB Scaling
Essentially - Scaling data systems
rise of KVs Distributed - Replicated - Fault-tolerant - Sorted*
*optional
Distributed Data Stores & Distributed Compute Platforms
Unify them?
Existing Solutions CoProc with HBase
Applications should OWN everything
What if we can “enable” building them?
Distributed System Primitives - Communication - Membership - Routing /
Sharding / Partitioning - Replication - Handling Failure
Communication gRPC
Membership Static | Dynamic Config-Driven | Atomix
Sharding / Partitioning / Routing Consistent Hash Ring, Pluggable
Handling Failures
Replication Sync | Async
Storage* RocksDB | Pluggable * optional
Getting Started - gRPC Service using Protobuf2 - Generate stubs
& implement them - Connect using Suuchi “Server” abstraction
Server Abstraction - Pluggable membership mechanism - Pluggable routing strategy
- Pluggable replication method