Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Suuchi - FifthElephant - Talk Outline

Avatar for Sriram Sriram
May 23, 2017
Technology
0
140

Suuchi - FifthElephant - Talk Outline

Avatar for Sriram

Sriram

May 23, 2017
Tweet

More Decks by Sriram

See All by Sriram
Why we built a distributed system - DSConf, Pune 2018
Avatar for Sriram brewkode
1
45
Using Monoids for large scale aggregation - Scala.io, Lyon 2017
Avatar for Sriram brewkode
0
73
Suuchi - FifthElephant, Bengaluru 2017
Avatar for Sriram brewkode
0
110

Other Decks in Technology

See All in Technology
ラスベガスの歩き方 2025年版（re:Invent 事前勉強会）
Avatar for JunjiKoide junjikoide
0
570
RemoteFunctionを使ったコロケーション
Avatar for Matsumoto Kazutaka mkazutaka
1
150
re:Invent 2025の見どころと便利アイテムをご紹介 / Highlights and Useful Items for re:Invent 2025
Avatar for Yuji Oshima yuj1osm
0
360
SRE × マネジメントレイヤーが挑戦した組織・会社のオブザーバビリティ改革 ― ビジネス価値と信頼性を両立するリアルな挑戦
Avatar for coconala_engineer coconala_engineer
0
300
OpenCensusと歩んだ7年間
Avatar for Atsushi Tanaka bgpat
0
230
20251024_TROCCO／COMETAアップデート紹介といくつかデモもやります！_#p_UG 東京：データ活用が進む組織の作り方
Avatar for D soysoysoyb
0
130
コンパウンド組織のCRE #cre_meetup
Avatar for LayerX layerx
PRO
1
290
だいたい分かった気になる 『SREの知識地図』 / introduction-to-sre-knowledge-map-book
Avatar for katsuhisa_ katsuhisa91
PRO
3
1.5k
個人でデジタル庁の デザインシステムをVue.jsで 作っている話
Avatar for にしはら nishiharatsubasa
3
5.2k
SREのキャリアから経営に近づく - Enterprise Risk Managementを基に -
Avatar for shonansurvivors shonansurvivors
1
390
AIエージェントによる業務効率化への飽くなき挑戦 -AWS上の実開発事例から学んだ効果、現実そしてギャップ-
Avatar for Kiminori Yokoi nasuvitz
5
1.4k
組織全員で向き合うAI Readyなデータ利活用
Avatar for harry gappy50
5
1.7k

Featured

See All Featured
Site-Speed That Sticks
Avatar for Harry Roberts csswizardry
13
930
Code Review Best Practice
Avatar for Trisha Gee trishagee
72
19k
How to Think Like a Performance Engineer
Avatar for Harry Roberts csswizardry
27
2.2k
No one is an island. Learnings from fostering a developers community.
Avatar for Antonio thoeni
21
3.5k
Rebuilding a faster, lazier Slack
Avatar for samanthasiow samanthasiow
84
9.2k
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
72
11k
Docker and Python
Avatar for Tania Allard trallard
46
3.6k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
Avatar for Irina Nazarova irinanazarova
9
1k
What's in a price? How to price your products and services
Avatar for Michael Herold michaelherold
246
12k
Building an army of robots
Avatar for Kyle Neath kneath
306
46k
We Have a Design System, Now What?
Avatar for Morgane Peng morganepeng
53
7.8k
Navigating Team Friction
Avatar for Lara Hogan lara
190
15k

Transcript

  1. Suuchi, toolkit to build distributed systems

  2. About me Sriram @ Indix

  3. About Indix - 840M Products - 1.5B Offers - 50K+

    Brands - ~7.5K Categories and counting...

  4. Handling Scale

  5. Layered Scaling

  6. Buck stops with DB Scaling

  7. Essentially - Scaling data systems

  8. rise of KVs Distributed - Replicated - Fault-tolerant - Sorted*

    *optional

  9. Distributed Data Stores & Distributed Compute Platforms

  10. Unify them?

  11. Existing Solutions CoProc with HBase

  12. Applications should OWN everything

  13. What if we can “enable” building them?

  14. Distributed System Primitives - Communication - Membership - Routing /

    Sharding / Partitioning - Replication - Handling Failure

  15. Communication gRPC

  16. Membership Static | Dynamic Config-Driven | Atomix

  17. Sharding / Partitioning / Routing Consistent Hash Ring, Pluggable

  18. Handling Failures

  19. Replication Sync | Async

  20. Storage* RocksDB | Pluggable * optional

  21. Getting Started - gRPC Service using Protobuf2 - Generate stubs

    & implement them - Connect using Suuchi “Server” abstraction

  22. Server Abstraction - Pluggable membership mechanism - Pluggable routing strategy

    - Pluggable replication method