Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Suuchi - FifthElephant - Talk Outline

Avatar for Sriram Sriram
May 23, 2017
Technology
0
140

Suuchi - FifthElephant - Talk Outline

Avatar for Sriram

Sriram

May 23, 2017
Tweet

More Decks by Sriram

See All by Sriram
Why we built a distributed system - DSConf, Pune 2018
Avatar for Sriram brewkode
1
38
Using Monoids for large scale aggregation - Scala.io, Lyon 2017
Avatar for Sriram brewkode
0
67
Suuchi - FifthElephant, Bengaluru 2017
Avatar for Sriram brewkode
0
100

Other Decks in Technology

See All in Technology
手動からの解放！！Strands Agents で実現する総合テスト自動化
Avatar for 井手亮太 ideaws
3
390
生成AIによる情報システムへのインパクト
Avatar for Takaaki Yayoi taka_aki
1
200
Shadow DOMとセキュリティ - 光と影の境界を探る / Shibuya.XSS techtalk #13
Avatar for Masato Kinugawa masatokinugawa
0
310
スプリントレビューを効果的にするために
Avatar for Miho Nagase miholovesq
9
1.7k
CSPヘッダー導入で実現するWebサイトの多層防御：今すぐ試せる設定例と運用知見
Avatar for llamakko llamakko
1
260
MCPと認可まわりの話 / mcp_and_authorization
Avatar for convto convto
2
290
AI工学特論: MLOps・継続的評価
Avatar for Asei Sugiyama asei
10
2k
AWS表彰プログラムとキャリアについて
Avatar for Naoki naoki_0531
1
140
複数のGemini CLIが同時開発する狂気 - Jujutsuが実現するAIエージェント協調の新世界
Avatar for Gunther Brunner gunta
13
3.8k
地域コミュニティへの「感謝」と「恩返し」 / 20250726jawsug-tochigi
Avatar for kasacchiful kasacchiful
0
100
経験がないことを言い訳にしない、 AI時代の他領域への染み出し方
Avatar for Yuki Harayama parayama0625
0
260
私とAWSとの関わりの歩み～意志あるところに道は開けるかも？～
Avatar for nagisa_53 nagisa53
1
130

Featured

See All Featured
Large-scale JavaScript Application Architecture
Avatar for Addy Osmani addyosmani
512
110k
Fight the Zombie Pattern Library - RWD Summit 2016
Avatar for Marcelo Somers marcelosomers
234
17k
Site-Speed That Sticks
Avatar for Harry Roberts csswizardry
10
720
The Cult of Friendly URLs
Avatar for Andy Hume andyhume
79
6.5k
Practical Tips for Bootstrapping Information Extraction Pipelines
Avatar for Matthew Honnibal honnibal
PRO
21
1.4k
What's in a price? How to price your products and services
Avatar for Michael Herold michaelherold
246
12k
jQuery: Nuts, Bolts and Bling
Avatar for Doug Neiner dougneiner
63
7.8k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
Avatar for Chris Coyier chriscoyier
507
140k
A Modern Web Designer's Workflow
Avatar for Chris Coyier chriscoyier
695
190k
Stop Working from a Prison Cell
Avatar for Chris Michel hatefulcrawdad
271
21k
RailsConf 2023
Avatar for Aaron Patterson tenderlove
30
1.2k
For a Future-Friendly Web
Avatar for Brad Frost brad_frost
179
9.8k

Transcript

  1. Suuchi, toolkit to build distributed systems

  2. About me Sriram @ Indix

  3. About Indix - 840M Products - 1.5B Offers - 50K+

    Brands - ~7.5K Categories and counting...

  4. Handling Scale

  5. Layered Scaling

  6. Buck stops with DB Scaling

  7. Essentially - Scaling data systems

  8. rise of KVs Distributed - Replicated - Fault-tolerant - Sorted*

    *optional

  9. Distributed Data Stores & Distributed Compute Platforms

  10. Unify them?

  11. Existing Solutions CoProc with HBase

  12. Applications should OWN everything

  13. What if we can “enable” building them?

  14. Distributed System Primitives - Communication - Membership - Routing /

    Sharding / Partitioning - Replication - Handling Failure

  15. Communication gRPC

  16. Membership Static | Dynamic Config-Driven | Atomix

  17. Sharding / Partitioning / Routing Consistent Hash Ring, Pluggable

  18. Handling Failures

  19. Replication Sync | Async

  20. Storage* RocksDB | Pluggable * optional

  21. Getting Started - gRPC Service using Protobuf2 - Generate stubs

    & implement them - Connect using Suuchi “Server” abstraction

  22. Server Abstraction - Pluggable membership mechanism - Pluggable routing strategy

    - Pluggable replication method