Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Suuchi - FifthElephant - Talk Outline

Avatar for Sriram Sriram
May 23, 2017
Technology
0
140

Suuchi - FifthElephant - Talk Outline

Avatar for Sriram

Sriram

May 23, 2017
Tweet

More Decks by Sriram

See All by Sriram
Why we built a distributed system - DSConf, Pune 2018
Avatar for Sriram brewkode
1
43
Using Monoids for large scale aggregation - Scala.io, Lyon 2017
Avatar for Sriram brewkode
0
70
Suuchi - FifthElephant, Bengaluru 2017
Avatar for Sriram brewkode
0
110

Other Decks in Technology

See All in Technology
M5製品で作るポン置きセルラー対応カメラ
Avatar for Hisaya OKADA sayacom
0
140
研究開発部メンバーの働き⽅ / Sansan R&D Profile
Avatar for Sansan, Inc. sansan33
PRO
3
20k
リーダーになったら未来を語れるようになろう/Speak the Future
Avatar for Genki Sano sanogemaru
0
280
pprof vs runtime/trace (FlightRecorder)
Avatar for task4233 task4233
0
160
非エンジニアのあなたもできる＆もうやってる！コンテキストエンジニアリング
Avatar for ファインディ株式会社（イベント資料アップ用） findy_eventslides
3
910
生成AIで「お客様の声」を ストーリーに変える 新潮流「Generative ETL」
Avatar for Satoru Ishikawa ishikawa_satoru
1
310
ZOZOのAI活用実践〜社内基盤からサービス応用まで〜
Avatar for ZOZO Developers zozotech
PRO
0
170
ACA でMAGI システムを社内で展開しようとした話
Avatar for Yuji Masaoka | まっぴぃ mappie_kochi
1
250
Findy Team+のSOC2取得までの道のり
Avatar for adachi.ryo rvirus0817
0
330
「AI駆動PO」を考えてみる - 作る速さから価値のスループットへ：検査・適応で未来を開発 / AI-driven product owner. scrummat2025
Avatar for yosuke nagai yosuke_nagai
4
580
GA technologiesでのAI-Readyの取り組み@DataOps Night
Avatar for yuto16 yuto16
0
270
実装で解き明かす並行処理の歴史
Avatar for ZOZO Developers zozotech
PRO
1
320

Featured

See All Featured
The Web Performance Landscape in 2024 [PerfNow 2024]
Avatar for Tammy Everts tammyeverts
9
850
Building an army of robots
Avatar for Kyle Neath kneath
306
46k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
Avatar for Eileen M. Uchitelle eileencodes
140
34k
Agile that works and the tools we love
Avatar for Rasmus Luckow-Nielsen rasmusluckow
331
21k
Code Review Best Practice
Avatar for Trisha Gee trishagee
72
19k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
Avatar for Dan Newman danielanewman
229
22k
Practical Tips for Bootstrapping Information Extraction Pipelines
Avatar for Matthew Honnibal honnibal
PRO
23
1.5k
Helping Users Find Their Own Way: Creating Modern Search Experiences
Avatar for Dan Newman danielanewman
30
2.9k
Thoughts on Productivity
Avatar for Jon Yablonski jonyablonski
70
4.9k
The Cult of Friendly URLs
Avatar for Andy Hume andyhume
79
6.6k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
Avatar for Addy Osmani addyosmani
7
890
Building Flexible Design Systems
Avatar for Yesenia Perez-Cruz yeseniaperezcruz
329
39k

Transcript

  1. Suuchi, toolkit to build distributed systems

  2. About me Sriram @ Indix

  3. About Indix - 840M Products - 1.5B Offers - 50K+

    Brands - ~7.5K Categories and counting...

  4. Handling Scale

  5. Layered Scaling

  6. Buck stops with DB Scaling

  7. Essentially - Scaling data systems

  8. rise of KVs Distributed - Replicated - Fault-tolerant - Sorted*

    *optional

  9. Distributed Data Stores & Distributed Compute Platforms

  10. Unify them?

  11. Existing Solutions CoProc with HBase

  12. Applications should OWN everything

  13. What if we can “enable” building them?

  14. Distributed System Primitives - Communication - Membership - Routing /

    Sharding / Partitioning - Replication - Handling Failure

  15. Communication gRPC

  16. Membership Static | Dynamic Config-Driven | Atomix

  17. Sharding / Partitioning / Routing Consistent Hash Ring, Pluggable

  18. Handling Failures

  19. Replication Sync | Async

  20. Storage* RocksDB | Pluggable * optional

  21. Getting Started - gRPC Service using Protobuf2 - Generate stubs

    & implement them - Connect using Suuchi “Server” abstraction

  22. Server Abstraction - Pluggable membership mechanism - Pluggable routing strategy

    - Pluggable replication method