Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Suuchi - FifthElephant - Talk Outline

Avatar for Sriram Sriram
May 23, 2017
Technology
160
0

Suuchi - FifthElephant - Talk Outline

Avatar for Sriram

Sriram

May 23, 2017

More Decks by Sriram

See All by Sriram
Why we built a distributed system - DSConf, Pune 2018
Avatar for Sriram brewkode
1
59
Using Monoids for large scale aggregation - Scala.io, Lyon 2017
Avatar for Sriram brewkode
0
81
Suuchi - FifthElephant, Bengaluru 2017
Avatar for Sriram brewkode
0
130

Other Decks in Technology

See All in Technology
260422_Sansan_Tech_Talk__関西_vol.3_データ活用のリアル__矢田__.pdf
Avatar for SansanTech sansantech
PRO
0
130
VespaのParent Childを用いたフィードパフォーマンスの改善
Avatar for 小野崇之 taking
0
140
Arcana: Production-Ready RAG in Elixir @ ElixirConf EU 2026
Avatar for georgeguimaraes georgeguimaraes
0
120
Scovilleモバイルエンジニア募集中.pdf
Avatar for Julien Rudin julienrudin
0
130
ServiceNow Knowledge 26 の歩き方
Avatar for ServiceNow Japan Meetup manarobot
0
250
[最強DB講義]推薦システム | 評価編
Avatar for RecSysLab recsyslab
PRO
0
110
Angular Architecture Revisited Modernizing Angular Architectural Patterns
Avatar for Rainer Hahnekamp rainerhahnekamp
0
100
AIが自律的に働く時代へ Amazon Quick で実現するAIエージェント紹介
Avatar for こーへい koheiyoshikawa
0
150
Rapid Start: Faster Internet Connections, with Ruby's Help
Avatar for kazuho kazuho
2
910
UIライブラリに依存しすぎないReact Native設計を目指して
Avatar for Takahiro Kato grandbig
0
160
AgentCore Managed Harness を使ってみよう
Avatar for やくも yakumo
2
260
Oracle AI Database@AWS：サービス概要のご紹介
Avatar for oracle4engineer oracle4engineer
PRO
4
2.4k

Featured

See All Featured
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
Avatar for Dan Newman danielanewman
231
23k
Put a Button on it: Removing Barriers to Going Fast.
Avatar for kastner kastner
60
4.2k
Game over? The fight for quality and originality in the time of robots
Avatar for Wayne Barker wayneb77
1
160
Joys of Absence: A Defence of Solitary Play
Avatar for Sebastian Deterding codingconduct
1
350
The Cult of Friendly URLs
Avatar for Andy Hume andyhume
79
6.9k
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
96
14k
Digital Ethics as a Driver of Design Innovation
Avatar for Per Axbom axbom
PRO
1
270
Leadership Guide Workshop - DevTernity 2021
Avatar for David Neal reverentgeek
1
270
Building a Scalable Design System with Sketch
Avatar for Laura Van Doore lauravandoore
463
34k
Reflections from 52 weeks, 52 projects
Avatar for Jefferson Lam jeffersonlam
356
21k
Keith and Marios Guide to Fast Websites
Avatar for Keith Pitt keithpitt
413
23k
Fireside Chat
Avatar for paigeccino paigeccino
42
3.9k

Transcript

  1. Suuchi, toolkit to build distributed systems

  2. About me Sriram @ Indix

  3. About Indix - 840M Products - 1.5B Offers - 50K+

    Brands - ~7.5K Categories and counting...

  4. Handling Scale

  5. Layered Scaling

  6. Buck stops with DB Scaling

  7. Essentially - Scaling data systems

  8. rise of KVs Distributed - Replicated - Fault-tolerant - Sorted*

    *optional

  9. Distributed Data Stores & Distributed Compute Platforms

  10. Unify them?

  11. Existing Solutions CoProc with HBase

  12. Applications should OWN everything

  13. What if we can “enable” building them?

  14. Distributed System Primitives - Communication - Membership - Routing /

    Sharding / Partitioning - Replication - Handling Failure

  15. Communication gRPC

  16. Membership Static | Dynamic Config-Driven | Atomix

  17. Sharding / Partitioning / Routing Consistent Hash Ring, Pluggable

  18. Handling Failures

  19. Replication Sync | Async

  20. Storage* RocksDB | Pluggable * optional

  21. Getting Started - gRPC Service using Protobuf2 - Generate stubs

    & implement them - Connect using Suuchi “Server” abstraction

  22. Server Abstraction - Pluggable membership mechanism - Pluggable routing strategy

    - Pluggable replication method