Lock in $30 Savings on PRO—Offer Ends Soon! ⏳

Suuchi - FifthElephant - Talk Outline

Avatar for Sriram Sriram
May 23, 2017
Technology
0
140

Suuchi - FifthElephant - Talk Outline

Avatar for Sriram

Sriram

May 23, 2017
Tweet

More Decks by Sriram

See All by Sriram
Why we built a distributed system - DSConf, Pune 2018
Avatar for Sriram brewkode
1
49
Using Monoids for large scale aggregation - Scala.io, Lyon 2017
Avatar for Sriram brewkode
0
77
Suuchi - FifthElephant, Bengaluru 2017
Avatar for Sriram brewkode
0
120

Other Decks in Technology

See All in Technology
Databricksによるエージェント構築
Avatar for Takaaki Yayoi taka_aki
1
120
20251127 BigQueryリモート関数で作る、お手軽AIバッチ実行環境
Avatar for daimatz daimatz
0
430
オープンデータの内製化から分かったGISデータを巡る行政の課題
Avatar for 室木直樹 naokim84
2
1.3k
AI駆動開発によるDDDの実践
Avatar for ディップ株式会社 dip_tech
PRO
0
290
Docker, Infraestructuras seguras y Hardening
Avatar for José Juan Sánchez Hernández josejuansanchez
0
150
Introduction to Sansan, inc / Sansan Global Development Center, Inc.
Avatar for Sansan, Inc. sansan33
PRO
0
2.9k
ML PM Talk #1 - ML PMの分類に関する考察
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
1
520
Oracle Database@AWS：サービス概要のご紹介
Avatar for oracle4engineer oracle4engineer
PRO
0
120
All About Sansan – for New Global Engineers
Avatar for Sansan, Inc. sansan33
PRO
1
1.3k
【５分でわかる】セーフィー エンジニア向け会社紹介
Avatar for Safie safie_recruit
0
37k
事業部のプロジェクト進行と開発チームの改善の “時間軸" のすり合わせ
Avatar for konifar konifar
9
3k
安いGPUレンタルサービスについて
Avatar for Aratako aratako
1
2.1k

Featured

See All Featured
Fashionably flexible responsive web design (full day workshop)
Avatar for Andy Clarke malarkey
407
66k
Principles of Awesome APIs and How to Build Them.
Avatar for Keavy McMinn keavy
127
17k
BBQ
Avatar for Matthew Crist matthewcrist
89
9.9k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
Avatar for Rebecca Miller-Webster rmw
35
3.3k
Code Review Best Practice
Avatar for Trisha Gee trishagee
73
19k
GraphQLの誤解/rethinking-graphql
Avatar for sonatard sonatard
73
11k
Performance Is Good for Brains [We Love Speed 2024]
Avatar for Tammy Everts tammyeverts
12
1.3k
KATA
Avatar for Megan Lloyd mclloyd
PRO
32
15k
Java REST API Framework Comparison - PWX 2021
Avatar for Matt Raible mraible
34
9k
The Pragmatic Product Professional
Avatar for Laura Van Doore lauravandoore
37
7.1k
Done Done
Avatar for chrislema chrislema
186
16k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
Avatar for Stéphanie Walter stephaniewalter
285
14k

Transcript

  1. Suuchi, toolkit to build distributed systems

  2. About me Sriram @ Indix

  3. About Indix - 840M Products - 1.5B Offers - 50K+

    Brands - ~7.5K Categories and counting...

  4. Handling Scale

  5. Layered Scaling

  6. Buck stops with DB Scaling

  7. Essentially - Scaling data systems

  8. rise of KVs Distributed - Replicated - Fault-tolerant - Sorted*

    *optional

  9. Distributed Data Stores & Distributed Compute Platforms

  10. Unify them?

  11. Existing Solutions CoProc with HBase

  12. Applications should OWN everything

  13. What if we can “enable” building them?

  14. Distributed System Primitives - Communication - Membership - Routing /

    Sharding / Partitioning - Replication - Handling Failure

  15. Communication gRPC

  16. Membership Static | Dynamic Config-Driven | Atomix

  17. Sharding / Partitioning / Routing Consistent Hash Ring, Pluggable

  18. Handling Failures

  19. Replication Sync | Async

  20. Storage* RocksDB | Pluggable * optional

  21. Getting Started - gRPC Service using Protobuf2 - Generate stubs

    & implement them - Connect using Suuchi “Server” abstraction

  22. Server Abstraction - Pluggable membership mechanism - Pluggable routing strategy

    - Pluggable replication method