Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Suuchi - FifthElephant - Talk Outline

3ad75e16884079ab99b47f7e0bc52577?s=47 Sriram
May 23, 2017
Technology
0
120

Suuchi - FifthElephant - Talk Outline

3ad75e16884079ab99b47f7e0bc52577?s=128

Sriram

May 23, 2017
Tweet

More Decks by Sriram

See All by Sriram
Why we built a distributed system - DSConf, Pune 2018
3ad75e16884079ab99b47f7e0bc52577?s=48 brewkode
1
29
Using Monoids for large scale aggregation - Scala.io, Lyon 2017
3ad75e16884079ab99b47f7e0bc52577?s=48 brewkode
0
36
Suuchi - FifthElephant, Bengaluru 2017
3ad75e16884079ab99b47f7e0bc52577?s=48 brewkode
0
78

Other Decks in Technology

See All in Technology
Trusted Web プロトタイプ
525442fc70ca92f82ae503f826956137?s=48 finengine
0
310
年700万円損するサーバレスの 認可システムをご紹介します！！
Fb0a40e5e7a9dc85520f1646fd41eb44?s=48 higuuu
3
290
DeepDive into Modern Development with AWS
F42c7349266a0ebefe5b67b7f43c565d?s=48 mokocm
1
300
金融スタートアップの上場準備で大事にしたマインドセット / 2022-08-04-the-mindset-in-preparing-for-ipo
0251532f4fb413ea1a026efe6eb16b87?s=48 stajima
0
290
Learning to Solve Hard Minimal Problems
2c88806cbaab6024dc95b9a654c99d86?s=48 takmin
1
240
モノリシックサービスのレガシーインフラをEKSに移行するにあたり、他マイクロサービスと共通化した部分としなかった部分
8847086af047cbf895ab3277b59529fe?s=48 andpad
0
160
最先端の生成AIから考える、ビジネスにおける10年後のパラダイムシフト
61c616e83bef28a1cd2666439ebf334b?s=48 sbtechnight
1
300
Simplify Cloud Native Security with Trivy
3f2e97dc4e6a5daaf1cb8a406c533176?s=48 knqyf263
0
460
ソフトウェアアーキテクチャの基礎: Software Architecture in a Nutshell
941b170e5a115a295cccb5f5cdf0a800?s=48 snoozer05
26
8k
DevelopersIO 2022 俺のTerraform Pipeline
08dd0b93e011904f40d60d5a1b54c671?s=48 takakuni
0
420
バッファープールが大きいMySQL v5.7でDROP DATABASEが詰まった原因と対策 / Causes and Remedies for DROP DATABASE Stuck in MySQL v5.7 with Large Buffer Pool
A3966f193f4bef226a0d3e3c1f728d7f?s=48 line_developers
PRO
4
670
SPAとWebアプリケーションでCognitoの使い方はどう変わるのか？ / How do we use cognito with SPA and web applications?
7d75345644fa75da12a5e5215ac2352a?s=48 kitano_yuichi
0
340

Featured

See All Featured
How to name files
0a4f62e90c976eeb44d33add75cca5af?s=48 jennybc
40
63k
The World Runs on Bad Software
20bfe76b3d6105641f879fe45cfc9272?s=48 bkeepers
PRO
57
5.4k
Fashionably flexible responsive web design (full day workshop)
433acaea1012b25d97ae66da9b998dad?s=48 malarkey
396
62k
Fight the Zombie Pattern Library - RWD Summit 2016
9fa239b3154a0169d99ab7bf1422dd12?s=48 marcelosomers
226
15k
Making Projects Easy
C4de88ea47538e4594750e3861a341c8?s=48 brettharned
98
4.4k
Building an army of robots
5f2da528927a2ec9ba4fec2069cbc958?s=48 kneath
299
40k
The Art of Programming - Codeland 2020
719435d98d452de7ac367c828266cf01?s=48 erikaheidi
32
11k
Why You Should Never Use an ORM
88bc30284c6a424b63a92aad27d0ba36?s=48 jnunemaker
PRO
47
7.6k
Docker and Python
Ecdea9b9714877b86cee08458f085481?s=48 trallard
27
1.6k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
498
130k
Stop Working from a Prison Cell
C1daf20e5c49ff910745198ef9869ac2?s=48 hatefulcrawdad
262
17k
Web Components: a chance to create the future
E190023b66e2b8aa73a842b106920c93?s=48 zenorocha
303
40k

Transcript

  1. Suuchi, toolkit to build distributed systems

  2. About me Sriram @ Indix

  3. About Indix - 840M Products - 1.5B Offers - 50K+

    Brands - ~7.5K Categories and counting...

  4. Handling Scale

  5. Layered Scaling

  6. Buck stops with DB Scaling

  7. Essentially - Scaling data systems

  8. rise of KVs Distributed - Replicated - Fault-tolerant - Sorted*

    *optional

  9. Distributed Data Stores & Distributed Compute Platforms

  10. Unify them?

  11. Existing Solutions CoProc with HBase

  12. Applications should OWN everything

  13. What if we can “enable” building them?

  14. Distributed System Primitives - Communication - Membership - Routing /

    Sharding / Partitioning - Replication - Handling Failure

  15. Communication gRPC

  16. Membership Static | Dynamic Config-Driven | Atomix

  17. Sharding / Partitioning / Routing Consistent Hash Ring, Pluggable

  18. Handling Failures

  19. Replication Sync | Async

  20. Storage* RocksDB | Pluggable * optional

  21. Getting Started - gRPC Service using Protobuf2 - Generate stubs

    & implement them - Connect using Suuchi “Server” abstraction

  22. Server Abstraction - Pluggable membership mechanism - Pluggable routing strategy

    - Pluggable replication method