Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Build Scalable Chat Platform That Scalable with...

Avatar for evanpurnama evanpurnama
November 02, 2018
Technology
1
92

Build Scalable Chat Platform That Scalable with Bot

Build Scalable Chat Platform That Scalable with Bot

Avatar for evanpurnama

evanpurnama

November 02, 2018
Tweet

More Decks by evanpurnama

See All by evanpurnama
Build Your Own AI-Compatible Chat Using Qiscus Chat SDK
Avatar for evanpurnama evnpr
0
130
Lessons Learned: ~ 2 years on RoR
Avatar for evanpurnama evnpr
0
2.1k
open qiscus [obsolette, when qiscus is still Slack-like app]
Avatar for evanpurnama evnpr
0
130
Scaling Rails with RabbitMQ and Memcached
Avatar for evanpurnama evnpr
2
970
CI, Django, Rails
Avatar for evanpurnama evnpr
1
150

Other Decks in Technology

See All in Technology
実運用で考える PGO
Avatar for KNOWLEDGE WORK / 株式会社ナレッジワーク kworkdev
PRO
0
150
AIエージェントの活用に重要な「MCP （Model Context Protocol）」とは何か
Avatar for Masaya Mori (森正弥) / CAIO (Chief AI Officer) masayamoriofficial
0
290
複数サービスを支える マルチテナント型 Batch MLプラットフォーム
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
0
200
RSCの時代にReactとフレームワークの境界を探る
Avatar for uhyo uhyo
10
3.1k
AWSで推進するデータマネジメント
Avatar for かわなご kawanago
0
1.1k
Grafana MCPサーバーによるAIエージェント経由でのGrafanaダッシュボード動的生成
Avatar for 濱田孝治 hamadakoji
1
1.4k
エニグモ_会社紹介資料（エンジニア職種向け）.pdf
Avatar for 株式会社エニグモ enigmo_hr
0
2.2k
Autonomous Database - Dedicated 技術詳細 / adb-d_technical_detail_jp
Avatar for oracle4engineer oracle4engineer
PRO
4
9.9k
ガチな登山用デバイスからこんにちは
Avatar for halka halka
1
210
機械学習を扱うプラットフォーム開発と運用事例
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
0
180
下手な強制、ダメ！絶対！ 「ガードレール」を「檻」にさせない"ガバナンス"の取り方とは？
Avatar for Masataka Tsukamoto tsukaman
2
350
生成AI時代のデータ基盤設計〜ペースレイヤリングで実現する高速開発と持続性〜 / Levtech Meetup_Session_2
Avatar for Sansan R&D sansan_randd
1
140

Featured

See All Featured
BBQ
Avatar for Matthew Crist matthewcrist
89
9.8k
Code Reviewing Like a Champion
Avatar for maltzj maltzj
525
40k
Building a Modern Day 
E-commerce SEO Strategy
Avatar for Aleyda Solis aleyda
43
7.5k
Reflections from 52 weeks, 52 projects
Avatar for Jefferson Lam jeffersonlam
352
21k
Raft: Consensus for Rubyists
Avatar for Patrick Van Stee vanstee
140
7.1k
Connecting the Dots Between Site Speed, User Experience & Your Business [WebExpo 2025]
Avatar for Tammy Everts tammyeverts
8
520
Speed Design
Avatar for Sergey Chernyshev sergeychernyshev
32
1.1k
Music & Morning Musume
Avatar for Bryan Veloso bryan
46
6.8k
Automating Front-end Workflow
Avatar for Addy Osmani addyosmani
1370
200k
Scaling GitHub
Avatar for Zach Holman holman
463
140k
Building an army of robots
Avatar for Kyle Neath kneath
306
46k
Practical Orchestrator
Avatar for Shlomi Noach shlominoach
190
11k

Transcript

  1. Build Reliable and Scalable Chat Platform that Bot Compatible by

    Evan Purnama (CTO, Qiscus)

  2. What is Qiscus? We are a startup that help companies

    to enable conversations in their apps. #EnablingConversations

  3. What is Qiscus? #EnablingConversations

  4. Our Customers … and 100+ more apps already registered in

    our system ~ 6 millions chat users (on our cloud server) #EnablingConversations

  5. Use cases ◦ Connect user to user (doctor to patient,

    student to teacher) ◦ Connect between user to admin/agent (customer services) ◦ Connect between user to bot engine (chatbot) ◦ Create alternative of internal messaging (create WA-like App) #EnablingConversations

  6. Some of tech that we are using #EnablingConversations

  7. Chat System That Reliable and Scalable

  8. Reliability #EnablingConversations

  9. Uptime ◦ Measure of system reliability ◦ Service Level Agreement

    (SLA) #EnablingConversations

  10. Uptime #EnablingConversations

  11. Uptime #EnablingConversations > 99.9 %

  12. None

  13. Scalability #EnablingConversations

  14. Architecture & Infrastructure #EnablingConversations Frontend / Client Side Backend /

    Web Server / Middleware DB General IT System

  15. Architecture & Infrastructure #EnablingConversations Frontend / Client Side Backend /

    Web Server / Middleware DB General IT System

  16. Scalable General IT System #EnablingConversations Load Balancer

  17. Scalable General IT System : Frontend #EnablingConversations Content Delivery Network

    (CDN)

  18. Scalable General IT System : Frontend #EnablingConversations Server Side Rendering

  19. Scalable General IT System : Frontend #EnablingConversations Lazy Load Data

  20. Scalable General IT System : Backend #EnablingConversations

  21. Scalable General IT System : Backend #EnablingConversations

  22. Scalable General IT System : Database #EnablingConversations Optimise Query and

    Indexing

  23. Scalable General IT System : Database #EnablingConversations DB DB Vertical

    Scaling

  24. Scalable General IT System : Database #EnablingConversations Caching Backend /

    Web Server / Middleware DB Cache

  25. Scalable General IT System : Database #EnablingConversations Caching

  26. Scalable General IT System : Database #EnablingConversations DB DB Horisontal

    Scaling DB DB

  27. Scalable General IT System : Database #EnablingConversations Horisontal Scaling :

    Master / Slave

  28. Scalable General IT System : Database #EnablingConversations Horisontal Scaling :

    Sharding

  29. Scalable General IT System : Database #EnablingConversations Scaling Write (?)

    Backend / Web Server / Middleware DB

  30. Scalable General IT System : Database #EnablingConversations Throttle / Queue

    Backend / Web Server / Middleware DB PubSub

  31. Scalable General IT System : Database #EnablingConversations Distributed Database

  32. Scalable General IT System : Database #EnablingConversations Distributed Database

  33. Realtime Communication System #EnablingConversations Frontend / Client Side Backend /

    Web Server / Middleware DB Realtime Server Architecture & Infrastructure

  34. #EnablingConversations Realtime Server Scaling Realtime Server

  35. #EnablingConversations Load Balancer Scaling Realtime Server RealTime Server RealTime Server

    RealTime Server

  36. #EnablingConversations Load Balancer Scaling Realtime Server RealTime Server RealTime Server

    RealTime Server

  37. #EnablingConversations Scaling Realtime Server “DNS” Load Balancer RealTime Server RealTime

    Server RealTime Server Shared Memory

  38. #EnablingConversations Scaling Realtime Server “DNS” Load Balancer Distributed Realtime Server

  39. #EnablingConversations Scaling Realtime Server

  40. #EnablingConversations Scaling Realtime Server Cluster

  41. #EnablingConversations Scaling Realtime Server 10 MILLION CONCURRENT USERS

  42. None

  43. Chat System That Bot Compatible

  44. Chatbot #EnablingConversations

  45. #EnablingConversations And lot more …

  46. #EnablingConversations How Chatbot Works Request Response

  47. #EnablingConversations How Chatbot Works Response Instance AI Engine Request

  48. #EnablingConversations How Chatbot Works Request Response Middleware AI Engine Response

    Request

  49. #EnablingConversations How Chatbot Works Chat Platform Response Request Response Request

  50. #EnablingConversations How Chatbot Works Chat Platform Response Request Response Middleware

    AI Engine Request Webhook Post Message Server API

  51. #EnablingConversations Chat Platform Must Have Chat Platform Input Trigger Webhook

    Post Message Server API

  52. #EnablingConversations Chat Platform Nice to Have Chat Platform Typing API

    Read API Various event API

  53. #EnablingConversations Chat Platform Nice to Have

  54. #EnablingConversations Chat Platform Nice to Have

  55. Build a Scalable Chat Platform That Compatible with Bot Is

    NOT Easy

  56. Make it easier

  57. #EnablingConversations By Using

  58. We are hiring! Especially Backend, SRE Engineers, and Mobile Developers

    Contact Me : [email protected]

  59. Thank you. Let’s have a conversation.