Using Postgres & Citus for Lightning Fast Analytics | Live Demo | Sai Srirampur

Sai Srirampur, Solutions Engineer at Citus Data, gave a live demo of how you can use Postgres and the Citus Cloud database as a service to manage real-time analytics workloads.

Watch, if you & your application need:

>> A data store for customer-facing analytics dashboards with real-time data ingest and a large volume of queries

>> A way to scale out Postgres horizontally, to address the performance hiccups you’re experiencing as you run into the resource limits of single-node Postgres

>> A way to consolidate your database platforms, to avoid having separate stores for your transactional and analytics workloads

Using a 4-node Citus database cluster in the cloud, Sai will show you how Citus shards Postgres to give you lightning fast performance, at scale.

Transcript

1. Live Demo of Using Postgres and Citus for Lightning Fast Analytics | December 2018
   WITH FROM
   Thu 06 December at 10am PT
   Using Postgres & Citus
   for Lightning Fast
   Analytics
   PRESENTED BY:
   SAI
   SRIRAMPUR
   LIVE DEMO
   

   View Slide

2. Using Postgres and Citus for Lightning Fast Analytics | December 2018
   Ask private questions in
   Q&A panel (mouseover at
   bottom to see Q&A icon)
   We plan to do 1-2 quick
   polls, also.
   Logistics
   X
   

   View Slide

3. Sai Srirampur | PyConCA 2018
   • Sai Srirampur a.k.a Sai
   • Engineer at Citus Data
   • Joined Citus to make it so
   developers never have to
   worry about scaling their
   database
   • About to get married!
   • Follow me @saisrirampur
   @citusdata
   

   View Slide

4. Live Demo of Using Postgres and Citus for Lightning Fast Analytics | December 2018
   Does
   this
   sound
   like
   you?
   Need to query BOTH
   real-time & historical
   data—fast
   1
   

   View Slide

5. Live Demo of Using Postgres and Citus for Lightning Fast Analytics | December 2018
   Does
   this
   sound
   like
   you?
   Hitting resource limits
   with single-node
   Postgres, but don’t want
   to give up Postgres
   2
   

   View Slide

6. Live Demo of Using Postgres and Citus for Lightning Fast Analytics | December 2018
   Want to reduce dev costs
   by consolidating—&
   avoid separate stores for
   analytics & transactional
   workloads
   Does
   this
   sound
   like
   you?
   3
   

   View Slide

7. Live Demo of Using Postgres and Citus for Lightning Fast Analytics | December 2018
   Live Demo of Using Postgres and Citus for Lightning Fast Analytics | December 2018
   

   View Slide

8. Live Demo of Using Postgres and Citus for Lightning Fast Analytics | December 2018
   Live Demo of Using Postgres and Citus for Lightning Fast Analytics | December 2018
   Why Postgres? TLDR;
   Open source
   Constraints
   Extensions
   PostGIS / Geospatial
   HLL, TopN, Citus
   Foreign data wrappers
   Rich SQL
   CTEs
   Window functions
   Full text search
   Datatypes
   JSONB
   

   View Slide

9. Live Demo of Using Postgres and Citus for Lightning Fast Analytics | December 2018
   Live Demo of Using Postgres and Citus for Lightning Fast Analytics | December 2018
   Q: Why Citus?
   A: Citus transforms Postgres into a
   distributed database
   

   View Slide

10. Live Demo of Using Postgres and Citus for Lightning Fast Analytics | December 2018
    Live Demo of Using Postgres and Citus for Lightning Fast Analytics | December 2018
    TLDR; on scaling out Postgres w/Citus
    1. Distributes data across multiple nodes
    2. More memory, cpu, disk + parallelization
    3. Extension to Postgres (not a fork)
    DATABASE AS A SERVICE ENTERPRISE SOFTWARE OPEN SOURCE
    

    View Slide

11. Live Demo of Using Postgres and Citus for Lightning Fast Analytics | December 2018
    11
    

    View Slide

12. Live Demo of Using Postgres and Citus for Lightning Fast Analytics | December 2018
    Live Demo of Using Postgres and Citus for Lightning Fast Analytics | December 2018
    

    View Slide

13. Live Demo of Using Postgres and Citus for Lightning Fast Analytics | December 2018
    13
    Already provisioned a 4-node Citus database cluster
    for today’s demo / & regular Postgres on single node
    

    View Slide

14. Live Demo of Using Postgres and Citus for Lightning Fast Analytics | December 2018
    Live Demo of Using Postgres and Citus for Lightning Fast Analytics | December 2018
    Load data
    Create indexes (btree and GIN)
    Query patterns in analytics workload
    Sample OLTP queries
    What I will show you in today’s analytics demo?
    Citus
    4-node
    cluster
    Single
    node
    Postgres
    TOP
    BOTTOM
    Load data
    Create indexes (btree and GIN)
    Query patterns in analytics workload
    Sample OLTP queries
    

    View Slide

15. Live Demo of Using Postgres and Citus for Lightning Fast Analytics | December 2018
    Sai Srirampur | PyConCA 2018
    

    View Slide

16. Live Demo of Using Postgres and Citus for Lightning Fast Analytics | December 2018
    Live Demo of Using Postgres and Citus for Lightning Fast Analytics | December 2018
    1/ Parallelism
    2/ Linear scale
    3/ Freshness (real-time, concurrency)
    4/ Both transactional && analytics
    

    View Slide

17. Live Demo of Using Postgres and Citus for Lightning Fast Analytics | December 2018
    Sai Srirampur | PyConCA 2018
    citusdata.com/customers/heap
    

    View Slide

18. Scaling Postgres for Time Series Data with Citus | Nov 15 2018 | Marco Slot | Claire Giordano
    Scaling Postgres for Time Series Data with Citus | Nov 15 2018 | Marco Slot | Claire Giordano
    Min Wei of
    Microsoft
    

    View Slide

19. Live Demo of Using Postgres and Citus for Lightning Fast Analytics | December 2018
    19
    citusdata.com/customers/freshworks
    

    View Slide

20. Live Demo of Using Postgres and Citus for Lightning Fast Analytics | December 2018
    

    View Slide

21. Live Demo of Using Postgres and Citus for Lightning Fast Analytics | December 2018
    21
    Todo List
    DOWNLOAD CITUS OPEN SOURCE:
    https://www.citusdata.com/download
    CREATE CITUS CLOUD DEV ACCOUNT:
    https://www.citusdata.com/product/cloud
    JOIN OUR PUBLIC SLACK:
    https://slack.citusdata.com/
    

    View Slide

22. Live Demo of Citus Cloud | July 2018
    www.citusdata.com @citusdata
    © 2018 Citus Data. All right reserved.
    Sai Srirampur | @saisrirampur
    Thank you for your time
    

    View Slide