Microsoft Azure Meetup

Intro to Cassandra and deploying DataStax on Azure

Transcript

1. scaling for the future with cassandra and azure
2. Solutions Engineer at DataStax, previously Basho/OpenCredo. Interested in data and distributed systems. About Me @joeljacobson
3. scalable & fault tolerant cassandra overview 01
4. User Defined Functions JSON Commit Log compression Materialised views Version 1.1 Mixed ssd/spinning disk Self tuning row cache Row level isolation Version 0.7/0.8/1.0 Cassandra Query Language Secondary Indexes Live Schema changes Compression Levelled Compaction Version 0.6 Top level Apache project. Integrated Caching Hadoop M/R 2015 2013 2011 2010 Developed at FaceBook. Used for inbox search feature 2008 history of cassandra
5. data distribution Fully distributed all nodes equal data replication n5 n1 n2 n3 n4
6. geo replication multi datacenter highly available no spof n6 n7 n8 n9 n10 n1 n2 n3 n4 n5 London New York
7. more storage? horizontal scale compute power? n5 n1 n2 n3 n4 n6 n7 n8 n9 n10 Linear scaling ops/s 00k 200k 400k 600k 800k n nodes 0 50 100 150
8. consistency tUneable consistency vs latency n5 n1 n2 n3 n4 Write request Consistency level = Quorum Replication Factor = 3 Consistency levels one all Quorum Local Quorum Each Quorum
9. consistency tUneable consistency vs availability n5 n1 n2 n3 n4 Read request Consistency level = Quorum Replication Factor = 3
10. n6 n7 n8 n9 n10 n1 n2 n3 n4 n5 London New York tUneable consistency consistency vs availability
11. cql data modelling SQL-Like syntax CQL shell
12. Tables reside cassandra Keyspace Replication Single / Multi DC CREATE KEYSPACE demo WITH REPLICATION = {'class' : 'NetworkTopologyStrategy', 'London': 3, 'New York': 3); n6 n7 n8 n9 n10 n1 n2 n3 n4 n5 London New York
13. denomalized cassandra Table query driven data types CREATE TABLE monthly_transactions_by_customer ( cust_id text, date text, type text, time timestamp, cust_name text, location text, amount double, PRIMARY KEY ((cust_id, date), type, time) ) WITH CLUSTERING ORDER BY (type asc, time desc);
14. visual querying datastax devcenter jSON support auto completion
15. monitoring datastax opscenter administration deployment
16. Everyday interactions Cassandra at Scale 02
17. playlists & personalisation • Leading streaming music provider with over 40M+ active monthly users • Over 1 billion playlists created and managed in real time • More than 40,000 requests/second • 500+ nodes in 4 data centers
18. profiles & recommendations • 95% of all Netflix data stored in DSE • Does 1 trillion transactions/day with DSE • Replaced Oracle in six data centers
19. internet of things • Connected Homes, a new business unit, handles IoT-based customer systems • Provides remote control over thermostats and boilers via smart phones/tablets • Delivers analytics on energy usage to customers • Will be using predictive analysis to forecast things like boiler failures • DSE for transactional data consumption and real-time analytics
20. cassandra in Banking • real time banking systems • highly available architecture • no spof • Predictable scaling • Performance
21. operational cloud services • 100,000+ nodes • 10s of petabytes • million ops/s • largest single cluster 1000+
22. Partner Alliance Datastax & microsoft 03
23. 1-10 nodes active / passive high availability disaster recovery enterprise apps, dynamics, etc. ms sql server doesn't microsoft sell a database? 10-10,000 nodes active / Active Geo-distributed continuous availability disaster avoidance web, mobile, iot datastax enterprise
25. supported datastax enterprise certified multi-workload Offline Application OpsCenter Services Monitoring Operations Operational Application Real Time Search Real Time Analytics Batch Analytics RDBMS Analytics Transformations Certified Apache Cassandra – No single point of failure – Linear Scalability – Disaster Avoidance Security In-Memory
26. analytics multi workload search no etl oltp olap
27. Presented by ‘your name’ Presentation name
28. Presented by ‘your name’ Presentation name
29. Up in minutes Deploying in the marketplace 04
30. Presented by ‘your name’ Presentation name
31. Presented by ‘your name’ Presentation name
32. Presented by ‘your name’ Presentation name
33. Presented by ‘your name’ Presentation name
34. Presented by ‘your name’ Presentation name
35. Presented by ‘your name’ Presentation name
36. Presented by ‘your name’ Presentation name
37. Presented by ‘your name’ Presentation name
38. Presented by ‘your name’ Presentation name
39. continued learning useful resources 05
40. supported .Net driver on nuget cql3 support also! java python ruby c++ php
41. self paced free Training instructor led hands on
42. useful links www.datastax.com docs.datastax.com datastax.academy.com planetcassandra.org github.com/datastax github.com/joeljacobson
43. Questions? joel.jacobson@datastax.com thank you