6 • Visual, browser-based user interface • Installation, configuration, and administration tasks carried out in point-and-click fashion • REST API allows scripting of any OpsCenter function • Works on any device (tablet, etc.)
7 • Repair service – automatically keeps data consistent across a cluster. • Capacity service – historical trend analysis and forecasts future resource needs. • Performance service – provides insight into the performance of a cluster with queryable CQL-based diagnostic objects • Best Practice service – enforces best practice rules across many areas (e.g. security, configuration, etc.) to ensure proper setup and optimization. • Proactive alerts and external notifications
9 • 24x7x365 Technical Support • Covers both production and non-production environments • Scheduled health checks for assistance on architecture, design, and tuning • Hot-fix support for emergency maintenance situations
10 • Integrated Real-Time Analytics • Integrated Batch Analytics • External Batch Analytics – external Hadoop connectivity, certified to Cloudera, HortonWorks – link hot transactional data with cold data from data warehouse / lake ETL
11 • DSE Search inherits all the power and capabilities of Solr and builds on top of it • Built-in scale out and continuous availability for search operations • Enabled across multiple data centers and cloud providers • Search via native API or through CQL ETL
12 • Brings all the goodness of Cassandra to an in-memory database • In-Memory tables look and act like any Cassandra table • Great for use cases requiring low latency reads • Combine with in-memory analytics for full in-memory transactional / analytical processing
Distributed NoSQL Database • Google BigTable ✖ Amazon Dynamo • Continuously Available • Disaster avoidance, not disaster recovery • Scale Out with Linear Performance • Just add nodes • Run on Commodity Hardware • In the cloud, on premise, or hybrid What is Apache Cassandra? 15
Distributed • Data spread over multiple nodes • All nodes participate in a cluster • Configurable data replication • Masterless • All nodes are equal • Read from or write to any node • No Single Point of Failure Distributed Architecture 16 Node 1 1st copy Node 4 Node 5 Node 2 2nd copy Node 3 3rd copy
Vocabulary Lesson Replication Factor – RF • Specifies how many copies of a row of data C* distributes across nodes • Highly configurable for SLA and network topology (racks, data centers) CREATE KEYSPACE "Excalibur" WITH REPLICATION = {'class' : 'NetworkTopologyStrategy', 'NY1' : 3, 'NY2' : 3}; 17
Vocabulary Lesson Replication Factor – RF • Specifies how many copies of a row of data C* distributes across nodes • Highly configurable for SLA and network topology (racks, data centers) CREATE KEYSPACE "Excalibur" WITH REPLICATION = {'class' : 'NetworkTopologyStrategy', 'NY1' : 3, 'NY2' : 3}; 17 Consistency Level – CL • Specifies how synchronized a row of data must be across C* nodes • Tunable consistency: client application decides CL for each operation ANY … ONE … QUORUM … EACH_QUORUM … ALL
Vocabulary Lesson Replication Factor – RF • Specifies how many copies of a row of data C* distributes across nodes • Highly configurable for SLA and network topology (racks, data centers) CREATE KEYSPACE "Excalibur" WITH REPLICATION = {'class' : 'NetworkTopologyStrategy', 'NY1' : 3, 'NY2' : 3}; 17 Consistency Level – CL • Specifies how synchronized a row of data must be across C* nodes • Tunable consistency: client application decides CL for each operation ANY … ONE … QUORUM … EACH_QUORUM … ALL
CREATE TABLE market_prices ( symbol TEXT, date TIMESTAMP, price DECIMAL, side INT, PRIMARY KEY (symbol, date) ) WITH CLUSTERING ORDER BY (date DESC); CQL: Cassandra Query Language • Syntax similar to RDBMS SQL • Create objects via DDL • e.g. CREATE… • INSERT, UPDATE, DELETE • GRANT, REVOKE • SELECT…WHERE • Command line and GUI tools 25
the Enterprise Ecosystem 28 Offline Application External Hadoop Distribution (e.g. Cloudera, Hortonworks) OpsCenter Services Monitoring Operations Operational Application Real Time Search Real Time Analytics Batch Analytics RDBMS Analytics Transformations Certified Apache Cassandra – No single point of failure – Linear Scalability – Disaster Avoidance Security In-Memory
Resilience Example: A Single Session DC NY1 DC NY2 • Stateless ➜ fault tolerant • Horizontally scalable • Store sessions in Cassandra • Sessions replicate naturally • Recover on disaster / failure 29 App Server Cache C* C* App Server Cache
Resilience Example: A Single Session DC NY1 DC NY2 • Stateless ➜ fault tolerant • Horizontally scalable • Store sessions in Cassandra • Sessions replicate naturally • Recover on disaster / failure 29 App Server Cache C* C* App Server Cache
Resilience Example: A Single Session DC NY1 DC NY2 • Stateless ➜ fault tolerant • Horizontally scalable • Store sessions in Cassandra • Sessions replicate naturally • Recover on disaster / failure 29 App Server Cache C* C* App Server Cache
Resilience Example: A Single Session DC NY1 DC NY2 • Stateless ➜ fault tolerant • Horizontally scalable • Store sessions in Cassandra • Sessions replicate naturally • Recover on disaster / failure 29 App Server Cache C* C* App Server Cache session
Resilience Example: A Single Session DC NY1 DC NY2 • Stateless ➜ fault tolerant • Horizontally scalable • Store sessions in Cassandra • Sessions replicate naturally • Recover on disaster / failure 29 C* C* App Server Cache session
Resilience Example: A Single Session DC NY1 DC NY2 • Stateless ➜ fault tolerant • Horizontally scalable • Store sessions in Cassandra • Sessions replicate naturally • Recover on disaster / failure 29 C* C* App Server Cache
Resilience Example: A Single Session DC NY1 DC NY2 • Stateless ➜ fault tolerant • Horizontally scalable • Store sessions in Cassandra • Sessions replicate naturally • Recover on disaster / failure 29 C* C* App Server Cache
Resilience Example: A Single Session DC NY1 DC NY2 • Stateless ➜ fault tolerant • Horizontally scalable • Store sessions in Cassandra • Sessions replicate naturally • Recover on disaster / failure 29 C* C* App Server Cache session
Resilience Example: A Single Session DC NY1 DC NY2 • Stateless ➜ fault tolerant • Horizontally scalable • Store sessions in Cassandra • Sessions replicate naturally • Recover on disaster / failure 29 C* C* App Server Cache session
dominates time series data • Extremely high ingest rates • Low latency retrievals • Efficient storage • Capture every tick and trade • Also important metadata, eg volume • Real-time risk analysis Capture Financial Market Data 33 • Example: Blue Mountain Capital Management • http://www.planetcassandra.org/blog/5-minute-c- interview-bluemountain-capital-management/
& Authorization DC LDN1 C* DC LDN2 C* DC AMS1 C* DC ZUR1 C* DSE Cluster Web User App Service DC LDN2 App App App App DC AMS1 App App App App … … session?
& Authorization DC LDN1 C* DC LDN2 C* DC AMS1 C* DC ZUR1 C* DSE Cluster Web User App Service DC LDN2 App App App App DC AMS1 App App App App … … session?
& Authorization session DC LDN1 C* DC LDN2 C* DC AMS1 C* DC ZUR1 C* DSE Cluster Web User App Service DC LDN2 App App App App DC AMS1 App App App App … …
& Authorization session DC LDN1 C* DC LDN2 C* DC AMS1 C* DC ZUR1 C* DSE Cluster Web User App Service DC LDN2 App App App App DC AMS1 App App App App … … quote?
& Authorization session DC LDN1 C* DC LDN2 C* DC AMS1 C* DC ZUR1 C* DSE Cluster Web User App Service DC LDN2 App App App App DC AMS1 App App App App … … quote?
& Authorization session DC LDN1 C* DC LDN2 C* DC AMS1 C* DC ZUR1 C* DSE Cluster Web User App Service DC LDN2 App App App App DC AMS1 App App App App … … quote
& Authorization session DC LDN1 C* DC LDN2 C* DC AMS1 C* DC ZUR1 C* DSE Cluster Web User App Service DC LDN2 App App App App DC AMS1 App App App App … … quote
Scale Legacy Infrastructure 35 … USA Equities UK FX UK Bonds Global Users Legacy Systems USA FX DataStax Enterprise Cluster C* User Interface / Application Services
techtekt
colopl
shogo4131
kizawa2020
pfn
kash1064
masakiokuda
camiha
y0hgi
bgpat
koukihosaka
seathinner
marktimemedia
nikkihalliwell
marketingsoph
techseoconnect
popppiees
cassininazir
jdejongh
maggiecrowley
moore
inesmontani
baasie
