Managing Elasticsearch Clusters Deep Dive Session

Elastic{ON} Tour London - June 22, 2017

Learn how to easily deploy and manage secure Elasticsearch clusters at scale and on the infrastructure of your choice using Elastic Cloud Enterprise.

Uri Cohen | Sr. Director, Product Management | Elastic

Transcript

1. Uri Cohen Sr. Director, Product Management Introducing Elastic Cloud Enterprise
2. 2 The Typical Elastic Adoption Pattern More data More tenants More use cases
3. 3 So What’s Wrong with One Big Cluster? Tenants Different data lifecycles Different access profiles Expects different SLA Different backup policies Different versions Ops Maintenance windows are a drag Fair use is hard to impossible Upgrades affect all tenants Data isolation is not complete KibanaS VS
4. 4 Time to Split!
5. 5 Time to Split!
6. 6 But Splitting Is Not Easy... • How do you split?(by volume, tenant, use case, access profile) ‒ When one tenant gets its own cluster, then others will want one too • You now have multiple clusters to manage ‒ Different Elasticsearch versions ‒ Different support SLAs ‒ Different HW? Same HW? How do you isolate resources? ‒ What about backups? ‒ What about security? ‒ And how do you even track and monitor all of this?
7. 7 We Actually Do All of This, Today Elastic Cloud
8. 8 8 Provisioning, orchestration, and management of multiple clusters Deployed on-premise, in your private cloud … or wherever you want Leverages the same technology used in Elastic Cloud Automates frequent tasks such as snapshot/restore, upgrade and scale
9. 9 9 WHAT CAN YOU USE IT FOR?
10. 10 Multiple Applications, Multiple Clusters
11. 11 Centralized Logging LOG ANALYTICS LOG ANALYTICS LOG ANALYTICS LOG ANALYTICS LOG ANALYTICS LOG ANALYTICS LOG ANALYTICS LOG ANALYTICS LOG ANALYTICS LOG ANALYTICS
12. 12 Multiple environments - dev, test, QA, prod...
13. 13 What Use Cases Should You Be Looking For? • As a backing service for PaaS / SaaS • Examples: ‒ Service Brokers for CloudFoundry and OpenShift ‒ Cluster per customer in a SaaS app • Easily create a cluster per user / tenant • Maintain isolation between users and tenants
14. 14 14 DEMO
15. 15 15 ARCHITECTURE
16. 16 Allocator Cloud UI Admin API ZooKeeper + Director Constructor Allocator ES Admin Cluster Allocator ES Logging Cluster Allocator Load Balancer (User supplied) Proxy Proxy Proxy + HTTP + HTTPS TLS Over Stunnel HTTPS Admin User HTTPS Elastic Cloud Enterprise High Level Architecture Allocator HTTPS HTTPS Runner Client Forwarder Beats
17. 17 THANK YOU!