Save 37% off PRO during our Black Friday Sale! »

Managing Elasticsearch Clusters Deep Dive Session

Managing Elasticsearch Clusters Deep Dive Session

Elastic{ON} Tour London - June 22, 2017

Learn how to easily deploy and manage secure Elasticsearch clusters at scale and on the infrastructure of your choice using Elastic Cloud Enterprise.

Uri Cohen | Sr. Director, Product Management | Elastic

Dd9d954997353b37b4c2684f478192d3?s=128

Elastic Co

June 22, 2017
Tweet

Transcript

  1. Uri Cohen Sr. Director, Product Management Introducing Elastic Cloud Enterprise

  2. 2 The Typical Elastic Adoption Pattern More data More tenants

    More use cases
  3. 3 So What’s Wrong with One Big Cluster? Tenants Different

    data lifecycles Different access profiles Expects different SLA Different backup policies Different versions Ops Maintenance windows are a drag Fair use is hard to impossible Upgrades affect all tenants Data isolation is not complete KibanaS VS
  4. 4 Time to Split!

  5. 5 Time to Split!

  6. 6 But Splitting Is Not Easy... • How do you

    split?(by volume, tenant, use case, access profile) ‒ When one tenant gets its own cluster, then others will want one too • You now have multiple clusters to manage ‒ Different Elasticsearch versions ‒ Different support SLAs ‒ Different HW? Same HW? How do you isolate resources? ‒ What about backups? ‒ What about security? ‒ And how do you even track and monitor all of this?
  7. 7 We Actually Do All of This, Today Elastic Cloud

  8. 8 8 Provisioning, orchestration, and management of multiple clusters Deployed

    on-premise, in your private cloud … or wherever you want Leverages the same technology used in Elastic Cloud Automates frequent tasks such as snapshot/restore, upgrade and scale
  9. 9 9 WHAT CAN YOU USE IT FOR?

  10. 10 Multiple Applications, Multiple Clusters

  11. 11 Centralized Logging LOG ANALYTICS LOG ANALYTICS LOG ANALYTICS LOG

    ANALYTICS LOG ANALYTICS LOG ANALYTICS LOG ANALYTICS LOG ANALYTICS LOG ANALYTICS LOG ANALYTICS
  12. 12 Multiple environments - dev, test, QA, prod...

  13. 13 What Use Cases Should You Be Looking For? •

    As a backing service for PaaS / SaaS • Examples: ‒ Service Brokers for CloudFoundry and OpenShift ‒ Cluster per customer in a SaaS app • Easily create a cluster per user / tenant • Maintain isolation between users and tenants
  14. 14 14 DEMO

  15. 15 15 ARCHITECTURE

  16. 16 Allocator Cloud UI Admin API ZooKeeper + Director Constructor

    Allocator ES Admin Cluster Allocator ES Logging Cluster Allocator Load Balancer (User supplied) Proxy Proxy Proxy + HTTP + HTTPS TLS Over Stunnel HTTPS Admin User HTTPS Elastic Cloud Enterprise High Level Architecture Allocator HTTPS HTTPS Runner Client Forwarder Beats
  17. 17 THANK YOU!