Elastic{ON} Tour 2018 Paris : Orchestration de clusters Elasticsearch avec Elastic Cloud Enterprise

Elastic{ON} Tour Pairs - January 30, 2018

Apprenez comment facilement déployer et gérer des clusters Elasticsearch sécurisés à l’échelle et sur l’infrastructure de votre choix en utilisant Elastic Cloud Enterprise (ECE).

Sylvain Wallez | Software Engineer | Elastic

Transcript

1. 1 Elastic Cloud Enterprise Sylvain Wallez Software engineer, Cloud team @bluxte
2. Why Elastic Cloud Enterprise?
3. More tenants The typical Elastic adoption pattern Single cluster Single small app 1 One cluster Multiple apps Single cluster Single (larger) app Multiple clusters Multiple apps 2 3 4 More use cases More data
4. Things can get messy
5. So what’s wrong with one big cluster? • Different data life cycles • Different access profiles • Different SLAs • Different backup policies • True fair use impossible • Upgrades and maintenance windows affect all tenants • Data isolation is not complete • More than just Elasticsearch: Kibana, Logstash, APM…
6. Time to split!
7. 7 Challenges of managing multiple clusters Versions Security Backups • Management of multiple versions • Upgrades • Enforce security • Apply security patches in time • Audit access • Isolation • Consistent policy • Scheduled backups • Easy restore Infrastructure • Different teams have different needs • Utilization • Dynamically adding/removing resources
8. Providers AWS | GCP Azure is coming soon 2 Regions 8 AWS + 4 GCP More in the pipe 12 Clusters For any use case you can think of 10ks We already solved these challenges!
9. Introducing Elastic Cloud Enterprise
10. Core Features
11. 11 Orchestrate and manage your Elastic fleet • Centrally manage any number of clusters • Simplify management: – Upgrades – Scaling – Node and host failure recovery – Scheduled backups • Dynamically add hosts as needed • Centralized logging and monitoring
12. 12 Deploy anywhere • Bare metal • Virtual machines • Private or public cloud
13. How customers use ECE today
14. Multiple applications, multiple clusters
15. Centralized logging LOG ANALYTICS LOG ANALYTICS LOG ANALYTICS LOG ANALYTICS LOG ANALYTICS LOG ANALYTICS LOG ANALYTICS LOG ANALYTICS LOG ANALYTICS LOG ANALYTICS
16. Multiple environments Dev QA Staging Prod
17. Architecture
18. 18 Allocator Admin API ZooKeeper + Director Constructor Allocator ES Admin Cluster Allocator ES Logging Cluster Allocator Load Balancer (User supplied) Proxy Proxy Proxy + HTTP + HTTPS TLS HTTPS Admin User HTTPS Elastic Cloud Enterprise high level architecture Allocator HTTPS HTTPS Runner Client Forwarder Beats Cloud UI Management Services
19. Live Demo
20. Thank You! @elastic