What's Next for Elastic Cloud?

Elastic Cloud is Elastic’s hosted offering, allowing you to provision and use clusters on AWS at a click of a button. More recently, we've been working on Elastic Cloud Enterprise, which allows users to setup an Elastic Cloud environment on their own infrastructure and manage tens, hundreds – even thousands of clusters with ease.

In this session, Alex and Chris will cover past, present, and future for Elastic Cloud and Elastic Cloud Enterprise. They'll touch on how it works, as well as give a live demo of Elastic Cloud Enterprise, where they’ll provision, secure, scale, and upgrade an Elasticsearch cluster with just a few clicks.

Alex Brasetvik l Elastic Cloud Creator & Tech Lead l Elastic
Chris Overton l Elastic Cloud Team Lead l Elastic

Transcript

1. What's Next for Elastic Cloud Alex Brasetvik Elastic Cloud Tech Lead Chris Overton Elastic Cloud Engineering Lead
2. 2 Why am I here? If you’re looking for an easier way to deploy and manage a secure Elasticsearch cluster – or thousands – this session is for you.
3. • Elastic Stack as a Service • Configurable cluster sizes • Runs in AWS (8 Regions) What is Elastic Cloud?
6. • Found founded in 2009 • Launched hosted Elasticsearch in 2012 • Acquired by Elastic in 2015 History
7. 7 #Requests 0 25 50 75 100 2015-06 2015-10 2016-02 2016-06 2016-10 0 1.5 3 4.5 6 2015-06 2015-10 2016-02 2016-06 2016-10 2017-02 Node hours (billions/month) (millions/month)
8. 2009 2012 2013 2015 2016 2017
9. • Ten more coming • Doubling in 12 months • Elastic ❤ Cloud Cloud Team's Growth
10. Fast Elastic Stack Updates
11. Security Not Optional
12. Free Backups Snapshots every 30 minutes, keeping 100 snapshots
13. Support
14. AWS Billing Integration Cloud Enterprise on your AWS Bill AWS Billing Integration
15. AWS Billing Integration Cloud Enterprise on your AWS Bill
16. Who is using Elastic Cloud
17. • Host your own Elastic Cloud • Use your hosting environment • Provide Elastic Cloud to your internal users Elastic Cloud Enterprise
18. • Larger Organizations • Already have hosting and IT resources • Need to provide Elastic Stack services to multiple teams • Specific Data Management Requirements Who’s it for?
19. Beta How to test? https://www.elastic.co/downloads/enterprise
20. Architecture
27. server node
31. Zone A Zone B Zone C
35. Load Balancer Clients ELB / haproxy / ...
41. Scheduler Admin Console ZooKeeper
42. Scheduler • Manages container lifecycle • Issues cluster control commands • Changes a live cluster in 50 simple steps
43. Admin Console • REST-API for managing everything • … and a UI
44. ZooKeeper • Coordination system • Quorum of 3 or 5 servers • 1-2 servers can fail • … and we help you replace them
45. Scheduler Admin Console ZooKeeper
46. Scheduler Admin Console ZooKeeper
47. Scheduler Admin Console ZooKeeper Coordination Routing Allocation
48. Demo
49. Scheduler Admin Console ZooKeeper Current State
50. Admin Console Contained
51. Contained? $ $ $
52. $ ./root-CVE-of-the-week.sh ________ < U MAD? > -------- \ ^__^ \ (oo)\_______ (__)\ )\/\ ||----w | || ||
53. Admin Console $
54. Scheduler Admin Console ZooKeeper
55. Scheduler Admin Console ZooKeeper
56. Demo
57. Demo Summary • From nothing to 7 server install • Upgraded, created and moved clusters around • Crashed a server and replaced it
58. Future • RBAC • LDAP, AD, & OAuth support • API • Official API support in CE • Coming in SaaS
59. Future • Different Cluster Types: • Logging and Archiving – Hot/Warm clusters • High CPU • Machine Learning, Ingest, …
60. Future • Hosted Enterprise Subscription • We run Elastic Cloud for you. • … in your cloud
61. Future … and a whole lot of stuff coming in Elastic Stack 6.x
62. Elastic Cloud Deep Dive Learn how all of this is used to manage thousands of clusters
63. Questions
64. Thank you! elastic.co/cloud