Slide 1

Slide 1 text

Introduction to Elastic stack Bhavya Raju Mandya

Slide 2

Slide 2 text

2 Elastic Stack 100% open source No enterprise edition All new versions with 5.0

Slide 3

Slide 3 text

3 100M+ Product Downloads 3,000+ Subscription Customers 85,000+ Community Members Statistics since 2012, founding of Elastic 2

Slide 4

Slide 4 text

4 X-Pack Single install Extensions for the Elastic Stack Subscription pricing Security Alerting Monitoring Reporting Graph Machine Learning

Slide 5

Slide 5 text

5 Elastic Cloud Hosted Elasticsearch & Kibana Includes X-Pack features Starts at $45/mo Available in AWS today Available in Google Cloud Platform Available as a private cloud/on-premise solution (Elastic Cloud Enterprise)

Slide 6

Slide 6 text

6 Elastic Cloud Enterprise Provision and manage multiple Elastic Stack environments; Expose logging as a service to your entire organization

Slide 7

Slide 7 text

7 Elasticsearch Heart of the Elastic Stack Distributed, Scalable High-availability Multi-tenancy Developer Friendly Real-time, Full-text Search Aggregations

Slide 8

Slide 8 text

8 Logstash Data processing pipeline Ingest data of all shapes, sizes, and sources Parse and dynamically transform data Transport data to any output Secure and encrypt data inputs Build your own pipeline More than 200+ plugins

Slide 9

Slide 9 text

9 Kibana Window into the Elastic Stack Visualize and analyze Geospatial Customize and Share Reports Graph Exploration UX to secure and manage the Elastic Stack Build Custom Apps

Slide 10

Slide 10 text

10 Beats Lightweight data shippers Ship data from the source Ship and centralize in Elasticsearch Ship to Logstash for transformation and parsing Ship to Elastic Cloud Libbeat: API framework to build custom beats 30+ community Beats

Slide 11

Slide 11 text

11 FILEBEAT Log Files METRICBEAT Metrics PACKETBEAT Network Data WINGLOGBEAT Window Events More than 30 community Beats and growing … Apachebeat, dockbeat, httpbeat, mysqlbeat, nginxbeat, redis beats, twitterbeat, and more

Slide 12

Slide 12 text

12 X-Pack adds value across all use cases \ LOG ANALYTICS METRICS ANALYTICS BUSINESS ANALYTICS SEARCH SECURITY ANALYTICS Monitor your Elastic Stack Find links in your data Be alerted on changes Protect your data Share your insights Detect anomalies

Slide 13

Slide 13 text

Solutions use case: 1 App search • You have definitely touched elasticsearch in the last 24 hours • Elasticsearch ships with a simple, consistent query language and uses standard RESTful APIs and JSON. It also has a love for language clients — Python, Ruby, .NET, Java, Groovy, the list goes on — that feel natural and let you work with Elasticsearch the way you want regardless of programming background. • Elastic search demo - demo with Shakespeare data and discover 13

Slide 14

Slide 14 text

Solutions use case: 2 Logging • Fast and scalable logging, that won't quit. • With out-of-the-box support for common data sources and default dashboards to boot, the Elastic Stack is all about the it-just-works experience. Ship logs with Filebeat and Winlogbeat, index into Elasticsearch, and visualize it all in Kibana in minutes. • Demo with filebeat/logstash • Demo with logs data 14

Slide 15

Slide 15 text

Solutions use case 3: Metrics • Do the numbers: CPU, memory, and more. • Super computers use Elastic: 1.2 billion documents, 160 GB. That's how much data the National Energy Research Scientific Computing Center (NERSC) collects on any given day. From substation power usage KPIs to building air and water temperature, computer disk and network I/O, and system load, they index all kinds of metrics to keep scientific discovery moving forward. • Demo with heartbeat/metricbeat - "[Metricbeat System] Overview”, "[Heartbeat] HTTP Monitoring" 15

Slide 16

Slide 16 text

Solutions use case 4: Security Analytics • Interactive investigation at speed and scale. • Demo with Packetbeat - "[Packetbeat] DNS Tunneling" 16

Slide 17

Slide 17 text

Resources • https://www.elastic.co/learn • https://www.elastic.co/blog/category/engineering • https://discuss.elastic.co/ 17

Slide 18

Slide 18 text

THANK YOU @elastic www.elastic.co