Introduction to Elastic Stack and various use cases

Bhavya Raju Mandya, Engineer at Kibana team explaining about Elastic Stack and its use cases.

Transcript

1. Introduction to Elastic stack Bhavya Raju Mandya
2. 2 Elastic Stack 100% open source No enterprise edition All new versions with 5.0
3. 3 100M+ Product Downloads 3,000+ Subscription Customers 85,000+ Community Members Statistics since 2012, founding of Elastic 2
4. 4 X-Pack Single install Extensions for the Elastic Stack Subscription pricing Security Alerting Monitoring Reporting Graph Machine Learning
5. 5 Elastic Cloud Hosted Elasticsearch & Kibana Includes X-Pack features Starts at $45/mo Available in AWS today Available in Google Cloud Platform Available as a private cloud/on-premise solution (Elastic Cloud Enterprise)
6. 6 Elastic Cloud Enterprise Provision and manage multiple Elastic Stack environments; Expose logging as a service to your entire organization
7. 7 Elasticsearch Heart of the Elastic Stack Distributed, Scalable High-availability Multi-tenancy Developer Friendly Real-time, Full-text Search Aggregations
8. 8 Logstash Data processing pipeline Ingest data of all shapes, sizes, and sources Parse and dynamically transform data Transport data to any output Secure and encrypt data inputs Build your own pipeline More than 200+ plugins
9. 9 Kibana Window into the Elastic Stack Visualize and analyze Geospatial Customize and Share Reports Graph Exploration UX to secure and manage the Elastic Stack Build Custom Apps
10. 10 Beats Lightweight data shippers Ship data from the source Ship and centralize in Elasticsearch Ship to Logstash for transformation and parsing Ship to Elastic Cloud Libbeat: API framework to build custom beats 30+ community Beats
11. 11 FILEBEAT Log Files METRICBEAT Metrics PACKETBEAT Network Data WINGLOGBEAT Window Events More than 30 community Beats and growing … Apachebeat, dockbeat, httpbeat, mysqlbeat, nginxbeat, redis beats, twitterbeat, and more
12. 12 X-Pack adds value across all use cases \ LOG ANALYTICS METRICS ANALYTICS BUSINESS ANALYTICS SEARCH SECURITY ANALYTICS Monitor your Elastic Stack Find links in your data Be alerted on changes Protect your data Share your insights Detect anomalies
13. Solutions use case: 1 App search • You have definitely touched elasticsearch in the last 24 hours • Elasticsearch ships with a simple, consistent query language and uses standard RESTful APIs and JSON. It also has a love for language clients — Python, Ruby, .NET, Java, Groovy, the list goes on — that feel natural and let you work with Elasticsearch the way you want regardless of programming background. • Elastic search demo - demo with Shakespeare data and discover 13
14. Solutions use case: 2 Logging • Fast and scalable logging, that won't quit. • With out-of-the-box support for common data sources and default dashboards to boot, the Elastic Stack is all about the it-just-works experience. Ship logs with Filebeat and Winlogbeat, index into Elasticsearch, and visualize it all in Kibana in minutes. • Demo with filebeat/logstash • Demo with logs data 14
15. Solutions use case 3: Metrics • Do the numbers: CPU, memory, and more. • Super computers use Elastic: 1.2 billion documents, 160 GB. That's how much data the National Energy Research Scientific Computing Center (NERSC) collects on any given day. From substation power usage KPIs to building air and water temperature, computer disk and network I/O, and system load, they index all kinds of metrics to keep scientific discovery moving forward. • Demo with heartbeat/metricbeat - "[Metricbeat System] Overview”, "[Heartbeat] HTTP Monitoring" 15
16. Solutions use case 4: Security Analytics • Interactive investigation at speed and scale. • Demo with Packetbeat - "[Packetbeat] DNS Tunneling" 16
17. Resources • https://www.elastic.co/learn • https://www.elastic.co/blog/category/engineering • https://discuss.elastic.co/ 17
18. THANK YOU @elastic www.elastic.co