Introduction to the ELK Stack

Elasticsearch NYC Meetup talk on December 9, 2014 at XO Group

Transcript

1. what is the ELK stack? Peter Kim, Solutions Architect @elasticsearch
2. Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited. me
3. Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited. the ELK stack Collect / enrich Store / search / analyze Visualize
4. Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited. logstash collect and enrich your logs/data
5. Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited. elasticsearch Full-text search and analytics engine Distributed, horizontally-scalable JSON everywhere: documents, queries, responses APIs for everything! Queries, inserts, administration, configuration, status, etc. Blazing fast sub-second response times HTTP/REST API + client APIs for Java, Python, .NET, Ruby, PHP, Python, Javascript, and more
6. Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited. kibana
7. Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited. elasticsearch, the company training development and production support employ 8 of top 10 apache lucene committers employ all primary contributors to elasticsearch, logstash and kibana commercial plugins: monitoring, security, and more
8. Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited. use cases
9. Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited. what are people doing with elasticsearch? Centralized log analysis Enterprise search Source code search Location-aware mobile search SIEM Cloud search service Quality of service monitoring E-commerce search and navigation Social media analytics Open data APIs
10. Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited. ELK for centralized log analytics
11. Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited. ELK logging architecture
12. Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited. ELK for querying lots of data
13. Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited. if you need to use Hadoop…
14. Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited. otherwise…
15. kibana 4 demo