ELK Stack

Transcript

1. Big data analytics: ELK Stack by Craciun Daniela
2. What is the ELK Stack? The ELK stack (now known as the Elastic Stack) consists of Elasticsearch, Logstash, and Kibana and they work exceptionally well together.
4. Logstash pipeline data to and from anywhere via a tool known as an ETL pipeline it also allows us to fetch, transform, and store into ElasticSearch
5. Elasticsearch based on Apache Lucene "schema-less" database easy to scale horizontally powerful search capabilities
6. What does "schema-less" mean? You have the ability to pass lightweight JSON at the database and it will update the schema as you go along.
7. ElasticSearch indexes every single eld, so you can search anything (including full-text search) and it will aggregate and group the data. If you want to register a new node to a cluster then it is a matter of installing ElasticSearch on a machine and editing a con g le, which is a pretty simple ask. ElasticSearch then takes care of spreading data around and splitting out requests over multiple servers.
8. Kibana web-based dashboarding and data analysis tool that leverages ElasticSearch's search capabilities so you can visualise data
9. Kibana interface
10. Why ELK stack? It is great at handling large numbers of logs and requires relatively little con guration Essentially the strengths of this technology stack are ideally suited to log-driven big data projects
11. The end!