Log Visualization for dummies

During this talk the attendees will have an opportunity to use the ELK(Elasticsearch, Logstash, Kibana) stack to visualize their complex log data.
​
Abstract
Data is the new bacon. For all industries, including health, security, entertainment, etc., it is impossible for anyone to store and analyze data without using an automated platform. A unified platform is needed to provide data visualization and extract intelligence.

Elasticsearch is a distributed, real-time, search and analytics platform. With the help of a restful API, Elasticsearch saves data and auto indexes the parsed data.

During our talk, we will walk attendees through configuring the ELK stack and visualize datasets on Kibana.

Transcript

1. BY VARANG AMIN & DARLENE WONG
2. • • •
3. • PROBLEM STATEMENT • CURRENTLY AVAILABLE SOLUTIONS • COMPARISONS • WHY WE CHOOSE ELK ? • DATA2ELK MODULE • SHOWTIME
4. • • HOW TO VISUALIZE THE DATA IN SIMPLER MANNER ? • HOW TO GENERATE AN INTELLIGENCE FROM IT ? Gold New Black Baco n
5. DATA ANALYSIS TOOLS/TECHNIQUES • • • GREP
6. • • • •
7. ELK VS ENTERPRISE SOLUTIONS • • • •
8. • CSV • Log Data • Input • Filter • Output LogStash • Index ElasticSearch • Visualization • Dashboard • Search Kibana
9. • Event processing engine • Collect data • Parse, filter, normalize, enrich, data • Forward data • 200+ plugins available
10. • JSON Document-oriented search engine • Powered by Apache Lucene • Schema-free • REST API
11. • • • •
12. • CSV • Log Data • Input • Filter • Output LogStash • Index ElasticSearch • Visualization • Dashboard • Search Kibana
13. • • •
15. DATA2ELK • • • •
16. • • • • • •
20. ?