2016 - Varang Amin, Darlene Wong - Log Visualization for dummies

Description
During this talk the attendees will have an opportunity to use the ELK(Elasticsearch, Logstash, Kibana) stack to visualize their complex log data.
​
Abstract
Data is the new bacon. For all industries, including health, security, entertainment, etc., it is impossible for anyone to store and analyze data without using an automated platform. A unified platform is needed to provide data visualization and extract intelligence.

Elasticsearch is a distributed, real-time, search and analytics platform. With the help of a restful API, Elasticsearch saves data and auto indexes the parsed data.

During our talk, we will walk attendees through configuring the ELK stack and visualize datasets on Kibana.

Bio
Varang Amin is working as a Sr Staff Engineer at Palo Alto Networks. Darlene Wong is working as a Sr Staff Engineer at Palo Alto Networks.
​
Bio2
Darlene Wong is working as a Sr Staff Engineer at Palo Alto Networks. Before PAN, she worked in development role at Juniper Networks & Cisco Systems.

https://youtu.be/Qizad77FxNU

Transcript

1. BY VARANG AMIN & DARLENE WONG
2. • • •
3. • PROBLEM STATEMENT • CURRENTLY AVAILABLE SOLUTIONS • COMPARISONS • WHY WE CHOOSE ELK ? • DATA2ELK MODULE • SHOWTIME
4. • • HOW TO VISUALIZE THE DATA IN SIMPLER MANNER ? • HOW TO GENERATE AN INTELLIGENCE FROM IT ? Gold New Black Bacon
5. DATA ANALYSIS TOOLS/TECHNIQUES • • • GREP
6. • • • •
7. ELK VS ENTERPRISE SOLUTIONS • • • •
8. • CSV • Log Data • Input • Filter • Output LogStash • Index ElasticSearch • Visualization • Dashboard • Search Kibana
9. • Event processing engine • Collect data • Parse, filter, normalize, enrich, data • Forward data • 200+ plugins available
10. • JSON Document-oriented search engine • Powered by Apache Lucene • Schema-free • REST API
11. • • • •
12. • CSV • Log Data • Input • Filter • Output LogStash • Index ElasticSearch • Visualization • Dashboard • Search Kibana
13. • • •
15. DATA2ELK • • • •
16. • • • • • •
20. ?