Machine Learning with Elastic Stack

This talk gives you a brief of Machine Learning, various algorithmic approaches and Where could Elastic help you/your organization?

Transcript

1. 1 Aravind Putrevu @aravindputrevu Engineer | Developer Advocate Machine Learning with Elastic Stack It Catches What You Might Miss, All by Itself
2. 2 Takeaways Overview of Holy Grail 1 What is in store from Elastic? 3 What it can/can’t do? 4 Demo Instructions 5 ML Leaps 2
3. 3 Takeaways Overview of Holy Grail 1 What is in store from Elastic? 3 What it can/can’t do? 4 Demo Instructions 5 ML Leaps 2
4. 4 Takeaways Overview of Holy Grail 1 What is in store from Elastic? 3 What it can/can’t do? 4 Demo Instructions 5 ML Leaps 2
5. 5 Takeaways Overview of Holy Grail 1 What is in store from Elastic? 3 What it can/can’t do? 4 Demo Instructions 5 ML Leaps 2
6. 6 Takeaways Overview of Holy Grail 1 What is in store from Elastic? 3 What it can/can’t do? 4 Demo Instructions 5 ML Leaps 2
7. 7 Elastic Stack No enterprise edition All new versions with 6.2 X-Pack Security Alerting Monitoring Reporting Machine Learning Graph
8. 8 “ “ A computer program is said to learn from experience E with respect to some class of tasks T and performance measure P if its performance at tasks in T, as measured by P, improves with experience E
9. 9 Image Credit : Toptal
11. 11 Datasets Computational Power ThinkTank Hardware
13. 13 AI and ML
14. 14 Algorithmic Approaches • Labelled Data • Driven by objective • NNs, SVMs, Decision Trees • No Label • No objective, only Data • K-means, Apriori • No Label • Driven by objective • Q-Learning, SARSA, DQL Supervised Unsupervised Reinforcement
15. 15 Image Credit : Udacity
16. 16 How can I use? 1 2 3 Develop your own Using a Framework Ready made solution
17. 17 17 • Online Unsupervised Learning • Index Visualizer • Anomaly Detection • Forecasting Elastic Machine Learning
18. 18 Who are you? • DevOps Engineer • Security Analyst / SOC Engineer / SecDevOps • Business Analysts / Application Owner
19. 19 What you can do? Operational Analytics Security Analytics Business Analytics • Drop in Orders? • Unusual Traffic • Early hints before things go wrong • MITM detection • Malware? Insider Threat? • Maliciously running processes • Latency in response times • Low click through rate on ads
20. 20 Anomaly Detection • Single or Multi-metric time series • Outliers in population • Rare events categorization
21. 21 21
22. 22 22 Forecasting
23. 23 23 Index Visualization
24. DEMO
25. 25 What it can’t do?
26. • https://www.elastic.co/products/x-pack/machine-learning • https://www.elastic.co/guide/en/kibana/current/introduction.html • https://www.elastic.co/elasticon/conf/2018/sf/machine-learning-in-the-elastic-stack • https://www.elastic.co/elasticon/conf/2018/sf/the-math-behind-elastic-machine-learning • https://discuss.elastic.co/c/x-pack bit.ly/OracleCode Where else I can look?
27. 27 Fin!