Elastic{ON} 2018 - Monitor and Manage Your Cloud Environment with the Logstash Azure Monitoring Module

Transcript

1. February 28, 2018 Monitor your Cloud Environment with the Logstash Azure Monitoring Module Olivia Klose Software Development Engineer Microsoft Alvin Chen Principal Product Manager Elastic
2. Monitoring observe and check the progress or quality of (something) over a period of time
7. 7 Monitoring is often a fragmented experience • Many different assets to monitor • Each organization may have different goals and skill sets • Multiple technologies for solving monitoring problems
8. 8 Database Monitoring NoSQL Monitoring Container Monitoring Cloud Monitoring Admin Monitoring is often a fragmented experience
9. 9 Monitoring is often a fragmented experience Database Monitoring NoSQL Monitoring Container Monitoring Cloud Monitoring RIP X X
10. 10 Monitoring with the Elastic Stack Monitoring The Elastic Stack BKD Trees Time Series Visual Builder Modules
11. The Elastic Stack 11 Logging Metrics Security Monitoring Monitoring spans multiple use cases
12. The Elastic Stack 12 Logging Metrics Security Monitoring Centrally monitor everything with a single pane of glass. Azure
13. Trusted Productive Intelligent Hybrid Core infrastructure Compute Storage Networking Security Management Advanced workloads Web + mobile Internet of Things Microservices Containers Serverless Identity Data + analytics Artificial intelligence Cognitive services High performance computing Tools Developer tools DevOps Portal + scripting Azure Stack + Hybrid
14. 42Azure regions
15. Microsoft’s approach to open source in the cloud
16. Microsoft Elastic Azure Search “We like it because of its versatility” Pablo Castro, Partner Director of Engineering at Microsoft Microsoft Social Engagement for Microsoft Dynamics 365
17. 17 Elastic on the Azure Marketplace https://github.com/elastic/azure-marketplace https://azuremarketplace.microsoft.com/en-us/marketplace/apps/elastic.elasticsearch
18. 18 • Search for better healthcare • Queries from hours to milliseconds • Meeting HIPAA requirements https://www.elastic.co/use-cases/influence-health
19. 19 • Analytics-based vision for security monitoring • Detection of previously overseen threats and breaches https://www.youtube.com/watch?v=K5yTI9pXe0U
21. • Built-In monitoring support for Azure resources • Out-of-box metrics and logs • Alert rules to get notified & take automated actions Azure Monitor Infrastructure Activity Logs Resources Metrics Diagnostics Logs Azure Monitor
22. • Built-In monitoring support for Azure resources • Out-of-box metrics and logs • Alert rules to get notified & take automated actions • APIs for 3rd party integration Azure Monitor Infrastructure Activity Logs Resources Metrics Diagnostics Logs Azure Monitor Azure Event Hubs
23. So many questions, so little time... Where did my instances go? Why was Jessica logging in from China yesterday? How many alerts & incidents occurred in the last hour? Who’s mining Bitcoin with our Azure account? Which SQL DB queries are causing high DTU?
24. Monitoring Azure should be easy
25. 25 Logstash Azure Monitoring Module Coming Soon Free X-Pack Basic
26. 26 Monitor your Azure infrastructure and services with the Elastic Stack Start exploring in minutes with bundled Kibana dashboards Just one command to get started Logstash Azure Monitoring Module Event Hub Activity Log SQL DB Logstash Elasticsearch Kibana X-Pack Azure Monitoring Module Logs & Metrics
27. 27 Centralized ingestion of Azure logs & metrics Automated processing and enrichment Alerting and anomaly detection with X-Pack Logstash Azure Monitoring Module Event Hub Activity Log SQL DB Logstash Elasticsearch Kibana X-Pack Azure Monitoring Module Logs & Metrics
28. • Analyze infrastructure changes and authorization activity • Identify suspicious behaviors and potential malicious actors • Perform root-cause analysis by investigating user activity • Monitor and optimize SQL DB deployments Use Cases Logstash Azure Monitoring Module
29. Get Started Quick 29 Configure logs and metrics to Azure Monitor 1 2 3 Run the Logstash Azure Monitoring module Start exploring with packaged Kibana dashboards Logstash Azure Monitoring Module Demo Time
30. 30 What integrations would you like to see next? http://go.es.io/2F1H6p3 Azure Monitoring Survey Event Hub Activity Log SQL DB { ??? } Logstash Elasticsearch Kibana X-Pack Azure Monitoring Module Logs & Metrics
31. 31 Thank You Know more. React faster. Secure everything. Questions & Feedback • Email: monitor-azure@elastic.co • Survey: http://go.es.io/2F1H6p3 • Visit us @ the AMA & Microsoft booth Olivia Klose @oliviaklose @oliviak Alvin Chen @acchen97
32. www.elastic.c o