Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Elastic{ON} 2018 - Monitor and Manage Your Cloud Environment with the Logstash Azure Monitoring Module

Elastic{ON} 2018 - Monitor and Manage Your Cloud Environment with the Logstash Azure Monitoring Module

Elastic Co

March 01, 2018
Tweet

More Decks by Elastic Co

Other Decks in Technology

Transcript

  1. February 28, 2018
    Monitor your Cloud Environment with the
    Logstash Azure Monitoring Module
    Olivia Klose
    Software Development Engineer
    Microsoft
    Alvin Chen
    Principal Product Manager
    Elastic

    View full-size slide

  2. Monitoring
    observe and check the progress or quality of
    (something) over a period of time

    View full-size slide

  3. 7
    Monitoring is often
    a fragmented
    experience
    • Many different assets to monitor
    • Each organization may have
    different goals and skill sets
    • Multiple technologies for solving
    monitoring problems

    View full-size slide

  4. 8
    Database
    Monitoring
    NoSQL
    Monitoring
    Container
    Monitoring
    Cloud
    Monitoring
    Admin
    Monitoring is often
    a fragmented
    experience

    View full-size slide

  5. 9
    Monitoring is often
    a fragmented
    experience
    Database
    Monitoring
    NoSQL
    Monitoring
    Container
    Monitoring
    Cloud
    Monitoring
    RIP
    X X

    View full-size slide

  6. 10
    Monitoring with
    the Elastic Stack
    Monitoring
    The Elastic Stack
    BKD Trees
    Time Series
    Visual Builder
    Modules

    View full-size slide

  7. The Elastic Stack
    11
    Logging Metrics Security
    Monitoring
    Monitoring spans
    multiple use cases

    View full-size slide

  8. The Elastic Stack
    12
    Logging Metrics Security
    Monitoring
    Centrally monitor
    everything
    with a single
    pane of glass.
    Azure

    View full-size slide

  9. Trusted
    Productive
    Intelligent
    Hybrid
    Core infrastructure
    Compute Storage Networking
    Security Management
    Advanced workloads
    Web + mobile
    Internet of Things
    Microservices
    Containers
    Serverless
    Identity
    Data + analytics
    Artificial intelligence
    Cognitive services
    High performance computing
    Tools
    Developer
    tools
    DevOps Portal +
    scripting
    Azure Stack + Hybrid

    View full-size slide

  10. 42Azure
    regions

    View full-size slide

  11. Microsoft’s approach to open source in the cloud

    View full-size slide

  12. Microsoft Elastic
    Azure Search
    “We like it because of its versatility”
    Pablo Castro, Partner Director of Engineering at Microsoft
    Microsoft Social Engagement for Microsoft Dynamics 365

    View full-size slide

  13. 17
    Elastic on the
    Azure Marketplace
    https://github.com/elastic/azure-marketplace
    https://azuremarketplace.microsoft.com/en-us/marketplace/apps/elastic.elasticsearch

    View full-size slide

  14. 18
    • Search for better healthcare
    • Queries from hours to milliseconds
    • Meeting HIPAA requirements
    https://www.elastic.co/use-cases/influence-health

    View full-size slide

  15. 19
    • Analytics-based vision for security
    monitoring
    • Detection of previously overseen
    threats and breaches
    https://www.youtube.com/watch?v=K5yTI9pXe0U

    View full-size slide

  16. • Built-In monitoring support for
    Azure resources
    • Out-of-box metrics and logs
    • Alert rules to get notified &
    take automated actions
    Azure Monitor
    Infrastructure
    Activity Logs
    Resources
    Metrics
    Diagnostics Logs
    Azure Monitor

    View full-size slide

  17. • Built-In monitoring support for
    Azure resources
    • Out-of-box metrics and logs
    • Alert rules to get notified &
    take automated actions
    • APIs for 3rd party integration
    Azure Monitor
    Infrastructure
    Activity Logs
    Resources
    Metrics
    Diagnostics Logs
    Azure Monitor
    Azure Event Hubs

    View full-size slide

  18. So many questions, so little time...
    Where did my instances go?
    Why was Jessica logging in from China yesterday?
    How many alerts & incidents occurred in the last hour?
    Who’s mining Bitcoin with our Azure account?
    Which SQL DB queries are causing high DTU?

    View full-size slide

  19. Monitoring Azure
    should be easy

    View full-size slide

  20. 25
    Logstash
    Azure Monitoring
    Module
    Coming Soon
    Free
    X-Pack Basic

    View full-size slide

  21. 26
    Monitor your Azure infrastructure
    and services with the Elastic Stack
    Start exploring in minutes with
    bundled Kibana dashboards
    Just one command to get started
    Logstash
    Azure Monitoring Module
    Event Hub
    Activity Log
    SQL DB
    Logstash
    Elasticsearch
    Kibana X-Pack
    Azure
    Monitoring
    Module
    Logs & Metrics

    View full-size slide

  22. 27
    Centralized ingestion of
    Azure logs & metrics
    Automated processing and
    enrichment
    Alerting and anomaly detection
    with X-Pack
    Logstash
    Azure Monitoring Module
    Event Hub
    Activity Log
    SQL DB
    Logstash
    Elasticsearch
    Kibana X-Pack
    Azure
    Monitoring
    Module
    Logs & Metrics

    View full-size slide

  23. • Analyze infrastructure changes and authorization activity
    • Identify suspicious behaviors and potential malicious actors
    • Perform root-cause analysis by investigating user activity
    • Monitor and optimize SQL DB deployments
    Use Cases
    Logstash Azure Monitoring Module

    View full-size slide

  24. Get Started Quick
    29
    Configure logs and
    metrics to Azure
    Monitor
    1 2 3
    Run the Logstash
    Azure Monitoring
    module
    Start exploring with
    packaged Kibana
    dashboards
    Logstash Azure Monitoring Module
    Demo
    Time

    View full-size slide

  25. 30
    What integrations would you like
    to see next?
    http://go.es.io/2F1H6p3
    Azure Monitoring
    Survey
    Event Hub
    Activity Log
    SQL DB
    { ??? }
    Logstash
    Elasticsearch
    Kibana X-Pack
    Azure
    Monitoring
    Module
    Logs & Metrics

    View full-size slide

  26. 31
    Thank You
    Know more.
    React faster.
    Secure everything.
    Questions & Feedback
    • Email: [email protected]
    • Survey: http://go.es.io/2F1H6p3
    • Visit us @ the AMA & Microsoft booth
    Olivia Klose
    @oliviaklose
    @oliviak
    Alvin Chen
    @acchen97

    View full-size slide

  27. www.elastic.c
    o

    View full-size slide