Upgrade to Pro — share decks privately, control downloads, hide ads and more …

AzureBootcamp2022: Introduction to Azure Monitoring by Thomas Hafermalz

AzureBootcamp2022: Introduction to Azure Monitoring by Thomas Hafermalz

This session is one of the sessions of Azure Bootcamp Switzerland 2022.
www.azurebootcamp.ch

In this session I am going to provide an overview of the Azure Monitor(ing) options. We will learn from where you can get your telemetry data and how you can analyse it with queries and display options as well as how you can react on it, tangible with examples in a demo.

🙂 THOMAS HAFERMALZ ⚡️ Azure Solution Architect @ Trivadis

Check out Thomas at: https://www.linkedin.com/in/thomashafermalz/

More Decks by Azure Zurich User Group

Other Decks in Technology

Transcript

  1. Azure Monitoring
    History, Collection, Working with the Data
    Thomas Hafermalz
    11.5.2022 Azure Bootcamp

    View full-size slide

  2. Agenda
    ▪ Overview
    ▪ Data types & collection
    ▪ Working with the data
    ▪ Demo

    View full-size slide

  3. AZURE MONITOR OVERVIEW

    View full-size slide

  4. History
    ▪ 2007: System Center Operations Manager (SCOM)
    ▪ 2015: Operations Mangement Suite (OMS) / Log Analytics

    View full-size slide

  5. History
    ▪ 2015: Application Insights

    View full-size slide

  6. History
    ▪ 2018: Azure Monitor
    Monitor your
    ▪ Applications
    ▪ Infrastructure
    ▪ Network
    ▪ … (everything)

    View full-size slide

  7. Azure Monitor
    ▪ Standard service
    ▪ always available and does not need to be
    provisioned as an extra resource in a resource
    group
    ▪ Rich set of options for monitoring
    ▪ Data connection to a wide range of sources
    ▪ many analysis options
    ▪ Further processing in the business process.

    View full-size slide

  8. Azure Arc
    ▪ Handle different environments
    ▪ Multi-Cloud
    ▪ On-prem resources
    ▪ Azure Stack HCI
    ▪ Non-Azure resources get resourceId
    ▪ Servers (& SQL on VM)
    ▪ K8s Clusters
    ▪ →

    View full-size slide

  9. DATA TYPES & COLLECTION

    View full-size slide

  10. Data Types
    ▪ Metrics
    ▪ numeric data in a time-series database
    ▪ lightweight for real-time scenarios
    ▪ Logs
    ▪ Log Data in text form (JSON)
    ▪ Table data row with columns

    View full-size slide

  11. Monitoring Levels
    ▪ Tenant (AAD Logs)
    ▪ sign-in activities AAD
    ▪ Subscription (Activity logs)
    ▪ Subscription operations & Service health
    ▪ Ressource Level (Diagnostics Settings)
    ▪ Metrics, configuration changes
    ▪ Guest OS Data
    ▪ VM-Data
    ▪ Application
    ▪ Performance and functionality of the code

    View full-size slide

  12. Standard Monitoring
    ▪ Automatic collection of different data
    ▪ Logs & Metrics
    ▪ Retention time of data differs:
    ▪ Tenant Logs 30d
    ▪ Activity Logs 90d
    ▪ Metrics 93d
    ▪ Example:
    ▪ AppService / VM performance metrics
    ▪ Service Bus / Event Hub message traffic

    View full-size slide

  13. Log Analytics Workspace
    ▪ Central data repository for collection
    ▪ Based on Azure Data Explorer Database
    ▪ Different sources = different tables

    View full-size slide

  14. Application Insights (classic)
    ▪ Own data store retires in 2024

    View full-size slide

  15. Advanced: Diagnostic settings
    ▪ Ressource Level
    ▪ Different options depending on each Azure resource
    ▪ Requests on storage account
    ▪ Web Application Firewall Logs
    ▪ 3 Options sending the data to:
    ▪ Log Analytics Workspace
    ▪ Storage Account
    ▪ Event hub

    View full-size slide

  16. Virtual Machine Data
    ▪ 4-5 different agents to send the data!
    ▪ Azure Monitoring Agent launched
    ▪ Performance counters
    ▪ Boot diagnostics
    ▪ Network traffic
    ▪ Event Logs / Sys Logs
    ▪ Security Center

    View full-size slide

  17. Costs
    ▪ Data Exports, Custom Metrics, Alerts…
    ▪ Daily data cap configurable
    ▪ Capacity Reservations for Workspace possible
    ▪ Archive in Storage account possible.
    Feature Free Further
    Data Ingress
    5 GB/Month/Bill
    Account
    ~ 2,23 CHF/GB
    Data Retention
    31 d (Workspace)
    90 d (AppInsights)
    ~ 0,09 CHF/GB/Month

    View full-size slide

  18. ANALYZING THE DATA

    View full-size slide

  19. Network Watcher
    ▪ regional service for network diagnostics &
    monitoring
    ▪ Inspect traffic:
    ▪ IP flow verify for packet allowance / denial
    ▪ Route inspection
    ▪ Network diagrams
    ▪ Check VPN Gateways & connections
    ▪ Check combined working NSG rules

    View full-size slide

  20. KQL
    ▪ KQL (this context) = Kusto Query Language.
    ▪ SQL-like query language, also based on tables and columns
    ▪ optimized for read queries of big data
    ▪ Invented for MSFT Big Data Telemetry Analysis
    ▪ Azure Data Explorer
    ▪ Used in
    ▪ Resource Graph
    ▪ Log Analytics Workspace
    ▪ Application Insights
    ▪ Data Explorer

    View full-size slide

  21. KQL
    ▪ Queries:
    ▪ Essentially: table source, filtered with conditions and possible
    projections
    ▪ The pipe | operator is used to pass the intermediate results.
    ▪ MSSQL:
    SELECT operation_Name, type, method
    FROM exceptions
    WHERE operation_Name = “Myfunction”
    ▪ → KQL:
    exceptions
    | where operation_Name == “Myfunction”
    | project operation_Name, type, method

    View full-size slide

  22. Log Analytics
    ▪ Area in the Azure Portal to query the log data

    View full-size slide

  23. Workbooks
    ▪ Kind of interactive dashboard
    ▪ collections of KQL queries & charts
    ▪ Parametrizable, results chainable

    View full-size slide

  24. Alerts
    ▪ Always based on log / metric data
    ▪ Scope
    ▪ Which resource / subscription shall be
    checked?
    ▪ Definition of signals and criteria
    ▪ Which condition / Query / event
    ▪ Definition of Action Groups
    ▪ Who should be notified?
    ▪ Additional actions
    ▪ States:
    ▪ New, Acknowledged, Closed

    View full-size slide

  25. Alerts - Attention
    ▪ Specifying a query period in alert config actually already filters
    ▪ only this subset is queried, regardless of timeframe stated in the
    query
    ▪ selection of a stored query only takes over its text - no reference is
    made
    ▪ action groups and the alert rules are stored as resources in a resource
    group. However, these are hidden by default.

    View full-size slide

  26. Insights
    ▪ Applications Insights
    ▪ own resource, application monitoring
    ▪ “Additional” insights
    ▪ Tailored monitoring view for several resources
    ▪ VM Insights
    ▪ Container Insights
    ▪ Key Vault
    ▪ Storage
    ▪ Some require Workspace / configuration

    View full-size slide

  27. Application Insights
    ▪ Tracking web applications, Azure functions
    ▪ Requests
    ▪ response times, failure rates
    ▪ Page views , loading times
    ▪ Exceptions
    ▪ Host diagnostics
    ▪ Custom events & metrics (SDK)
    ▪ Application Map
    ▪ Distributed Tracing

    View full-size slide

  28. Storage Insights
    ▪ Capacity & Transactions

    View full-size slide

  29. Useful Links:
    ▪ https://docs.microsoft.com/en-us/azure/azure-monitor/logs/scope
    ▪ https://docs.microsoft.com/en-us/azure/azure-monitor/monitor-reference
    ▪ https://docs.microsoft.com/en-us/azure/azure-monitor/app/apm-tables
    ▪ https://docs.microsoft.com/en-us/azure/data-explorer/query-monitor-data
    ▪ Style Workbooks: https://docs.microsoft.com/en-us/azure/azure-
    monitor/visualize/workbooks-grid-visualizations
    ▪ https://github.com/tyconsulting/AzureResourceGraph

    View full-size slide

  30. THOMAS HAFERMALZ
     Azure Solution Architect & Trainer @Trivadis AG →
    Accenture (Zurich )
     Industrial Environmental Informatics
     Meetup: Azure Zurich User Group
     www.thomashafermalz.net
    www.linkedin.com/in/thomashafermalz

    View full-size slide

  31. KQL Demo
    ▪ https://aka.ms/AIAnalyticsDemo

    View full-size slide

  32. TOGETHER WE ARE
    #1 PARTNER FOR BUSINESSES TO
    HARNESS THE POWER OF DATA
    FOR A SMARTER LIFE

    View full-size slide