Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Introduction to Anomaly Detector

Introduction to Anomaly Detector

Bethany Jepchumba

October 19, 2022
Tweet

More Decks by Bethany Jepchumba

Other Decks in Technology

Transcript

  1. Prerequisites  Basic familiarity with Azure  Ability to navigate

    the Azure portal  Basic familiarity with Azure Cognitive Services
  2. Learning objectives  Describe the Anomaly Detector service  Briefly

    describe how Anomaly Detector works  Describe when to use Anomaly Detector
  3. Agenda  Introduction  What is Anomaly Detector?  How

    Anomaly Detector works  When to use Anomaly Detector  Exercise
  4. Introduction Anomaly detection is an artificial intelligence technique used to

    determine whether values in a series are within expected parameters. Potential use cases include: • monitoring blood pressure • evaluating mean time between failures for hardware products • comparing month-over-month expenses for product costs
  5. What is Anomaly Detector? Anomalies are values that are outside

    the expected values or range of values.
  6. How Anomaly Detector works • The Anomaly Detector service identifies

    anomalies that exist outside the scope of a boundary. • The Anomaly Detector service accepts data in JSON format.
  7. Data consistency recommendations If your data may have missing values

    in the sequence, consider the following recommendations. • Sampling occurs every few minutes and has less than 10% of the expected number of points missing. In this case, the impact should be negligible on the detection results. • If you have more than 10% missing, there are options to help "fill" the data set. Consider using a linear interpolation method to fill in the missing values and complete the data set. This will fill gaps with evenly distributed values.
  8. When to use Anomaly Detector The Anomaly Detector service supports

    batch processing of time series data and last-point anomaly detection for real-time data.
  9. Batch detection Batch detection involves applying the algorithm to an

    entire data series at one time. • Flat trend time series data with occasional spikes or dips • Seasonal time series data with occasional anomalies • Seasonality is considered to be a pattern in your data, that occurs at regular intervals. Examples would be hourly, daily, or monthly patterns. Using seasonal data, and specifying a period for that pattern, can help to reduce the latency in detection. • the maximum allowable temperature • the minimum allowable temperature • the acceptable duration of time for temperatures to be outside the safe range
  10. Real-time detection Real-time detection uses streaming data by comparing previously

    seen data points to the last data point to determine if your latest one is an anomaly.
  11. Exercise To test the capabilities of the Anomaly Detection service,

    we'll use a simple command-line application that runs in the Cloud Shell. • Create an Anomaly Detector resource • Run Cloud Shell • Configure and run a client application • Learn more
  12. Question 1 What is meant by seasonal data? A. Data

    based on the time or year it was recorded. B. How far apart the values are by default for each recorded period. C. Data occurring at regular intervals.
  13. Question 1 What is meant by seasonal data? A. Data

    based on the time or year it was recorded. B. How far apart the values are by default for each recorded period. C. Data occurring at regular intervals.
  14. Question 2 What is the purpose of specifying granularity in

    your JSON data object? A. It is used to indicate the recording pattern of the data. B. It tells the service how to chunk up the results that are returned for review, independent of the time series data pattern. C. It is used to indicate the range of acceptable values.
  15. Question 2 What is the purpose of specifying granularity in

    your JSON data object? A. It is used to indicate the recording pattern of the data. B. It tells the service how to chunk up the results that are returned for review, independent of the time series data pattern. C. It is used to indicate the range of acceptable values.
  16. Question 3 How does the Anomaly Detector service evaluate real-time

    data for anomalies? A. It collects all the values in a window of time and evaluates them all at once. B. It evaluates the current value against the previous value. C. It uses interpolation based on the current value and the previous value to predict what the expected value should be.
  17. Question 3 How does the Anomaly Detector service evaluate real-time

    data for anomalies? A. It collects all the values in a window of time and evaluates them all at once. B. It evaluates the current value against the previous value. C. It uses interpolation based on the current value and the previous value to predict what the expected value should be.