Slide 25
Slide 25 text
Edit page reference
25 | Month Year | Title of project
● Real-world examples of businesses that have successfully used automated monitoring and anomaly detection to improve customer satisfaction
● JET:
○ For real-time app/web events to track if measurement/tagging is working as expected. (Note: JET team currently only monitor the funnel step
'transaction', but we do plan for other events (funnel steps) to track. They don't have dimensions so we currently aren't using RCA)
○ if there is a sudden drop in orders at a certain stage of the funnel, it could indicate a problem with the ordering process, such as technical difficulties or
unclear instructions (Ex:outage examples: payment service provider down, DDOS attack, new software releases). By identifying and fixing these anomalies,
the food delivery app can ensure that customers are able to complete their orders smoothly and efficiently, leading to a higher level of satisfaction.
○ Additionally, regularly monitoring the measurement funnel can help identify trends and areas for improvement, allowing the app to continuously
optimize the customer experience.
○ We can use the following steps for the demo script
■ To identify anomalies in the measurement funnel orders for a food delivery app, you can follow these steps:
● Define the measurement funnel: The count of events (spikes/drops) help Identify the changes in key stages of the ordering process,
such as: add item to basket, go to checkout, list restaurants, open restaurant menu.
● Collect and analyze data: Collect data on the number of customers at each stage of the funnel and analyze it to identify any unusual
patterns or deviations from the expected results.
● Use statistical models: Use statistical models, such as regression analysis or time series analysis, to detect outliers or unusual
patterns in the data. (include challenges and solutions for detecting anomalies on highly seasonal data on a small time aggregation
(15min))
● Determine granularity:
○ define whether you’d like to receive outliers per dimension value. For example per country or state.
○ Define the latency and time monitoring interval with respect to time. We picked 15m time interval with 1 minute latency.
● Visualize the data: Use data visualization tools, such as charts or graphs, to help visualize the data and identify any anomalies more
easily.
● Investigate the anomalies: Once anomalies have been identified, it's important to investigate the root cause of the issue and take
corrective action to improve the customer experience.