Growing App with AB Testing in Firebase

DevFest2021 LAHORE

Transcript

1. Growing Apps with AB Testing in Firebase Abid Jami l Technical Lead, GrocerApp
2. I am leading Growth Pod of Engineering team at GrocerAp p I write codes in Kotlin, and Java for Androi d I am Programmer, CS Researcher, & Speaker 
 ABOUT ME
4. AB Testing
5. AB Testing Process
6. AB Testing Lifecycle
7. Example AB Testing
8. Example AB Testing we have to create our own dataset. The dataset will contain the columns below: • customer_id: the unique identifier of the customer • segment: customer’s segment; high-value or low-value • group: indicates whether the customer is in the test or control group • purchase_count: # of purchases completed by the customer
14. Firebase AB Testing
15. Firebase Analytics
16. Firebase Predictions
17. Firebase Predicitions
18. Setting up the experiment
19. Define your targets
20. Decide your goals
21. Create variants
22. Create variants
23. Create variants
24. Decide weights
25. Experimentation Results
26. Interpreting test results • Powered by Google Optimize. • Uses Bayesian inference • Observed data is calculated directly from analytics data • Modeled data comes from the application of our Bayesian model
27. Observed Data •Probability to beat baseline: how likely that the metric is higher for this variant compared to the baseline •Percent difference from baseline: based on the median model estimates of the metric for the variant and the baseline •Metric ranges: the ranges where the value of the metric is most likely to to be found.
28. Thank You! https://www.linkedin.com/in/abidjamil/