Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Growing App with AB Testing in Firebase

Abid Jamil
December 18, 2021

Growing App with AB Testing in Firebase

DevFest2021 LAHORE

Abid Jamil

December 18, 2021

Transcript

28 slides
  1. I am leading Growth Pod of Engineering team at GrocerAp

    p I write codes in Kotlin, and Java for Androi d I am Programmer, CS Researcher, & Speaker 
 ABOUT ME
  2. Example AB Testing we have to create our own dataset.

    The dataset will contain the columns below: • customer_id: the unique identifier of the customer • segment: customer’s segment; high-value or low-value • group: indicates whether the customer is in the test or control group • purchase_count: # of purchases completed by the customer
  3. Interpreting test results • Powered by Google Optimize. • Uses

    Bayesian inference • Observed data is calculated directly from analytics data • Modeled data comes from the application of our Bayesian model
  4. Observed Data •Probability to beat baseline: how likely that the

    metric is higher for this variant compared to the baseline •Percent difference from baseline: based on the median model estimates of the metric for the variant and the baseline •Metric ranges: the ranges where the value of the metric is most likely to to be found.

More Decks by Abid Jamil

Other Decks in Programming