Upgrade to Pro — share decks privately, control downloads, hide ads and more …

A look into AB testing

Aydar
September 03, 2018

A look into AB testing

Introduction to AB testing and some personal learnings. Presented on the Munich iOS Developers Meetup.

Aydar

September 03, 2018
Tweet

More Decks by Aydar

Other Decks in Programming

Transcript

  1. Feature Flags at Freeletics remoteConfig = RemoteConfig.remoteConfig() remoteConfig.setDefaults(fromPlist: "RemoteConfigDefaults") …

    remoteConfig.fetch { (status, error) -> Void in if status == .success { print("Config fetched!") self.remoteConfig.activateFetched() } else { print("Config not fetched") } }
  2. Learnings Clarify future scenarios • How long should an AB

    test be alive? • If the test is successful, then … • If the test failed, then …
  3. Learnings Prototype • Targeted to one locale and specific group

    • Looks like designed • Tracks user behavior Learn fast
  4. Learnings Tips for coding Be ready for feature flag changes

    TableView Model FeatureFlag Storage numberOfRows() isEnabled() false 100 cellForRow(99) isEnabled() true User scrolls down Choose extended model Choose compact model Out of bounds Feature Flag update
  5. Learnings • Clarify future scenarios • Learn fast • Build

    prototypes • Cleanup ASAP • Test • Debug panel • Tips for coding • Nothing bad in copy-pasting • Be ready for feature flag changes