A look into AB testing

52d6b8fd288036707ddd50eb6f595cb7?s=47 Aydar
September 03, 2018

A look into AB testing

Introduction to AB testing and some personal learnings. Presented on the Munich iOS Developers Meetup.

52d6b8fd288036707ddd50eb6f595cb7?s=128

Aydar

September 03, 2018
Tweet

Transcript

  1. 16.

    Feature Flags at Freeletics remoteConfig = RemoteConfig.remoteConfig() remoteConfig.setDefaults(fromPlist: "RemoteConfigDefaults") …

    remoteConfig.fetch { (status, error) -> Void in if status == .success { print("Config fetched!") self.remoteConfig.activateFetched() } else { print("Config not fetched") } }
  2. 18.
  3. 20.

    Learnings Clarify future scenarios • How long should an AB

    test be alive? • If the test is successful, then … • If the test failed, then …
  4. 26.

    Learnings Prototype • Targeted to one locale and specific group

    • Looks like designed • Tracks user behavior Learn fast
  5. 40.

    Learnings Tips for coding Be ready for feature flag changes

    TableView Model FeatureFlag Storage numberOfRows() isEnabled() false 100 cellForRow(99) isEnabled() true User scrolls down Choose extended model Choose compact model Out of bounds Feature Flag update
  6. 41.

    Learnings • Clarify future scenarios • Learn fast • Build

    prototypes • Cleanup ASAP • Test • Debug panel • Tips for coding • Nothing bad in copy-pasting • Be ready for feature flag changes