Upgrade to Pro — share decks privately, control downloads, hide ads and more …

A/B Testing

BoldMinded
October 27, 2018

A/B Testing

Using science to make UX decisions and increase conversions.

Presentation given at EE CONF 2018 in Nashville, TN

BoldMinded

October 27, 2018

Transcript

38 slides
  1. 1

  2. 4

  3. Advantages • Objective decision-making process • Focus on action and

    outcomes • Mitigate risk • Quantify value of design decisions • Competitive advantage • Growth-driver 7
  4. Goal of Program Convince the marketing organization: 1. This is

    how we should make decisions about the website 2. Quantify impact of website on business outcomes 3. Drive incremental improvement toward goals 9
  5. Keys to Success • Stakeholder buy-in • Informed test plan

    • Implementation • Actionable process 10 Image from http:/ /eyeflow.com/4-major-keys-to-social-media-success/
  6. Stakeholder Buy-in Generate business case or proof of concept •

    Identify areas most closely tied to business outcomes & website success • Quantify the value of conversions to show opportunity potential of program 11
  7. Informed Test Plan Focus efforts on resolving pain-points. • Internal

    discussions and research • WHAT users do - web data • WHY users do it - survey and feedback • Pipeline of potential tests based on greatest impact 12
  8. 14

  9. 15

  10. 16

  11. 17

  12. Client Side Pros • Easy, Fast, and Cheap Cons •

    Less control • Flicker effect 18
  13. 20

  14. 22

  15. Server Side Pros • More Control • No flicker effect

    Cons • Requires development effort 24
  16. {exp:channel:entries channel="pages" entry_id="1"} {exp:experiments:bloqs} {bloqs_field} # blocks {/bloqs_field} {/exp:experiments:bloqs} {/exp:channel:entries}

    {exp:experiments:content} {original} Original Content #1 {/original} Always Shown {variant} Variant Content #1 {/variant} {/exp:experiments:content} 27
  17. 29

  18. 30

  19. 31

  20. 32

  21. 33

  22. 34

  23. 35

  24. 38

More Decks by BoldMinded

Other Decks in Business