Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Finance@Google2015 Simply Business - Living the...
Search
Lukas Oberhuber
September 16, 2015
Technology
0
57
Finance@Google2015 Simply Business - Living the Test Culture
A talk I gave on how and when we test at Simply Business, and some of the challenges.
Lukas Oberhuber
September 16, 2015
Tweet
Share
More Decks by Lukas Oberhuber
See All by Lukas Oberhuber
Lean Startup Conference 2019: 8 Maladies of Rapid Experimentation
lukaso
0
330
Technical Bankruptcy
lukaso
0
570
Other Decks in Technology
See All in Technology
Flutter向けPDFビューア、pdfrxのpdfium WASM対応について
espresso3389
0
130
KubeCon + CloudNativeCon Japan 2025 Recap by CA
ponkio_o
PRO
0
300
Should Our Project Join the CNCF? (Japanese Recap)
whywaita
PRO
0
340
Geminiとv0による高速プロトタイピング
shinya337
1
270
fukabori.fm 出張版: 売上高617億円と高稼働率を陰で支えた社内ツール開発のあれこれ話 / 20250704 Yoshimasa Iwase & Tomoo Morikawa
shift_evolve
PRO
2
7.8k
Model Mondays S2E04: AI Developer Experiences
nitya
0
140
使いたいMCPサーバーはWeb APIをラップして自分で作る #QiitaBash
bengo4com
0
1.9k
Enhancing SaaS Product Reliability and Release Velocity through Optimized Testing Approach
ropqa
1
230
AI専用のリンターを作る #yumemi_patch
bengo4com
5
4.3k
敢えて生成AIを使わないマネジメント業務
kzkmaeda
2
450
american aa airlines®️ USA Contact Numbers: Complete 2025 Support Guide
aaguide
0
180
LLM時代の検索
shibuiwilliam
2
170
Featured
See All Featured
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
281
13k
Testing 201, or: Great Expectations
jmmastey
43
7.6k
How GitHub (no longer) Works
holman
314
140k
A Tale of Four Properties
chriscoyier
160
23k
Building Better People: How to give real-time feedback that sticks.
wjessup
367
19k
Building a Scalable Design System with Sketch
lauravandoore
462
33k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
130
19k
Designing for humans not robots
tammielis
253
25k
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
50
5.5k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
34
3.1k
Navigating Team Friction
lara
187
15k
KATA
mclloyd
30
14k
Transcript
Case: Living the Test Culture Lukas Oberhuber | CTO -
Simply Business
55,000,000 € Revenues 300 Employees 300,000 Policies
None
flickr photo by Pink Sherbet Photography http://flickr.com/photos/pinksherbet/3370498053 shared under a
Creative Commons (BY) license
The Principles of Living a Test Culture Build, Measure, Learn
Test What’s Important How You Should Roll Be Bold It’s Hard
Foundation to Test Build Learn Measure
What we test Everything Everything Everything Everything Everything Everything Everything
How we set up Tests • Decide what to learn
(Hypothesis) • Write experiment (Measures) • Build and run experiment • Results • Pivot or persevere
How to Ensure Accurate Data • Not easy • Biases
and missing skills get in the way • Avoid post hoc analysis
Results “You will walk through the valley of the shadow
of death” 26% YoY growth in conversion through incremental change
Comparison Pages Multi-month build Driven by customer requests Good usability
results A/B Test showed 3 point uplift
How should you Roll? Sell policies via brokers • Small
investment • Failed • New hypothesis • None worked • Pivoted Test what’s important, not what’s easy
Be Bold Source https://www.123-reg.co.uk/blog/top-6-lists/six-ab-tests-to-skyrocket-your-sales/
Be Bold Small tests, small results People win the lottery
all the time! Could it be? Yes it could. Something’s coming, something good. Gonna be great. Source https://www.123-reg.co.uk/blog/top-6-lists/six-ab-tests-to-skyrocket-your-sales/
How should you Roll? Look beyond the Comfortable And A/B
testing is only one of the methods Source: http://www.nngroup.com/articles/which-ux-research-methods/
flickr photo by stephen w morris http://flickr.com/photos/nonlin/4013035510 shared under a
Creative Commons (BY) license Culture
A Word about HiPPOs
THANKS! Lukas Oberhuber
[email protected]
www.simplybusiness.co.uk @lukasco