Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Finance@Google2015 Simply Business - Living the...
Search
Lukas Oberhuber
September 16, 2015
Technology
0
57
Finance@Google2015 Simply Business - Living the Test Culture
A talk I gave on how and when we test at Simply Business, and some of the challenges.
Lukas Oberhuber
September 16, 2015
Tweet
Share
More Decks by Lukas Oberhuber
See All by Lukas Oberhuber
Lean Startup Conference 2019: 8 Maladies of Rapid Experimentation
lukaso
0
330
Technical Bankruptcy
lukaso
0
570
Other Decks in Technology
See All in Technology
AI専用のリンターを作る #yumemi_patch
bengo4com
5
4.3k
ビズリーチにおけるリアーキテクティング実践事例 / JJUG CCC 2025 Spring
visional_engineering_and_design
1
120
スタートアップに選択肢を 〜生成AIを活用したセカンダリー事業への挑戦〜
nstock
0
200
20250707-AI活用の個人差を埋めるチームづくり
shnjtk
4
3.9k
United airlines®️ USA Contact Numbers: Complete 2025 Support Guide
unitedflyhelp
0
310
NewSQLや分散データベースを支えるRaftの仕組み - 仕組みを理解して知る得意不得意
hacomono
PRO
2
160
Delta airlines®️ USA Contact Numbers: Complete 2025 Support Guide
airtravelguide
0
340
AWS認定を取る中で感じたこと
siromi
1
190
Core Audio tapを使ったリアルタイム音声処理のお話
yuta0306
0
190
ビズリーチが挑む メトリクスを活用した技術的負債の解消 / dev-productivity-con2025
visional_engineering_and_design
3
7.6k
United Airlines Customer Service– Call 1-833-341-3142 Now!
airhelp
0
170
Getting to Know Your Legacy (System) with AI-Driven Software Archeology (WeAreDevelopers World Congress 2025)
feststelltaste
1
130
Featured
See All Featured
Product Roadmaps are Hard
iamctodd
PRO
54
11k
Automating Front-end Workflow
addyosmani
1370
200k
Java REST API Framework Comparison - PWX 2021
mraible
31
8.7k
Embracing the Ebb and Flow
colly
86
4.7k
The Cost Of JavaScript in 2023
addyosmani
51
8.5k
Practical Orchestrator
shlominoach
189
11k
10 Git Anti Patterns You Should be Aware of
lemiorhan
PRO
656
60k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
30
2.1k
Connecting the Dots Between Site Speed, User Experience & Your Business [WebExpo 2025]
tammyeverts
6
300
Typedesign – Prime Four
hannesfritz
42
2.7k
YesSQL, Process and Tooling at Scale
rocio
173
14k
Agile that works and the tools we love
rasmusluckow
329
21k
Transcript
Case: Living the Test Culture Lukas Oberhuber | CTO -
Simply Business
55,000,000 € Revenues 300 Employees 300,000 Policies
None
flickr photo by Pink Sherbet Photography http://flickr.com/photos/pinksherbet/3370498053 shared under a
Creative Commons (BY) license
The Principles of Living a Test Culture Build, Measure, Learn
Test What’s Important How You Should Roll Be Bold It’s Hard
Foundation to Test Build Learn Measure
What we test Everything Everything Everything Everything Everything Everything Everything
How we set up Tests • Decide what to learn
(Hypothesis) • Write experiment (Measures) • Build and run experiment • Results • Pivot or persevere
How to Ensure Accurate Data • Not easy • Biases
and missing skills get in the way • Avoid post hoc analysis
Results “You will walk through the valley of the shadow
of death” 26% YoY growth in conversion through incremental change
Comparison Pages Multi-month build Driven by customer requests Good usability
results A/B Test showed 3 point uplift
How should you Roll? Sell policies via brokers • Small
investment • Failed • New hypothesis • None worked • Pivoted Test what’s important, not what’s easy
Be Bold Source https://www.123-reg.co.uk/blog/top-6-lists/six-ab-tests-to-skyrocket-your-sales/
Be Bold Small tests, small results People win the lottery
all the time! Could it be? Yes it could. Something’s coming, something good. Gonna be great. Source https://www.123-reg.co.uk/blog/top-6-lists/six-ab-tests-to-skyrocket-your-sales/
How should you Roll? Look beyond the Comfortable And A/B
testing is only one of the methods Source: http://www.nngroup.com/articles/which-ux-research-methods/
flickr photo by stephen w morris http://flickr.com/photos/nonlin/4013035510 shared under a
Creative Commons (BY) license Culture
A Word about HiPPOs
THANKS! Lukas Oberhuber
[email protected]
www.simplybusiness.co.uk @lukasco