Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Finance@Google2015 Simply Business - Living the...
Search
Lukas Oberhuber
September 16, 2015
Technology
0
57
Finance@Google2015 Simply Business - Living the Test Culture
A talk I gave on how and when we test at Simply Business, and some of the challenges.
Lukas Oberhuber
September 16, 2015
Tweet
Share
More Decks by Lukas Oberhuber
See All by Lukas Oberhuber
Lean Startup Conference 2019: 8 Maladies of Rapid Experimentation
lukaso
0
330
Technical Bankruptcy
lukaso
0
570
Other Decks in Technology
See All in Technology
ビズリーチにおけるリアーキテクティング実践事例 / JJUG CCC 2025 Spring
visional_engineering_and_design
1
120
面倒な作業はAIにおまかせ。Flutter開発をスマートに効率化
ruideengineer
0
260
American airlines ®️ USA Contact Numbers: Complete 2025 Support Guide
airhelpsupport
0
380
Glacierだからってコストあきらめてない? / JAWS Meet Glacier Cost
taishin
1
160
Operating Operator
shhnjk
1
590
スタートアップに選択肢を 〜生成AIを活用したセカンダリー事業への挑戦〜
nstock
0
190
LangChain Interrupt & LangChain Ambassadors meetingレポート
os1ma
2
310
品質と速度の両立:生成AI時代の品質保証アプローチ
odasho
1
350
使いたいMCPサーバーはWeb APIをラップして自分で作る #QiitaBash
bengo4com
0
1.9k
自律的なスケーリング手法FASTにおけるVPoEとしてのアカウンタビリティ / dev-productivity-con-2025
yoshikiiida
1
17k
SEQUENCE object comparison - db tech showcase 2025 LT2
nori_shinoda
0
140
「クラウドコスト絶対削減」を支える技術—FinOpsを超えた徹底的なクラウドコスト削減の実践論
delta_tech
4
170
Featured
See All Featured
The Art of Delivering Value - GDevCon NA Keynote
reverentgeek
15
1.5k
The Straight Up "How To Draw Better" Workshop
denniskardys
234
140k
Java REST API Framework Comparison - PWX 2021
mraible
31
8.7k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
44
2.4k
GraphQLの誤解/rethinking-graphql
sonatard
71
11k
Testing 201, or: Great Expectations
jmmastey
43
7.6k
The Web Performance Landscape in 2024 [PerfNow 2024]
tammyeverts
8
690
The Pragmatic Product Professional
lauravandoore
35
6.7k
BBQ
matthewcrist
89
9.7k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
46
9.6k
Documentation Writing (for coders)
carmenintech
72
4.9k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
53
2.9k
Transcript
Case: Living the Test Culture Lukas Oberhuber | CTO -
Simply Business
55,000,000 € Revenues 300 Employees 300,000 Policies
None
flickr photo by Pink Sherbet Photography http://flickr.com/photos/pinksherbet/3370498053 shared under a
Creative Commons (BY) license
The Principles of Living a Test Culture Build, Measure, Learn
Test What’s Important How You Should Roll Be Bold It’s Hard
Foundation to Test Build Learn Measure
What we test Everything Everything Everything Everything Everything Everything Everything
How we set up Tests • Decide what to learn
(Hypothesis) • Write experiment (Measures) • Build and run experiment • Results • Pivot or persevere
How to Ensure Accurate Data • Not easy • Biases
and missing skills get in the way • Avoid post hoc analysis
Results “You will walk through the valley of the shadow
of death” 26% YoY growth in conversion through incremental change
Comparison Pages Multi-month build Driven by customer requests Good usability
results A/B Test showed 3 point uplift
How should you Roll? Sell policies via brokers • Small
investment • Failed • New hypothesis • None worked • Pivoted Test what’s important, not what’s easy
Be Bold Source https://www.123-reg.co.uk/blog/top-6-lists/six-ab-tests-to-skyrocket-your-sales/
Be Bold Small tests, small results People win the lottery
all the time! Could it be? Yes it could. Something’s coming, something good. Gonna be great. Source https://www.123-reg.co.uk/blog/top-6-lists/six-ab-tests-to-skyrocket-your-sales/
How should you Roll? Look beyond the Comfortable And A/B
testing is only one of the methods Source: http://www.nngroup.com/articles/which-ux-research-methods/
flickr photo by stephen w morris http://flickr.com/photos/nonlin/4013035510 shared under a
Creative Commons (BY) license Culture
A Word about HiPPOs
THANKS! Lukas Oberhuber
[email protected]
www.simplybusiness.co.uk @lukasco