Hilary Roberts – Science and Sensibility: Thoughts on Experimentation and Growth (Turing Fest 2016)

Transcript

1. science and sensibility hilary roberts, senior product manager at skyscanner thoughts on experimentation and growth
2. learn build minimise total time through the loop measure lean startup
3. 50M 800 40 users per month people product managers
4. L B M startup enterprise L B M
5. L B M L B M L B M L B M L B M startup at scale
6. 0 50 100 150 200 250 Experiment iterations
7. 0 50 100 150 200 250 Experiment iterations Hypotheses
8. hypothesis: based on insight, we predict that product change will cause impact. L B M
9. two possible outcomes successful failed L B M
10. two four possible outcomes L B M invalid flailed successful failed
11. case study returning users redirected to hotels home page instead of flights
12. Skyscanner you are really annoying me with your hotels and car hire options! You are not called HotelScanner or CarHireScanner. You are Sky as in aeroplanes! If you want to diversify into other services then you should have thought of that before calling your website SKYscanner. Imagine Compare The Market had limited themselves by calling it Compare The Car Insurance Market! They can now ease into the Travel Insurance market with no issue because they didnt specify which market they are comparing. You cant! and please stop defaulting me to Hotels I'm here for flights!! letter from a passionate skyscanner user “ ”
13. Verdict invalid
14. case study increasing propensity to search from news pages
15. verdict flailed
16. case study the right metric for travellers
23. British Airways! successful
24. “Any time a team attempts to justify its failures by resorting to learning as an excuse, it is engaged in pseudoscience.” The Lean Startup (page 279)
25. http://codevoyagers.com Hilary Roberts