Slide 1

Slide 1 text

Are you making your product better or worse? LUKAS FITTL @lfittl spark59.com ACTIONABLE METRICS Lean Startup is trademarked by Eric Ries and used with permission. Business Model Canvas is created by Alex Osterwalder and licensed under CC-BY-SA. Thursday, 23 May 2013

Slide 2

Slide 2 text

About Myself & Spark59 Founded 2 tech startups, worked with many others Thursday, 23 May 2013

Slide 3

Slide 3 text

Thursday, 23 May 2013

Slide 4

Slide 4 text

“Am I making progress into the right direction?” Thursday, 23 May 2013

Slide 5

Slide 5 text

$$$/users/etc Time Thursday, 23 May 2013

Slide 6

Slide 6 text

Product/ Market Fit 1. Deliver Value 2. Accelerate Growth Thursday, 23 May 2013

Slide 7

Slide 7 text

Product/ Market Fit 1. Value 2. Growth Thursday, 23 May 2013

Slide 8

Slide 8 text

Product/Market Fit: The moment when you can consistently deliver value to the right people. Thursday, 23 May 2013

Slide 9

Slide 9 text

Focus on Outcome, not Tasks. Thursday, 23 May 2013

Slide 10

Slide 10 text

Make Customers Happy Make Happy Customers Thursday, 23 May 2013

Slide 11

Slide 11 text

$10000 / month $2000 / month Now June 2013 ? Thursday, 23 May 2013

Slide 12

Slide 12 text

Break Revenue Targets, down into Unit Economics. Thursday, 23 May 2013

Slide 13

Slide 13 text

Dave McClure’s AARRR ACQUISITION ACTIVATION RETENTION REVENUE REFERRAL How do users find you? Do users have a reat first experience? Do users come back? How do you make money? Do users tell others? Thursday, 23 May 2013

Slide 14

Slide 14 text

$2000 / month ACQ ACT 20% to paid at $35 RET REV 20% stay for 1 week 8% activate 5% sign up 2 paid $70 / day 10 retained 50 activated 625 signed up 12500 unique visitors Each Day: Thursday, 23 May 2013

Slide 15

Slide 15 text

Cohort Analysis Thursday, 23 May 2013

Slide 16

Slide 16 text

Cohort: Group of people that share a common characteristic over a period of time. Thursday, 23 May 2013

Slide 17

Slide 17 text

Thursday, 23 May 2013

Slide 18

Slide 18 text

Track people, not events. Thursday, 23 May 2013

Slide 19

Slide 19 text

Group users by sign-up date and track their lifecycle. Thursday, 23 May 2013

Slide 20

Slide 20 text

Thursday, 23 May 2013

Slide 21

Slide 21 text

Thursday, 23 May 2013

Slide 22

Slide 22 text

Thursday, 23 May 2013

Slide 23

Slide 23 text

Cohort Analysis for Retention Thursday, 23 May 2013

Slide 24

Slide 24 text

Thursday, 23 May 2013

Slide 25

Slide 25 text

$10000 / month $2000 / month Now June 2013 ? Thursday, 23 May 2013

Slide 26

Slide 26 text

$2000 / month ACQ ACT 20% to paid at $35 RET REV 20% stay for 1 week 8% activate 5% sign up 2 paid $70 / day 10 retained 50 activated 625 signed up 12500 Unique Visitors / day Cohort of February 12th, 2013 Thursday, 23 May 2013

Slide 27

Slide 27 text

$2000 / month Now ACQ ACT 20% to paid at $35 RET REV 20% stay for 1 week 8% activate 5% sign up $70 / day 12500 Uniques $10000 / month June 2013 20% to paid at $35 20% stay for 1 week 20% activate 10% sign up $350 / day 12500 Uniques 2 10 50 625 10 50 250 1250 Thursday, 23 May 2013

Slide 28

Slide 28 text

$2000 / month Now ACQ ACT 20% to paid at $35 RET REV 20% stay for 1 week 8% activate 5% sign up $70 / day 12500 Uniques $10000 / month June 2013 20% to paid at $35 20% stay for 1 week 20% activate 10% sign up $350 / day 12500 Uniques 2 10 50 625 10 50 250 1250 Thursday, 23 May 2013

Slide 29

Slide 29 text

Delivering Value Thursday, 23 May 2013

Slide 30

Slide 30 text

Customers need to experience the value, otherwise they will leave. Thursday, 23 May 2013

Slide 31

Slide 31 text

ACQUISITION ACTIVATION RETENTION REVENUE REFERRAL Value Metrics How do users find you? Do users have a great first experience? Do users come back? How do you make money? Do users tell others? Thursday, 23 May 2013

Slide 32

Slide 32 text

ACQUISITION ACTIVATION RETENTION REVENUE REFERRAL Value Metrics How do users find you? Do users have a great first experience? Do users come back? How do you make money? Do users tell others? Thursday, 23 May 2013

Slide 33

Slide 33 text

ACQUISITION ACTIVATION RETENTION REVENUE REFERRAL Value Metrics How do users find you? Do users have a great first experience? Do users come back? How do you make money? Do users tell others? Thursday, 23 May 2013

Slide 34

Slide 34 text

ACQUISITION ACTIVATION RETENTION REVENUE REFERRAL Value Metrics How do users find you? Do users have a great first experience? Do users come back? How do you make money? Do users tell others? Thursday, 23 May 2013

Slide 35

Slide 35 text

Network effect vs Marketplace vs SaaS Who delivers the actual value? Critical Mass of People The Right People Your Product Thursday, 23 May 2013

Slide 36

Slide 36 text

[ Exercise ] How do you deliver your Initial Value? Thursday, 23 May 2013

Slide 37

Slide 37 text

ACQUISITION ACTIVATION RETENTION REVENUE REFERRAL Value Metrics How do users find you? Do users have a great first experience? Do users come back? How do you make money? Do users tell others? Thursday, 23 May 2013

Slide 38

Slide 38 text

Feature Usage of successful & unsuccessful customers Thursday, 23 May 2013

Slide 39

Slide 39 text

Time to Complete Useful for Email Campaigns! Thursday, 23 May 2013

Slide 40

Slide 40 text

Request Demo Commit to become paying customer Visit landing page Create Account Provide billing info for 14-day trial Get welcome email with link to docs Schedule weekly meetings Review docs Establish success metrics Map user actions Send first production event ACTIVATION SIGNUP ACQUISITION Baseline AARRR metrics Identify key metric to improve Define experiments First meeting UPGRADE RETENTION Send events to staging Day 1 Day 2 Day 3 Week 2 Week 3 Week 4 Customer Journey Maps Thursday, 23 May 2013

Slide 41

Slide 41 text

Usability Tests http://www.slideshare.net/JohnnyForeigner/active-testing-sketches-leancamp-bcn Thursday, 23 May 2013

Slide 42

Slide 42 text

ACQUISITION ACTIVATION RETENTION REVENUE REFERRAL Value Metrics How do users find you? Do users have a great first experience? Do users come back? How do you make money? Do users tell others? Thursday, 23 May 2013

Slide 43

Slide 43 text

Did Key Activity More than Once “Created at least 3 cards on the Kan-ban board” “Wrote at least 2 blog posts” “Wrote at least 5 restaurant reviews” Thursday, 23 May 2013

Slide 44

Slide 44 text

Customer Happiness Index (CHI) Created Blog Post = 5 Points Shared Post on Twitter = 10 Points Visited Site = 0.1 Points Sum together per User in Ranked List & Reset Each Week Visualises your Power Users Thursday, 23 May 2013

Slide 45

Slide 45 text

1-day 52% 7-day 31% 14-day 22% 30-day 14% Thursday, 23 May 2013

Slide 46

Slide 46 text

Thursday, 23 May 2013

Slide 47

Slide 47 text

Accelerating Growth Thursday, 23 May 2013

Slide 48

Slide 48 text

ACQUISITION ACTIVATION RETENTION REVENUE REFERRAL Growth Metrics How do users find you? Do users have a great first experience? Do users come back? How do you make money? Do users tell others? Thursday, 23 May 2013

Slide 49

Slide 49 text

ACQUISITION ACTIVATION RETENTION REVENUE REFERRAL Growth Metrics How do users find you? Do users have a great first experience? Do users come back? How do you make money? Do users tell others? Thursday, 23 May 2013

Slide 50

Slide 50 text

ACQUISITION ACTIVATION RETENTION REVENUE REFERRAL Growth Metrics How do users find you? Do users have a great first experience? Do users come back? How do you make money? Do users tell others? Thursday, 23 May 2013

Slide 51

Slide 51 text

The engine of growth is the mechanism that startups use to achieve sustainable growth. -Eric Ries, The Lean Startup Thursday, 23 May 2013

Slide 52

Slide 52 text

Sticky Organic Growth > Churn Rate Thursday, 23 May 2013

Slide 53

Slide 53 text

Paid 3x Acquisition Cost < Lifetime Value Thursday, 23 May 2013

Slide 54

Slide 54 text

Viral Viral Coefficient > 1.0 Thursday, 23 May 2013

Slide 55

Slide 55 text

3x Acquisition Cost < Lifetime Value Content Marketing vs Direct Sales vs Advertising Avg Length of Sales Cycle Monthly Churn Customer Happiness Index 7/14/30 day retention Avg Revenue / User Typical SaaS Company Thursday, 23 May 2013

Slide 56

Slide 56 text

Taking Action Thursday, 23 May 2013

Slide 57

Slide 57 text

Metrics are not a “Task”. ☑ Built a Metrics Dashboard ☐ Profit! ☐ ? Thursday, 23 May 2013

Slide 58

Slide 58 text

IDEAS PRODUCT DATA MEASURE BUILD LEARN Thursday, 23 May 2013

Slide 59

Slide 59 text

IDEAS PRODUCT DATA MEASURE BUILD LEARN Experiment Thursday, 23 May 2013

Slide 60

Slide 60 text

Hypotheses instead of Requirements Thursday, 23 May 2013

Slide 61

Slide 61 text

Requirement: Users can add a Cover Photo to their Profile. Thursday, 23 May 2013

Slide 62

Slide 62 text

We believe that users will add a cover photo and spend more time on other profiles. Hypothesis: Thursday, 23 May 2013

Slide 63

Slide 63 text

50% of newly signed up users will upload a cover photo, Avg time spent on user profiles will go from 30s to 1min+ Falsifiable Hypothesis: Thursday, 23 May 2013

Slide 64

Slide 64 text

[Exercise] Example Experiment + Hypothesis Thursday, 23 May 2013

Slide 65

Slide 65 text

IDEAS PRODUCT DATA MEASURE BUILD LEARN Build Measure Learn ✓ ✘ Kan-ban Board Thursday, 23 May 2013

Slide 66

Slide 66 text

Build Measure Learn ✓ ✘ Thursday, 23 May 2013

Slide 67

Slide 67 text

Build Measure Learn ✓ ✘ Experiment Scope How long do we run this experiment? Thursday, 23 May 2013

Slide 68

Slide 68 text

Dictates how fast you can learn Experiment Scope Your Runway How long you can survive Thursday, 23 May 2013

Slide 69

Slide 69 text

Example! Thursday, 23 May 2013

Slide 70

Slide 70 text

Split URL Test Thursday, 23 May 2013

Slide 71

Slide 71 text

VARIANT Thursday, 23 May 2013

Slide 72

Slide 72 text

VARIANT Thursday, 23 May 2013

Slide 73

Slide 73 text

VARIANT Thursday, 23 May 2013

Slide 74

Slide 74 text

VARIANT Thursday, 23 May 2013

Slide 75

Slide 75 text

Thursday, 23 May 2013

Slide 76

Slide 76 text

New variant will increase conversion by 5% Falsifiable Hypothesis: 10-14 hours to build & implement 1,000 visitors per page Experiment Scope: Thursday, 23 May 2013

Slide 77

Slide 77 text

VARIANT Visual Website Optimizer CONTROL 50% 50% Measurements via unique visitors Thursday, 23 May 2013

Slide 78

Slide 78 text

VARIANT CONTROL ?? How did we do? ?? Thursday, 23 May 2013

Slide 79

Slide 79 text

VARIANT CONTROL 42.2% Conversion 20% Better 35.1% Conversion Thursday, 23 May 2013

Slide 80

Slide 80 text

VARIANT WHY??? New LAYOUT New COPY New SOCIAL PROOF Thursday, 23 May 2013

Slide 81

Slide 81 text

VARIANT Visual Website Optimizer Experiments are additive #4 #3 Thursday, 23 May 2013

Slide 82

Slide 82 text

VARIANT #4 #3 Same content, just new layout Visual Website Optimizer #5 Thursday, 23 May 2013

Slide 83

Slide 83 text

Design only variant will increase conversion by 2% Falsifiable Hypothesis: ~ 2 hours to build & implement ~ 1,000 visitors per page Experiment Scope: Thursday, 23 May 2013

Slide 84

Slide 84 text

VARIANT 2 42.6% Conversion 44.5% Conversion CONTROL Thursday, 23 May 2013

Slide 85

Slide 85 text

INCREASE ACQUISITION SEO RANKING LANDING PAGE CONVERSION INBOUND CHANNELS # Depends on your resources & experiment scope Thursday, 23 May 2013

Slide 86

Slide 86 text

Thanks! [email protected] Setup a 1:1 meeting on Dashboard.io Thursday, 23 May 2013