Slide 1

Slide 1 text

Transitioning to Lean @DhruvBansal @JimEngland @TimGasper

Slide 2

Slide 2 text

We’re in a predicament with DATA.

Slide 3

Slide 3 text

DATA is the raw materials

Slide 4

Slide 4 text

DATA involves many markets and data types

Slide 5

Slide 5 text

DATA involves a wide variety of customers in undefined markets

Slide 6

Slide 6 text

how does Infochimps fit into the data landscape?

Slide 7

Slide 7 text

Data marketplace Social media influence IP intelligence Geolocated data our existing products

Slide 8

Slide 8 text

Our lean mission is to determine solutions to must-have problems for sizable markets.

Slide 9

Slide 9 text

foursquare data derivatives social media solutions new product hypotheses

Slide 10

Slide 10 text

No content

Slide 11

Slide 11 text

We have a significant portion of the foursquare check-in firehose.

Slide 12

Slide 12 text

HYPOTHESIS FOURSQUARE DEVS Want venue hotness and venue ID matching for their applications.

Slide 13

Slide 13 text

How many 4sq devs are there?

Slide 14

Slide 14 text

How many would pay?

Slide 15

Slide 15 text

HYPOTHESIS DIGITAL AGENCIES Want venue hotness and brand comparisons for their clients.

Slide 16

Slide 16 text

How many brands want 4sq metrics?

Slide 17

Slide 17 text

How many would pay?

Slide 18

Slide 18 text

Must have Nice to have Don’t need

Slide 19

Slide 19 text

No content

Slide 20

Slide 20 text

No content

Slide 21

Slide 21 text

No content

Slide 22

Slide 22 text

killing a feature is just as important as building one :)

Slide 23

Slide 23 text

Social media data

Slide 24

Slide 24 text

DEVELOPERS Wanted detailed and transparent influence metrics and rankings.

Slide 25

Slide 25 text

trstrank

Slide 26

Slide 26 text

HYPOTHESIS DIGITAL AGENCIES Want detailed and transparent influence metrics and rankings.

Slide 27

Slide 27 text

interviews later... 15+

Slide 28

Slide 28 text

Digital agencies actually wanted analytics research tools and dashboards.

Slide 29

Slide 29 text

No content

Slide 30

Slide 30 text

That’s not our market. That’s not a feature set we’ve ever built. Leverages stuff we know, but little of what we’ve built. Sends the company in a very different direction. PROBLEMS

Slide 31

Slide 31 text

you’ve found a market and a product; should you build it?

Slide 32

Slide 32 text

Learn from and measure what you already have. Diagnose whether to pivot or persevere.

Slide 33

Slide 33 text

Product Strategy Vision Optimization Pivot

Slide 34

Slide 34 text

You shouldn’t define where to pivot to unless you know why you should pivot.

Slide 35

Slide 35 text

You can only know why if... 1 2 3 4

Slide 36

Slide 36 text

Clearly defined hypotheses. 1 2 Clearly defined actionable metrics. vs. vanity metrics

Slide 37

Slide 37 text

You’ve been experimenting and optimizing. 3 4 The experimenting and optimizing still has you short of your goals of creating a sustainable business.

Slide 38

Slide 38 text

Pivots are a change in strategy. The lean canvas provides a powerful strategy framework.

Slide 39

Slide 39 text

ERIC RIES STRATEGY Product roadmap Customer definition Partners & competitors Business model ASH MAURYA LEAN CANVAS Problem, solution & key metrics Customer segments & channels Value proposition, unfair competitive advantage Cost structure & revenue streams

Slide 40

Slide 40 text

the bottom line

Slide 41

Slide 41 text

Lean is more straightforward if you start with it from the beginning. If you haven’t been lean, you must revisit the past.

Slide 42

Slide 42 text

Move through the loop faster.

Slide 43

Slide 43 text

data web

Slide 44

Slide 44 text

TWO USE CASES, ONE WEBSITE developers data scientists

Slide 45

Slide 45 text

DATA SCIENTISTS business analysts, marketers, consultants, economists, statisticians, etc.

Slide 46

Slide 46 text

We provide data scientists access to data through downloadable data sets.

Slide 47

Slide 47 text

We provide developers access to data through RESTful APIs.

Slide 48

Slide 48 text

DATA SCIENTISTS? NO PROBLEM Downloadable data sets follow a typical web flow

Slide 49

Slide 49 text

homepage data set page search results blog twitter signup download

Slide 50

Slide 50 text

MULTI-STEP

Slide 51

Slide 51 text

DEVELOPERS? IT’S COMPLICATED API usage funnel involves many steps and is more difficult to track & define

Slide 52

Slide 52 text

homepage data set page search results blog twitter signup

Slide 53

Slide 53 text

new developer

Slide 54

Slide 54 text

new developer

Slide 55

Slide 55 text

active developer

Slide 56

Slide 56 text

A developer becomes active when they send over 1,000 API calls per month.

Slide 57

Slide 57 text

How do we convert a developer to an active developer?

Slide 58

Slide 58 text

HOWTOs CODE EXAMPLES

Slide 59

Slide 59 text

No content

Slide 60

Slide 60 text

DATA SET PAGES API REFERENCE

Slide 61

Slide 61 text

No content

Slide 62

Slide 62 text

homepage data set page search results blog twitter signup howto guide code example api reference data set page search results active user

Slide 63

Slide 63 text

PLUS

Slide 64

Slide 64 text

We need to connect user activity on the website with user activity on our APIs. TECHNICAL PROBLEM

Slide 65

Slide 65 text

GOOGLE ANALYTICS CUSTOM VARIABLES TO THE RESCUE SOLUTION

Slide 66

Slide 66 text

We use Google Analytics to track visitor behavior on our websites.

Slide 67

Slide 67 text

There are a lot of other options • Cookie, JS-based data collection • No servers to maintain • APIs for reports •Without JS, client-side behavior is a mystery •Lots of work •Potentially awesome

Slide 68

Slide 68 text

Web Data One identity is known to us. The other is known to Google.

Slide 69

Slide 69 text

? Web Data

Slide 70

Slide 70 text

Google stores 3 cookies: VISITOR expires after 2 years SESSION expires after 30 minutes PAGE set on every pageview

Slide 71

Slide 71 text

No content

Slide 72

Slide 72 text

Username First seen at Segment Original traffic source Milestones • Signed up • Downloaded • Searched • Bought • Queried Visitor Variables Milestones • Signed up • Downloaded • Searched • Bought • Queried Session Variables Category Completeness Pricing Distribution Page Variables

Slide 73

Slide 73 text

CUSTOM VARIABLES

Slide 74

Slide 74 text

Visitor Variables c=201110;ms=dev;ds=1;sd=1;u=dhruv First seen in October, 2011 (c) Is a developer (ms) Has seen a dataset (ds) Has done a search (sd) Username is ‘dhruv’ (u)

Slide 75

Slide 75 text

WE CAN GET THIS DATA OVER THE WEB.

Slide 76

Slide 76 text

WE CAN GET THIS DATA THROUGH AN API.

Slide 77

Slide 77 text

Web Data

Slide 78

Slide 78 text

developers developers developers developers

Slide 79

Slide 79 text

The web team’s goal is to increase the number of active API users. But we don’t have a traditional funnel for converting these users.

Slide 80

Slide 80 text

So, we started by focusing on the overall site experience for developers.

Slide 81

Slide 81 text

No content

Slide 82

Slide 82 text

No content

Slide 83

Slide 83 text

No content

Slide 84

Slide 84 text

to Lean TRANSITIONING

Slide 85

Slide 85 text

We haven’t run any experiments on the website... yet.

Slide 86

Slide 86 text

web experiments brainstorm

Slide 87

Slide 87 text

Developer-centric email campaigns 1

Slide 88

Slide 88 text

Improved “getting started” dashboard 2 http://twilio.com/user/account

Slide 89

Slide 89 text

Improved search experience 3

Slide 90

Slide 90 text

thank you @DhruvBansal @JimEngland @TimGasper