Slide 1

Slide 1 text

Measuring Design Success Sameer Bhiwani @sambert bruno murai

Slide 2

Slide 2 text

No content

Slide 3

Slide 3 text

No content

Slide 4

Slide 4 text

No content

Slide 5

Slide 5 text

No content

Slide 6

Slide 6 text

Sleep

Slide 7

Slide 7 text

unsplash.com rocks!

Slide 8

Slide 8 text

www.flickr.com/photos/ruralgeek/2215424639

Slide 9

Slide 9 text

What % of 
 your dreams are nightmares?

Slide 10

Slide 10 text

What % of 
 a blind person’s dreams 
 are nightmares?

Slide 11

Slide 11 text

your nightmares > blind person’s nightmares raise hand

Slide 12

Slide 12 text

your nightmares < blind person’s nightmares stand

Slide 13

Slide 13 text

Why? theories

Slide 14

Slide 14 text

blind person’s nightmares 4x of your nightmares fact

Slide 15

Slide 15 text

Why? theories

Slide 16

Slide 16 text

I never guess. 
 It is a capital mistake to 
 theorise before one has data. 
 Insensibly, one begins to 
 twist facts to suit theories, 
 instead of theories to suit facts. Sir Arthur Conan Doyle,
 Author of Sherlock Holmes stories

Slide 17

Slide 17 text

No content

Slide 18

Slide 18 text

Before we begin…

Slide 19

Slide 19 text

1. Case Studies 2. 4 Point Framework 3. Hands-on Activity 4. Discussion

Slide 20

Slide 20 text

Case study from Jared Spool

Slide 21

Slide 21 text

One small change

Slide 22

Slide 22 text

45% More purchases 15 Million More revenue in the first month 300 Million More revenue in first year

Slide 23

Slide 23 text

The 300 million dollar button

Slide 24

Slide 24 text

Sales?

Slide 25

Slide 25 text

Design?

Slide 26

Slide 26 text

Satisfaction?

Slide 27

Slide 27 text

Customer Metrics

Slide 28

Slide 28 text

Customer Metrics Customer Needs

Slide 29

Slide 29 text

Business Metrics

Slide 30

Slide 30 text

Business Metrics Business Needs

Slide 31

Slide 31 text

No content

Slide 32

Slide 32 text

No content

Slide 33

Slide 33 text

No content

Slide 34

Slide 34 text

Design is the bridge

Slide 35

Slide 35 text

1. Get the facts 2. Measure Measure Measure

Slide 36

Slide 36 text

Measuring Design Success

Slide 37

Slide 37 text

Measuring Design Success

Slide 38

Slide 38 text

Measuring Design Success

Slide 39

Slide 39 text

Measuring Design Success

Slide 40

Slide 40 text

What

Slide 41

Slide 41 text

Why

Slide 42

Slide 42 text

When

Slide 43

Slide 43 text

What you get

Slide 44

Slide 44 text

What you don’t get

Slide 45

Slide 45 text

Theorise!

Slide 46

Slide 46 text

BlueJeans Case Study

Slide 47

Slide 47 text

Primetime 
 Online Video Events

Slide 48

Slide 48 text

Primetime 
 Executive All Hands

Slide 49

Slide 49 text

Primetime 
 Marketing Webinars

Slide 50

Slide 50 text

Primetime 
 Athletes and fans

Slide 51

Slide 51 text

No content

Slide 52

Slide 52 text

Crowded Out of sequence Untracked

Slide 53

Slide 53 text

Dedicated Q&A Section

Slide 54

Slide 54 text

No content

Slide 55

Slide 55 text

Measure Q&A Success

Slide 56

Slide 56 text

1 Define goal

Slide 57

Slide 57 text

2 Define Success

Slide 58

Slide 58 text

3 Ask Questions

Slide 59

Slide 59 text

4 List Measurements

Slide 60

Slide 60 text

1. Define goal 2. Define success 3. Ask questions 4. List measurements

Slide 61

Slide 61 text

Goal Success Questions Measurements

Slide 62

Slide 62 text

Goal 1. Move questions out of chat 2. Respond to questions 3. Improve engagement

Slide 63

Slide 63 text

Success 1. Fewer questions on chat 2. Presenters answering questions

Slide 64

Slide 64 text

Questions 1. As Q&A usage picks up, do ‘questions’ on chat reduce? 2. Are all questions answered? How soon? 3. Do people who ask questions engage more?

Slide 65

Slide 65 text

Measurements 1. Chat usage 2. Q&A Usage 3. Compare to attendees to get ratio 4. Q&A usage behaviour

Slide 66

Slide 66 text

No content

Slide 67

Slide 67 text

Break

Slide 68

Slide 68 text

Let’s Dance!

Slide 69

Slide 69 text

s

Slide 70

Slide 70 text

1. Create a post

Slide 71

Slide 71 text

2. Full create dialog

Slide 72

Slide 72 text

3. Background

Slide 73

Slide 73 text

4. Feeling/Activity

Slide 74

Slide 74 text

5. Check-in Location

Slide 75

Slide 75 text

6. Tag friend

Slide 76

Slide 76 text

7. Sticker

Slide 77

Slide 77 text

8. Post text

Slide 78

Slide 78 text

9. Emoji

Slide 79

Slide 79 text

10. Post visibility

Slide 80

Slide 80 text

3 Goals Each Post-its 2 min

Slide 81

Slide 81 text

Vote with dots 5 min

Slide 82

Slide 82 text

2 Goals Measures 3 Success Criteria 5 Questions

Slide 83

Slide 83 text

Top 2 on chart 1 min

Slide 84

Slide 84 text

Discuss + write 3 success criteria 5 min

Slide 85

Slide 85 text

Discuss + write 5 questions 10 min

Slide 86

Slide 86 text

2 screens each

Slide 87

Slide 87 text

1 measure each 10 min

Slide 88

Slide 88 text

Discard Blanks

Slide 89

Slide 89 text

Top 3 on chart 5 min

Slide 90

Slide 90 text

Present! 2+1 min each

Slide 91

Slide 91 text

Interpretation

Slide 92

Slide 92 text

Goal Success Questions Measurements

Slide 93

Slide 93 text

~ fin ~ @sambert