Measuring Design Success

As designers create various flows and visualisations to support the goals of the business and users, there is a need to measure the specific actions and interactions with a view to improve them and make them more effective.
These are the slides from a workshop I conducted for HelloMeets on 20-MAY-2017 to walk attendees through the process of defining goals, success criteria, asking questions and listing the measurements to answer those questions and see if they are succeeding.

Transcript

1. Measuring Design Success Sameer Bhiwani @sambert bruno murai
6. Sleep
7. unsplash.com rocks!
8. www.flickr.com/photos/ruralgeek/2215424639
9. What % of 
 your dreams are nightmares?
10. What % of 
 a blind person’s dreams 
 are nightmares?
11. your nightmares > blind person’s nightmares raise hand
12. your nightmares < blind person’s nightmares stand
13. Why? theories
14. blind person’s nightmares 4x of your nightmares fact
15. Why? theories
16. I never guess. 
 It is a capital mistake to 
 theorise before one has data. 
 Insensibly, one begins to 
 twist facts to suit theories, 
 instead of theories to suit facts. Sir Arthur Conan Doyle,
 Author of Sherlock Holmes stories
18. Before we begin…
19. 1. Case Studies 2. 4 Point Framework 3. Hands-on Activity 4. Discussion
20. Case study from Jared Spool
21. One small change
22. 45% More purchases 15 Million More revenue in the first month 300 Million More revenue in first year
23. The 300 million dollar button
24. Sales?
25. Design?
26. Satisfaction?
27. Customer Metrics
28. Customer Metrics Customer Needs
29. Business Metrics
30. Business Metrics Business Needs
34. Design is the bridge
35. 1. Get the facts 2. Measure Measure Measure
36. Measuring Design Success
37. Measuring Design Success
38. Measuring Design Success
39. Measuring Design Success
40. What
41. Why
42. When
43. What you get
44. What you don’t get
45. Theorise!
46. BlueJeans Case Study
47. Primetime 
 Online Video Events
48. Primetime 
 Executive All Hands
49. Primetime 
 Marketing Webinars
50. Primetime 
 Athletes and fans
52. Crowded Out of sequence Untracked
53. Dedicated Q&A Section
55. Measure Q&A Success
56. 1 Define goal
57. 2 Define Success
58. 3 Ask Questions
59. 4 List Measurements
60. 1. Define goal 2. Define success 3. Ask questions 4. List measurements
61. Goal Success Questions Measurements
62. Goal 1. Move questions out of chat 2. Respond to questions 3. Improve engagement
63. Success 1. Fewer questions on chat 2. Presenters answering questions
64. Questions 1. As Q&A usage picks up, do ‘questions’ on chat reduce? 2. Are all questions answered? How soon? 3. Do people who ask questions engage more?
65. Measurements 1. Chat usage 2. Q&A Usage 3. Compare to attendees to get ratio 4. Q&A usage behaviour
67. Break
68. Let’s Dance!
69. s
70. 1. Create a post
71. 2. Full create dialog
72. 3. Background
73. 4. Feeling/Activity
74. 5. Check-in Location
75. 6. Tag friend
76. 7. Sticker
77. 8. Post text
78. 9. Emoji
79. 10. Post visibility
80. 3 Goals Each Post-its 2 min
81. Vote with dots 5 min
82. 2 Goals Measures 3 Success Criteria 5 Questions
83. Top 2 on chart 1 min
84. Discuss + write 3 success criteria 5 min
85. Discuss + write 5 questions 10 min
86. 2 screens each
87. 1 measure each 10 min
88. Discard Blanks
89. Top 3 on chart 5 min
90. Present! 2+1 min each
91. Interpretation
92. Goal Success Questions Measurements
93. ~ fin ~ @sambert