Helpfulness Measure

Transcript

1. 06/11/2013 Introducing a Better Helpfulness Measure 1 Exchange Squad
2. The Epic Bringing people to more helpful information & allowing them to rate their content based on how helpful they found it.
3. 3 Why do we need a helpfulness measure? Ranking pieces of advice as helpful is one the main reinforcement mechanisms that encourages users to write more & answer questions with better advice and thoughtful insights. As a result, incorporating a helpfulness tool will also filter out the good content from the poor quality content.
4. 4 What’s wrong with the current one? - Data isn’t being tracked - It’s not much of a factor when browsing for the best pieces of advice - Users aren’t notified when they get an upvote - It doesn’t rank the best content in any way.
5. 5 How do we weigh advice from reputable members vs new users? i.e. Meredith Wood vs New user that joined 4 mins ago Users should be rewarded for contributing great advice in the past. We will need to find a ranking algorithm that helps our top users get their content pushed higher. • Answers with more upvotes are ranked higher. • Answers with more downvotes are ranked lower. • A vote from a user who has written good answers in the past carries more weight (both upvotes and downvotes). • Answers written by users who have written good answers in the past will be ranked higher. • Votes from people detected to be gaming the system (vote collusion, spam, bullying, etc.) will be ignored or minimized. This is also against policy and may result in a ban. • Whether a user is an admin or reviewer does not affect the scores in this system. The basics of Quora’s PeopleRanking algorithm
6. 6 Competition should not be a factor for great content. Users should be incentivized to post good quality advice and content to benefit the community and expand the knowledge of new and existing members. They should not want to post purely to increase their helpfulness measure as a popularity tool.
7. 7 Isolating advice & comments https://www.openforum.com/question/if-you-could-only-use-one-social-media-platform-to- promote-your-small-business-which-one-would-it-be/ We currently keep advice & comments on the same level. The above link is a great example of a post with a lot of contribution and discussion from members. However it’s very difficult to find the best answers when there’s so much discussion happening around it. How can we separate this better? How does Quora solve for this? They simply implemented a “Thanks” button. Example: The word thanks appears in this thread 19 times. This would be a comment, not advice. Example of a comment on the above OPEN Forum thread
8. Ranking Systems 8
9. Up/Down Voting quora reddit stackoverflow
10. Numerical Rating IMDb Wong-Baker Pain Rating Scale
11. Poll forrst
12. Emotion based storylane buzzfeed
13. User Stories 13
14. As a user I would like to mark advice and answers as helpful so that I can help other members locate the best piece of advice. quora reddit stackoverflow
15. As a user I want to know what the members I’m following marked as helpful so that I can see what people I follow find interesting. quora
16. As a user I would like to see quality content first in the content detail page so that I can find the best answers easier. amazon branch yelp
17. As a user I would like other members to know what I rated as helpful so that they may be more inclined to read the post. facebook quora
18. As a user I would like to give members feedback on why I voted their content a certain way so that I can help them produce more appropriate content in the future. forrst open forum wireframe open forum wireframe
19. As a user I would like to be notified when my advice or post has been rated unhelpful by another member. forrst
20. As a user I would like to see the amount of times a piece of advice has been rated helpful, but not unhelpful. quora reddit stackoverflow
21. As a user I would like to select the piece of advice that solved my question so other users can easily identify which advice worked for me. apple discussions forum
22. Benchmarks
23. As a user I would like to be pointed towards helpful content if I find something unhelpful. branch open forum wireframe
24. As a user I would like to be rewarded for submitting content that has been rated very helpful. reddit stackoverflow quora
25. As a moderator I would like to reward the top contributors in specific industries/topics so that other forum members will know which experts to reach out to for advice linkedin
26. As a user I would like to see content organized by how helpful it is. Additionally, I would like to sort content by helpful, active and recency as well. stackoverflow
27. As a user I would like to highlight specific parts of advice posts so that other members can know what parts were helpful. branch
28. As a user I would like private statistics so that I can see how my content is being received throughout the community. dribbble