Design Research: P2PU.org's Course Creation Flow

User interviews and usertesting.com caps on p2pu.org's course creation process, mockups and recommendations for improved experience.

Transcript

1. • Mission! • Tools & Methods • Interviews • User Testing Screencasts • Recommendations DESIGN RESEARCH: COURSE CREATION Vanessa Gennarelli @mozzadrella CC-BY
2. • P2PU <3 course creators • Align our design with human behavior MISSION!
3. • Interviews with our totally rad power users • 3 screencasts with usability testing tool usertesting.com: http:// www.usertesting.com/ TOOLS & METHODS ?
4. • Formative evaluation • 11 interviews over 2 weeks • Subjects are power-users • All data is self- reported • Focus on process of creating a course INTERVIEWS
5. GENERAL BACKGROUND Individual Community Members n=11 Mean= 9.45 courses Median= 6 courses Mode= 6 courses Mean= 23 months Median=18 months Mode= 36 months
6. TIMEFRAMES n=11 3 3 5 4 2 4
7. TIMEFRAMES 4 2 4 n=11 3 3 5 60% of folks take 2 weeks+ to develop courses Users iterate quite a bit: 72% visit P2PU 21 times or more over development 45% are on P2PU.org constantly over development
8. TOOLS USED IN COURSE DEVELOPMENT (n=11) • Users asked to list tools used over the development of their course
9. TOOLS USED IN COURSE DEVELOPMENT Why Etherpad? • “The P2PU website did not seem to be a place where you batted around ideas” • “There was nowhere to draft a course.” • “Feel like there’s a social aspect that’s missing--quick communication with people.” (n=11) Tools that support co-creation of content were most frequently cited (Etherpad, Googledocs) Only one respondent worked entirely in P2PU.org for course development Means our users are doing *a lot* of copying and pasting...bummer.
10. • How many people did you work with on your P2PU course? • Answer includes respondent COLLABORATIVE WORK 25 15 6 3 2 6 2 2 1 1 1
11. • How many people did you work with on your P2PU course? • Answer includes respondent COLLABORATIVE WORK 25 15 6 3 2 6 2 2 1 1 1 Mean= 5.81 Median= 2 Mode= 2 Most course organizers (81%) develop courses in collaboration with others
12. USERTESTING.COM SCREENCASTS • 3 users asked to create a course from scratch and publish • Note: we are being tested against Watch results: • User 1: https://www.usertesting.com/videos/42K77HnmZFA%3d • User 2: https://www.usertesting.com/videos/hS5QE8b0WtA%3d • User 3: https://www.usertesting.com/videos/H%2b1aF %2bmmBtc%3d
13. • Design course creation to look & feel like actually *being* in the course • Hover commands or a shadowbox to help the user (disappears upon 2nd sign in) • Support features that help users iterate (incremental save, improve text editor) • Bump up collaborative editing feature to support co-creation of content RECOMMENDATIONS
14. RECOMMENDATIONS: CREATE COURSE 1 I’m a Course Title: Fill Me in with a Zippy Title! Home > Learn > Course Title Home Page I’m a Task: Fill Me In With What You’d Like Folks to do First I’m a subtitle: fill me in with a bit more description & context. I’m a Task: Fill Me In With What You’d Like Folks to do Second I’m a subtitle: fill me in with a bit more description & context. Next Step: Ask for Community Review New task Course Organizer Bio: I am into Religious Studies and Anthropology and am a freak about research, fact checking, and curating content. I write the internet, maybe you have read it? Christopher Crawford Start Course Course Home Invite Collaborators Admin Course
15. I’m a Course Title: Fill Me in with a Zippy Title! Home > Learn > Course Title Home Page I’m a Task: Fill Me In With What You’d Like Folks to do First I’m a subtitle: fill me in with a bit more description & context. I’m a Task: Fill Me In With What You’d Like Folks to do Second I’m a subtitle: fill me in with a bit more description & context. Next Step: Ask for Community Review New task Course Organizer Bio: I am into Religious Studies and Anthropology and am a freak about research, fact checking, and curating content. I write the internet, maybe you have read it? Christopher Crawford Start Course Course Home Invite Collaborators Admin Course RECOMMENDATIONS: CREATE COURSE 2 Directly edit text inline, which autosaves Add organizer bio Move in-course nav to all flesh right, add invite/share Move “new task” button to where users need it Include Community Review Step
16. I’m a Course Title: Fill Me in with a Zippy Title! Home > Learn > Course Title Home Page I’m a Task: Fill Me In With What You’d Like Folks to do First I’m a subtitle: fill me in with a bit more description & context. I’m a Task: Fill Me In With What You’d Like Folks to do Second I’m a subtitle: fill me in with a bit more description & context. Next Step: Ask for Community Review New task Course Organizer Bio: I am into Religious Studies and Anthropology and am a freak about research, fact checking, and curating content. I write the internet, maybe you have read it? Christopher Crawford Start Course Course Home Invite Collaborators Admin Course RECOMMENDATIONS: CREATE COURSE 3 Start by giving your course a name Then add a photo Begin to fill in the tasks for your course Create more tasks as you see fit When you’re at a point you’re happy with, ask for Community Review See all tasks Share & invite collaborators Give feedback Tweak under the hood
17. RECOMMENDATIONS: CREATE COURSE 4 I’m a Course Title: Fill Me in with a Zippy Title! Home > Learn > Course Title Home Page I’m a Task: Fill Me In With What You’d Like Folks to do First I’m a subtitle: fill me in with a bit more description & context. I’m a Task: Fill Me In With What You’d Like Folks to do Second I’m a subtitle: fill me in with a bit more description & context. New task Course Organizer Bio: I am into Religious Studies and Anthropology and am a freak about research, fact checking, and curating content. I write the internet, maybe you have read it? Christopher Crawford Start Course Course Home Invite Collaborators Admin Course Last Step: Open for Signup
18. • Community review & testing • Add advice on learning theory to the copy • Integrate with Dirk’s “unification” plan • Next study: mental model research on *why* people create courses • Raw data is up on Googledocs: http://ow.ly/dujBH • Direct feedback to community list or to vanessa@p2pu.org • Thanks to usertesting.com for comping the tests! NEXT STEPS Vanessa Gennarelli @mozzadrella CC-BY