• Formative evaluation • 11 interviews over 2 weeks • Subjects are power-users • All data is self- reported • Focus on process of creating a course INTERVIEWS
TIMEFRAMES 4 2 4 n=11 3 3 5 60% of folks take 2 weeks+ to develop courses Users iterate quite a bit: 72% visit P2PU 21 times or more over development 45% are on P2PU.org constantly over development
TOOLS USED IN COURSE DEVELOPMENT Why Etherpad? • “The P2PU website did not seem to be a place where you batted around ideas” • “There was nowhere to draft a course.” • “Feel like there’s a social aspect that’s missing--quick communication with people.” (n=11) Tools that support co-creation of content were most frequently cited (Etherpad, Googledocs) Only one respondent worked entirely in P2PU.org for course development Means our users are doing *a lot* of copying and pasting...bummer.
• How many people did you work with on your P2PU course? • Answer includes respondent COLLABORATIVE WORK 25 15 6 3 2 6 2 2 1 1 1 Mean= 5.81 Median= 2 Mode= 2 Most course organizers (81%) develop courses in collaboration with others
USERTESTING.COM SCREENCASTS • 3 users asked to create a course from scratch and publish • Note: we are being tested against Watch results: • User 1: https://www.usertesting.com/videos/42K77HnmZFA%3d • User 2: https://www.usertesting.com/videos/hS5QE8b0WtA%3d • User 3: https://www.usertesting.com/videos/H%2b1aF %2bmmBtc%3d
• Design course creation to look & feel like actually *being* in the course • Hover commands or a shadowbox to help the user (disappears upon 2nd sign in) • Support features that help users iterate (incremental save, improve text editor) • Bump up collaborative editing feature to support co-creation of content RECOMMENDATIONS
RECOMMENDATIONS: CREATE COURSE 1 I’m a Course Title: Fill Me in with a Zippy Title! Home > Learn > Course Title Home Page I’m a Task: Fill Me In With What You’d Like Folks to do First I’m a subtitle: fill me in with a bit more description & context. I’m a Task: Fill Me In With What You’d Like Folks to do Second I’m a subtitle: fill me in with a bit more description & context. Next Step: Ask for Community Review New task Course Organizer Bio: I am into Religious Studies and Anthropology and am a freak about research, fact checking, and curating content. I write the internet, maybe you have read it? Christopher Crawford Start Course Course Home Invite Collaborators Admin Course
I’m a Course Title: Fill Me in with a Zippy Title! Home > Learn > Course Title Home Page I’m a Task: Fill Me In With What You’d Like Folks to do First I’m a subtitle: fill me in with a bit more description & context. I’m a Task: Fill Me In With What You’d Like Folks to do Second I’m a subtitle: fill me in with a bit more description & context. Next Step: Ask for Community Review New task Course Organizer Bio: I am into Religious Studies and Anthropology and am a freak about research, fact checking, and curating content. I write the internet, maybe you have read it? Christopher Crawford Start Course Course Home Invite Collaborators Admin Course RECOMMENDATIONS: CREATE COURSE 2 Directly edit text inline, which autosaves Add organizer bio Move in-course nav to all flesh right, add invite/share Move “new task” button to where users need it Include Community Review Step
I’m a Course Title: Fill Me in with a Zippy Title! Home > Learn > Course Title Home Page I’m a Task: Fill Me In With What You’d Like Folks to do First I’m a subtitle: fill me in with a bit more description & context. I’m a Task: Fill Me In With What You’d Like Folks to do Second I’m a subtitle: fill me in with a bit more description & context. Next Step: Ask for Community Review New task Course Organizer Bio: I am into Religious Studies and Anthropology and am a freak about research, fact checking, and curating content. I write the internet, maybe you have read it? Christopher Crawford Start Course Course Home Invite Collaborators Admin Course RECOMMENDATIONS: CREATE COURSE 3 Start by giving your course a name Then add a photo Begin to fill in the tasks for your course Create more tasks as you see fit When you’re at a point you’re happy with, ask for Community Review See all tasks Share & invite collaborators Give feedback Tweak under the hood
RECOMMENDATIONS: CREATE COURSE 4 I’m a Course Title: Fill Me in with a Zippy Title! Home > Learn > Course Title Home Page I’m a Task: Fill Me In With What You’d Like Folks to do First I’m a subtitle: fill me in with a bit more description & context. I’m a Task: Fill Me In With What You’d Like Folks to do Second I’m a subtitle: fill me in with a bit more description & context. New task Course Organizer Bio: I am into Religious Studies and Anthropology and am a freak about research, fact checking, and curating content. I write the internet, maybe you have read it? Christopher Crawford Start Course Course Home Invite Collaborators Admin Course Last Step: Open for Signup
• Community review & testing • Add advice on learning theory to the copy • Integrate with Dirk’s “unification” plan • Next study: mental model research on *why* people create courses • Raw data is up on Googledocs: http://ow.ly/dujBH • Direct feedback to community list or to [email protected] • Thanks to usertesting.com for comping the tests! NEXT STEPS Vanessa Gennarelli @mozzadrella CC-BY
mozzadrella
greensmile
uzabase
hiranotomoki
linewofficial
nttcom
ozontech
rasagy
akinen
fujiiitakarin
sysbird
kasikasikasi
yuyaink
addyosmani
jasonvnalue
tmm1
robhawkes
paulrobertlloyd
colly
gr2m
thekraken
mthomps
mza
trallard
iamctodd