Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Interventions in the Online Classroom
Search
Justin Cheng
May 29, 2014
Research
90
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Interventions in the Online Classroom
Presented at HCI Lunch in 2012.
Justin Cheng
May 29, 2014
More Decks by Justin Cheng
See All by Justin Cheng
Country Differences in Social Comparison on Social Media
jcccf
0
550
Understanding Perceptions of Problematic Facebook Use
jcccf
1
490
Do Diffusion Protocols Govern Cascade Growth?
jcccf
0
570
Antisocial Computing
jcccf
1
480
Antisocial Computing
jcccf
1
1.3k
Predicting Intent Using Activity Logs
jcccf
1
690
Anyone Can Become a Troll
jcccf
0
1.4k
Do Cascades Recur?
jcccf
3
750
Antisocial Behavior in Online Discussion Communities
jcccf
1
1.2k
Other Decks in Research
See All in Research
オンライン凸最適化の基礎とゲーム理論への応用 (IBIS 2026 チュートリアル)
taira_tsuchiya
2
1.4k
The Conductor Pattern -Multi-Granularity Feedback for Creative Agents-
shibuiwilliam
2
120
Kaggle|AI Agent Security — しくじり先生、俺みたいになるな
pomcho555
1
140
論文紹介: Understanding Epistemic Language with a Language-augmented Bayesian Theory of Mind
hisaokatsumi
0
210
Work in progress: How have changes in the labour market over the past decade affected attitudes to work?
resolutionfoundation
0
230
XDPerf: A High-Performance Traffic Generator Built with WASM and eBPF
takehaya
1
380
Adapter les bergeries aux fortes chaleurs
institutdelelevage
PRO
0
170
ふとした出会いで生まれたSkillが、 社内利用1位になるまで
mikimhk
22
25k
[UAI2026, Tutorial Talk] Tensor Networks for Density Estimation: The merits of low-rank structures, tractable inference, and uncertainty quantification
gkazunii
0
120
PHTalks Bengaluru - SSRF When All Else Fails
dk999
0
1.2k
Kunai: Toward a Verifier-Safe Layered DSL for Nested Encapsulation Packet Filtering on eBPF
takehaya
1
200
Top 4セキュリティ会議に一通り論文が採択されるまでの道のりと展望 / Top 4 Security Grand Slam
takaomurakami
0
1.1k
Featured
See All Featured
Java REST API Framework Comparison - PWX 2021
mraible
34
9.8k
The Art of Delivering Value - GDevCon NA Keynote
reverentgeek
16
2.2k
Max Prin - Stacking Signals: How International SEO Comes Together (And Falls Apart)
techseoconnect
PRO
0
520
The Director’s Chair: Orchestrating AI for Truly Effective Learning
tmiket
1
350
YesSQL, Process and Tooling at Scale
rocio
174
15k
Unlocking the hidden potential of vector embeddings in international SEO
frankvandijk
0
1k
Crafting Experiences
bethany
1
430
Sam Torres - BigQuery for SEOs
techseoconnect
PRO
0
610
Game over? The fight for quality and originality in the time of robots
wayneb77
1
330
The Invisible Side of Design
smashingmag
301
52k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
38
3.1k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
10
1.4k
Transcript
interventions NLINE CLASSROOM in the JUSTIN CHENG SCOTT KLEMMER CHINMAY
KULKARNI 1
How do we increase student retention in online classes? (Assignment
Completion) 2
Retention is important Interested students may need an additional push
to complete a course Important metric in measuring how engaging a class is 3
Sociality Feedback · Peer Assessment Individual / Group · Grades
· Action Plans · Contextual Hints · Commitment Contracts · Office Hours · Generic Hints · Personalized Email · 1-on-1 tutors Passive / Active · Co-located group work 4
Social Effects People are consistent in their actions [Cialdini ‘01]
People are influenced by what their friends do [Cialdini ‘07] – “Scott and 4 other friends completed this assignment” 5
6
Commitment Sign a commitment contract [Werner, et. al ‘95] A
small commitment followed by a larger one [Taylor & Booth-Butterfield ‘93] Bet on your success [Giné, et. Al ‘08] 7
We find that The effects of commitment is affected by
social influence Using checklists encourages task completion … 8
So what did we do? 9
Experimental Setup Conducted on Fall 2012 Stanford HCI Online class
Waitlist control to minimize participant backlash 10
Social Feedback / not Commitment / not Exp. 1 Social
Feedback + Commitment 2384 participants 2 x 2 conditions • How does social feedback and commitment affect student retention? • How do these interact with each other? 11
Exp. 1 Social Feedback + Commitment Both Social Feedback +
Commitment Condition “I’ve started button” + List of friends (on Announcements Page & Assignment Page) 12
Exp. 1 Social Feedback + Commitment Both Social Feedback +
Commitment Condition Email before due date - friends who’ve started Email after due date – see your friends’ work 13
Exp. 1 Social Feedback + Commitment Social Feedback Only Condition
List of friends (on Announcements Page & Assignment Page) Generic email before due date See friends’ work email after due date 14
Exp. 1 Social Feedback + Commitment Commitment Only Condition “I’ve
started” button (on Announcements Page & Assignment Page) Generic email before due date Generic email after due date 15
Exp. 1 Social Feedback + Commitment No Social, No Commitment
Condition 16
Exp. 2 Personalized & Generic Email Personalized Emails Generic Emails
No Email 1439 participants 3 conditions • Does sending emails affect retention? • Are personalized emails more effective than generic emails? 17
Exp. 2 Personalized & Generic Email Generic Email Condition Generic
encouragement Examples of good work 18
Exp. 2 Personalized & Generic Email Personalized Email Condition Number
of videos watched, quiz score reporting Use of student’s name Generic encouragement Examples of good work 19
Exp. 2 Personalized & Generic Email No Email Condition 20
Exp. 3 Action Plans Action Plans No Action Plans 1439
participants 2 conditions • Do interactive checklists help people complete assignments? 21
Exp. 3 Action Plans Interactive checklist at the top of
an assignment Inline step completion 22
Facebook Friends have no noticeable impact on retention 23
An “I’ve started” Button reduces assignment completion (and retention) 24
But both together increase completion! (p < 0.05) 25
Control Commitment 0 20 40 60 80 100 Control Social
Control Social social_feedback_condition count 26
Emails that we sent have no noticeable impact on retention
27
0 500 1000 None Generic Personalized intervention_condition count 28
But! Personalized Emails discourage people from clicking on examples! (p
< 0.05) Assignment Link Example Link Example Link 29
3 4 5 0 50 100 150 Generic Personalized Generic
Personalized Generic Personalized factor(intervention_condition) count 30
Action Plans increase assignment completion (and retention) (p < 0.05)
31
0 100 200 300 400 500 600 Control Action plan
Experimental condition Number of submissions 32
To conclude, Commitment goes hand-in-hand with social influence Action plans
or interactive assignments in general are promising 33
What’s next? What are other ways to increase retention? 34