Interdisciplinary Frontiers in Affective Health & Communication

Job Talk Slides from Jeffrey M. Girard, Phd (Carnegie Mellon University)

Transcript

1. Interdisciplinary Frontiers in Affective Health & Communication Jeffrey Girard, PhD
2. Communicative Behavior Connects Us
3. Affective Communication Matters
4. My Research Framework
5. My Research Framework
6. Presentation Roadmap
7. Measuring Facial Behavior • Girard & Cohn (2011) ICCV • Jeni, Girard, Cohn, & De la Torre (2013) AFGR • Girard et al. (2015) AFGR • Girard et al. (2015) Pattern Recognition Letters • Girard et al. (2015) Behavior Research Methods • Valstar, Almaev, Girard, et al. (2015) AFGR • Valstar et al. (2017) AFGR • Cohn et al. (2019) Multimodal behavior analysis
8. Measuring Behavior is Difficult Behavioral Rating Scales Facial Action Coding System
9. Perhaps Computer Science Can Help
10. Facial Landmark Tracking
11. Computerized Action Unit Estimation
12. Gender, Culture, and Smiling • McDuff, Girard, Kaliouby (2017) J. Nonverbal Behavior • Girard & McDuff (2017) AFGR • McDuff & Girard (2019) ACII • Girard & McDuff (in prep.) {Nature Human Behavior}
13. Gender, Culture, and Smiling
14. Smiling in Market Research Settings
15. Smiling Rates in Different Countries
16. Sociocultural Hypotheses Country’s citizen average on questionnaire (Hofstede Dimension Matrix: 1980–2015) Country’s number of immigration sources (World Migration Matrix: 1500–2000)
17. Multilevel Hypothesis Testing Parameter Est. p-val. 2.27 < .001 0.40 .506 0.63 .025 0.15 .673 × −0.06 .869 × 0.37 .014 × 0.13 .440
18. Multilevel Hypothesis Testing Parameter Est. p-val. 2.27 < .001 0.40 .506 0.63 .025 0.15 .673 × −0.06 .869 × 0.37 .014 × 0.13 .440
19. Automatic Assessment of Depression • Girard et al. (2013) AFGR • Girard et al. (2014) Image & Vision Computing • Girard & Cohn (2015) Current Opinion in Psychology • Girard & Cohn (2020) What the face reveals 3rd Ed.
20. Automatic Assessment of Depression 32 6 31 9 10 8 13 20 14 15 19 21 18 7 Time 1 Time 2 Facial Actions Head Motion Symptoms
21. Facial Affect in Depression Automated vs. Expert Coding = 0.90, 95% CI: [0.87, 0.93] NRMSE = 0.119 MAE = 0.076
22. Head Motion in Depression Amplitude: Velocity:
23. Next Steps: Clinical Assessment Computerized Screening Psychotherapy Process
24. Primary Collaborators • • • • • • • Sources of Research Funding • • • Acknowledgments