Interdisciplinary Frontiers in Affective Health & Communication

Transcript

1. Interdisciplinary Frontiers in Affective Health & Communication Jeffrey Girard, PhD

2. Communicative Behavior Connects Us

3. Affective Communication Matters

4. My Research Framework

5. My Research Framework

6. Presentation Roadmap

7. Measuring Facial Behavior • Girard & Cohn (2011) ICCV •

   Jeni, Girard, Cohn, & De la Torre (2013) AFGR • Girard et al. (2015) AFGR • Girard et al. (2015) Pattern Recognition Letters • Girard et al. (2015) Behavior Research Methods • Valstar, Almaev, Girard, et al. (2015) AFGR • Valstar et al. (2017) AFGR • Cohn et al. (2019) Multimodal behavior analysis

8. Measuring Behavior is Difficult Behavioral Rating Scales Facial Action Coding

   System

9. Perhaps Computer Science Can Help

10. Facial Landmark Tracking

11. Computerized Action Unit Estimation

12. Gender, Culture, and Smiling • McDuff, Girard, Kaliouby (2017) J.

    Nonverbal Behavior • Girard & McDuff (2017) AFGR • McDuff & Girard (2019) ACII • Girard & McDuff (in prep.) {Nature Human Behavior}

13. Gender, Culture, and Smiling

14. Smiling in Market Research Settings

15. Smiling Rates in Different Countries

16. Sociocultural Hypotheses Country’s citizen average on questionnaire (Hofstede Dimension Matrix:

    1980–2015) Country’s number of immigration sources (World Migration Matrix: 1500–2000)

17. Multilevel Hypothesis Testing Parameter Est. p-val. 2.27 < .001 0.40

    .506 0.63 .025 0.15 .673 × −0.06 .869 × 0.37 .014 × 0.13 .440

18. Multilevel Hypothesis Testing Parameter Est. p-val. 2.27 < .001 0.40

    .506 0.63 .025 0.15 .673 × −0.06 .869 × 0.37 .014 × 0.13 .440

19. Automatic Assessment of Depression • Girard et al. (2013) AFGR

    • Girard et al. (2014) Image & Vision Computing • Girard & Cohn (2015) Current Opinion in Psychology • Girard & Cohn (2020) What the face reveals 3rd Ed.

20. Automatic Assessment of Depression 32 6 31 9 10 8

    13 20 14 15 19 21 18 7 Time 1 Time 2 Facial Actions Head Motion Symptoms

21. Facial Affect in Depression Automated vs. Expert Coding = 0.90,

    95% CI: [0.87, 0.93] NRMSE = 0.119 MAE = 0.076

22. Head Motion in Depression Amplitude: Velocity:

23. Next Steps: Clinical Assessment Computerized Screening Psychotherapy Process

24. Primary Collaborators • • • • • • • Sources

    of Research Funding • • • Acknowledgments