Interdisciplinary Frontiers in Affective Health & Communication

Interdisciplinary Frontiers in Affective Health & Communication

Job Talk Slides from Jeffrey M. Girard, Phd (Carnegie Mellon University)

D5982f56a0e8f345a32780c546e90a87?s=128

Jeffrey M Girard

January 20, 2020
Tweet

Transcript

  1. Interdisciplinary Frontiers in Affective Health & Communication Jeffrey Girard, PhD

  2. Communicative Behavior Connects Us

  3. Affective Communication Matters

  4. My Research Framework

  5. My Research Framework

  6. Presentation Roadmap

  7. Measuring Facial Behavior • Girard & Cohn (2011) ICCV •

    Jeni, Girard, Cohn, & De la Torre (2013) AFGR • Girard et al. (2015) AFGR • Girard et al. (2015) Pattern Recognition Letters • Girard et al. (2015) Behavior Research Methods • Valstar, Almaev, Girard, et al. (2015) AFGR • Valstar et al. (2017) AFGR • Cohn et al. (2019) Multimodal behavior analysis
  8. Measuring Behavior is Difficult Behavioral Rating Scales Facial Action Coding

    System
  9. Perhaps Computer Science Can Help

  10. Facial Landmark Tracking

  11. Computerized Action Unit Estimation

  12. Gender, Culture, and Smiling • McDuff, Girard, Kaliouby (2017) J.

    Nonverbal Behavior • Girard & McDuff (2017) AFGR • McDuff & Girard (2019) ACII • Girard & McDuff (in prep.) {Nature Human Behavior}
  13. Gender, Culture, and Smiling

  14. Smiling in Market Research Settings

  15. Smiling Rates in Different Countries

  16. Sociocultural Hypotheses Country’s citizen average on questionnaire (Hofstede Dimension Matrix:

    1980–2015) Country’s number of immigration sources (World Migration Matrix: 1500–2000)
  17. Multilevel Hypothesis Testing Parameter Est. p-val. 2.27 < .001 0.40

    .506 0.63 .025 0.15 .673 × −0.06 .869 × 0.37 .014 × 0.13 .440
  18. Multilevel Hypothesis Testing Parameter Est. p-val. 2.27 < .001 0.40

    .506 0.63 .025 0.15 .673 × −0.06 .869 × 0.37 .014 × 0.13 .440
  19. Automatic Assessment of Depression • Girard et al. (2013) AFGR

    • Girard et al. (2014) Image & Vision Computing • Girard & Cohn (2015) Current Opinion in Psychology • Girard & Cohn (2020) What the face reveals 3rd Ed.
  20. Automatic Assessment of Depression 32 6 31 9 10 8

    13 20 14 15 19 21 18 7 Time 1 Time 2 Facial Actions Head Motion Symptoms
  21. Facial Affect in Depression Automated vs. Expert Coding = 0.90,

    95% CI: [0.87, 0.93] NRMSE = 0.119 MAE = 0.076
  22. Head Motion in Depression Amplitude: Velocity:

  23. Next Steps: Clinical Assessment Computerized Screening Psychotherapy Process

  24. Primary Collaborators • • • • • • • Sources

    of Research Funding • • • Acknowledgments