Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Interdisciplinary Frontiers in Affective Health...
Search
Jeffrey M Girard
January 20, 2020
Science
1
45
Interdisciplinary Frontiers in Affective Health & Communication
Job Talk Slides from Jeffrey M. Girard, Phd (Carnegie Mellon University)
Jeffrey M Girard
January 20, 2020
Tweet
Share
More Decks by Jeffrey M Girard
See All by Jeffrey M Girard
Large-scale observational research
jmgirard
2
73
Leveraging Data Science to Advance the Scientific Study of Smiling
jmgirard
1
69
Data Visualization Principles and Practice
jmgirard
1
310
Other Decks in Science
See All in Science
統計的因果探索: 背景知識とデータにより因果仮説を探索する
sshimizu2006
4
1k
AIによる科学の加速: 各領域での革新と共創の未来
masayamoriofficial
0
170
People who frequently use ChatGPT for writing tasks are accurate and robust detectors of AI-generated text
rudorudo11
0
110
AI(人工知能)の過去・現在・未来 —AIは人間を超えるのか—
tagtag
0
110
AI(人工知能)の過去・現在・未来 —AIは人間を超えるのか—
tagtag
1
140
生成AIと学ぶPythonデータ分析再入門-Pythonによるクラスタリング・可視化をサクサク実施-
datascientistsociety
PRO
4
1.8k
Transport information Geometry: Current and Future II
lwc2017
0
210
ランサムウェア対策にも考慮したVMware、Hyper-V、Azure、AWS間のリアルタイムレプリケーション「Zerto」を徹底解説
climbteam
0
140
ド文系だった私が、 KaggleのNCAAコンペでソロ金取れるまで
wakamatsu_takumu
2
1.4k
データベース15: ビッグデータ時代のデータベース
trycycle
PRO
0
360
CV_5_3dVision
hachama
0
150
コンピュータビジョンによるロボットの視覚と判断:宇宙空間での適応と課題
hf149
1
370
Featured
See All Featured
Java REST API Framework Comparison - PWX 2021
mraible
33
8.9k
Why You Should Never Use an ORM
jnunemaker
PRO
59
9.6k
Producing Creativity
orderedlist
PRO
347
40k
The Cult of Friendly URLs
andyhume
79
6.6k
GraphQLの誤解/rethinking-graphql
sonatard
73
11k
The Straight Up "How To Draw Better" Workshop
denniskardys
238
140k
Optimizing for Happiness
mojombo
379
70k
Why Our Code Smells
bkeepers
PRO
339
57k
Writing Fast Ruby
sferik
629
62k
What’s in a name? Adding method to the madness
productmarketing
PRO
23
3.7k
Making the Leap to Tech Lead
cromwellryan
135
9.6k
10 Git Anti Patterns You Should be Aware of
lemiorhan
PRO
657
61k
Transcript
Interdisciplinary Frontiers in Affective Health & Communication Jeffrey Girard, PhD
Communicative Behavior Connects Us
Affective Communication Matters
My Research Framework
My Research Framework
Presentation Roadmap
Measuring Facial Behavior • Girard & Cohn (2011) ICCV •
Jeni, Girard, Cohn, & De la Torre (2013) AFGR • Girard et al. (2015) AFGR • Girard et al. (2015) Pattern Recognition Letters • Girard et al. (2015) Behavior Research Methods • Valstar, Almaev, Girard, et al. (2015) AFGR • Valstar et al. (2017) AFGR • Cohn et al. (2019) Multimodal behavior analysis
Measuring Behavior is Difficult Behavioral Rating Scales Facial Action Coding
System
Perhaps Computer Science Can Help
Facial Landmark Tracking
Computerized Action Unit Estimation
Gender, Culture, and Smiling • McDuff, Girard, Kaliouby (2017) J.
Nonverbal Behavior • Girard & McDuff (2017) AFGR • McDuff & Girard (2019) ACII • Girard & McDuff (in prep.) {Nature Human Behavior}
Gender, Culture, and Smiling
Smiling in Market Research Settings
Smiling Rates in Different Countries
Sociocultural Hypotheses Country’s citizen average on questionnaire (Hofstede Dimension Matrix:
1980–2015) Country’s number of immigration sources (World Migration Matrix: 1500–2000)
Multilevel Hypothesis Testing Parameter Est. p-val. 2.27 < .001 0.40
.506 0.63 .025 0.15 .673 × −0.06 .869 × 0.37 .014 × 0.13 .440
Multilevel Hypothesis Testing Parameter Est. p-val. 2.27 < .001 0.40
.506 0.63 .025 0.15 .673 × −0.06 .869 × 0.37 .014 × 0.13 .440
Automatic Assessment of Depression • Girard et al. (2013) AFGR
• Girard et al. (2014) Image & Vision Computing • Girard & Cohn (2015) Current Opinion in Psychology • Girard & Cohn (2020) What the face reveals 3rd Ed.
Automatic Assessment of Depression 32 6 31 9 10 8
13 20 14 15 19 21 18 7 Time 1 Time 2 Facial Actions Head Motion Symptoms
Facial Affect in Depression Automated vs. Expert Coding = 0.90,
95% CI: [0.87, 0.93] NRMSE = 0.119 MAE = 0.076
Head Motion in Depression Amplitude: Velocity:
Next Steps: Clinical Assessment Computerized Screening Psychotherapy Process
Primary Collaborators • • • • • • • Sources
of Research Funding • • • Acknowledgments