Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Interdisciplinary Frontiers in Affective Health...
Search
Jeffrey M Girard
January 20, 2020
Science
1
45
Interdisciplinary Frontiers in Affective Health & Communication
Job Talk Slides from Jeffrey M. Girard, Phd (Carnegie Mellon University)
Jeffrey M Girard
January 20, 2020
Tweet
Share
More Decks by Jeffrey M Girard
See All by Jeffrey M Girard
Large-scale observational research
jmgirard
2
73
Leveraging Data Science to Advance the Scientific Study of Smiling
jmgirard
1
69
Data Visualization Principles and Practice
jmgirard
1
320
Other Decks in Science
See All in Science
データマイニング - グラフデータと経路
trycycle
PRO
1
230
Lean4による汎化誤差評価の形式化
milano0017
1
340
深層学習を用いた根菜類の個数カウントによる収量推定法の開発
kentaitakura
0
190
アナログ計算機『計算尺』を愛でる Midosuji Tech #4/Analog Computing Device Slide Rule now and then
quiver
1
300
Gemini Prompt Engineering: Practical Techniques for Tangible AI Outcomes
mfonobong
2
180
データベース08: 実体関連モデルとは?
trycycle
PRO
0
950
機械学習 - 授業概要
trycycle
PRO
0
260
academist Prize 4期生 研究トーク延長戦!「美は世界を救う」っていうけど、どうやって?
jimpe_hitsuwari
0
400
データベース01: データベースを使わない世界
trycycle
PRO
1
820
「美は世界を救う」を心理学で実証したい~クラファンを通じた新しい研究方法
jimpe_hitsuwari
1
170
機械学習 - SVM
trycycle
PRO
1
910
Celebrate UTIG: Staff and Student Awards 2025
utig
0
270
Featured
See All Featured
A better future with KSS
kneath
239
18k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
chriscoyier
508
140k
GitHub's CSS Performance
jonrohan
1032
470k
Optimizing for Happiness
mojombo
379
70k
We Have a Design System, Now What?
morganepeng
53
7.8k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
46
2.5k
Faster Mobile Websites
deanohume
310
31k
Making Projects Easy
brettharned
120
6.4k
Fantastic passwords and where to find them - at NoRuKo
philnash
52
3.5k
The Power of CSS Pseudo Elements
geoffreycrofte
79
6k
Intergalactic Javascript Robots from Outer Space
tanoku
273
27k
The World Runs on Bad Software
bkeepers
PRO
72
11k
Transcript
Interdisciplinary Frontiers in Affective Health & Communication Jeffrey Girard, PhD
Communicative Behavior Connects Us
Affective Communication Matters
My Research Framework
My Research Framework
Presentation Roadmap
Measuring Facial Behavior • Girard & Cohn (2011) ICCV •
Jeni, Girard, Cohn, & De la Torre (2013) AFGR • Girard et al. (2015) AFGR • Girard et al. (2015) Pattern Recognition Letters • Girard et al. (2015) Behavior Research Methods • Valstar, Almaev, Girard, et al. (2015) AFGR • Valstar et al. (2017) AFGR • Cohn et al. (2019) Multimodal behavior analysis
Measuring Behavior is Difficult Behavioral Rating Scales Facial Action Coding
System
Perhaps Computer Science Can Help
Facial Landmark Tracking
Computerized Action Unit Estimation
Gender, Culture, and Smiling • McDuff, Girard, Kaliouby (2017) J.
Nonverbal Behavior • Girard & McDuff (2017) AFGR • McDuff & Girard (2019) ACII • Girard & McDuff (in prep.) {Nature Human Behavior}
Gender, Culture, and Smiling
Smiling in Market Research Settings
Smiling Rates in Different Countries
Sociocultural Hypotheses Country’s citizen average on questionnaire (Hofstede Dimension Matrix:
1980–2015) Country’s number of immigration sources (World Migration Matrix: 1500–2000)
Multilevel Hypothesis Testing Parameter Est. p-val. 2.27 < .001 0.40
.506 0.63 .025 0.15 .673 × −0.06 .869 × 0.37 .014 × 0.13 .440
Multilevel Hypothesis Testing Parameter Est. p-val. 2.27 < .001 0.40
.506 0.63 .025 0.15 .673 × −0.06 .869 × 0.37 .014 × 0.13 .440
Automatic Assessment of Depression • Girard et al. (2013) AFGR
• Girard et al. (2014) Image & Vision Computing • Girard & Cohn (2015) Current Opinion in Psychology • Girard & Cohn (2020) What the face reveals 3rd Ed.
Automatic Assessment of Depression 32 6 31 9 10 8
13 20 14 15 19 21 18 7 Time 1 Time 2 Facial Actions Head Motion Symptoms
Facial Affect in Depression Automated vs. Expert Coding = 0.90,
95% CI: [0.87, 0.93] NRMSE = 0.119 MAE = 0.076
Head Motion in Depression Amplitude: Velocity:
Next Steps: Clinical Assessment Computerized Screening Psychotherapy Process
Primary Collaborators • • • • • • • Sources
of Research Funding • • • Acknowledgments