Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Leveraging Data Science to Advance the Scientific Study of Smiling

Leveraging Data Science to Advance the Scientific Study of Smiling

Brownbag (Chalk) Talk Slides from Jeffrey M. Girard, PhD (Carnegie Mellon University)

Jeffrey M Girard

January 28, 2020
Tweet

More Decks by Jeffrey M Girard

Other Decks in Science

Transcript

  1. Data Science in Psychology Solutions (Hammers) • • • •

    • • • • • • • • • Challenges (Nails) • • • • • • • • • • • • •
  2. Web-Scraped Celebrity Smiles: Validate Measure Algorithm Positive Smile Positive Rating

    0.79 Smile Rating 0.78 0.94 Expert FACS 0.87 0.97 0.94 Measure ICC(A,5) 95% CI Positive Rating 0.90 [0.88, 0.92] Smile Rating 0.90 [0.88, 0.92]
  3. Web-Scraped Celebrity Smiles: Model • • • • • •

    • • Zero-Inflated Beta Regression ZI Beta = 0 ∈ (0, 1)
  4. Spontaneous Emotion Database: Design/Collect Emotion Rating Scale Afraid/Scared 0 1

    2 3 4 5 Angry/Upset 0 1 2 3 4 5 Disgusted 0 1 2 3 4 5 … … Other (write in) 0 1 2 3 4 5
  5. Spontaneous Emotion Database: Collect AU 1 + 10 + 12

    + 15 + 17 + 64 Action Unit Occurrence Did the action unit happen? {Absent = 0, 1 = Present} Action Unit Intensity How strong was the action unit? {Trace = 1, 2, 3, 4, 5 = Maximum}
  6. Spontaneous Emotion Database: Collect/Process AU12 AU12 AU06 2 2 3

    4 4 4 2 4 2 2 2 2 2 2 3 3 3 3 3 0 0 1 1 0 0 0 1 1 1 1 1 1 0 0 1 1 1 1 1 1 1 1 1 1 1 Action Unit Occurrence: {0=Absent, 1=Present} Action Unit Intensity: {1=Trace, 2=Slight, 3=Pronounced, 4=Extreme, 5=Maximum}
  7. Algorithmic Smile Interpretation: Process Example Smile Event Video Clips Fr

    AU12 AU6 1 3 0 2 3 3 3 4 2 4 0 0 5 2 0 6 2 0 Frs AU12i AU6o AU6i 1 to 3 4 1 3 5 to 6 2 0 0