OpenTalks.AI - Ольга Перепелкина, Human-centered AI: распознавание эмоций и физиологических сигналов по видео

Ad8ae7af280edaecb09bd73a551b5e5f?s=47 OpenTalks.AI
February 21, 2020

OpenTalks.AI - Ольга Перепелкина, Human-centered AI: распознавание эмоций и физиологических сигналов по видео

Ad8ae7af280edaecb09bd73a551b5e5f?s=128

OpenTalks.AI

February 21, 2020
Tweet

Transcript

  1. 2.

    !2 ONE BILLION $ QUESTIONS What do people really think

    and feel? How do people make decisions, for example, about purchases? What do people want?
  2. 3.

    !3

  3. 6.

    SOFTWARE • Affectiva: Affdex • CrowdEmotion: FaceVideo • Emotient: Facet

    • Microsoft: Cognitive Services • MorphCast: EmotionalTracking • Neurodatalab: EmotionRecognition (facial NN) • VicarVision: FaceReader • VisageTechnologies: FaceAnalysis DATABASES • BU-4DFE: 468 videos, posed • UT-Dallas: 470 videos, spontaneous https://psyarxiv.com/kzhds/
  4. 7.

    Classifiers VisageTechnologies (FaceAnalysis) VicarVision (FaceReader) Neurodatalab (EmotionRecognition) MorphCast (EmotionalTracking) Microsoft

    (Cognitive Services) Emotient (Facet) CrowdEmotion (Face Video) Affectiva (Affdex) Human Observers Accuracy, % 0 25 50 75
  5. 8.

    Classifiers VisageTechnologies (FaceAnalysis) VicarVision (FaceReader) Neurodatalab (EmotionRecognition) MorphCast (EmotionalTracking) Microsoft

    (Cognitive Services) Emotient (Facet) CrowdEmotion (Face Video) Affectiva (Affdex) Human Observers Accuracy, % 0 25 50 75
  6. 11.

    !11 LOSE WIN OR LOSE? LOSE WIN LOSE WIN WIN

    Aviezer, H., Trope, Y. and Todorov, A. 2012
  7. 17.

    !17 A: audio, V: video, T: text, B: body 7

    classes: Happy, Sad, Angry, Surprised, Anxious, Disgusted, Neutral
  8. 23.

    !23

  9. 25.

    !25

  10. 28.

    !28 Wearable MAE (Device) MAE (NDL) Honor Band 4 8.69

    0.97 Amazfit Bip 3.51 3.92 Xiaomi Mi Band 3 5.07 3.71 Apple Watch 2 3.81 2.61 Garmin 2.03 2.46 Samsung Gear S3 2.03 3.28 Mean ± SD 3.6 ± 4.9 2.4 ± 4.5 Device - heart rate detected by wearables NDL - heart rate detected from video by Neurodata Lab
  11. 30.

    !30

  12. 33.
  13. 35.

    !35

  14. 38.

    !38 Male 33 years VALUES Offline targeting Higher conversion +5-125%

    Test faster & find out what works best Better optimization
  15. 39.
  16. 40.