CSC570 Lecture 10

jgs CSC 570 Current Topics in Computer Science Applied Affective
Computing Lecture 10: Face Gestures Dr. Javier Gonzalez-Sanchez [email protected] www.javiergs.com Building 14 -227 Office Hours: By appointment

jgs Previously

jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |
3 Face https://doi.org/10.1371/journal.pone.0251057

4 Emotiv EPOC X

5 Towards This Scenario

jgs Face Gestures

7 § EEG § Inertial Measurement Unit (IMU) sensors to detect movements of the head and face. § IMU measures changes in acceleration, orientation, and rotation, which allow the headset to detect head movements, such as tilting or nodding, as well as movements of the face, such as jaw clenching or mouth opening. Headset

8 1. Smile: The software recognizes a smile as an upward movement of the corners of the mouth (low-quality happy/agreement) 3. Clench: The software recognizes the clenching of the jaw 4. Mouth open: The software recognizes an open mouth Data

9 1.Raise Brow: The software recognizes the movement of raising the eyebrows (low-quality surprise) 2. Furrow Brow: The software recognizes the movement of raising the eyebrows (low-quality frustration) 1.Blink: The software recognizes a blink as a momentary closing of the eyes 3. Wink: The software recognizes a wink as a momentary closing of one eye Data

10 Data

jgs Software

12 Maven

13 Main.java

14 EmotivSocket.java (Part 1/2)

15 EmotivSocket.java (Part 2/2)

16 EmotivDelegate.java (Part 1/5)

21 Let’s Work

22 met

23 PAD +P+A+D Engagement +P-A+D Meditation Concentration Thought Relaxation +P+A-D Excitement Interest Dependence +P-A-D Starting Agreement Docility -P+A+D Disagreement Hostility -P-A+D Disdain -P+A-D Frustration Unsureness Anxiety -P-A-D Boredom Pleasure (Valence) Arousal (Activation) Dominance

24 fac

25 WebSocket (in Java) https://github.com/javiergs/CSC570 Java Emotiv Client

jgs Assignment 04

27 Towards This Scenario

28 Architecture Bluetooth EMOTIV PRO Your App WebSocket (server) WebSocket (client) Your App WebGazer Facial Gestures Affect

29 Simulator

30 Power On

31 Connect

32

33 Configuration

34 Data

35 Questions

36 Office Hours Tuesday and Thursday 3 - 5 pm But an appointment required Sent me an email – [email protected]

jgs CSC 570 Applied Affective Computing Javier Gonzalez-Sanchez, Ph.D. [email protected]
Spring 2023 Copyright. These slides can only be used as study material for the class CSC308 at Cal Poly. They cannot be distributed or used for another purpose.

CSC570 Lecture 10

CSC570 Lecture 10

More Decks by Javier Gonzalez-Sanchez

Other Decks in Research

Featured

Transcript