jgs CSC 570 Current Topics in Computer Science Applied Affective Computing Lecture 09: Facial Emotion Recognition Dr. Javier Gonzalez-Sanchez [email protected] www.javiergs.com Building 14 -227 Office Hours: By appointment
jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 4 Architecture Bluetooth EMOTIV PRO Your App WebSocket (server) WebSocket (client) Your App WebGazer
jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 16 Breaking down facial expressions into individual muscle movements, called "action units" that can be combined to create a wide range of facial expressions. Facial Action Coding System, 46 actions (plus head movements). Facial Action Coding System (FACS)
jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 19 § AU 1 (Inner Brow Raiser) involves the raising of the inner portion of the eyebrows, closest to the nose. This movement produces a vertical furrow between the eyebrows and is associated with emotions such as sadness, concern, and concentration. § AU 2 (Outer Brow Raiser) involves the raising of the outer portion of the eyebrows, further away from the nose. This movement produces a diagonal furrow along the forehead and is associated with emotions such as surprise, fear, and anger. § AU 3 (Brow Lowerer) involves the lowering of the eyebrows in the center of the forehead. This movement produces a vertical furrow between the eyebrows and is associated with emotions such as worry, frustration, and anger.
jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 30 Face 30 30 frames per second 10 inferences per second 600 values per minute 36,000 values per hour
jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 32 Emotion Recognition Ali Raza Shahid, Sheheryar Khan, Hong Yan. Contour and region harmonic features for sub-local facial expression recognition. Journal of Visual Communication and Image Representation. Volume 73. 2020. doi.org/10.1016/j.jvcir.2020.102949.
jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 43 § The Haar Cascade classifiers are pre-trained classifiers in OpenCV that are used for object detection. § OpenCV provides pre-trained Haar Cascade classifiers for a variety of objects, including faces, eyes, noses, and full bodies. § The name "Haar Cascade" comes from the Haar Wavelets used to encode image features that are used by the classifier. § Haar Wavelets are a type of mathematical function Definition
jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 46 Office Hours Tuesday and Thursday 3 - 5 pm But an appointment required Sent me an email – [email protected]
jgs CSC 570 Applied Affective Computing Javier Gonzalez-Sanchez, Ph.D. [email protected] Spring 2023 Copyright. These slides can only be used as study material for the class CSC308 at Cal Poly. They cannot be distributed or used for another purpose.
javiergs
kuanyi_n_n
sumauma
.png){kind=avatar}
researchconf
sensetime_japan
stktu
abemii
hide2kano
kyoun
mickey_kubo
codingconduct
marcduiker
smashingmag
akosma
reverentgeek
sstephenson
revolveconf
sferik
morganepeng
holman
chriscoyier
keavy