pyladiesvan.pdf

Transcript

1. Scientific Background Application Areas Facial Expression Recognition (FER) Challenges in FER FER framework FER in Python Python + OpenCV + Demo! The Mood Machine - Building an Emotion Detection System in Python Tanushri Chakravorty PhD, Researcher, Computer Vision 1 / 10
2. Scientific Background Application Areas Facial Expression Recognition (FER) Challenges in FER FER framework FER in Python Python + OpenCV + Demo! Outline 1 Scientific Background 2 Application Areas 3 Facial Expression Recognition (FER) 4 Challenges in FER 5 FER framework 6 FER in Python 7 Python + OpenCV + Demo! 2 / 10
3. Scientific Background Application Areas Facial Expression Recognition (FER) Challenges in FER FER framework FER in Python Python + OpenCV + Demo! Scientific Background Figure 1: Background and areas of research and work expertise 3 / 10
4. Scientific Background Application Areas Facial Expression Recognition (FER) Challenges in FER FER framework FER in Python Python + OpenCV + Demo! Application Areas Popular Applications: Security and surveillance Human-Computer Interaction Video editing Augmented Reality Open Source Code https://github.com/sinbycos/ 4 / 10
5. Scientific Background Application Areas Facial Expression Recognition (FER) Challenges in FER FER framework FER in Python Python + OpenCV + Demo! Facial Expression Recognition (FER) To understand human emotions from images (static) or videos(dynamic). Ekman and Friesen categorized expressions into anger, disgust, fear, happiness, sadness, and surprise. 5 / 10
6. Scientific Background Application Areas Facial Expression Recognition (FER) Challenges in FER FER framework FER in Python Python + OpenCV + Demo! Challenges in FER Difficulty in finding similarity due to uncontrolled surrounding conditions. Variability of faces. Figure 2: Degree of Variability of expressions for being happy. Image taken from Flickr (CC License). 6 / 10
7. Scientific Background Application Areas Facial Expression Recognition (FER) Challenges in FER FER framework FER in Python Python + OpenCV + Demo! FER framework Figure 3: Steps in performing Face Expression Recognition. Image taken from https://www.thoughtworks.com/insights/blog/recognizing-human-facial-expressions-machine-learning 7 / 10
8. Scientific Background Application Areas Facial Expression Recognition (FER) Challenges in FER FER framework FER in Python Python + OpenCV + Demo! FER in Python EmoPy - Python framework for FER by Thoughtworks Python Code https://github.com/thoughtworksarts/EmoPy 8 / 10
9. Scientific Background Application Areas Facial Expression Recognition (FER) Challenges in FER FER framework FER in Python Python + OpenCV + Demo! Python + OpenCV + Demo! OpenCV: Open source Computer Vision Library Designed a small experiment to test EmoPy in real-time!! On the way submission of Pull Request You can also find it on my Github: https://github.com/sinbycos/ 9 / 10
10. Scientific Background Application Areas Facial Expression Recognition (FER) Challenges in FER FER framework FER in Python Python + OpenCV + Demo! Questions  tanushri.c@gmail.com 10 / 10