CSC570 Lecture 11

Applied Affective Computing
Connecting the Dots
(202305)

Transcript

1. jgs
   CSC 570
   Current Topics in Computer Science
   Applied Affective Computing
   Lecture 11:
   Connecting the Dots
   Dr. Javier Gonzalez-Sanchez
   javiergs@calpoly.edu
   www.javiergs.com
   Building 14 -227
   Office Hours: By appointment
   

   View Slide

2. jgs
   Let Us Work
   

   View Slide

3. jgs
   Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 3
   Towards This Scenario
   

   View Slide

4. jgs
   Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 4
   Towards This Scenario
   

   View Slide

5. jgs
   Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 5
   Architecture
   Bluetooth
   EMOTIV PRO Your App
   WebSocket
   (server)
   WebSocket
   (client)
   Your App
   WebGazer
   Facial Gestures
   Affect
   

   View Slide

6. jgs
   About PAD
   

   View Slide

7. jgs
   Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 7
   PAD
   +P+A+D
   Engagement
   +P-A+D
   Meditation
   Concentration
   Thought
   Relaxation
   +P+A-D
   Excitement
   Interest
   Dependence
   +P-A-D
   Starting
   Agreement
   Docility
   -P+A+D
   Disagreement
   Hostility
   -P-A+D
   Disdain
   -P+A-D
   Frustration
   Unsureness
   Anxiety
   -P-A-D
   Boredom
   Pleasure
   (Valence)
   Arousal
   (Activation)
   Dominance
   

   View Slide

8. jgs
   Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 8
   Fusion
   + + +
   + + -
   - + -
   + - +
   + + -
   + - +
   

   View Slide

9. jgs
   Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 9
   Fusion
   

   View Slide

10. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 10
    Question 01
    Where these Stress/Attention vectors point out?
    

    View Slide

11. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 11
    Question 02
    Can we calculate them real-time?
    

    View Slide

12. jgs
    Programming Java
    

    View Slide

13. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 13
    Question 03
    Can you update my source code to calculate PAD
    in real-time?
    

    View Slide

14. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 14
    Question 04
    What about adding a GUI?
    What are the good SE practices to follow?
    

    View Slide

15. jgs
    Connecting Dots
    

    View Slide

16. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 16
    Question 05
    

    View Slide

17. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 17
    Calendar
    

    View Slide

18. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 18
    Architecture
    EMOTIV PRO Your App
    WebSocket
    (server)
    WebSocket
    (client)
    Your App
    WebGazer
    PAD
    👀
    

    View Slide

19. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 19
    Project
    Box
    Name1
    Name2
    class Name1 {
    }
    class Name2 {
    method(){
    Name1
    Cat
    }
    }
    class Cat
    extends Name1 {
    Car
    }
    Cat
    Car
    

    View Slide

20. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 20
    Ideas
    

    View Slide

21. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 21
    Homework
    a) Reading mental states (affective states) from Emotiv Software
    (simulator)
    b) Calculate the equivalent PAD vector per emotion.
    c) Calculate a single vector fusing the 6 vectors from step B (one
    per emotion reported by Emotiv.
    d) Draw a dot in a 3D space showing the vector place (magnitude and
    direction from a center that is 0)
    e) Assign each dot a lifetime - dots disappear after that time.
    Consider using an Alpha value to slowly disappear the dot (make
    it transparent)
    f) The group of dots is going to become a cloud of dots given a
    time period. Notice how the cloud evolves.
    g) Bonus: calculate the center of the cloud and draw it on the
    screen
    h) Bonus: draw a vector that shows how this cloud is moving in our
    space
    

    View Slide

22. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 22
    Questions
    

    View Slide

23. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 23
    Office Hours
    Tuesday and Thursday 3 - 5 pm
    But an appointment required
    Sent me an email – javiergs@calpoly.edu
    

    View Slide

24. jgs
    CSC 570 Applied Affective Computing
    Javier Gonzalez-Sanchez, Ph.D.
    javiergs@calpoly.edu
    Spring 2023
    Copyright. These slides can only be used as study material for the class CSC308 at Cal Poly.
    They cannot be distributed or used for another purpose.
    

    View Slide