Upgrade to Pro — share decks privately, control downloads, hide ads and more …

CSC570 Lecture 11

CSC570 Lecture 11

Applied Affective Computing
Connecting the Dots
(202305)

Javier Gonzalez-Sanchez
PRO

May 09, 2023
Tweet

More Decks by Javier Gonzalez-Sanchez

Other Decks in Research

Transcript

  1. jgs
    CSC 570
    Current Topics in Computer Science
    Applied Affective Computing
    Lecture 11:
    Connecting the Dots
    Dr. Javier Gonzalez-Sanchez
    [email protected]
    www.javiergs.com
    Building 14 -227
    Office Hours: By appointment

    View Slide

  2. jgs
    Let Us Work

    View Slide

  3. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 3
    Towards This Scenario

    View Slide

  4. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 4
    Towards This Scenario

    View Slide

  5. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 5
    Architecture
    Bluetooth
    EMOTIV PRO Your App
    WebSocket
    (server)
    WebSocket
    (client)
    Your App
    WebGazer
    Facial Gestures
    Affect

    View Slide

  6. jgs
    About PAD

    View Slide

  7. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 7
    PAD
    +P+A+D
    Engagement
    +P-A+D
    Meditation
    Concentration
    Thought
    Relaxation
    +P+A-D
    Excitement
    Interest
    Dependence
    +P-A-D
    Starting
    Agreement
    Docility
    -P+A+D
    Disagreement
    Hostility
    -P-A+D
    Disdain
    -P+A-D
    Frustration
    Unsureness
    Anxiety
    -P-A-D
    Boredom
    Pleasure
    (Valence)
    Arousal
    (Activation)
    Dominance

    View Slide

  8. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 8
    Fusion
    + + +
    + + -
    - + -
    + - +
    + + -
    + - +

    View Slide

  9. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 9
    Fusion

    View Slide

  10. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 10
    Question 01
    Where these Stress/Attention vectors point out?

    View Slide

  11. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 11
    Question 02
    Can we calculate them real-time?

    View Slide

  12. jgs
    Programming Java

    View Slide

  13. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 13
    Question 03
    Can you update my source code to calculate PAD
    in real-time?

    View Slide

  14. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 14
    Question 04
    What about adding a GUI?
    What are the good SE practices to follow?

    View Slide

  15. jgs
    Connecting Dots

    View Slide

  16. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 16
    Question 05

    View Slide

  17. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 17
    Calendar

    View Slide

  18. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 18
    Architecture
    EMOTIV PRO Your App
    WebSocket
    (server)
    WebSocket
    (client)
    Your App
    WebGazer
    PAD
    👀

    View Slide

  19. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 19
    Project
    Box
    Name1
    Name2
    class Name1 {
    }
    class Name2 {
    method(){
    Name1
    Cat
    }
    }
    class Cat
    extends Name1 {
    Car
    }
    Cat
    Car

    View Slide

  20. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 20
    Ideas

    View Slide

  21. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 21
    Homework
    a) Reading mental states (affective states) from Emotiv Software
    (simulator)
    b) Calculate the equivalent PAD vector per emotion.
    c) Calculate a single vector fusing the 6 vectors from step B (one
    per emotion reported by Emotiv.
    d) Draw a dot in a 3D space showing the vector place (magnitude and
    direction from a center that is 0)
    e) Assign each dot a lifetime - dots disappear after that time.
    Consider using an Alpha value to slowly disappear the dot (make
    it transparent)
    f) The group of dots is going to become a cloud of dots given a
    time period. Notice how the cloud evolves.
    g) Bonus: calculate the center of the cloud and draw it on the
    screen
    h) Bonus: draw a vector that shows how this cloud is moving in our
    space

    View Slide

  22. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 22
    Questions

    View Slide

  23. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 23
    Office Hours
    Tuesday and Thursday 3 - 5 pm
    But an appointment required
    Sent me an email – [email protected]

    View Slide

  24. jgs
    CSC 570 Applied Affective Computing
    Javier Gonzalez-Sanchez, Ph.D.
    [email protected]
    Spring 2023
    Copyright. These slides can only be used as study material for the class CSC308 at Cal Poly.
    They cannot be distributed or used for another purpose.

    View Slide