CSC570 Lecture 03

Applied Affective Computing
Data Representation
(202304)

Transcript

1. jgs
   CSC 570
   Current Topics in Computer Science
   Applied Affective Computing
   Lecture 03:
   PAD Vector
   Dr. Javier Gonzalez-Sanchez
   javiergs@calpoly.edu
   www.javiergs.com
   Building 14 -227
   Office Hours: By appointment
   

   View Slide

2. jgs
   Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 2
   Affective Computing + Interactive Interaction
   (ACII 2023)
   Demo
   Deadline: 30th June 2023
   September 10–13. Cambridge, MA.
   https://acii-conf.net/2023/calls/demos/
   Conference
   

   View Slide

3. jgs
   Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 3
   ACM Symposium on User Interface Software and Technology
   (UIST 2023)
   Demo
   Deadline: July 19, 2023
   October 29–November 1, California Bay Area.
   https://uist.acm.org/2023/cfp/#demos
   Conference
   

   View Slide

4. jgs
   Previously …
   

   View Slide

5. jgs
   Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 5
   Affect, Emotion, Mood
   Label
   🧪 🧪
   +
   ⚡ ⚡
   🧪
   +
   ⚡
   Label
   🧪 🧪
   +
   ⚡ ⚡
   🧪 🧪
   +
   ⚡ ⚡
   🧪 🧪
   +
   ⚡ ⚡
   

   View Slide

6. jgs
   Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 6
   PAD
   +P+A+D
   Engagement
   +P-A+D
   Meditation
   Concentration
   Thought
   Relaxation
   +P+A-D
   Excitement
   Interest
   Dependence
   +P-A-D
   Starting
   Agreement
   Docility
   -P+A+D
   Disagreement
   Hostility
   -P-A+D
   Disdain
   -P+A-D
   Frustration
   Unsureness
   Anxiety
   -P-A-D
   Boredom
   Pleasure
   (Valence)
   Arousal
   (Activation)
   Dominance
   

   View Slide

7. jgs
   Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 7
   PAD
   (+++)
   Engagement
   (-++)
   Disagreement
   Hostility
   (++-)
   Excitement
   Interest
   Dependence
   (-+-)
   Frustration
   Unsureness
   Anxiety
   (+-+)
   Meditation
   Concentration
   Thought
   Relaxation
   (--+)
   Disdain
   (+--)
   Starting
   Agreement
   Docility
   (---)
   Boredom
   controlled
   In control controlled
   In control
   Aroused
   Aroused
   Pleasure
   Pleasure
   🙂🫀🕹 🙂🫀👾 🙂 🕹 🙂 👾
   Pleasure
   Pleasure
   controlled
   In control controlled
   In control
   Aroused
   Aroused
   🫀🕹 🫀👾 🕹 👾
   

   View Slide

8. jgs
   Test Yourselves
   

   View Slide

9. jgs
   Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 9
   Thoughts?
   Unsureness(-+-)
   Anxiety(-+-)
   Surprised(++-)
   Hostility(-++)
   🙂
   🙂 🙂
   🫀 🫀
   🫀 🫀
   🫀 🫀 🫀 🕹
   🕹
   🙂
   Concentration(+-+)
   Excitement(++-) Dependance(++-)
   Frustration (-+-)
   🫀
   Fear(-+-)
   Disdain (---)
   

   View Slide

10. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 10
    Thoughts?
    

    View Slide

11. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 11
    Affective States
    thechalkboardmag.com
    👾
    🫀👾
    🫀🕹
    🙂🫀👾
    🙂🫀🕹
    🕹
    👾
    

    View Slide

12. jgs
    Data Collection
    

    View Slide

13. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 13
    Y = X1
    + X2
    + X3
    + …
    ML
    

    View Slide

14. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 14
    Workflow
    

    View Slide

15. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 15
    Emotiv EPOC X
    

    View Slide

16. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 17
    Brain
    Timestamp AF3 F7 F3 FC5 T7 P7 O1 O2 P8 T8 FC6 F4 F8 AF4 AccX AccY
    101116112544901 4542.05 4831.79 4247.18 4690.26 4282.56 4395.38 4591.79 4569.23 4360 4570.77 4297.44 4311.28 4282.56 4367.18 1660 2003
    101116112544901 4536.92 4802.05 4243.08 4673.85 4272.31 4393.33 4592.82 4570.26 4354.87 4570.26 4292.31 4309.74 4277.95 4370.77 1658 2002
    101116112545010 4533.33 4798.97 4234.87 4669.74 4301.03 4396.92 4592.31 4570.77 4351.28 4561.03 4281.54 4301.54 4271.28 4363.59 1659 2003
    101116112545010 4549.23 4839.49 4241.03 4691.28 4333.85 4397.95 4596.41 4567.18 4355.9 4556.41 4286.15 4306.15 4277.95 4369.74 1659 2003
    101116112545010 4580 4865.64 4251.79 4710.26 4340 4401.54 4603.59 4572.82 4360 4558.46 4298.97 4324.62 4296.41 4395.9 1657 2004
    101116112545010 4597.44 4860 4252.82 4705.64 4350.26 4412.31 4603.59 4577.44 4357.44 4555.9 4295.38 4329.23 4296.41 4414.36 1656 2005
    101116112545010 4584.62 4847.69 4246.67 4690.26 4360 4409.23 4597.44 4569.74 4351.79 4549.74 4278.97 4316.92 4272.82 4399.49 1656 2006
    101116112545010 4566.15 4842.05 4238.46 4684.1 4322.05 4389.74 4592.82 4566.67 4351.79 4549.74 4274.36 4310.26 4262.05 4370.77 1655 2005
    101116112545010 4563.59 4844.62 4231.79 4687.69 4267.69 4387.69 4594.36 4580 4361.03 4556.41 4278.97 4310.77 4274.36 4370.77 1653 2006
    101116112545010 4567.18 4847.18 4233.33 4688.72 4285.13 4409.23 4602.05 4589.23 4368.21 4560 4280.51 4310.77 4281.54 4390.26 1655 2004
    101116112545010 4562.05 4840.51 4227.18 4673.85 4300 4405.13 4611.28 4601.03 4376.41 4561.54 4280 4303.59 4279.49 4374.87 1652 2000
    

    View Slide

17. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 18
    Brain
    14 channels
    128 samples per second
    1,792 values por second
    107,520 values per minute
    6,451,200 values per hour
    

    View Slide

18. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 19
    Let’s Work
    

    View Slide

19. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 20
    Brain
    Timestamp Short Term Excitement Long Term Excitement Engagement Meditation Frustration
    101116091145065 0.447595 0.54871 0.834476 0.333844 0.536197
    101116091145190 0.447595 0.54871 0.834476 0.333844 0.536197
    101116091145315 0.447595 0.54871 0.834476 0.333844 0.536197
    101116091145440 0.487864 0.546877 0.834146 0.339548 0.54851
    101116091145565 0.487864 0.546877 0.834146 0.339548 0.54851
    101116091145690 0.487864 0.546877 0.834146 0.339548 0.54851
    101116091145815 0.487864 0.546877 0.834146 0.339548 0.54851
    101116091145940 0.521663 0.545609 0.839321 0.348321 0.558228
    101116091146065 0.521663 0.545609 0.839321 0.348321 0.558228
    101116091146190 0.521663 0.545609 0.839321 0.348321 0.558228
    101116091146315 0.521663 0.545609 0.839321 0.348321 0.558228
    101116091146440 0.509297 0.544131 0.84401 0.358717 0.546771
    101116091146565 0.509297 0.544131 0.84401 0.358717 0.546771
    101116091146690 0.509297 0.544131 0.84401 0.358717 0.546771
    101116091146815 0.509297 0.544131 0.84401 0.358717 0.546771
    101116091146941 0.451885 0.541695 0.848087 0.368071 0.533919
    

    View Slide

20. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 21
    Brain
    21
    5 samples per second
    5 affective states
    25 values per second
    1,500 values per minute
    90,000 values per hour
    

    View Slide

21. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 22
    Let’s Work
    

    View Slide

22. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 23
    Homework
    A. Create your Team
    B. Decide what your project will be
    C. Start Working on a proposal
    § What - Problem to be Address
    § Why – Impact or Relevance
    § How – Your product and tools to be used
    § Have something similar been done before?
    § Why are you different?
    (Google Scholar)
    

    View Slide

23. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 24
    Questions
    

    View Slide

24. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 25
    Office Hours
    Tuesday and Thursday 3 - 5 pm
    But an appointment required
    Sent me an email – javiergs@calpoly.edu
    

    View Slide

25. jgs
    CSC 570 Applied Affective Computing
    Javier Gonzalez-Sanchez, Ph.D.
    javiergs@calpoly.edu
    Spring 2023
    Copyright. These slides can only be used as study material for the class CSC308 at Cal Poly.
    They cannot be distributed or used for another purpose.
    

    View Slide