CSC570 Lecture 04

Applied Affective Computing
Sensing vs. Perception
(202304)

Transcript

1. jgs
   CSC 570
   Current Topics in Computer Science
   Applied Affective Computing
   Lecture 04:
   Sensing vs. Perception
   Dr. Javier Gonzalez-Sanchez
   javiergs@calpoly.edu
   www.javiergs.com
   Building 14 -227
   Office Hours: By appointment
   

   View Slide

2. jgs
   Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 2
   Affective Computing + Interactive Interaction
   (ACII 2023)
   Demo
   Deadline: 30th June 2023
   September 10–13. Cambridge, MA.
   https://acii-conf.net/2023/calls/demos/
   Conference
   

   View Slide

3. jgs
   Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 3
   ACM Symposium on User Interface Software and Technology
   (UIST 2023)
   Demo
   Deadline: July 19, 2023
   October 29–November 1, California Bay Area.
   https://uist.acm.org/2023/cfp/#demos
   Conference
   

   View Slide

4. jgs
   Previously …
   

   View Slide

5. jgs
   Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 5
   Workflow
   

   View Slide

6. jgs
   Perception and Sensing
   

   View Slide

7. jgs
   Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 7
   Sensing
   Definition
   measures a
   physical property
   § Voltage (difference in charge between two points)
   § Current (a stream of charged particles)
   § Temperature
   § Conductance (Skin)
   § Audio Signal (Heart Rate)
   These are your X n
   

   View Slide

8. jgs
   Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 8
   Emotiv EPOC X
   

   View Slide

9. jgs
   Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 9
   Emotiv Insight
   

   View Slide

10. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 10
    Brain
    Timestamp AF3 F7 F3 FC5 T7 P7 O1 O2 P8 T8 FC6 F4 F8 AF4 AccX AccY
    101116112544901 4542.05 4831.79 4247.18 4690.26 4282.56 4395.38 4591.79 4569.23 4360 4570.77 4297.44 4311.28 4282.56 4367.18 1660 2003
    101116112544901 4536.92 4802.05 4243.08 4673.85 4272.31 4393.33 4592.82 4570.26 4354.87 4570.26 4292.31 4309.74 4277.95 4370.77 1658 2002
    101116112545010 4533.33 4798.97 4234.87 4669.74 4301.03 4396.92 4592.31 4570.77 4351.28 4561.03 4281.54 4301.54 4271.28 4363.59 1659 2003
    101116112545010 4549.23 4839.49 4241.03 4691.28 4333.85 4397.95 4596.41 4567.18 4355.9 4556.41 4286.15 4306.15 4277.95 4369.74 1659 2003
    101116112545010 4580 4865.64 4251.79 4710.26 4340 4401.54 4603.59 4572.82 4360 4558.46 4298.97 4324.62 4296.41 4395.9 1657 2004
    101116112545010 4597.44 4860 4252.82 4705.64 4350.26 4412.31 4603.59 4577.44 4357.44 4555.9 4295.38 4329.23 4296.41 4414.36 1656 2005
    101116112545010 4584.62 4847.69 4246.67 4690.26 4360 4409.23 4597.44 4569.74 4351.79 4549.74 4278.97 4316.92 4272.82 4399.49 1656 2006
    101116112545010 4566.15 4842.05 4238.46 4684.1 4322.05 4389.74 4592.82 4566.67 4351.79 4549.74 4274.36 4310.26 4262.05 4370.77 1655 2005
    101116112545010 4563.59 4844.62 4231.79 4687.69 4267.69 4387.69 4594.36 4580 4361.03 4556.41 4278.97 4310.77 4274.36 4370.77 1653 2006
    101116112545010 4567.18 4847.18 4233.33 4688.72 4285.13 4409.23 4602.05 4589.23 4368.21 4560 4280.51 4310.77 4281.54 4390.26 1655 2004
    101116112545010 4562.05 4840.51 4227.18 4673.85 4300 4405.13 4611.28 4601.03 4376.41 4561.54 4280 4303.59 4279.49 4374.87 1652 2000
    

    View Slide

11. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 11
    Brain
    14 channels
    128 samples per second
    1,792 values por second
    107,520 values per minute
    6,451,200 values per hour
    

    View Slide

12. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 12
    Perception
    Definition
    become aware of something
    through the senses
    § A state (such as an affective state)
    This is your Y
    

    View Slide

13. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 13
    Brain
    Timestamp Short Term Excitement Long Term Excitement Engagement Meditation Frustration
    101116091145065 0.447595 0.54871 0.834476 0.333844 0.536197
    101116091145190 0.447595 0.54871 0.834476 0.333844 0.536197
    101116091145315 0.447595 0.54871 0.834476 0.333844 0.536197
    101116091145440 0.487864 0.546877 0.834146 0.339548 0.54851
    101116091145565 0.487864 0.546877 0.834146 0.339548 0.54851
    101116091145690 0.487864 0.546877 0.834146 0.339548 0.54851
    101116091145815 0.487864 0.546877 0.834146 0.339548 0.54851
    101116091145940 0.521663 0.545609 0.839321 0.348321 0.558228
    101116091146065 0.521663 0.545609 0.839321 0.348321 0.558228
    101116091146190 0.521663 0.545609 0.839321 0.348321 0.558228
    101116091146315 0.521663 0.545609 0.839321 0.348321 0.558228
    101116091146440 0.509297 0.544131 0.84401 0.358717 0.546771
    101116091146565 0.509297 0.544131 0.84401 0.358717 0.546771
    101116091146690 0.509297 0.544131 0.84401 0.358717 0.546771
    101116091146815 0.509297 0.544131 0.84401 0.358717 0.546771
    101116091146941 0.451885 0.541695 0.848087 0.368071 0.533919
    

    View Slide

14. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 14
    Brain
    14
    5 samples per second
    5 affective states
    25 values per second
    1,500 values per minute
    90,000 values per hour
    

    View Slide

15. jgs
    Emotiv
    Sensing and Perception
    

    View Slide

16. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 16
    https://github.com/pandark/emotiv-community-sdk
    Emotiv
    

    View Slide

17. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 17
    Architecture | Old
    Bluetooth
    API for
    Developers
    Your App
    

    View Slide

18. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 18
    Architecture | New
    Bluetooth
    EMOTIV PRO Your App
    WebSocket
    (server)
    WebSocket
    (client)
    EMOTIV BrainViz
    EMOTIV BCI
    

    View Slide

19. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 19
    Emotiv
    

    View Slide

20. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 20
    Emotiv
    

    View Slide

21. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 21
    Emotiv
    

    View Slide

22. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 22
    Emotiv
    

    View Slide

23. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 23
    https://www.emotiv.com/knowledge-base/connecting-to-service/
    Issues
    

    View Slide

24. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 24
    Emotiv
    

    View Slide

25. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 25
    Emotiv
    

    View Slide

26. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 26
    Emotiv
    

    View Slide

27. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 27
    Emotiv
    

    View Slide

28. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 28
    Theory vs Reality
    

    View Slide

29. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 29
    1. Create an Emotiv Account
    2. Install Emotiv Software (Emotiv PRO)
    3. Review the Cortex API
    https://emotiv.gitbook.io/cortex-api/
    Homework
    

    View Slide

30. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 30
    Homework
    A. Create your Team
    B. Decide what your project will be
    C. Start Working on a proposal
    § What - Problem to be Address
    § Why – Impact or Relevance
    § How – Your product and tools to be used
    § Have something similar been done before?
    § Why are you different?
    (Google Scholar)
    

    View Slide

31. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 31
    Questions
    

    View Slide

32. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 32
    Office Hours
    Tuesday and Thursday 3 - 5 pm
    But an appointment required
    Sent me an email – javiergs@calpoly.edu
    

    View Slide

33. jgs
    CSC 570 Applied Affective Computing
    Javier Gonzalez-Sanchez, Ph.D.
    javiergs@calpoly.edu
    Spring 2023
    Copyright. These slides can only be used as study material for the class CSC308 at Cal Poly.
    They cannot be distributed or used for another purpose.
    

    View Slide