CSC570 Lecture 04

Applied Affective Computing
Sensing vs. Perception
(202304)

Transcript

1. jgs CSC 570 Current Topics in Computer Science Applied Affective Computing Lecture 04: Sensing vs. Perception Dr. Javier Gonzalez-Sanchez javiergs@calpoly.edu www.javiergs.com Building 14 -227 Office Hours: By appointment
2. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 2 Affective Computing + Interactive Interaction (ACII 2023) Demo Deadline: 30th June 2023 September 10–13. Cambridge, MA. https://acii-conf.net/2023/calls/demos/ Conference
3. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 3 ACM Symposium on User Interface Software and Technology (UIST 2023) Demo Deadline: July 19, 2023 October 29–November 1, California Bay Area. https://uist.acm.org/2023/cfp/#demos Conference
4. jgs Previously …
5. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 5 Workflow
6. jgs Perception and Sensing
7. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 7 Sensing Definition measures a physical property § Voltage (difference in charge between two points) § Current (a stream of charged particles) § Temperature § Conductance (Skin) § Audio Signal (Heart Rate) These are your X n
8. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 8 Emotiv EPOC X
9. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 9 Emotiv Insight
10. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 10 Brain Timestamp AF3 F7 F3 FC5 T7 P7 O1 O2 P8 T8 FC6 F4 F8 AF4 AccX AccY 101116112544901 4542.05 4831.79 4247.18 4690.26 4282.56 4395.38 4591.79 4569.23 4360 4570.77 4297.44 4311.28 4282.56 4367.18 1660 2003 101116112544901 4536.92 4802.05 4243.08 4673.85 4272.31 4393.33 4592.82 4570.26 4354.87 4570.26 4292.31 4309.74 4277.95 4370.77 1658 2002 101116112545010 4533.33 4798.97 4234.87 4669.74 4301.03 4396.92 4592.31 4570.77 4351.28 4561.03 4281.54 4301.54 4271.28 4363.59 1659 2003 101116112545010 4549.23 4839.49 4241.03 4691.28 4333.85 4397.95 4596.41 4567.18 4355.9 4556.41 4286.15 4306.15 4277.95 4369.74 1659 2003 101116112545010 4580 4865.64 4251.79 4710.26 4340 4401.54 4603.59 4572.82 4360 4558.46 4298.97 4324.62 4296.41 4395.9 1657 2004 101116112545010 4597.44 4860 4252.82 4705.64 4350.26 4412.31 4603.59 4577.44 4357.44 4555.9 4295.38 4329.23 4296.41 4414.36 1656 2005 101116112545010 4584.62 4847.69 4246.67 4690.26 4360 4409.23 4597.44 4569.74 4351.79 4549.74 4278.97 4316.92 4272.82 4399.49 1656 2006 101116112545010 4566.15 4842.05 4238.46 4684.1 4322.05 4389.74 4592.82 4566.67 4351.79 4549.74 4274.36 4310.26 4262.05 4370.77 1655 2005 101116112545010 4563.59 4844.62 4231.79 4687.69 4267.69 4387.69 4594.36 4580 4361.03 4556.41 4278.97 4310.77 4274.36 4370.77 1653 2006 101116112545010 4567.18 4847.18 4233.33 4688.72 4285.13 4409.23 4602.05 4589.23 4368.21 4560 4280.51 4310.77 4281.54 4390.26 1655 2004 101116112545010 4562.05 4840.51 4227.18 4673.85 4300 4405.13 4611.28 4601.03 4376.41 4561.54 4280 4303.59 4279.49 4374.87 1652 2000
11. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 11 Brain 14 channels 128 samples per second 1,792 values por second 107,520 values per minute 6,451,200 values per hour
12. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 12 Perception Definition become aware of something through the senses § A state (such as an affective state) This is your Y
13. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 13 Brain Timestamp Short Term Excitement Long Term Excitement Engagement Meditation Frustration 101116091145065 0.447595 0.54871 0.834476 0.333844 0.536197 101116091145190 0.447595 0.54871 0.834476 0.333844 0.536197 101116091145315 0.447595 0.54871 0.834476 0.333844 0.536197 101116091145440 0.487864 0.546877 0.834146 0.339548 0.54851 101116091145565 0.487864 0.546877 0.834146 0.339548 0.54851 101116091145690 0.487864 0.546877 0.834146 0.339548 0.54851 101116091145815 0.487864 0.546877 0.834146 0.339548 0.54851 101116091145940 0.521663 0.545609 0.839321 0.348321 0.558228 101116091146065 0.521663 0.545609 0.839321 0.348321 0.558228 101116091146190 0.521663 0.545609 0.839321 0.348321 0.558228 101116091146315 0.521663 0.545609 0.839321 0.348321 0.558228 101116091146440 0.509297 0.544131 0.84401 0.358717 0.546771 101116091146565 0.509297 0.544131 0.84401 0.358717 0.546771 101116091146690 0.509297 0.544131 0.84401 0.358717 0.546771 101116091146815 0.509297 0.544131 0.84401 0.358717 0.546771 101116091146941 0.451885 0.541695 0.848087 0.368071 0.533919
14. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 14 Brain 14 5 samples per second 5 affective states 25 values per second 1,500 values per minute 90,000 values per hour
15. jgs Emotiv Sensing and Perception
16. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 16 https://github.com/pandark/emotiv-community-sdk Emotiv
17. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 17 Architecture | Old Bluetooth API for Developers Your App
18. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 18 Architecture | New Bluetooth EMOTIV PRO Your App WebSocket (server) WebSocket (client) EMOTIV BrainViz EMOTIV BCI
19. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 19 Emotiv
20. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 20 Emotiv
21. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 21 Emotiv
22. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 22 Emotiv
23. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 23 https://www.emotiv.com/knowledge-base/connecting-to-service/ Issues
24. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 24 Emotiv
25. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 25 Emotiv
26. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 26 Emotiv
27. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 27 Emotiv
28. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 28 Theory vs Reality
29. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 29 1. Create an Emotiv Account 2. Install Emotiv Software (Emotiv PRO) 3. Review the Cortex API https://emotiv.gitbook.io/cortex-api/ Homework
30. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 30 Homework A. Create your Team B. Decide what your project will be C. Start Working on a proposal § What - Problem to be Address § Why – Impact or Relevance § How – Your product and tools to be used § Have something similar been done before? § Why are you different? (Google Scholar)
31. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 31 Questions
32. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 32 Office Hours Tuesday and Thursday 3 - 5 pm But an appointment required Sent me an email – javiergs@calpoly.edu
33. jgs CSC 570 Applied Affective Computing Javier Gonzalez-Sanchez, Ph.D. javiergs@calpoly.edu Spring 2023 Copyright. These slides can only be used as study material for the class CSC308 at Cal Poly. They cannot be distributed or used for another purpose.