CSC570 Lecture 12

Applied Affective Computing
Physiological Sensors
(202305)

Transcript

1. jgs CSC 570 Current Topics in Computer Science Applied Affective Computing Lecture 12: Physiological Sensors Dr. Javier Gonzalez-Sanchez javiergs@calpoly.edu www.javiergs.com Building 14 -227 Office Hours: By appointment
2. jgs Platform
3. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 3 Towards This Scenario
4. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 4 Homework a) Reading mental states (affective states) from Emotiv Software (simulator) b) Calculate the equivalent PAD vector per emotion. c) Calculate a single vector fusing the 6 vectors from step B (one per emotion reported by Emotiv. d) Draw a dot in a 3D space showing the vector place (magnitude and direction from a center that is 0) e) Assign each dot a lifetime - dots disappear after that time. Consider using an Alpha value to slowly disappear the dot (make it transparent) f) The group of dots is going to become a cloud of dots given a time period. Notice how the cloud evolves. g) Bonus: calculate the center of the cloud and draw it on the screen h) Bonus: draw a vector that shows how this cloud is moving in our space
5. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 5 Architecture EMOTIV PRO PAD Your App WebGazer Affective States 👀 EMOTIV PRO PAD Cloud
6. jgs Next
7. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 7 Project Box Name1 Name2 class Name1 { } class Name2 { method(){ Name1 Cat } } class Cat extends Name1 { Car } Cat Car
8. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 8 Question 03 Show us What You Have. Monday May 22
9. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 9 Demo of your project. Show your project running (Slide 4) What is (will be) the Goal? (Blue Box) Wizard of OZ approach First Act – Demo
10. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 10 How do things work? Challenges, Performance, Data Processing (run-time) Good SE Practices are being applied? (principles, design patterns, clean coding, …) Code Second Act – Evaluation
11. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 11 How will things be Evaluated? Population, Protocol, Data, and Analysis Third Act – Demo
12. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 12 Fusion + + + + + - - + - + - + + + - + - +
13. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 13 PAD +P+A+D Engagement +P-A+D Meditation Concentration Thought Relaxation +P+A-D Excitement Interest Dependence +P-A-D Starting Agreement Docility -P+A+D Disagreement Hostility -P-A+D Disdain -P+A-D Frustration Unsureness Anxiety -P-A-D Boredom Pleasure (Valence) Arousal (Activation) Dominance
14. jgs Physiological Sensors
15. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 15
16. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 16 § Devices that monitor and measure physiological signals from the human body 1.Heart Rate Monitor -optical sensors that detect blood flow changes. 2.Galvanic Skin Response (GSR): Measures the electrical conductance of the skin, often used as an indicator of emotional or physiological arousal. 3.Respiration Monitor 4.Temperature Sensor Definition
17. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 17 § The human skin has sweat glands that produce sweat in response to various stimuli, including emotional arousal, stress, and excitement. § The sweat produced by the sweat glands increases the skin's conductivity, allowing electrical currents to flow more easily. § Two electrodes are placed on the skin's surface. One electrode, known as the "driver," applies a small, harmless electrical current to the skin, while the other electrode, known as the ”recorder" electrode, detects the skin's electrical response. GSR
18. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 18 § https://ieee-dataport.org/documents/ lie-detection-using-detection-ecg-and-gsr-sensor-readings-dataset Polygraph Test
19. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 19 § MLII (modified limb lead II) – A type of electrocardiogram (ECG) signal that represents the electrical activity of the heart. obtained by placing the electrodes on the chest. § GSR signals § Gaze (Pitch - vertical + Yaw - horizontal), § Blinking ratio, § Lip ratio lie-detection-using-detection-ecg-and-gsr-sensor-readings-dataset
20. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 20 Sensors 2012, 12, 6075-6101; doi:10.3390/s120506075
21. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 21 Sensors 2012, 12, 6075-6101; doi:10.3390/s120506075
22. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 22
23. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 23
24. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 24 Galvanic Skin Conductance Provide information on the activity of physiological functions of an individual. Arousal detection. Measures the electrical conductance of the skin, which varies with its moisture level that depends on the sweat glands, which are controlled by the sympathetic, and parasympathetic nervous systems. [10] Hardware designed by MIT Media Lab. It is a Wireless Bluetooth device that reports data in intervals of 500 ms approximately (2Hz) [10] M. Strauss, C. Reynolds, S. Hughes, K. Park, G. McDarby, and R.W. Picard, “The HandWave Bluetooth Skin Conductance Sensor,” Proc. First International Conference on Affective Computing and Intelligent Interaction (ACII 05), Springer-Verlang, Oct. 2005, pp. 699-706, doi:10.1007/11573548_90.
25. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 25 Galvanic Skin Conductance
26. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 26 Galvanic Skin Conductance Field Description Values Timestamp It is the timestamp (date and time) of the computer running the system. It could be used to synchronize the data with other sensors. Format "yymmddhhmmssSSS" (y - year, m - month, d - day, h - hour, m - minutes, s - seconds, S - milliseconds). Battery Voltage Level of the battery voltage. 0 - 3 Volts Conductance Level of arousal. 0 - 3 Volts
27. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 27 Galvanic Skin Conductance Timestamp Voltage Conductance 101116101332262 2.482352941 1.030696176 101116101332762 2.482352941 1.023404165 101116101333262 2.482352941 1.019813274 101116101333762 2.482352941 1.041657802 101116101334247 2.482352941 0.998280273 101116101334747 2.482352941 0.991181142 101116101335247 2.482352941 0.980592229 101116101335747 2.482352941 0.998280273 101116101336247 2.482352941 1.012586294 101116101336762 2.482352941 1.012586294 101116101337231 2.482352941 1.012586294 101116101337747 2.482352941 1.009008251 101116101338247 2.482352941 0.998280273 101116101338747 2.482352941 0.991181142 101116101339247 2.482352941 0.987628521 101116101339731 2.482352941 0.987628521 101116101340231 2.482352941 0.980592229
28. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 28 PAD +P+A+D Engagement +P-A+D Meditation Concentration Thought Relaxation +P+A-D Excitement Interest Dependence +P-A-D Starting Agreement Docility -P+A+D Disagreement Hostility -P-A+D Disdain -P+A-D Frustration Unsureness Anxiety -P-A-D Boredom Pleasure (Valence) Arousal (Activation) Dominance
29. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 29 Ideas
30. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 30 Questions
31. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 31 Office Hours Tuesday and Thursday 3 - 5 pm But an appointment required Sent me an email – javiergs@calpoly.edu
32. jgs CSC 570 Applied Affective Computing Javier Gonzalez-Sanchez, Ph.D. javiergs@calpoly.edu Spring 2023 Copyright. These slides can only be used as study material for the class CSC308 at Cal Poly. They cannot be distributed or used for another purpose.