# CSC570 Lecture 12

Applied Affective Computing
Physiological Sensors
(202305)

May 16, 2023

## Transcript

1. jgs
CSC 570
Current Topics in Computer Science
Applied Affective Computing
Lecture 12:
Physiological Sensors
Dr. Javier Gonzalez-Sanchez
[email protected]
www.javiergs.com
Building 14 -227
Office Hours: By appointment

2. jgs
Platform

3. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 3
Towards This Scenario

4. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 4
Homework
a) Reading mental states (affective states) from Emotiv Software
(simulator)
b) Calculate the equivalent PAD vector per emotion.
c) Calculate a single vector fusing the 6 vectors from step B (one
per emotion reported by Emotiv.
d) Draw a dot in a 3D space showing the vector place (magnitude and
direction from a center that is 0)
e) Assign each dot a lifetime - dots disappear after that time.
Consider using an Alpha value to slowly disappear the dot (make
it transparent)
f) The group of dots is going to become a cloud of dots given a
time period. Notice how the cloud evolves.
g) Bonus: calculate the center of the cloud and draw it on the
screen
h) Bonus: draw a vector that shows how this cloud is moving in our
space

5. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 5
Architecture
EMOTIV PRO
WebGazer
Affective
States
👀
EMOTIV PRO

6. jgs
Next

7. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 7
Project
Box
Name1
Name2
class Name1 {
}
class Name2 {
method(){
Name1
Cat
}
}
class Cat
extends Name1 {
Car
}
Cat
Car

8. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 8
Question 03
Show us What You Have.
Monday May 22

9. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 9
Show your project running (Slide 4)
What is (will be) the Goal? (Blue Box)
Wizard of OZ approach
First Act – Demo

10. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 10
How do things work?
Challenges, Performance, Data Processing (run-time)
Good SE Practices are being applied?
(principles, design patterns, clean coding, …)
Code
Second Act – Evaluation

11. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 11
How will things be Evaluated?
Population, Protocol, Data, and Analysis
Third Act – Demo

12. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 12
Fusion
+ + +
+ + -
- + -
+ - +
+ + -
+ - +

13. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 13
+P+A+D
Engagement
+P-A+D
Meditation
Concentration
Thought
Relaxation
+P+A-D
Excitement
Interest
Dependence
+P-A-D
Starting
Agreement
Docility
-P+A+D
Disagreement
Hostility
-P-A+D
Disdain
-P+A-D
Frustration
Unsureness
Anxiety
-P-A-D
Boredom
Pleasure
(Valence)
Arousal
(Activation)
Dominance

14. jgs
Physiological Sensors

15. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 15

16. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 16
§ Devices that monitor and measure physiological signals from the human body
1.Heart Rate Monitor -optical sensors that detect blood flow changes.
2.Galvanic Skin Response (GSR): Measures the electrical conductance of the skin,
often used as an indicator of emotional or physiological arousal.
3.Respiration Monitor
4.Temperature Sensor
Definition

17. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 17
§ The human skin has sweat glands that produce sweat in response to various stimuli,
including emotional arousal, stress, and excitement.
§ The sweat produced by the sweat glands increases the skin's conductivity, allowing
electrical currents to flow more easily.
§ Two electrodes are placed on the skin's surface. One electrode, known as the
"driver," applies a small, harmless electrical current to the skin, while the other
electrode, known as the ”recorder" electrode, detects the skin's electrical response.
GSR

18. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 18
§ https://ieee-dataport.org/documents/
Polygraph Test

19. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 19
§ MLII (modified limb lead II) – A type of electrocardiogram (ECG) signal that
represents the electrical activity of the heart. obtained by placing the electrodes on
the chest.
§ GSR signals
§ Gaze (Pitch - vertical + Yaw - horizontal),
§ Lip ratio

20. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 20
Sensors 2012, 12, 6075-6101; doi:10.3390/s120506075

21. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 21
Sensors 2012, 12, 6075-6101; doi:10.3390/s120506075

22. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 22

23. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 23

24. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 24
Galvanic Skin Conductance
Provide information on the activity of physiological functions of an individual.
Arousal detection. Measures the electrical conductance of the skin, which
varies with its moisture level that depends on the sweat glands, which are
controlled by the sympathetic, and parasympathetic nervous systems. [10]
Hardware designed by MIT Media Lab.
It is a Wireless Bluetooth device that reports data in intervals of 500 ms
approximately (2Hz)
[10] M. Strauss, C. Reynolds, S. Hughes, K. Park, G. McDarby, and R.W. Picard, “The HandWave Bluetooth Skin Conductance Sensor,” Proc. First International Conference on
Affective Computing and Intelligent Interaction (ACII 05), Springer-Verlang, Oct. 2005, pp. 699-706, doi:10.1007/11573548_90.

25. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 25
Galvanic Skin Conductance

26. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 26
Galvanic Skin Conductance
Field Description Values
Timestamp
It is the timestamp (date and time) of the computer running
the system. It could be used to synchronize the data with other
sensors.
Format "yymmddhhmmssSSS"
(y - year, m - month, d - day, h - hour, m - minutes, s -
seconds, S - milliseconds).
Battery Voltage Level of the battery voltage. 0 - 3 Volts
Conductance Level of arousal. 0 - 3 Volts

27. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 27
Galvanic Skin Conductance
Timestamp Voltage Conductance
101116101332262 2.482352941 1.030696176
101116101332762 2.482352941 1.023404165
101116101333262 2.482352941 1.019813274
101116101333762 2.482352941 1.041657802
101116101334247 2.482352941 0.998280273
101116101334747 2.482352941 0.991181142
101116101335247 2.482352941 0.980592229
101116101335747 2.482352941 0.998280273
101116101336247 2.482352941 1.012586294
101116101336762 2.482352941 1.012586294
101116101337231 2.482352941 1.012586294
101116101337747 2.482352941 1.009008251
101116101338247 2.482352941 0.998280273
101116101338747 2.482352941 0.991181142
101116101339247 2.482352941 0.987628521
101116101339731 2.482352941 0.987628521
101116101340231 2.482352941 0.980592229

28. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 28
+P+A+D
Engagement
+P-A+D
Meditation
Concentration
Thought
Relaxation
+P+A-D
Excitement
Interest
Dependence
+P-A-D
Starting
Agreement
Docility
-P+A+D
Disagreement
Hostility
-P-A+D
Disdain
-P+A-D
Frustration
Unsureness
Anxiety
-P-A-D
Boredom
Pleasure
(Valence)
Arousal
(Activation)
Dominance

29. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 29
Ideas

30. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 30
Questions

31. jgs
Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 31
Office Hours
Tuesday and Thursday 3 - 5 pm
But an appointment required
Sent me an email – [email protected]

32. jgs
CSC 570 Applied Affective Computing
Javier Gonzalez-Sanchez, Ph.D.
[email protected]
Spring 2023
Copyright. These slides can only be used as study material for the class CSC308 at Cal Poly.
They cannot be distributed or used for another purpose.