Upgrade to Pro — share decks privately, control downloads, hide ads and more …

CSC570 Lecture 12

CSC570 Lecture 12

Applied Affective Computing
Physiological Sensors
(202305)

Javier Gonzalez-Sanchez
PRO

May 16, 2023
Tweet

More Decks by Javier Gonzalez-Sanchez

Other Decks in Research

Transcript

  1. jgs
    CSC 570
    Current Topics in Computer Science
    Applied Affective Computing
    Lecture 12:
    Physiological Sensors
    Dr. Javier Gonzalez-Sanchez
    [email protected]
    www.javiergs.com
    Building 14 -227
    Office Hours: By appointment

    View Slide

  2. jgs
    Platform

    View Slide

  3. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 3
    Towards This Scenario

    View Slide

  4. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 4
    Homework
    a) Reading mental states (affective states) from Emotiv Software
    (simulator)
    b) Calculate the equivalent PAD vector per emotion.
    c) Calculate a single vector fusing the 6 vectors from step B (one
    per emotion reported by Emotiv.
    d) Draw a dot in a 3D space showing the vector place (magnitude and
    direction from a center that is 0)
    e) Assign each dot a lifetime - dots disappear after that time.
    Consider using an Alpha value to slowly disappear the dot (make
    it transparent)
    f) The group of dots is going to become a cloud of dots given a
    time period. Notice how the cloud evolves.
    g) Bonus: calculate the center of the cloud and draw it on the
    screen
    h) Bonus: draw a vector that shows how this cloud is moving in our
    space

    View Slide

  5. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 5
    Architecture
    EMOTIV PRO
    PAD
    Your App
    WebGazer
    Affective
    States
    👀
    EMOTIV PRO
    PAD Cloud

    View Slide

  6. jgs
    Next

    View Slide

  7. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 7
    Project
    Box
    Name1
    Name2
    class Name1 {
    }
    class Name2 {
    method(){
    Name1
    Cat
    }
    }
    class Cat
    extends Name1 {
    Car
    }
    Cat
    Car

    View Slide

  8. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 8
    Question 03
    Show us What You Have.
    Monday May 22

    View Slide

  9. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 9
    Demo of your project.
    Show your project running (Slide 4)
    What is (will be) the Goal? (Blue Box)
    Wizard of OZ approach
    First Act – Demo

    View Slide

  10. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 10
    How do things work?
    Challenges, Performance, Data Processing (run-time)
    Good SE Practices are being applied?
    (principles, design patterns, clean coding, …)
    Code
    Second Act – Evaluation

    View Slide

  11. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 11
    How will things be Evaluated?
    Population, Protocol, Data, and Analysis
    Third Act – Demo

    View Slide

  12. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 12
    Fusion
    + + +
    + + -
    - + -
    + - +
    + + -
    + - +

    View Slide

  13. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 13
    PAD
    +P+A+D
    Engagement
    +P-A+D
    Meditation
    Concentration
    Thought
    Relaxation
    +P+A-D
    Excitement
    Interest
    Dependence
    +P-A-D
    Starting
    Agreement
    Docility
    -P+A+D
    Disagreement
    Hostility
    -P-A+D
    Disdain
    -P+A-D
    Frustration
    Unsureness
    Anxiety
    -P-A-D
    Boredom
    Pleasure
    (Valence)
    Arousal
    (Activation)
    Dominance

    View Slide

  14. jgs
    Physiological Sensors

    View Slide

  15. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 15

    View Slide

  16. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 16
    § Devices that monitor and measure physiological signals from the human body
    1.Heart Rate Monitor -optical sensors that detect blood flow changes.
    2.Galvanic Skin Response (GSR): Measures the electrical conductance of the skin,
    often used as an indicator of emotional or physiological arousal.
    3.Respiration Monitor
    4.Temperature Sensor
    Definition

    View Slide

  17. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 17
    § The human skin has sweat glands that produce sweat in response to various stimuli,
    including emotional arousal, stress, and excitement.
    § The sweat produced by the sweat glands increases the skin's conductivity, allowing
    electrical currents to flow more easily.
    § Two electrodes are placed on the skin's surface. One electrode, known as the
    "driver," applies a small, harmless electrical current to the skin, while the other
    electrode, known as the ”recorder" electrode, detects the skin's electrical response.
    GSR

    View Slide

  18. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 18
    § https://ieee-dataport.org/documents/
    lie-detection-using-detection-ecg-and-gsr-sensor-readings-dataset
    Polygraph Test

    View Slide

  19. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 19
    § MLII (modified limb lead II) – A type of electrocardiogram (ECG) signal that
    represents the electrical activity of the heart. obtained by placing the electrodes on
    the chest.
    § GSR signals
    § Gaze (Pitch - vertical + Yaw - horizontal),
    § Blinking ratio,
    § Lip ratio
    lie-detection-using-detection-ecg-and-gsr-sensor-readings-dataset

    View Slide

  20. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 20
    Sensors 2012, 12, 6075-6101; doi:10.3390/s120506075

    View Slide

  21. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 21
    Sensors 2012, 12, 6075-6101; doi:10.3390/s120506075

    View Slide

  22. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 22

    View Slide

  23. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 23

    View Slide

  24. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 24
    Galvanic Skin Conductance
    Provide information on the activity of physiological functions of an individual.
    Arousal detection. Measures the electrical conductance of the skin, which
    varies with its moisture level that depends on the sweat glands, which are
    controlled by the sympathetic, and parasympathetic nervous systems. [10]
    Hardware designed by MIT Media Lab.
    It is a Wireless Bluetooth device that reports data in intervals of 500 ms
    approximately (2Hz)
    [10] M. Strauss, C. Reynolds, S. Hughes, K. Park, G. McDarby, and R.W. Picard, “The HandWave Bluetooth Skin Conductance Sensor,” Proc. First International Conference on
    Affective Computing and Intelligent Interaction (ACII 05), Springer-Verlang, Oct. 2005, pp. 699-706, doi:10.1007/11573548_90.

    View Slide

  25. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 25
    Galvanic Skin Conductance

    View Slide

  26. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 26
    Galvanic Skin Conductance
    Field Description Values
    Timestamp
    It is the timestamp (date and time) of the computer running
    the system. It could be used to synchronize the data with other
    sensors.
    Format "yymmddhhmmssSSS"
    (y - year, m - month, d - day, h - hour, m - minutes, s -
    seconds, S - milliseconds).
    Battery Voltage Level of the battery voltage. 0 - 3 Volts
    Conductance Level of arousal. 0 - 3 Volts

    View Slide

  27. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 27
    Galvanic Skin Conductance
    Timestamp Voltage Conductance
    101116101332262 2.482352941 1.030696176
    101116101332762 2.482352941 1.023404165
    101116101333262 2.482352941 1.019813274
    101116101333762 2.482352941 1.041657802
    101116101334247 2.482352941 0.998280273
    101116101334747 2.482352941 0.991181142
    101116101335247 2.482352941 0.980592229
    101116101335747 2.482352941 0.998280273
    101116101336247 2.482352941 1.012586294
    101116101336762 2.482352941 1.012586294
    101116101337231 2.482352941 1.012586294
    101116101337747 2.482352941 1.009008251
    101116101338247 2.482352941 0.998280273
    101116101338747 2.482352941 0.991181142
    101116101339247 2.482352941 0.987628521
    101116101339731 2.482352941 0.987628521
    101116101340231 2.482352941 0.980592229

    View Slide

  28. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 28
    PAD
    +P+A+D
    Engagement
    +P-A+D
    Meditation
    Concentration
    Thought
    Relaxation
    +P+A-D
    Excitement
    Interest
    Dependence
    +P-A-D
    Starting
    Agreement
    Docility
    -P+A+D
    Disagreement
    Hostility
    -P-A+D
    Disdain
    -P+A-D
    Frustration
    Unsureness
    Anxiety
    -P-A-D
    Boredom
    Pleasure
    (Valence)
    Arousal
    (Activation)
    Dominance

    View Slide

  29. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 29
    Ideas

    View Slide

  30. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 30
    Questions

    View Slide

  31. jgs
    Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 | 31
    Office Hours
    Tuesday and Thursday 3 - 5 pm
    But an appointment required
    Sent me an email – [email protected]

    View Slide

  32. jgs
    CSC 570 Applied Affective Computing
    Javier Gonzalez-Sanchez, Ph.D.
    [email protected]
    Spring 2023
    Copyright. These slides can only be used as study material for the class CSC308 at Cal Poly.
    They cannot be distributed or used for another purpose.

    View Slide