Upgrade to Pro — share decks privately, control downloads, hide ads and more …

CSC570 Lecture 04

CSC570 Lecture 04

Applied Affective Computing
Sensing vs. Perception
(202304)

Javier Gonzalez-Sanchez

April 11, 2023
Tweet

More Decks by Javier Gonzalez-Sanchez

Other Decks in Research

Transcript

  1. jgs CSC 570 Current Topics in Computer Science Applied Affective

    Computing Lecture 04: Sensing vs. Perception Dr. Javier Gonzalez-Sanchez [email protected] www.javiergs.com Building 14 -227 Office Hours: By appointment
  2. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    2 Affective Computing + Interactive Interaction (ACII 2023) Demo Deadline: 30th June 2023 September 10–13. Cambridge, MA. https://acii-conf.net/2023/calls/demos/ Conference
  3. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    3 ACM Symposium on User Interface Software and Technology (UIST 2023) Demo Deadline: July 19, 2023 October 29–November 1, California Bay Area. https://uist.acm.org/2023/cfp/#demos Conference
  4. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    7 Sensing Definition measures a physical property § Voltage (difference in charge between two points) § Current (a stream of charged particles) § Temperature § Conductance (Skin) § Audio Signal (Heart Rate) These are your X n
  5. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    10 Brain Timestamp AF3 F7 F3 FC5 T7 P7 O1 O2 P8 T8 FC6 F4 F8 AF4 AccX AccY 101116112544901 4542.05 4831.79 4247.18 4690.26 4282.56 4395.38 4591.79 4569.23 4360 4570.77 4297.44 4311.28 4282.56 4367.18 1660 2003 101116112544901 4536.92 4802.05 4243.08 4673.85 4272.31 4393.33 4592.82 4570.26 4354.87 4570.26 4292.31 4309.74 4277.95 4370.77 1658 2002 101116112545010 4533.33 4798.97 4234.87 4669.74 4301.03 4396.92 4592.31 4570.77 4351.28 4561.03 4281.54 4301.54 4271.28 4363.59 1659 2003 101116112545010 4549.23 4839.49 4241.03 4691.28 4333.85 4397.95 4596.41 4567.18 4355.9 4556.41 4286.15 4306.15 4277.95 4369.74 1659 2003 101116112545010 4580 4865.64 4251.79 4710.26 4340 4401.54 4603.59 4572.82 4360 4558.46 4298.97 4324.62 4296.41 4395.9 1657 2004 101116112545010 4597.44 4860 4252.82 4705.64 4350.26 4412.31 4603.59 4577.44 4357.44 4555.9 4295.38 4329.23 4296.41 4414.36 1656 2005 101116112545010 4584.62 4847.69 4246.67 4690.26 4360 4409.23 4597.44 4569.74 4351.79 4549.74 4278.97 4316.92 4272.82 4399.49 1656 2006 101116112545010 4566.15 4842.05 4238.46 4684.1 4322.05 4389.74 4592.82 4566.67 4351.79 4549.74 4274.36 4310.26 4262.05 4370.77 1655 2005 101116112545010 4563.59 4844.62 4231.79 4687.69 4267.69 4387.69 4594.36 4580 4361.03 4556.41 4278.97 4310.77 4274.36 4370.77 1653 2006 101116112545010 4567.18 4847.18 4233.33 4688.72 4285.13 4409.23 4602.05 4589.23 4368.21 4560 4280.51 4310.77 4281.54 4390.26 1655 2004 101116112545010 4562.05 4840.51 4227.18 4673.85 4300 4405.13 4611.28 4601.03 4376.41 4561.54 4280 4303.59 4279.49 4374.87 1652 2000
  6. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    11 Brain 14 channels 128 samples per second 1,792 values por second 107,520 values per minute 6,451,200 values per hour
  7. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    12 Perception Definition become aware of something through the senses § A state (such as an affective state) This is your Y
  8. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    13 Brain Timestamp Short Term Excitement Long Term Excitement Engagement Meditation Frustration 101116091145065 0.447595 0.54871 0.834476 0.333844 0.536197 101116091145190 0.447595 0.54871 0.834476 0.333844 0.536197 101116091145315 0.447595 0.54871 0.834476 0.333844 0.536197 101116091145440 0.487864 0.546877 0.834146 0.339548 0.54851 101116091145565 0.487864 0.546877 0.834146 0.339548 0.54851 101116091145690 0.487864 0.546877 0.834146 0.339548 0.54851 101116091145815 0.487864 0.546877 0.834146 0.339548 0.54851 101116091145940 0.521663 0.545609 0.839321 0.348321 0.558228 101116091146065 0.521663 0.545609 0.839321 0.348321 0.558228 101116091146190 0.521663 0.545609 0.839321 0.348321 0.558228 101116091146315 0.521663 0.545609 0.839321 0.348321 0.558228 101116091146440 0.509297 0.544131 0.84401 0.358717 0.546771 101116091146565 0.509297 0.544131 0.84401 0.358717 0.546771 101116091146690 0.509297 0.544131 0.84401 0.358717 0.546771 101116091146815 0.509297 0.544131 0.84401 0.358717 0.546771 101116091146941 0.451885 0.541695 0.848087 0.368071 0.533919
  9. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    14 Brain 14 5 samples per second 5 affective states 25 values per second 1,500 values per minute 90,000 values per hour
  10. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    16 https://github.com/pandark/emotiv-community-sdk Emotiv
  11. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    17 Architecture | Old Bluetooth API for Developers Your App
  12. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    18 Architecture | New Bluetooth EMOTIV PRO Your App WebSocket (server) WebSocket (client) EMOTIV BrainViz EMOTIV BCI
  13. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    23 https://www.emotiv.com/knowledge-base/connecting-to-service/ Issues
  14. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    29 1. Create an Emotiv Account 2. Install Emotiv Software (Emotiv PRO) 3. Review the Cortex API https://emotiv.gitbook.io/cortex-api/ Homework
  15. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    30 Homework A. Create your Team B. Decide what your project will be C. Start Working on a proposal § What - Problem to be Address § Why – Impact or Relevance § How – Your product and tools to be used § Have something similar been done before? § Why are you different? (Google Scholar)
  16. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    32 Office Hours Tuesday and Thursday 3 - 5 pm But an appointment required Sent me an email – [email protected]
  17. jgs CSC 570 Applied Affective Computing Javier Gonzalez-Sanchez, Ph.D. [email protected]

    Spring 2023 Copyright. These slides can only be used as study material for the class CSC308 at Cal Poly. They cannot be distributed or used for another purpose.