Slide 1

Slide 1 text

Dr. Javier Gonzalez-Sanchez [email protected] www.javiergs.info o ffi ce: 14 -227 CSC 570 Current Topics in Computer Science Applied Affective Computing Lecture 01. Course Presentation

Slide 2

Slide 2 text

Introductions

Slide 3

Slide 3 text

First n a me L a st n a me Dr. J a vier Gonz a lez-S a nchez j a viergs@c a lpoly.edu www.j a viergs.info Contact Information

Slide 4

Slide 4 text

Where Am I from?

Slide 5

Slide 5 text

Context 5 
 HCI Affective Computing 
 SW Engineering Self- Adaptive Systems

Slide 6

Slide 6 text

Context 6 Rosalind Picard MIT MediaLab Winslow Burleson University of Arizona My PhD Advisor 
 HCI Affective Computing 1997 
 SW Engineering Self- Adaptive Systems

Slide 7

Slide 7 text

Context 7 Rosalind Picard MIT MediaLab Winslow Burleson University of Arizona My PhD Advisor 
 HCI Affective Computing 1997 
 SW Engineering Self- Adaptive Systems 
 SW Engineering Self- Adaptive Systems David Garlan Carnegie Mellon Rainbow Framework

Slide 8

Slide 8 text

www.j a viergs.info/te a ching/ At CSU: Softw a re Engineering (CSC 305, CSC 307, 308, 309, 508, 509) Hum a n-Computer Inter a ction (CSC 486 a nd CSC 570) Teaching

Slide 9

Slide 9 text

Research 9 Research

Slide 10

Slide 10 text

Your Turn • Wh a t is your n a me (or how you go by it)? • Why a re you here? • Did you took 307/308/309/486?

Slide 11

Slide 11 text

Course Content

Slide 12

Slide 12 text

De f inition Applied Affective Computing 12

Slide 13

Slide 13 text

Emotions Motivation 13 - signals what humans care about - are involved in rational decision-making and action selection.


Slide 14

Slide 14 text

Motivation 14 Rational decision-making

Slide 15

Slide 15 text

Motivation 15

Slide 16

Slide 16 text

Key Ideas 16

Slide 17

Slide 17 text

Tools (a.k.a. toys)

Slide 18

Slide 18 text

Brain-Computer Interfaces • Emotiv He a dsets https://www.emotiv.com/ • D a t a https://emotiv.gitbook.io/cortex-api/data-subscription/data-sample-object 18

Slide 19

Slide 19 text

• Met a Quest https://developers.meta.com/horizon/resources/compare-devices/ AR/VR 19

Slide 20

Slide 20 text

Eye Tracking • Tobii Sp a rk https://www.tobii.com/products/eye-trackers/screen-based/tobii-pro-spark • Tobii SDK https://www.tobii.com/products/software/applications-and-developer-kits/tobii-pro-sdk 20

Slide 21

Slide 21 text

Cobot • Univers a l Robotics e-Series https://www.universal-robots.com/media/1802432/e-series-brochure.pdf • Comm a nds th a t c a n be used https://s3-eu-west-1.amazonaws.com/ur-support-site/29983/Script command Examples.pdf 21

Slide 22

Slide 22 text

Eye Tracking • Petoi https://www.petoi.com/pages/software-apps • Arduino IoT (with MQTT) https://docs.arduino.cc/tutorials/uno-wifi-rev2/uno-wifi-r2-mqtt-device-to-device/ 22

Slide 23

Slide 23 text

Examples

Slide 24

Slide 24 text

Affect Recognition 24 BCI and Gaze Points engagement

Slide 25

Slide 25 text

Affect Recognition 25 BCI and Gaze Points frustration

Slide 26

Slide 26 text

Chavez, M., Christopherson, R., Gonzalez-Sanchez, J., Atkinson, R. User Experience. 2018 https://youtu.be/T9nBNYfvhbY Neuromarketing 26

Slide 27

Slide 27 text

Games 27 Harris, A., Hoch, A., Kral, R., Teposte, M., Villa, A., et. al. Including affect-driven adaptation to the Pac-Man video game. ACM ISWC 2014 https://youtu.be/7KbDUX0l7kM

Slide 28

Slide 28 text

Games 28 Bernays, R., Mone, J., Yau, P., Murcia, M., Gonzalez-Sanchez, J., et al. Lost in the dark: ACM UIST 2012 https://youtu.be/3ACKveG1arg

Slide 29

Slide 29 text

VR 29 Hang, B., Loucks, S., Patel, P., Wiseman, K. Capstone Project 2021 https://youtu.be/ZY6_0-A1n5s

Slide 30

Slide 30 text

Canete, A., Gonzalez-Sanchez, J. & Guerra-Silva, R. (2024). Exploring Cognition and Affect during Human-Cobot Interaction. 288–291. https://youtu.be/tpl3L49v6eA?si=Mzv_qi39D-ZOYEC0 Human-Robot Interaction 30

Slide 31

Slide 31 text

Tutoring Systems 31 VanLehn, K., Burleson, W., Chavez, M., Gonzalez-Sanchez, J., et al. The Affective Meta-Tutoring project ITS 2014 - 2018

Slide 32

Slide 32 text

Syllabus

Slide 33

Slide 33 text

Guidelines 33 Attendance (participation) is Expected

Slide 34

Slide 34 text

Guidelines 34 Hours per Week

Slide 35

Slide 35 text

Guidelines 35 Late Assignments

Slide 36

Slide 36 text

Guidelines 36 Regularly visit our course page on Canvas

Slide 37

Slide 37 text

Grading 38 Team Project + Paper 40% 30% Assignments, Quizzes, Labs 20% Final Exam 5% Attendance & Participation 5% Self / Peer Evaluation 100%

Slide 38

Slide 38 text

Grading 39 100 A >= 96.5 A- >= 93.0 B+ >= 89.5 B >= 86.0 B- >= 82.5 C+ >= 79 C >= 75.5 C- >= 72.0 D+ >= 68.5 D >= 65.0 D- >= 61.5 F < 61.5

Slide 39

Slide 39 text

Details for Final Project and Paper

Slide 40

Slide 40 text

Final Project a ) Fin a l Version of your Source Code - submit your J a v a f iles b) D a t a set - collected or simul a ted c) short p a per - (4 p a ges) d) Final presentation video – Sh a re a link to your recorded present a tion. 41

Slide 41

Slide 41 text

Short Paper 42 Go to: https://template-selector.ieee.org/ And select conferences.

Slide 42

Slide 42 text

Short Paper • Title – A concise a nd descriptive title th a t re f lects the m a in topic of the p a per. • Abstr a ct (Option a l) – A brief summ a ry (usu a lly 150–250 words) outlining the p a per’s objective, key f indings, a nd conclusions. • Introduction (-1) – Introduces the m a in topic, a nd st a tes the rese a rch question or problem. It should highlight the project purpose a nd signi f ic a nce. WHAT you did a nd WHY • B a ckground (-1-) – Summ a rizes relev a nt context: BCI or Eye Tr a cking, or XR, or Robotics, even Docker. Things th a t a lre a dy exist a nd you used • Methodology – Brie f ly expl a ins HOW d a t a w a s collected or a n a lyzed or HOW you implemented a n a pplic a tion th a t a d a pt in re a l-time • Discussion/An a lysis/Product (-1-) – Presents a rguments, evidence, or insights a bout wh a t work a nd wh a t did not. Showc a se your a chievements a nd do not be a fr a id to disclose f a ilures. • Conclusion – Summ a rizes the m a in points, reinforces key f indings, a nd m a y suggest future rese a rch or a pplic a tions. • References (1) – Lists sources cited in the p a per, following the required cit a tion form a t (e.g., APA, IEEE, or MLA). 43

Slide 43

Slide 43 text

Presentation Demo of your project. Show your project running. :: notes :: you c a n, a ddition a lly, t a lk (brie f ly) a bout your extr a items or missing items. 44

Slide 44

Slide 44 text

References

Slide 45

Slide 45 text

References

Slide 46

Slide 46 text

Questions 47

Slide 47

Slide 47 text

CSC 570 Applied Affective Computing Javier Gonzalez-Sanchez, Ph.D. [email protected] Spring 2025 Copyright. These slides can only be used as study material for the class CSC 570 at Cal Poly. They cannot be distributed or used for another purpose.