Upgrade to Pro — share decks privately, control downloads, hide ads and more …

CSC570 Lecture 08

Javier Gonzalez-Sanchez
PRO
April 25, 2023
Research
0
160

CSC570 Lecture 08

Applied Affective Computing
Gaze Tracking
(202304)

Javier Gonzalez-Sanchez
PRO

April 25, 2023
Tweet

More Decks by Javier Gonzalez-Sanchez

See All by Javier Gonzalez-Sanchez
CSC305 Lecture 26
javiergs
PRO
0
140
CSC305 Lecture 25
javiergs
PRO
0
140
CSC509 Lecture 14
javiergs
PRO
0
140
CSC305 Lecture 24
javiergs
PRO
0
49
CSC509 Lecture 13
javiergs
PRO
0
170
CSC305 Lecture 23
javiergs
PRO
1
130
CSC305 Lecture 22
javiergs
PRO
0
62
CSC509 Lecture 12
javiergs
PRO
0
210
CSC305 Lecture 21
javiergs
PRO
0
200

Other Decks in Research

See All in Research
医療支援AI開発における臨床と情報学の連携を円滑に進めるために
moda0
0
120
Weekly AI Agents News! 11月号 プロダクト/ニュースのアーカイブ
masatoto
0
220
The Relevance of UX for Conversion and Monetisation
itasohaakhib1
0
120
最近のVisual Odometryと Depth Estimation
sgk
1
320
marukotenant01/tenant-20240916
marketing2024
0
620
ダイナミックプライシング とその実例
skmr2348
3
490
論文読み会 KDD2024 | Relevance meets Diversity: A User-Centric Framework for Knowledge Exploration through Recommendations
cocomoff
0
120
ECCV2024読み会: Minimalist Vision with Freeform Pixels
hsmtta
1
310
Whoisの闇
hirachan
3
180
日本語医療LLM評価ベンチマークの構築と性能分析
fta98
3
790
129 2 th
0325
0
250
文献紹介：A Multidimensional Framework for Evaluating Lexical Semantic Change with Social Science Applications
a1da4
1
240

Featured

See All Featured
Agile that works and the tools we love
rasmusluckow
328
21k
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
PRO
10
810
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
48
2.2k
Designing for Performance
lara
604
68k
Fantastic passwords and where to find them - at NoRuKo
philnash
50
2.9k
No one is an island. Learnings from fostering a developers community.
thoeni
19
3k
YesSQL, Process and Tooling at Scale
rocio
170
14k
Visualization
eitanlees
146
15k
Building Flexible Design Systems
yeseniaperezcruz
327
38k
Art, The Web, and Tiny UX
lynnandtonic
298
20k
The Cult of Friendly URLs
andyhume
78
6.1k
The Web Performance Landscape in 2024 [PerfNow 2024]
tammyeverts
2
300

Transcript

  1. jgs CSC 570 Current Topics in Computer Science Applied Affective

    Computing Lecture 08: Gaze Tracking Dr. Javier Gonzalez-Sanchez [email protected] www.javiergs.com Building 14 -227 Office Hours: By appointment

  2. jgs Previously … Lab 01 and Assignment 02

  3. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    3 Assignment 02 • Open or Closed Eyes VS. Brain • 5 diverse stimulation scenarios VS. Brain • 5 diverse stimulation scenarios VS. Affect Follow 2 approaches: a) Clustering as described today (EM, K-means, Density) b) Explore another solution to the best of your knowledge (Machine Learning, Data mining, Statistics) Due: Monday (April 24)

  4. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    4 Lab 01 • 5 diverse stimulation scenarios VS. Brain • 5 diverse stimulation scenarios VS. Affect Follow Random Forest approach Due: Monday (April 26)

  5. jgs Preprocessing the Dataset UCI Emotiv

  6. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    6 1) EEG.AF3 2) EEG.F7 3) EEG.F3 4) EEG.FC5 5) EEG.T7 6) EEG.P7 7) EEG.O1 8) EEG.O2 9) EEG.P8 10)EEG.T8 11)EEG.FC6 12)EEG.F4 13)EEG.F8 14)EEG.AF4 Dataset Attributes | X

  7. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    7 Dataset Attributes | X 1) PM.Engagement.Scaled 2) PM.Excitement.Scaled 3) PM.Stress.Scaled 4) PM.Relaxation.Scaled 5) PM.Interest.Scaled 6) PM.Focus.Scaled

  8. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    8 § EEG.MarkerValueInt Dataset Attributes | Y

  9. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    9 § https://webgazer.cs.brown.edu § eye tracking library using common webcams to infer the eye-gaze locations of web visitors on a page in real-time. § written in JavaScript § can be integrated into a website § runs entirely in the client browser, so no video data needs to be sent to a server, and it requires the user's consent to access their webcam. WebGazer

  10. jgs Assignment 03

  11. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    11 Assignment 03 • Collect EEG Data (Emotiv PRO) • Collect Gaze Tracking Data (WebGazer) • Save the integrated data in a Dataset (CSV or ARFF file)

  12. jgs Assignment 03 | Part 01

  13. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    13 Add Lab 2 into the New Assignment 03 Imagen (photo) Observer 1 minute Record data What was the part that catch attention?

  14. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    14 § https://github.com/brownhci/WebGazer/blob/master/www/calibration.html Callibration

  15. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    15 Example

  16. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    16 <html> <head> <script src="./webgazer.js"></script> </head> <body> <div style="text-align: right;" id="gazeData"></div> <script> webgazer.resume(); webgazer.setGazeListener(function(data, elapsedTime) { if (data != null) { var x = data.x; var y = data.y; document.getElementById("gazeData").innerHTML = "Gaze coordinates: x=" + x + ", y=" + y; } }).begin(); </script> <!-- work here … --> Template

  17. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    17 <!-- work here … --> <style> html, body {height: 100%;margin: 0; padding: 0; } table {width: 100%;height: 100%;border-collapse: collapse;} td {border: 1px solid black;} </style> <table> <tr> <td>Cell 1</td> <td>Cell 2</td> <td>Cell 3</td> </tr> <tr> <td>Cell 4</td> <td>Cell 5</td> <td>Cell 6</td> </tr> <tr> <td>Cell 7</td> <td>Cell 8</td> <td>Cell 9</td> </tr> </table> </body> </html> Template

  18. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    18 Towards This Scenario

  19. jgs Assignment 03 | Part 02

  20. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    20 Emotiv

  21. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    21 Architecture Bluetooth EMOTIV PRO Your App WebSocket (server) WebSocket (client) EMOTIV BrainViz EMOTIV BCI

  22. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    22 Let’s Work

  23. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    23 Questions

  24. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    24 Office Hours Tuesday and Thursday 3 - 5 pm But an appointment required Sent me an email – [email protected]

  25. jgs CSC 570 Applied Affective Computing Javier Gonzalez-Sanchez, Ph.D. [email protected]

    Spring 2023 Copyright. These slides can only be used as study material for the class CSC308 at Cal Poly. They cannot be distributed or used for another purpose.