Upgrade to Pro — share decks privately, control downloads, hide ads and more …

CSC570 Lecture 08

Javier Gonzalez-Sanchez
PRO
April 25, 2023
Research
0
150

CSC570 Lecture 08

Applied Affective Computing
Gaze Tracking
(202304)

Javier Gonzalez-Sanchez
PRO

April 25, 2023
Tweet

More Decks by Javier Gonzalez-Sanchez

See All by Javier Gonzalez-Sanchez
CSC509 Lecture 13
javiergs
PRO
0
110
CSC305 Lecture 22
javiergs
PRO
0
61
CSC305 Lecture 22
javiergs
PRO
0
24
CSC509 Lecture 12
javiergs
PRO
0
160
CSC305 Lecture 21
javiergs
PRO
0
75
CSC305 Lecture 20
javiergs
PRO
0
59
CSC305 Lecture 19
javiergs
PRO
0
53
CSC509 Lecture 11
javiergs
PRO
0
180
CSC305 Lecture 18
javiergs
PRO
0
74

Other Decks in Research

See All in Research
医療支援AI開発における臨床と情報学の連携を円滑に進めるために
moda0
0
110
129 2 th
0325
0
240
VisFocus: Prompt-Guided Vision Encoders for OCR-Free Dense Document Understanding
sansan_randd
1
250
Large Vision Language Model (LVLM) に関する最新知見まとめ (Part 1)
onely7
21
3.5k
研究の進め方 ランダムネスとの付き合い方について
joisino
PRO
55
19k
Physics of Language Models: Part 3.1, Knowledge Storage and Extraction
sosk
1
950
3次元点群の分類における評価指標について
kentaitakura
0
430
熊本から日本の都市交通政策を立て直す～「車1割削減、渋滞半減、公共交通2倍」の実現へ～＠公共交通マーケティング研究会リスタートセミナー
trafficbrain
0
140
Weekly AI Agents News! 8月号 論文のアーカイブ
masatoto
1
180
機械学習でヒトの行動を変える
hiromu1996
1
310
20240820: Minimum Bayes Risk Decoding for High-Quality Text Generation Beyond High-Probability Text
de9uch1
0
120
20240918 交通くまもとーく 未来の鉄道網編（こねくま）
trafficbrain
0
230

Featured

See All Featured
How GitHub (no longer) Works
holman
310
140k
Facilitating Awesome Meetings
lara
50
6.1k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
27
4.3k
Building a Modern Day 
E-commerce SEO Strategy
aleyda
38
6.9k
YesSQL, Process and Tooling at Scale
rocio
169
14k
Music & Morning Musume
bryan
46
6.2k
Keith and Marios Guide to Fast Websites
keithpitt
409
22k
It's Worth the Effort
3n
183
27k
How STYLIGHT went responsive
nonsquared
95
5.2k
Rebuilding a faster, lazier Slack
samanthasiow
79
8.7k
A designer walks into a library…
pauljervisheath
204
24k
Learning to Love Humans: Emotional Interface Design
aarron
273
40k

Transcript

  1. jgs CSC 570 Current Topics in Computer Science Applied Affective

    Computing Lecture 08: Gaze Tracking Dr. Javier Gonzalez-Sanchez [email protected] www.javiergs.com Building 14 -227 Office Hours: By appointment

  2. jgs Previously … Lab 01 and Assignment 02

  3. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    3 Assignment 02 • Open or Closed Eyes VS. Brain • 5 diverse stimulation scenarios VS. Brain • 5 diverse stimulation scenarios VS. Affect Follow 2 approaches: a) Clustering as described today (EM, K-means, Density) b) Explore another solution to the best of your knowledge (Machine Learning, Data mining, Statistics) Due: Monday (April 24)

  4. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    4 Lab 01 • 5 diverse stimulation scenarios VS. Brain • 5 diverse stimulation scenarios VS. Affect Follow Random Forest approach Due: Monday (April 26)

  5. jgs Preprocessing the Dataset UCI Emotiv

  6. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    6 1) EEG.AF3 2) EEG.F7 3) EEG.F3 4) EEG.FC5 5) EEG.T7 6) EEG.P7 7) EEG.O1 8) EEG.O2 9) EEG.P8 10)EEG.T8 11)EEG.FC6 12)EEG.F4 13)EEG.F8 14)EEG.AF4 Dataset Attributes | X

  7. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    7 Dataset Attributes | X 1) PM.Engagement.Scaled 2) PM.Excitement.Scaled 3) PM.Stress.Scaled 4) PM.Relaxation.Scaled 5) PM.Interest.Scaled 6) PM.Focus.Scaled

  8. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    8 § EEG.MarkerValueInt Dataset Attributes | Y

  9. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    9 § https://webgazer.cs.brown.edu § eye tracking library using common webcams to infer the eye-gaze locations of web visitors on a page in real-time. § written in JavaScript § can be integrated into a website § runs entirely in the client browser, so no video data needs to be sent to a server, and it requires the user's consent to access their webcam. WebGazer

  10. jgs Assignment 03

  11. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    11 Assignment 03 • Collect EEG Data (Emotiv PRO) • Collect Gaze Tracking Data (WebGazer) • Save the integrated data in a Dataset (CSV or ARFF file)

  12. jgs Assignment 03 | Part 01

  13. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    13 Add Lab 2 into the New Assignment 03 Imagen (photo) Observer 1 minute Record data What was the part that catch attention?

  14. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    14 § https://github.com/brownhci/WebGazer/blob/master/www/calibration.html Callibration

  15. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    15 Example

  16. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    16 <html> <head> <script src="./webgazer.js"></script> </head> <body> <div style="text-align: right;" id="gazeData"></div> <script> webgazer.resume(); webgazer.setGazeListener(function(data, elapsedTime) { if (data != null) { var x = data.x; var y = data.y; document.getElementById("gazeData").innerHTML = "Gaze coordinates: x=" + x + ", y=" + y; } }).begin(); </script> <!-- work here … --> Template

  17. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    17 <!-- work here … --> <style> html, body {height: 100%;margin: 0; padding: 0; } table {width: 100%;height: 100%;border-collapse: collapse;} td {border: 1px solid black;} </style> <table> <tr> <td>Cell 1</td> <td>Cell 2</td> <td>Cell 3</td> </tr> <tr> <td>Cell 4</td> <td>Cell 5</td> <td>Cell 6</td> </tr> <tr> <td>Cell 7</td> <td>Cell 8</td> <td>Cell 9</td> </tr> </table> </body> </html> Template

  18. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    18 Towards This Scenario

  19. jgs Assignment 03 | Part 02

  20. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    20 Emotiv

  21. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    21 Architecture Bluetooth EMOTIV PRO Your App WebSocket (server) WebSocket (client) EMOTIV BrainViz EMOTIV BCI

  22. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    22 Let’s Work

  23. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    23 Questions

  24. jgs Javier Gonzalez-Sanchez | CSC 309 | Winter 2023 |

    24 Office Hours Tuesday and Thursday 3 - 5 pm But an appointment required Sent me an email – [email protected]

  25. jgs CSC 570 Applied Affective Computing Javier Gonzalez-Sanchez, Ph.D. [email protected]

    Spring 2023 Copyright. These slides can only be used as study material for the class CSC308 at Cal Poly. They cannot be distributed or used for another purpose.