back to search

Project Weeks: Gaze-Driven Collaborative Interaction Analysis

SOT10158Mandatory Modules6 ECTSEnglishsummer semesterDepartment Educational Sciences
AI-edited module sheet. Based on the TUMonline module description, edited for readability.Original in TUMonline

What it is about

You plan and carry out a small collaborative study in which several people wear mobile eye trackers and their interaction is recorded from the perspective of a third-person camera. You learn how to synchronize multimodal video and gaze data, automatically detect Areas of Interest (AOIs), assign gaze data to AOIs, and extract temporal interaction indicators such as joint visual attention or gaze contact. In the end you provide the analysis and visualizations and deliver the pipeline as a reusable resource.

What you will be able to do

  • Basic knowledge about gaze capture and video-based interaction analysis
  • Process gaze and video data for multimodal analyses
  • Apply LLMs to videos of collaborative interactions
  • Evaluate how gaze cues influence model predictions
  • Conduct small user studies and present results

What the module consists of

  • ProjektarbeitDurchführung des Versuchsaufbaus, Datenerhebung, Datenverarbeitung, Analyse und Bereitstellung der Pipeline
  • DiskussionenAustausch über Methoden, Ergebnisse und Herausforderungen
  • PräsentationenVorstellung der Studienergebnisse und der entwickelten Ressourcen

Teaching method

  • Projektarbeit in kleinen Gruppenpraktisches Erlernen von Versuchsaufbau, Datenerhebung und Datenverarbeitung
  • DiskussionenReflexion der Methoden und Ergebnisse im Team
  • PräsentationenKommunikation und Darstellung der Studienergebnisse

Dates

SeminarProjektwoche: Parallax - Wie verstehen multimodale große Sprachmodelle Menschen?

From the current semester, not binding.

Module ratings

No ratings for this module yet.

Rate this module

Only fill in the categories you can judge – for each one, either stars and text together or nothing at all.

Lecture
Tutorial
Exam

Reviews are automatically checked before they are published.

Official page in TUMonline · Details are not binding.