University of Twente Student Theses


See, hear, listen : head movements and the sensitive artificial listener

Kooijman, Ruben (2007) See, hear, listen : head movements and the sensitive artificial listener.

[img] PDF
Abstract:This thesis looks at several aspects of head movements used in dyadic face-toface conversations. Head movement behaviors are analyzed on external appearance (form) and how they are used, their meanings and purposes in conversations (function). Knowledge gained from these analyses can be incorporated in computational models for a Sensitive Artificial Listener (SAL) agent. Video data is used for an analyses of head movement forms and functions. It is shown in this thesis that a rich but tangible description of head movement form, here called elementary head movement (em), may contribute to automatic perception and synthesis of head movements. Furthermore it is investigated how head movement form can be mapped to head movement function in specific contexts. Special attention is given to head movement and gaze patterns in interactive contexts such as floor transitions and back-channels. The iam framework presented at the end of in this work, enables rule-like language constructs for describing the internal processes of SAL. A prototype system incorporating the ideas of iam is implemented, and rules defined in the prototype system, based on models from literature are defined in iam to automatically produce video output of listener behavior.
Item Type:Essay (Master)
Faculty:EEMCS: Electrical Engineering, Mathematics and Computer Science
Subject:54 computer science
Programme:Computer Science MSc (60300)
Link to this item:
Export this item as:BibTeX
HTML Citation
Reference Manager


Repository Staff Only: item control page