University of Twente Student Theses

Login

“Talk to me, Hal” : A Study of Player Experience and Interaction in a Voice Interaction VR Game Featuring AI-driven Non-player Characters

Tonini, Leandro (2024) “Talk to me, Hal” : A Study of Player Experience and Interaction in a Voice Interaction VR Game Featuring AI-driven Non-player Characters.

[img] PDF
852kB
Abstract:This paper aims to investigate how players experience a virtual reality (VR) game with AI-driven NPCs using voice interaction (VI) and explores players' perceptions and interactions with said NPCs. In an international study, participants primarily from Canada, the Netherlands, and Germany (N = 48) played a VR game with NPCs featuring large language model (LLM) implementation and provided feedback on their experience and game conceptions through a survey and subsequent interviews, with a following sentiment analysis of the player’s voice input. Results indicate participants found the game to be a positive and immersive experience, with aspects such as the entertainment value, immersion, and goal clarity being highlighted. However, issues with speech recognition were noted. Players perceived the NPCs as realistic and mostly believable conversation partners and utilised mostly polite and friendly language, although concerns were raised regarding the sometimes-artificial flow and structure of conversation, as well as frequent occurrence of erroneous or uninformative answers. Despite the challenges, the findings suggest numerous potential benefits of implementing AI-driven NPCs in VR games using VI for industry and future studies. Further research on NPCs utilizing LLMs and VI is necessary to overcome challenges and fully leverage the benefits for games and interventions.
Item Type:Essay (Master)
Faculty:BMS: Behavioural, Management and Social Sciences
Subject:77 psychology
Programme:Psychology MSc (66604)
Link to this item:https://purl.utwente.nl/essays/98788
Export this item as:BibTeX
EndNote
HTML Citation
Reference Manager

 

Repository Staff Only: item control page