Aim: This study examined whether generative NPC dialogue leads to different player experiences than traditional scripted NPC dialogue in text-based game. Specifically, it investigated the effects that dialogue condition had on narrative transportation, suspension of disbelief, enjoyment, and how these outcomes are related to players’ attitudes towards AI.
Methods: A between-subjects online experiment was conducted with adult gamers (N = 102) Participants were randomly assigned to either interacting with an NPC using generative NPC dialogue or scripted NPC dialogue in a medieval siege scenario. In the scripted condition (n = 53), the game was implemented using Formflow with a fixed branching structure. In the generative condition (n = 49), participants interacted via ChatGPT with a custom GPT model portraying the same character as in the scripted condition. Self-report measures assessed enjoyment, narrative transportation, suspension of disbelief, and attitudes towards AI.
Results: Narrative transportation and suspension of disbelief were higher in the generative dialogue condition compared to the scripted conditions, while no significant difference in enjoyment was found between conditions. Attitudes towards AI were positively associated with narrative transportation and suspension of disbelief but did not moderate the effect of dialogue condition. Mediation analyses showed that narrative transportation and suspension of disbelief functioned as indirect pathways linking dialogue condition to enjoyment, even though a direct effect was absent.
Conclusion: The findings suggest that generative NPC dialogue can enhance narrative engagement by increasing transportation and suspension of disbelief, without necessarily increasing overall enjoyment. Rather than showing a clear improvement over scripted systems, generative dialogue has both benefits and trade-offs, highlighting the need for theoretically informed and cautious integration of AI-driven dialogue in game design.