University of Twente Student Theses

Login

Modeling and Analyzing Board Games through Markov Decision Processes

Mocanu, D. (2023) Modeling and Analyzing Board Games through Markov Decision Processes.

This is the latest version of this item.

[img] PDF
587kB
Abstract:This research investigates the feasibility of using discrete-time Markov chains (DTMCs) and Markov Decision Processes (MDPs) to model the behavior of players in board games, which will allow for further analysis of the models. The analysis will be performed using the model-checking tool Prism, which supports a range of probabilistic models (including MDPs and DTMCs) but also the analysis of models (including automated metrics computation and strategy generation). This research paper will be focusing on analyzing the board game Incan Gold (in which players explore a temple trying to collect as many gems while avoiding hazards) as well as the Combat Dice Roll mechanic from the Hobbit Adventure board game (where the aim is to roll a high number using three dice in three rounds). The paper will focus on answering interesting questions regarding the 2 games, such as: "What is the probability of a roll resulting in a desired roll value ≥ x?" (Combat Dice Roll) or "At which point is the player encouraged to withdraw from the game?" (Incan Gold) but also try and answer more general questions about modeling board games as MDPs. Ultimately, this paper aims to show how to model and analyze board games as MDPs to investigate interesting properties of the games (such as optimal strategies and important metrics) but also to conclude some limitations of the model in regard to more complex games.
Item Type:Essay (Bachelor)
Faculty:EEMCS: Electrical Engineering, Mathematics and Computer Science
Subject:54 computer science
Programme:Computer Science BSc (56964)
Awards:Best Presentation Award
Link to this item:https://purl.utwente.nl/essays/96149
Export this item as:BibTeX
EndNote
HTML Citation
Reference Manager

 

Repository Staff Only: item control page