University of Twente Student Theses
Designing and Evaluating an Inclusive Version of the Bot Usability Scale (BUS) for Interaction with AI-Based Conversational Agents
Hristova, Maria (2022) Designing and Evaluating an Inclusive Version of the Bot Usability Scale (BUS) for Interaction with AI-Based Conversational Agents.
This is the latest version of this item.
|
PDF
1MB |
| Abstract: | For the world to become more accessible first the issue of accessibility in research needs to be addressed. This suggests the need to provide people with disabilities with an opportunity to participate in research, for which the accessibility of the scales used needs to be considered. The Bot Usability Scale (BUS) that is proposed by Borsci et al., 2022 has the potential to be used as a tool for assessment of the user’s experience with various chatbots and has been adapted for multiple languages. A new design is proposed to replace the existing one for the BUS-11. This new design, BUS-A is based on principles for accessible design and was constructed after testing possible variations with a focus group with representatives from the end-users. The new design makes use of the original 11 item formulation of the BUS since there were no issues found in the phrasing of the items. This proposed design has also been tested with a larger sample of participants and compared to results from the BUS-11 scale to check if the two versions measure the same concept. It was found that the assumed underlying factorial structure of the BUS-11 does not fit the BUS-A based on Chronbach alpha value over 0.7, therefore it cannot confidently replace the original design. However, on its own, the BUS-A showed sufficient internal consistency and reliability comparable to the original design, which suggests the scale has good psychometric properties and can be considered as a potential measurement tool of user satisfaction. |
| Item Type: | Essay (Bachelor) |
| Faculty: | BMS: Behavioural, Management and Social Sciences |
| Subject: | 77 psychology |
| Programme: | Psychology BSc (56604) |
| Link to this item: | https://purl.utwente.nl/essays/91457 |
| Export this item as: | BibTeX EndNote HTML Citation Reference Manager |
Show download statistics for this publication
Show download statistics for this publicationRepository Staff Only: item control page