University of Twente Student Theses
Influence of human-in-the-loop on the acceptance of AI-driven evaluation of essay questions by students.
Balickis, K. (2022) Influence of human-in-the-loop on the acceptance of AI-driven evaluation of essay questions by students.
|
PDF
631kB |
| Abstract: | Artificial intelligence (AI) is developing rapidly in the various fields of our lives. The education field could benefit from AI-based systems as well. Introducing AI-based evaluation systems for essay questions in higher education could benefit universities and their staff. Yet this area is underexplored. The existing research focuses on the technical aspects of AI-based systems for grading and not on the human side. This research finds the acceptance levels of AI-based evaluation from a student perspective. This would be important since the acceptance of the evaluation process in universities highly correlates with their reputation. A survey with Likert-type items was conducted. Participants answered the same questions three times for three different implementation scenarios of AI-driven evaluation. The first scenario is fully AI grading, and the two others include human-in-the-loop AI (HitAI). The result shows higher overall acceptance for scenarios with HitAI compared to a scenario with solely AI evaluation. Lastly, the discussion states limitations, and suggestions for future research. Practical implications for universities that planning to adopt such AI systems would be to keep humans in the loop. |
| Item Type: | Essay (Bachelor) |
| Faculty: | BMS: Behavioural, Management and Social Sciences |
| Subject: | 85 business administration, organizational science |
| Programme: | International Business Administration BSc (50952) |
| Link to this item: | https://purl.utwente.nl/essays/91297 |
| Export this item as: | BibTeX EndNote HTML Citation Reference Manager |
Show download statistics for this publication
Show download statistics for this publicationRepository Staff Only: item control page