University of Twente Student Theses
A Comparative Analysis of Human and A.I. Feedback on Business Idea Evaluation
Meijer, Bart (2023) A Comparative Analysis of Human and A.I. Feedback on Business Idea Evaluation.
|
PDF
1MB |
| Abstract: | The field of artificial intelligence (A.I.) has grown significantly. Businesses and individuals are increasingly utilizing A.I. chatbots like ChatGPT to enhance efficiency and manageability, as finding novel business ideas is becoming more and more challenging due to market saturation. It is getting more interesting to use A.I. in business idea evaluation to give instantaneous and constructed feedback. This study examines business idea evaluations from an innovation tournament for novel business ideas. This thesis compares the evaluations made by humans and an A.I. chatbot. The evaluations on the applications were based on five criteria: Alignment, Excellence, Impact, Implementation, and Team. The study incorporated two distinct scenarios involving the A.I. chatbot. In one scenario, the chatbot received solely the evaluation form and the application, while in the other it was equipped with supplementary project infor- mation (prompting). This allowed for an assessment of the impact of prompting on the chatbot’s evaluations. The results were then compared to human evaluations to assess the effectiveness and accuracy of the A.I. chatbot. This comparison was conducted using the T-test and the Man-Whitney U test to determine whether there were significant differences between the A.I. chatbot and human evaluations. According to these test there is a significant difference between humans and ChatGPT, with the exception of the evaluation from the more strict evaluating ChatGPT. This evaluation was not significantly different from the evaluation given by humans. It therefore suggests that given the right prompting ChatGPT is able to replicate the human evaluations. The findings of this study therefore have implications for the use of A.I. chatbots in evaluating business ideas and could streamline the evaluation process, making it more efficient and less reliant on human resources. |
| Item Type: | Essay (Bachelor) |
| Faculty: | BMS: Behavioural, Management and Social Sciences |
| Subject: | 85 business administration, organizational science |
| Programme: | International Business Administration BSc (50952) |
| Link to this item: | https://purl.utwente.nl/essays/95453 |
| Export this item as: | BibTeX EndNote HTML Citation Reference Manager |
Show download statistics for this publication
Show download statistics for this publicationRepository Staff Only: item control page