University of Twente Student Theses
LyrAIX - tweaking the style
Budnyk, Yevhenii (2023) LyrAIX - tweaking the style.
|
PDF
465kB |
| Abstract: | Recently, Large Language Models (LLMs) have been tested in different do- mains. This research examined the capabilities of a fine-tuned LLM to gen- erate lyrics in different styles. A pre-trained medium (355M of learning parameters) size GPT-2 model was fine-tuned with a compiled dataset of song parts and corresponding stylistic labels. The dataset was constructed from lyrics collected from the Genius website, which were later filtered and labeled with the help of unsupervised and rule-based classifiers. The model was tested to generate lyrics defined by such stylistic parameters as affect, topic, rhyme scheme, and content explicitness. Additionally, the model was assessed on the preservation of the author’s style originality and distinctive- ness. The results have shown that a fine-tuned LLM is more capable of lyrics generation with defined text explicitness and affect, rather than topics and rhyming scheme. Furthermore, a positive indication of the original author’s style preservation was discovered with the reported average similarity score of 6.167 on a 1 to 10 Likert scale |
| Item Type: | Essay (Bachelor) |
| Faculty: | EEMCS: Electrical Engineering, Mathematics and Computer Science |
| Subject: | 54 computer science |
| Programme: | Computer Science BSc (56964) |
| Link to this item: | https://purl.utwente.nl/essays/96311 |
| Export this item as: | BibTeX EndNote HTML Citation Reference Manager |
Show download statistics for this publication
Show download statistics for this publicationRepository Staff Only: item control page