Document Type
Poster
Publication Date
Fall 10-6-2022
Abstract
People often listen to songs that match their mood. Thus, an AI music recommendation system that is aware of the user’s emotions is likely to provide a superior user experience to one that is unaware. In this paper, we present an emotion-aware music recommendation system. Multiple models are discussed and evaluated for affect identification from a live image of the user. We propose two models: DRViT, which applies dynamic routing to vision transformers, and InvNet50, which uses involution. All considered models are trained and evaluated on the AffectNet dataset. Each model outputs the user’s estimated valence and arousal under the circumplex model of affect. These values are compared to the valence and arousal values for songs in a Spotify dataset, and the top-five closest-matching songs are presented to the user. Experimental results of the models and user testing are presented.
Recommended Citation
Tran, Hieu; Le, Tuan; Do, Anh; Vu, Tram; Bogaerts, Steven; and Howard, Brian, "Emotion-Aware Music Recommendation" (2022). Annual Student Research Poster Session. 93, Scholarly and Creative Work from DePauw University.
https://scholarship.depauw.edu/srfposters/93
Comments
We are grateful for the support of the Tenzer Center, the J. William Asher and Melanie J. Norton Endowed Fund in the Sciences, and the Kranbuehl, Roberts, and Hillger Endowed Fund for Faculty Summer Research.