System for matching paintings with music based on emotions

Abstract

People experience various emotions when they interact with artistic content such as music and visual art in the form of paintings. Thus, painters and composers use features in music and paintings to influence people emotionally. An analysis of methods employed to create features to influence people using paintings and music indicated that people apparently do not find it difficult to understand artistic content. When people view paintings, listening to music that creates a mood similar to that portrayed by the paintings could be helpful to understand the painter's intention. In this work, we extract the emotions from music and paintings depending on their features. Based on these extracted emotions, the proposed system suggests the most appropriate music to accompany a given image, and vice versa. In addition, based on our algorithm, we developed a mobile application that could assist people to enjoy music and paintings emotionally.