STARLINE: Contrastive Learning with Modality-Aware Graph Refinement for Effective Multimedia Recommendation

Abstract

Beyond using multimodal features of items in addition to user-item interactions, researchers have additionally utilized Contrastive Learning (CL) in recent multimedia recommender systems to highly alleviate the data sparsity problem. CL-based methods generate at least two embeddings (i.e., views) for each instance and enrich the information of each instance from various perspectives via the views, thereby alleviating the data sparsity problem. Therefore, CL-based methods have focused on generating views that effectively represent the characteristics of each instance for their downstream tasks. Similarly, CL-based multimedia recommender systems have made efforts to effectively generate their user/item views by leveraging items' multimodal features. However, we point out the following two limitations that they have overlooked in generating their views: (1) they either have not attempted to identify the influence of each modality feature of an item on user-item interactions, or have identified it by randomly masking or dropping user-item interactions, and (2) they have not attempted to identify non-interactions likely to result in interactions in the future. To overcome these limitations, we propose a novel multimedia recommendation framework, named STARLINE, utilizing contraSTive leARning with modaLIty-aware graph refiNEment. Extensive experiments on five real-world datasets validate the effectiveness and validity of STARLINE, especially showing consistently higher accuracy by up to 13.24% compared to the best competitor.