MVideoRec: Micro Video Recommendations through Modality Decomposition and Contrastive Learning

Personalized micro video recommendation aims to recommend the micro videos tailored to user preference based on the user’s interaction history with the micro videos, which has drawn increasing attention from both the academic and industrial communities. Existing solutions primarily concentrate on video-level interactions between users and micro videos to model their preferences, and cannot distinguish the finer-grained users’ interactions with various modalities. Ignoring modality-level interactions prevents the full understanding of the user’s true and subtle preferences on micro videos. To this end, in this article, we propose a Contrastive Multimodal Interaction Graph Learning ( MVideoRec ) model to automatically and explicitly learn the modality-level interaction between users and micro videos for recommendations. Specifically, we designed a graph structure learning module with a sparsification strategy to infer modality-level interaction graph, which will be dynamically and iteratively updated based on the node representations obtained from the node representation learning module. Furthermore, to address the lack of ground truth labels, we propose to generate teacher view from video-level interaction graph and student view from modality-level interaction graph, as well as construct intra-modality and inter-modality contrastive pairwise instances to provide self-supervised signals. Extensive experiments on three real-world micro video datasets validate the effectiveness of MVideoRec.