Answers are grounded in this paper and cite their sources.
Evaluates a multimodal recommendation system, highlighting improved efficacy using integrated data.
As user behavior sequences grow increasingly diverse, sequential recommender systems (SRS), especially multimodal SRS, are highly sought after. Distinct from traditional item identifier (ID)-based SRS, multimodal SRS exploits multiple-modality data (e.g., text and images) to capture fine-grained user-item interactions, thereby enhancing recommendation efficacy. A common approach to training a multimodal SRS is to employ a pre-trained model for item representations in terms of text (or image) features. However, the existing pre-trained models extract text and image features separately, which could result in visual-textual mismatches. In addition, the multimodal training objectives often suffer from a seesaw phenomenon (i.e., improving one objective's performance may degrade others’ performance). Recognizing these issues, in this paper, we propose a fine-tuned contrastive language-image with multi-gated expert sequential recommendation ( f CLI-MSR) framework, of which the main novelties lie in ( \(a\) ) an enhanced item representation by seamlessly integrating image-text matching information and ( \(b\) ) multimodal learning balance via carefully designed multi-gated expert networks and loss functions. We demonstrate the performance of the new framework over four public multimodal benchmark datasets, yielding improved item-prediction performance over sequential baselines and mitigates the seesaw phenomenon.
No takes yet. Share an insight, caveat, or question.
Li et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: