Benchmark evaluation demonstrates enhanced sentiment classification on CMU-MOSI video benchmarks, indicating the utility of constrained complex-valued representations in multimodal AI fusion.
Multimodal sentiment analysis is challenging because textual, visual, and acoustic evidence is heterogeneous and oft en weakly aligned. Here, we present QRSAN, a quantum-inspired residual self-attention network that integrates an LSTM text encoder, modality-specific multilayer perceptrons for visual and acoustic inputs, normalized complex-valued encoding, a TFN-derived interaction expansion, real-valued residual self-attention, and classical projection-score mapping. QRSAN runs entirely on classical hardware and does not perform physical quantum computation. Across CMU-MOSI, CMU-MOSEI, and IEMOCAP, QRSAN was evaluated using a common protocol. It achieved the highest numerical mean ACC and Binary_F1 among the evaluated models on CMU-MOSI, whereas its IEMOCAP label-wise accuracy was below that of EF-LSTM. These findings support the utility of combining constrained complex-valued representations with residual self-attention using the evaluated settings, without claiming universal state-of-the-art performance.
No takes yet. Share an insight, caveat, or question.
Liu et al. (2026) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: