Cross media Narrative of Piano and Digital Vision A Study on the Design of Ice and Snow themed Immersive Concerts

Traditional piano concerts mainly rely on auditory perception, while music and visual images often remain independent and cannot present an integrated ice-and-snow narrative. To address this limitation, this paper first constructs a four-part ice-and-snow narrative script. It then extracts piano pitch, dynamics, and rhythm in real time and maps them to visual parameters of a particle system. Six-channel projection mapping, optical image propagation, and motion-capture technology are used to generate aurora and glacier-crack effects linked to performer gestures. Finally, millisecond-level audio-visual synchronization is achieved through the OSC protocol. Experimental results show that, compared with traditional concerts, the immersive concert increases the immersion score by 18.15 points (70.52 versus 52.37), the narrative comprehension score by 4.10 points (11.23 versus 7.13), and produces a significant increase in physiological response indicators (p<0.001). The findings show that the cross-media narrative strategy improves ice-and-snow expression and audience immersion, with advantages in accurate real-time audio-visual mapping and multi-sensory perception fusion.