With the rapid advancement of big data and artificial intelligence, information presentation has shifted to a multimodal environment encompassing text, images, audio, video, and biological signals.Traditional visual information visualisation is challenged by limited expression dimensions and insufficient emotional and narrative capacity.The purpose of this study is to explore the theory and technical path of deep integration of graphic creativity and visual information visualisation in multimodal context.Firstly, the theoretical basis of multimodal cognition and perception is constructed; then, a technical framework integrating multimodal data perception, cross modal feature alignment, creative semantic generation and visual mapping is proposed; by introducing generative AI, attention mechanism and style transfer technologies, a data story aesthetic driven fusion design method is designed; finally, two case studies verify its effectiveness in enhancing information interpretation efficiency and user experience, offering theoretical support and technical solutions for complex information design.
Ren et al. (Thu,) studied this question.