Current digital media art interactive devices are difficult to adapt to complex environments due to fixed perception mechanisms, and are easily affected by noise interference and low light, resulting in reduced recognition accuracy and interaction delay, affecting the immersive experience. This study constructs a perception and sharing optimization mechanism for digital media art interactive devices driven by adaptive Artificial Intelligence (AI). A multi-channel data fusion perception network is proposed, and the Transformer encoder is used to fuse Red-Green-Blue (RGB) image, infrared depth map, and speech spectrum map features to improve perception robustness. A user behavior temporal modeling module based on Bidirectional Graph Recurrent Transformer (Bi-GRT) is designed to achieve dynamic recognition of continuous actions, gestures, and speech emotions. Environmental simulation and adaptive control mechanisms are applied, and reinforcement learning is combined to dynamically adjust sensor parameters to adapt to environmental changes. A multi-user interactive sharing framework is constructed through federated learning to ensure privacy while improving model consistency. Finally, a real-time feedback optimization and content rendering collaborative engine is developed to achieve dynamic scheduling and optimization of multi-dimensional output content based on Graph Attention Network (Bi-GRT). Experiments show that the system has an accuracy rate of over 80% in multi-action sample recognition; the environmental adaptability achieves a response delay of 210 ms in a noisy environment; the sequence similarity of each terminal in federated learning is above 0.91; the user immersion peak is 9.2 points, Compared with existing systems, this framework has achieved breakthrough progress in environmental adaptability, multi-user collaboration, and privacy protection, providing a quantifiable performance improvement path for digital media art interactive devices.
Building similarity graph...
Analyzing shared references across papers
Loading...
Cong Liu
International Journal for Simulation and Multidisciplinary Design Optimization
Building similarity graph...
Analyzing shared references across papers
Loading...
Cong Liu (Wed,) studied this question.
synapsesocial.com/papers/68e24e60d6d66a53c2473484 — DOI: https://doi.org/10.1051/smdo/2025017