With the advancement of digital technology, serious games have become an essential tool for disseminating and educating individuals about cultural heritage. However, systematic empirical research remains limited with respect to how visual elements influence users’ cognitive and emotional engagement through interactive behaviors. Using the “Macau Historic Centre Science Popularization System” as a case study, this mixed-methods study investigates the mechanisms by which visual elements affect user experience and learning outcomes in digital interactive environments. Eye-tracking data, behavioral logs, questionnaires, and semi-structured interviews from 30 participants were collected to examine the impact of visual elements on cognitive resource allocation and emotional engagement. The results indicate that the game intervention significantly enhanced participants’ retention and comprehension of cultural knowledge. Eye-tracking data showed that props, text boxes, historic buildings, and the architectural light and shadow shows (as incentive feedback elements) had the highest total fixation duration (TFD) and fixation count (FC). Active-interaction visual elements showed a stronger association with emotional arousal and were more likely to elicit high-arousal experiences than passive-interaction elements. The FC of architectural light and shadow shows a positive correlation with positive emotions, immersion, and a sense of accomplishment. Interview findings revealed users’ subjective experiences regarding visual design and narrative immersion. This study proposes an integrated analytical framework linking “visual elements–interaction behaviors–cognition–emotion.” By combining eye-tracking and information dynamics analysis, it enables multidimensional measurement of users’ cognitive processes and emotional responses, providing empirical evidence to inform visual design, interaction mechanisms, and incentive strategies in serious games for cultural heritage.
Zhao et al. (Mon,) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: