Experiential Media Wall Utilizing Hand Gesture Recognition

This research suggests implementing an interactive experiential media wall incorporating hand gesture recognition technology to improve the educational experience in media wall exhibition environments and executing usability survey and analyses. The proposed media wall allows users to explore contents through hand gestures on a map-based interface, providing information about heritage sites based on actual location data. We develop the overall system using the Unity 3D engine to recognize and interact with the hand gesture when the user stays in the correct hand gesture posture for a certain period. As a result, it was confirmed that the proposed approach exhibited high usability overall, regardless of gender and age. Additionally, using hand gestures for media wall interaction was key in increasing satisfaction with the educational experience.