Controlling and Assisting Manual Assembly Processes by Automated Progress and Gesture Recognition

The digital progress monitoring of manual assembly processes at goods with huge dimensions is a challenging task. The paper presents an approach using 3D-image sensors for gesture control and progress recognition. The developed system is able to avoid time and effort consuming walks of workers between assembly objects and computer terminals. Progress recognition of assembly processes is realized by interpreting the movements of the workers’ hands and by detecting the passing of defined coordinates within the assembly and warehouse areas.