Combining AR and input device to control remotely a robot arm

Arm robot technology has been introduced in manufacturing and other industries to improve worker safety and productivity. Although arm robot technology tends to automate tasks, some tasks are complex. Such tasks require human operators. However, many studies focus on this issue and propose methods for operating arm robots; various issues still need to be solved, such as the possibility of unintended movements and the difficulty of intuitive operation. We propose an intuitive arm robot manipulation method using augmented reality and input devices that prevent unintended movements and enable intuitive operation. This system enables the user to operate an actual arm robot in a remote location by manipulating a model of the arm robot presented in augmented reality. The system also controls the position and posture of the arm robot head and the opening and closing of the gripper by using a hand and a handheld input device to control each joint angle.