Intersubjective AI-driven multimodal interaction for advanced user-centric HRC applications - the JARVIS approach

This is the authors' abstract. We don't add key points for this paper.

The current EU manufacturing paradigm has shifted from mass production to highly customizable products, due to the green transition target of the community as well as the continuously varying needs of the population. To strengthen the competitiveness of the industry, there is an increasing need for flexible production, exploiting the capabilities of both the machinery and human workforce. The JARVIS EU project aims to develop a reusable set of tools that enable AI driven multimodal means of interaction: i) involving interfaces for physical and remote information exchange, robot control and programming, ii) providing social skills to a variety of robots to achieve seamless user-centric interaction that extends human ability for complex tasks and iii) demonstrating scalability of application and ability to achieve economies at scale. The proposed technologies will be tested for flexibility, scalability, trustworthiness, and user acceptance in four use cases, aiming to demonstrate production line and cross sector applicability in Agile Manufacturing and Inspection and Maintenance (I&M). Each pilot has been carefully selected to challenge and thus highlight the capabilities of the proposed solutions, covering a range of needs for HRI, while keeping human in the loop.