Research on Interactive Design of Social Interaction Training APP for Children with Autistic Spectrum Disorder (ASD) Based on Multi-modal Interaction

A number of studies have found that the difficulty in social interactive behaviors and recognize items are two core syndromes of Autistic Spectrum Disorder (ASD) children. Previous research has found that ASD children paid more attention to robots comparing to people.Intervention programs with robots as instructors or partners were also proved to be effective in improving ASD children’s social skills.Yet, few studies find robot intervention works in ASD children training.So research explore the possibility of apply such intervention programs into product design.The present study aimed at involving an animated character of robot in an application (APP) of intervention program to facilitate ASD children’s learning of social interactive skills.In order to achieve the goal, a training system based on sensory integration training was established by the design software of Sketch.Augmented Reality (AR) technology was used to create a multi-modal interactive environment of the APP.The present study is among the first attempt to apply sensory integration training in APP design, aiming at promoting social and cognitive performance in ASD children.