Technical Report on Designing Video Documentation System on the Practice of Early Childhood Education and Care, Utilizing Automatic Face and Emotion Recognition

In this study, we describe the process of jointly designing the advanced digital documentation systems by university and company researchers and early childhood teachers. Our system has great novelty. It mounts videos of educational practices, which teachers can select and see, and enables them to reflect on the points that they are concerned about in their practice without much effort. In addition, the system includes a function that automatically recognizes the faces of children appearing in videos and interprets their emotions from facial expressions. This paper discusses the implications of designing the system called ‘Flying baby’, its technical composition and verification. At this stage, it does not have a high level of practicality because it is very difficult to increase the accuracy of recognizing children’s faces and emotions from the videos, but this trial is what makes us think about the future of human-technology collaboration in the practice of ECEC.