SSSD: Speech Scene database by Smart Device for Visual Speech Recognition

Speech scenes of conventional databases available for lip reading or visual speech recognition (VSR), were record with a video camera fixed on a tripod in a well-maintained environment. On the other hand, VSR is expected to be used in smart devices such as smartphone and tablet as an interface. Therefore, collecting the speech scenes recorded with these devices is an important task for practical use of VSR. In this paper, we collect Japanese word utterance scenes taken with smart device, and build a new publicly available database named speech scene database by smart device (SSSD) for VSR. Moreover, we apply the existing method to our database and show baseline recognition accuracy.