Indoor Accidents Detection for Elderly Based on Features Fusion and LSTM

Nowadays, with aging of the human society, the "ratio of family care givers and elderly" is not equivalent and cannot give enough caring to the elderly in some countries. Therefore, automatic health monitoring system for elderly draws the interests of many researchers and become as special issue. In the implementation of elderly people monitoring system, the detection of fall events plays as an important role because the fall is the common cause which is very risky and threaten the health of elderly. The aim of this research is to implement the vision-based fall detection system which is important for health monitoring of elderly by applying the computer vision and deep learning technology. Most of the traditional vision-based fall detection systems which based on the height, width of human posture, fail to detect the fall events from different camera viewpoints. In this research, to accurately detect the fall from different camera viewpoint, the features fusion approach is applied over the deep learning model. In the implementation of the system, firstly, the human silhouette image is created by using the background subtraction. After that, the human silhouette image which have been extracted from two consecutive frames are fused as a single image called Silhouette History Image (SHI). Then, the SHI results are used as shape feature. On the other hand, the motion features called Dense Optical Flow (DOF) is extracted over the two consecutive video frames and fuse SHI and DOF as a single input image. Then, the results of features fusion are feed as input for pretrained Convolution Neural Network (CNN) for extracting the deep CNN features. Finally, the Recurrent Neural Network (RNN) called Long-Short-Term-Memory (LSTM) is trained over those CNN features for recognizing the sequence of fall event. The experiments are performed using the publicly available dataset of UP-fall detection dataset for evaluating and confirming the effectiveness of the proposed method.