An Integrated Real-Time Deep Learning and Belief Rule Base Intelligent System to Assess Facial Expression Under Uncertainty

Nowadays, the recognition of facial expression draws significant attention in various domains. In view of this, a realtime facial expression recognition system has been developed using a Deep Learning approach, which can classify ten emotions, including angry, disgust, fear, happy, mockery, neutral, sad, surprise, think, and wink. In addition, an integrated expert system has also been developed by integrating Deep Learning with a Belief Rule Base to support the assessment of the overall mental state of a person over a period of time from video streaming data under uncertainty. In this research, data-driven and knowledge-driven approaches are integrated together to assess the mental state of an individual. Such a system could enable the identification of a suspect before committing any crime beforehand by the law enforcement agency. The performance of this integrated system is found reliable than existing methods of facial expression assessment.