Animated Sign Language For People With Speaking And Hearing Disability Using Deep Learning

This paper addresses the communication barriers faced by individuals with speaking and hearing disabilities through the utilization of deep learning techniques. Our System consists of two modules where one converts the sign gestures performed by the deaf and dumb people to audio and the second module converts the words spoken by the normal people into Animations which perform the sign gestures corresponding to the audio. To enhance the user experience, we have integrated natural language processing (NLP) techniques to improve the fluency and coherence of the translated text. Additionally, our system utilizes expressive 3D gestures to animate the sign gestures, making the communication more engaging and relatable. These gestures are customizable to match the user's identity, further personalizing the interaction. Our system leverages the power of deep learning, NLP, and 3D animation to break down communication barriers for individuals with hearing and speaking disabilities. This innovative solution has the potential to transform the lives of millions by providing a means for them to effectively communicate with the broader society, thereby fostering inclusivity and equal opportunities.