PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
January 17, 20260 citationsOpen Access

AI Sign Language Translation System

View Full Paper
AJAvish JhalaniSLSuryansh Lodha

Key Points

  • The research aims to develop a real-time system for translating sign language to facilitate better communication between signers and non-signers.
  • Integrated a convolutional neural network for image-based gesture classification.
  • Utilized a MediaPipe-based multilayer perceptron for hand landmark feature analysis.
  • Deployed the system as a web application using Flask for real-time video streaming.
  • Conducted experiments to compare the accuracy and efficiency of CNN and MLP models.
  • CNN model achieved higher accuracy for classifying complex gestures.
  • MLP model demonstrated faster inference times and better computational efficiency.
  • The system's modular design allows for easy expansion to include additional sign language vocabularies.

Abstract

This preprint presents a real-time sign language translation system designed to bridge communication gaps between sign language users and non-signers. The system integrates two complementary deep learning approaches: a convolutional neural network (CNN) for image-based gesture classification and a MediaPipe-based multilayer perceptron (MLP) using hand landmark features. The application is deployed as a web-based platform using Flask, enabling real-time video streaming and live gesture recognition via standard webcams. Experimental results demonstrate that the CNN model achieves higher accuracy for complex gestures, while the MLP model provides faster inference and improved computational efficiency. The modular and extensible design allows easy expansion to additional sign vocabularies and supports future research in assistive and accessibility-focused technologies.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Jhalani et al. (2026) studied this question.

synapsesocial.com/papers/696b2672d2a12237a9349bd5https://doi.org/10.5281/zenodo.18258218
Ask AI
Helpful
Bookmark
Share
View Full Paper