SIGNBRIDGE
Nandhini D 1, Krishna Kumar S 2, Archana S 3, Subasri A 4, Suriyavel R 5
Assistant Professor, CST, SNS College of Engineering, Coimbatore – 641107. Email: nandhu29120919@gmail.com
Final Year, CST, SNS College of Engineering, Coimbatore – 641107. Email: skk12112003@gmail.com
Final Year, CST, SNS College of Engineering, Coimbatore – 641107. Email: archanasenthilvel4433@gmail.com
Final Year, CST, SNS College of Engineering, Coimbatore – 641107. Email: subasrianbazhagan812@gmail.com
Final Year, CST, SNS College of Engineering, Coimbatore - 641107. Email: suriyavel48@gmail.com
ABSTRACT- AI-Powered Sign Language & Lip Reading Translator is an AI-driven platform designed to bridge communication barriers for individuals with hearing and speech impairments by converting sign language into text/audio and utilizing lip-reading- based speech recognition for enhanced accessibility. By integrating deep learning, computer vision, and NLP, it ensures real-time, highly accurate communication. The platform features AI-Powered Sign Language Conversion to recognize and translate hand gestures and a Lip Reading Translator to convert lip movements into text/audio. Additionally, Text-to- Speech (TTS) and Speech-to-Text (STT) enable seamless interaction. The system utilizes React and Tailwind CSS for the frontend, Python (Django) for the backend, TensorFlow, OpenCV, and custom deep learning models for gesture and lip recognition, Firebase for database management, and integrates Text-to-Speech and Cloud AI Processing APIs for enhanced functionality. Built on the MERN stack, the system leverages computer vision technologies like MediaPipe and OpenCV, along with deep learning models such as CNN and CNN-LSTM with Attention. A secure API-based architecture ensures real-time predictions, while GPU acceleration optimizes processing efficiency. By addressing communication challenges, SignBridge fosters inclusivity in social, educational, and professional settings, empowering individuals with an intuitive AI-powered translation system for accessibility and efficiency.
Keywords – AI-powered Sign Language, Lip Reading Translator, Computer Vision, Accessibility.
