Inclusive Communication: Leveraging AI for Sign Language Translation and Real-Time Audio Transcription

Humans communicate through both natural language and body language, including gestures, facial expressions, and lip movements. While understanding spoken language is essential, recognizing sign language is equally important, especially for individuals with hearing impairments. Deaf individuals often struggle to communicate with those unfamiliar with sign language, making real-time translation systems invaluable. This paper proposes a real-time meeting platform that recognizes Indian Sign Language (ISL) gestures and converts them into text and speech, enabling smooth interaction between deaf and hearing individuals. The system uses image processing, computer vision, and deep learning—specifically Long Short-Term Memory (LSTM) networks—to analyze hand gestures from a live video stream. LSTM models effectively capture temporal patterns in gesture sequences, enhancing recognition accuracy. The identified gestures are then translated into text and synthesized into speech. This system aims to bridge communication gaps and improve accessibility for the hearing impaired.