Smart Mern Based Video Conferencing with Sign and Voice Assisstance

An inventive web-based communication tool called the Video Meeting Application using MERN Stack was created to encourage accessibility and inclusivity for both regular and speech/hearing-impaired users. Conventional video conferencing services, like Zoom or Google Meet, frequently require external tools or interpreters because they do not provide integrated support for those with communication challenges. In order to close that gap, this project combines WebRTC-based real-time video conferences with capabilities like text-to- speech voice conversion, speech-to-text subtitles, and sign language detection. The solution, which was developed using the MERN Stack (MongoDB, Express, React, and Node.js), allows users to create or join meeting rooms with secure JWT authentication and easily communicate via voice, text, and gestures. Using Media Pipe and TensorFlow.js, the system can recognize simple hand movements, translate them into readable text and voice for other participants, and use the Web voice API to simultaneously translate spoken audio into live captions for users with hearing impairments.