AI Sign Language Detection for Disabled People & Chatbot
Chaitali Mane1, Soham Matkar2, Vaishali Kakade3, Vrushabh Udeg4,Dr. Deepali Joshi
1,2,3,4 B.E. Students Department of Computer Science Engineering, 5HOD, Department of Computer Science Engineering, Bharat College of Engineering, Opp. Gajanan Maharaj Temple, Kanhor Road, Badlapur (West), Thane, Maharashtra - 421503
---------------------------------------------------------------------***---------------------------------------------------------------------
Abstract - This project presents an intelligent, multi-functional system designed to empower and support individuals with disabilities, especially those with hearing or speech impairments. The solution integrates real-time Sign Language Detection with an AI-powered assistant to facilitate seamless communication, access to essential services, and daily digital interactions. Built using HTML, CSS, JavaScript, and machine learning techniques, this innovative platform bridges the communication gap between differently-abled users and the digital world.
The system uses computer vision models to recognize sign language gestures, particularly the English alphabet, enabling users to communicate through hand signs. The recognized signs are then translated into text or voice using Text-to-Speech (TTS) modules. To extend usability, this feature is integrated into a user-friendly graphical interface that allows users to interact with the system visually and audibly.
A major highlight of the project is its Jarvis-inspired voice assistant, which responds to the wake word "Hey Jarvis." Once activated, the assistant can perform various tasks such as opening websites, fetching real-time information (e.g., weather, news, etc.), and responding to queries using a smart chatbot module. The chatbot fetches accurate responses from the Google Search API to ensure up-to-date and contextually relevant answers.
