Dynamic Translator for Sign Language
Dr. Ankita V. Karale1, Nivedita R. Vibhandik2, Mayur S. Patil3, Hemant N. Chaudhari4, Atharva D. Nikam5, Akshay S. Trimukhe6.
1 HOD, Department of Computer Engineering Sandip Institute of Technology and Research Centre Nashik, India.
2 Assistant Professor, Department of Computer Engineering Sandip Institute of Technology and Research Centre Nashik, India.
3 4 5 Research Scholar, Department of Computer Engineering Sandip Institute of Technology and Research Centre Nashik, India.
Abstract: In the evolving landscape of technology-driven communication, our project explores the development of a dynamic sign language translation system powered by machine learning. This system translates between American Sign Language (ASL), Indian Sign Language (ISL), and English, promoting inclusivity for the Mute People and hard-of-speaking communities. By integrating cutting-edge machine learning models, we ensure high accuracy in recognizing gestures and contextual nuances, enabling fluid communication across languages. The project emphasizes a robust pipeline for data collection, processing, and real-time translation, leveraging synthetic data and data augmentation to improve system efficiency. Ethical considerations guide the design, ensuring fairness, transparency, and cultural sensitivity in the multilingual translation of ASL, ISL, and English.Furthermore, our web-based platform offers an intuitive interface for users to input videos or text for real-time translations, supported by an animated avatar for gesture visualization. Future scopes include expanding language support, improving real-time translation features, and integrating mobile applications. This initiative represents a significant step toward bridging communication gaps and promoting more inclusive interactions for individuals with speaking disabilities.
Keywords: Dynamic sign language translation, American Sign Language (ASL), Indian Sign Language (ISL), machine learning, real-time translation, inclusivity, data collection, synthetic data, data augmentation, gesture recognition, ethical considerations, fairness, cultural sensitivity, animated avatar, communication accessibility, Mute People and hard-of-speaking communities, multilingual support, web-based platform, future enhancements.
