AI Powered Sign Language Translator

AI Powered Sign Language Translator

Prof. Aradhana Pawar1, Shital Kale2, Riya Kamble3 , Kiran Misal3
1Computer Department, Dr. D. Y. Patil college of Engineering and Innovation, Varale. 2Computer Department, Dr. D. Y. Patil college of Engineering and Innovation, Varale. 3Computer Department, Dr. D. Y. Patil college of Engineering and Innovation, Varale. 4Computer Department, Dr. D. Y. Patil college of Engineering and Innovation, Varale.

---------------------------------------------------------------------***---------------------------------------------------------------------

Abstract - This work proposes an AI-based sign language translator that aims to establish equal surroundings and enable people with hearing handicaps to communicate in their native language. In order to translate sign language into text, we used a transformer neural network, which can analyse more than 500 data points from a person's face and motions. Our machine learning pipeline allows the translator to grow, create new datasets, and develop models for sign language recognition. We created a sign language interpreter with over 200 phrases for an emergency call as a proof of concept. Encouraging those with hearing impairments to engage in social, political, economic, and cultural aspects of life is the overarching objective.

Key Words: Sign Language, Inclusion, Social Development, Artificial Intelligence, Machine Learning.