Sign Language Detection and Conversion to Text and Speech Conversion

Sign Language Detection and Conversion to Text and Speech Conversion

Ameer Khan B1, Chandru M2, Kalaiselvan R3

1UG Scholar, Electrical and Electronics Engineering & Bannari Amman Institute of Technology

2UG Scholar, Electrical and Electronics Engineering & Bannari Amman Institute of Technology

3UG Scholar, Electrical and Electronics Engineering & Bannari Amman Institute of Technology

---------------------------------------------------------------------***---------------------------------------------------------------------

Abstract - Sign language is one of the oldest and most natural form of language for communication, but since most people do not know sign language and interpreters are very difficult to come by we have come up with a real time method using neural networks for fingerspelling based american sign language.

In this method, the hand is first passed through a filter and after the filter is applied the hand is passed through a classifier which predicts the class of the hand gestures. This method provides 98.00 % accuracy for the 26 letters of the alphabet.

Key Words:  Python, Machine Learning, OpenCV, Keras, NumPY, Data Training