Tutorial for Deaf and Dumb
Mr. Indra Kishor 1, Preksha Agarwal 2, Ronak Khandelwal 3, Palak Agarwal 4
1 Poornima Institute of Engineering and Technology, Computer Science and Engineering, Jaipur, Rajasthan, India
2 Poornima Institute of Engineering and Technology, B. Tech. Student Dept. of Computer Science, Jaipur, Rajasthan, India
3 Poornima Institute of Engineering and Technology, B. Tech. Student Dept. of Computer Science, Jaipur, Rajasthan, India
4 Poornima Institute of Engineering and Technology, B. Tech. Student Dept. of Computer Science, Jaipur, Rajasthan, India
indra.kishor@poornima.org1, 2021pietcspreksha131@poornima.org2, 2021pietcsronak146@poornima.org3, 2021pietcspalak121@poornima.org4
Abstract
This is because communication mainly depends on sign language, which deaf and hard-of-hearing people rely upon to express themselves. However, the complexity and diversity of sign languages worldwide range from 138 to 300 different sign languages-all of which are different another barrier against inclusion. This overview discusses the development and analysis of Real-Time Sign Language Translation Systems from 2017 to 2021. Features include convolutional neural networks, bidirectional LSTM, and BERT transformers for gesture recognition, and language translation techniques are employed. So, techniques for L2 regularization are used there to avoid overfitting. In turn, these increase generalization performance. The proposed models also include media pipe for feature extraction promising results on standard datasets like INCLUDE-50, with a result of 89.5%. Moreover, this paper sums up how IoT can achieve this by bridging communication gaps. At the same time, it also showcases a framework for smart accessible, and voice-independent systems differently catering to these unique needs of the deaf and dumb community. It facilitates the development of tools to enhance communication between sign language users and the rest of the hearing world.
Keywords: Sign Language Recognition Gesture-Based Controls Convolutional Neural Networks (CNNs) LSTM BERT Transformers Media pipe Overfitting IoT Deaf and Dumb INCLUDE-50 Dataset Real-Time Translation Accessibility Technology.
