SIGN LANGUAGE TRANSLATOR USING PYTHON

SIGN LANGUAGE TRANSLATOR USING PYTHON

BAGATH S, DHANA VARSHINI S, JERSIL G M

DEPARTMENT OF ARTIFICIAL INTELLIGENCE AND DATA SCIENCE

SRI SHAKTHI INSTITUTE OF ENGINEERING AND TECHNOLOGY

COIMBATORE 641062

MS.M.BUVANA [AP/IT]

DEPARTMENT OF INFORMATION TECHNOLOGY

SRI SHAKTHI INSTITUTE OF ENGINEERING AND TECHNOLOGY

COIMBATORE 641062

ABSTRACT

The complex and ancient form of sign language, which is largely used by the deaf and hard of hearing, struggles with both a lack of qualified interpreters and low comprehension. Convolutional Neural Networks (CNNs), a cutting-edge technology, are being used to decode American Sign Language (ASL) motions in response and are particularly effective at fingerspelling. Pre-processing is used in this advanced method to clean up captured motions, which are then fed into a CNN that has been painstakingly trained on a variety of datasets. This makes it possible for the network to extract critical patterns and features for exact recognition. The CNN's classification layer effectively converts these movements into ASL letters or phrases. The ramifications are wide-ranging and touch on accessibility, communication, and education. The use of this technology might improve interactions between hearing people and deaf people. Additionally, it could help close societal disparities by promoting diversity in fields like healthcare and education. CNN-based ASL recognition represents significant progress toward seamless communication and understanding across hearing and non-hearing cultures, despite obstacles including illumination variability and gesture variation. These issues are expected to be resolved as methods and technology develop, improving the performance of CNN-based ASL identification systems and changing how people who are deaf or hard of hearing communicate with the outside world, ultimately resulting in a more inclusive society.

KEYWORDS

Open CV, TensorFlow, gTTS, NLP, Python, Recognition, Conversion, Translation.