SIGNIFY: SPEECH TO SIGN LANGUAGE TRANSLATOR

Language plays an important role in the communication of ideas, thoughts, and information to others. Hearing-impaired people can understand our thoughts using a language called as sign language. Every country or region can have a different sign language which is completely based on their native language. In our research paper, our main focus is on Indian Sign Language. The Indian sign language is widely used by speaking and hearing communities in India While communicating with others, one of the most vital factor is listening. It may happen that the other party is not able to hear or grasp what you are talking about. This situation is faced by almost every hearing-impaired person in our society. Thus, we introduced our project Signify: Speech to Indian Sign Language translation system which can reduce the gap in communication between hearing-impaired people and society. The proposed system takes audio and text as input and matches it with the videos present in the database. It then results in corresponding sign movement videos based on the grammar rules of Indian Sign Language; if not found, it then goes through the processes of tokenization and lemmatization. The technology behind the system is natural language processing which makes the system with tokenization, parsing, lemmatization, and part-of- speech tagging.