Sensor Embedded Glove for Assistive Communication in Partially Paralyzed Individuals

Sensor Embedded Glove for Assistive Communication in Partially Paralyzed Individuals

Ajay P 1 ,Elakiyan S 2 ,Gladwin Prince D 3

Department Of ECE

Panimalar Institute Of Technology

Chennai, India

Abstract: This project aims to develop a smart communication system for the deaf and mute community using an ESP32 microcontroller, a touch sensor, DFPlayer Mini speaker, LCD display, Bluetooth app, and an MPU6050 accelerometer. Existing technologies rely on conventional sign language learning methods and communication devices, which can be challenging and limited in real-time interaction. The proposed system leverages the touch sensor to detect hand gestures, converting them into text or speech through Bluetooth communication with a smartphone app. The MPU6050 tracks hand movements to improve gesture recognition accuracy, while the LCD display provides visual feedback. The DFPlayer Mini speaker enables vocal output for text-to-speech conversion, allowing users to communicate efficiently in various environments. This system provides an accessible, intuitive, and real-time solution for bridging the communication gap for the deaf and mute community.

Keywords: Assistive Technology, ESP32 Microcontroller, Deaf and Mute Communication,Touch Sensor, Gesture Recognition, MPU6050 Accelerometer, DFPlayer Mini, Text-to-Speech (TTS), Human-Computer Interaction, Embedded Systems