Loading article...
Loading article...
Stream/Area:
-
Subject:
-
Paper ID:
IJSREM45094
Volume:
9 |
4 |
Apr 2025
Pages:
Publication Frequency:
Monthly (12 issues per year)
License:International Journal of Scientific Research in Engineering and Management follows the Creative Commons Attribution 4.0 (CC BY 4.0) License, allowing free use and distribution with proper attribution.
The project was entitled “Real-Time Fingerspelling Recognition Using MediaPipe and Adaptive Neural Networks”. Real-Time Fingerspelling Recognition Using MediaPipe and Adaptive Neural Networks is designed to facilitate communication by translating Sign Language fingerspelling into both written text and spoken words. The system addresses a crucial accessibility challenge faced by the deaf and hard-of-hearing community. A computer vision-based approach is adopted, utilizing a readily available webcam as the primary sensory input. Hand motions are captured, and the MediaPipe toolkit is employed to reliably detect hands and extract key anatomical landmarks. The system then generates a skeletal representation of the hand, effectively circumventing issues stemming from fluctuating backgrounds and variable lighting. These extracted skeletal data points become the input for a specially constructed Convolutional Neural Network (CNN). When a gesture is successfully classified, its equivalent text is displayed, and concurrently transformed into speech via the pyttsx3 module, providing a multi-faceted output. Additionally, the system integrates word suggestions using the enchant library, enhancing communication fluidity and enabling user-led corrections via the interface. A user-friendly interface, built using Tkinter and Pillow, offers real-time visual feedback on hand tracking, gesture identification, alongside text and audio outputs. The project aims to provide an essential and cost-effective means of breaking down communication barriers between the hearing and deaf communities, with the aim of fostering greater inclusion and simplified interaction.
KEYWORDS
Publication Date
4/18/2025
Peer Review Type
Double-Blind Peer Review
Review Rounds: 2
Documents
Article Views
0
Total views since publication
PDF Downloads
0
Total downloads since publication
Geographic Reach
5
Digital Preservation: This article is permanently archived on Zenodo and complies with all data preservation standards across major indexing platforms.
Plagiarism Screening
This manuscript has been checked for plagiarism using TurnitinPlagiarismChecker software.
Conflict of Interest
The authors declare no conflict of interest related to this research work.
Funding Information
No funding information available for this research.
Related research in the same subject area
Loading similar articles...