Eye-Gazed Communication System

In conclusion, the Eye-Gaze Communication System effectively demonstrates how computer vision and real-time image processing techniques can be utilized to enable hands-free communication for individuals with speech and motor impairments. The system integrates a standard webcam with OpenCV-based face and eye detection, pupil tracking, and gaze estimation modules to accurately interpret user intent through natural eye movements. By eliminating the need for specialized hardware, the proposed solution offers a cost-effective and accessible alternative to conventional assistive communication technologies. Furthermore, the inclusion of a gaze-controlled virtual keyboard and optional text-to-speech functionality enhances the usability and communication efficiency of the system in healthcare and rehabilitation environments. The modular architecture ensures real-time responsiveness, accuracy, and ease of deployment across different platforms. Overall, the project successfully fulfills its objectives of improving accessibility, affordability, and interaction efficiency, while demonstrating the practical application of computer vision and assistive technology in enhancing the quality of life for speech-and motor-impaired users.

[1]. A. T. Duchowski, Eye Tracking Methodology: Theory and Practice, 2nd ed., London, UK: Springer, 2007. [2]. J. Hansen and Q. Ji, “In the eye of the beholder: A survey of models for eyes and gaze,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 32, no. 3, pp. 478–500, Mar. 2010. [3]. K. Krafka, A. Khosla, P. Kellnhofer, et al., “Eye tracking for everyone,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 2016, pp. 2176–2184. [4]. Z. Zhang, Y. Sugano, A. Bulling, and H. Gunes, “Appearance-based gaze estimation in the wild,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA, 2018, pp. 4511–4520. [5]. S. Majaranta and K.-J. Räihä, “Twenty years of eye typing: Systems and design issues,” in Proceedings of the 2002 Symposium on Eye Tracking Research & Applications, New Orleans, LA, USA, 2002, pp. 15–22. [6]. R. Baluja and D. Pomerleau, “Non-intrusive gaze tracking using artificial neural networks,” in Advances in Neural Information Processing Systems (NIPS), Denver, CO, USA, 1997, pp. 753–760. [7]. G. Bradski, “The OpenCV Library,” Dr. Dobb’s Journal of Software Tools, 2000. [8]. OpenCV Contributors, “OpenCV: Open Source Computer Vision Library,” OpenCV Documentation, 2024. [Online]. Available: https://opencv.org. [9]. T. Baltrušaitis, A. Zadeh, Y. C. Lim, and L.-P. Morency, “OpenFace 2.0: Facial behavior analysis toolkit,” in Proceedings of the IEEE International Conference on Automatic Face & Gesture Recognition (FG), Xi’an, China, 2018, pp. 59–66. [10].Y. Wu, Y. Liu, and X. Zhang, “Real-time eye gaze estimation using convolutional neural networks for assistive communication,” IEEE Access, vol. 11, pp. 45678–45689, 2023.