Virtual Whiteboard Using Hand Gesture Recognition And Voice Control
Dr. Sudhir R.Rangari1, Darshan Badgujar2, Harshal Bauskar3 , Vedant Dhage4, Ganesh Wadule5 , Sarthak Gajendragadkar6
1Dr.Sudhir R. Rangari, Department of Information Technology, JSCOE
2Darshan Badgujar, Department of Information Technology, JSCOE
3Harshal Bauskar, Department of Information Technology, JSCOE
4Vedant Dhage, Department of Information Technology, JSCOE
5 Ganesh Wadule, Department of Information Technology, JSCOE
6 Sarthak Gajendragadkar, Department of Information Technology, JSCOE
---------------------------------------------------------------------***---------------------------------------------------------------------
Abstract - This paper introduces a novel virtual whiteboard system that utilizes hand gesture recognition and voice control to advance contemporary teaching methods. Designed to overcome the shortcomings of conventional whiteboards and digital input devices, the system enables teachers to draw, write, and navigate through natural hand gestures and voice commands—without the need for physical contact. Developed with the help of computer vision technology like OpenCV and MediaPipe, the system identifies and comprehends live gestures, facilitating dynamic interaction with the virtual board. Voice recognition modules are included to allow for verbal commands, offering an effortless, hands-off user experience.
The frontend, created with React.js and Tailwind CSS, provides a simple and adaptive interface, while the Python-based backend handles gesture and audio data. This configuration ensures seamless performance ideal for both classroom and online learning environments. The project prioritizes accessibility, with the intent to assist physically challenged teachers and minimize the dependence on traditional teaching aids. Overall, this solution bridges the gap between human contact and technology-based teaching tools, enhancing an immersive, accessible, and technologically rich learning experience. It also presents possibilities for further growth into smart classrooms and AI-powered teaching platforms.
Key Words: Virtual Whiteboard, Hand Gesture Recognition, Voice Control, Computer Vision, OpenCV, MediaPipe, React.js, Tailwind CSS, Python, Accessibility, Remote Learning, Contactless Interaction, Smart Classrooms, AI-Powered Teaching, User Interface, Digital Education Tools, Natural Interaction, Teaching Technology, Inclusive Learning, Real-time Processing
