Hand Gesture Controller (Virtual Mouse) and Voice Assistant using OpenCV, ML, Python

Hand Gesture Controller (Virtual Mouse) and Voice Assistant using OpenCV, ML, Python

Dr. Pratibha V. Waje1

Ms.Shipranjali K. Gangurde, Ms. Snehal S. Sonawane, Ms. Pallavi S. Avhad, Mr.Shubham S. Raut

Department of Information Technology

Sir Visvesvaraya Institute of Technology

A/p: Chincholi Tal.:Sinnar, Dist.: Nashik, Maharashtra,India- 422102

ABSTRACT- The advancements in artificial intelligence technology have led to the increasing popularity of hand gesture recognition for controlling virtual devices. This paper proposes hand gesture controller (virtual mouse) and voice assistant that utilizes OpenCV for recognizing hand gestures and translating them into mouse movements. The system serves as an alternative interface for individuals who encounter difficulties when using a traditional mouse or keyboard. A camera captures images of the user's hand, which is processed by an AI algorithm to identify the gestures made. The system is scalable and adaptable to different environments and devices. Dynamic/static hand gestures and voice commands can control all input operations without any additional hardware requirements. We use ML and Computer Vision algorithms to recognize hand gestures and voice commands, implementing the model using CNN and the (Gesture-Controlled-Virtual-Mouse) [2]controlled virtual mouse system has potential applications in hazardous environments for enabling hand-free device operation and offering an alternative interface to hardware mouse users. Our proposed system has the potential to enhance user experience and improve accessibility through human-computer interaction [1].

Keywords: Computer vision, hand gesture recognition, Mediapipe, and virtual mouse.