Gesture Recognition Based Virtual Mouse and Keyboard

Gesture Recognition Based Virtual Mouse and Keyboard

Naresh Thoutam, Bhumi chavan, Kabir Patole, Sakshi Jadhav, Vidhya Bagal

Abstract - In this project, an optical mouse and keyboard are created utilizing hand motions and computer vision. The computer's camera will scan the image of various hand gestures made by a user, and the computer's mouse or pointer will move in accordance with the movements of the Users can even conduct right and left clicks using various gestures. Similar to this, several gestures can be used to operate the keyboard, such as the one-finger gesture for selecting an alphabet and the four- figure motion for swiping left and right. Without a wire or other external devices, it will function as a virtual mouse and keyboard. The project's webcam is its sole piece of hardware, and Python is used to code on the Anaconda platform. Here, the Convex hull defects are first constructed, and then an algorithm is generated and maps the mouse and keyboard functions to the defects using the defect calculations. By mapping a few of them with the mouse and keyboard, the computer will recognise the user's gesture and respond appropriately.

Index Terms - Optical Mouse, Face Recognition, Virtual Mouse And Keyboard, Anaconda Platform