AN INTERACTIVE COMPUTER SYSTEM WITH A GESTURE-BASED MOUSE AND KEYBOARD

In this world, researchers are now focused on making our devices more interactive and operational with minimal physical contact. In this research, we have submitted a real-time computer system that can operate without any physical hardware specifically a keyboard and mouse. This system can be beneficial to everyone, especially to paralyzed people who face difficulties to operate a physical keyboard and mouse. We used computer vision so that the user can type on a virtual keyboard using a yellow-colored cap on his fingertip, and can also navigate to the mouse-controlling system. Once the user is in mouse-controlling mode, the user can perform all the mouse operations only by showing a different number of fingers. We validated both modules of our system by a 52 years old paralyzed person and achieved around 80% accuracy on average.