Gaze Gesture Authentication System Against Shoulder Surfing Attacks

Shoulder surfing is the term used to describe one person observing another person’s computer or mobile device screen and keyboard to obtain sensitive information. Direct observation can be done by simply looking over someone’s shoulder – hence shoulder surfing – or using binoculars, video cameras, and other optical devices. Shoulder surfing usually has the goal of viewing and stealing sensitive information such as username and password combinations that can be used to enter a user’s account later. Credit card numbers, PIN, and sensitive personal information used in response to security questions are also targeted. So, the proposed Two-factor authentication would secure the system from the Shoulder Surfing Attack which is disparate from the traditional existing system where username and password are required for authentication. In the proposed system, the first phase is username & password validation just like a login page. The information for authentication is provided by the user while registering to the page. In the next phase, Gaze Gesture Authentication is used through Real time eye tracking using OpenCV and Dlib. Through multiple evaluations, we discuss how the authentication accuracy varies with respect to transition speed of numbers and user’s blink.