Detection of Drowsy Drivers in Video Sequences via LSTM with CNN Features

Detection of Drowsy Drivers in Video Sequences via LSTM with CNN Features

Navjot Kaur, Ghanta Giri Naga Siva Sai Durga Ramesh, M. Chandra Mouli, Rahul Kumar Kushwaha, M. Yesu Raju, A. Sunil Chowdary

Department of Computer Science

and Engineering

Lovely Professional University Phagwara, Punjab

Summary: Fatigued driving is one of the main causes of traffic accidents. This paper developed a method for sleep drive detection that makes use of the convolutional neural network (CNN), recurrent neural network (RNN), short-term neural network (LSTM), cascade, and cam switching algorithms. Using CNN, the algorithm initially extracts the driver's face traits.

The RNN that predicts the driver's degree of tiredness is then fed these features. The technology tracks the driver's eyes and eyelids using algorithms called Cascades and Cam shifts. The accuracy of the sleepiness prediction is increased further with the usage of this data. Using datasets of video recordings of attentive and somnolent drivers, the system was assessed. The outcomes demonstrated how well the algorithm could identify sleepy drivers. This system may be able to stop sleepy driving-related accidents. Ten thousand videos of awake and sleepy drivers were used to train the algorithm. Drivers can be observed in real time by the system. If the system detects that the driver is sleepy, it has the ability to sound an alarm. The technology can be used to stop driving when sleepy from causing accidents.

Keywords: Convolution neural network, Recurrent neural networks, long short-term memory, eye tracking, face detection, drowsy driver detection, deep learning, computer vision, machine learning, and deep learning.