Automatic Driver Drowsiness Detection Using Artificial Neural Network Based on Visual Facial Descriptors: Pilot Study

Abstract

Purpose: Driving while drowsy is a major cause of traffic accidents globally. Recent technologies for detection and alarm within automobiles for this condition are limited by their reliability, practicality, cost, and lack of clinical validation. In this study, we developed an early drowsiness detection algorithm and device based on the “gold standard brain biophysiological signal” and facial expression digital data. Methods: The data were obtained from 10 participants. Artificial neural networks (ANN) were adopted as the model. Composite features of facial descriptors (ie, eye aspect ratio (EAR), mouth aspect ratio (MAR), face length (FL), and face width balance (FWB)) extracted from two-second video frames were investigated. Results: The ANN combined with the EAR and MAR features had the most sensitivity (70.12%) while the ANN combined with the EAR, MAR, and FL features had the most accuracy and specificity (60.76% and 58.71%, respectively). In addition, by applying the discrete Fourier transform (DFT) to the composite features, the ANN combined with the EAR and MAR features again had the highest sensitivity (72.25%), while the ANN combined with the EAR, MAR, and FL features had the highest accuracy and specificity (60.40% and 54.10%, respectively). Conclusion: The ANN with DFT combined with the EAR, MAR, and FL offered the best performance. Our direct driver sleepiness detection system developed from the integration of biophysiological information and internal validation provides a valuable algorithm, specifically toward alertness level.