Raspberry Pi Based Driver Alertness Monitoring Using Facial Landmark Analysis

Abdurahman - Abdurahman, Ahmad Zarkasi, M Aren Saputra, Sutarno Sutarno, Aditya P. P. Prasetyo, Sarmayanta Sembiring

Abstract

Drowsiness while driving is one of the conditions that can reduce a driver’s concentration and alertness; therefore, an early warning system capable of directly monitoring the driver’s condition is required. This study aims to design a drowsiness detection system for four-wheeled vehicle drivers based on Raspberry Pi using the Facial Landmark Detection (FLD) method with the Eye Aspect Ratio (EAR) parameter. The system is designed by utilizing a webcam as the input device to capture the driver’s facial image, Raspberry Pi as the data processing unit, a buzzer as the warning output device, and a push button as the manual reset button. The detection process is carried out using MediaPipe Face Mesh to obtain landmark points in the eye area. The EAR value is used to determine whether the eyes are open or closed, while the number of eye blinks is used as an indicator to determine the driver’s drowsiness condition. Testing was conducted by measuring EAR values at various distances and face positions, as well as by testing the Eye Blink Counter by comparing the number of blinks calculated by the system with manual observations. The test results show that the system is able to detect faces and eye landmarks in most testing conditions with distance variations ranging from 10 to 95 centimeters. In the Eye Blink Counter test conducted 24 times with a duration of 60 seconds, an average error of 2.49 percent was obtained.

Keywords

Drowsiness Detection, Raspberry Pi, Facial Landmark Detection, Eye Aspect Ratio

Full Text:

PDF

References

[1] A. Moradi, S. S. Hashemi Nazari, and K. Rahmani, “Sleepiness and the risk of road traffic accidents: A systematic review and meta-analysis of previous studies,” Transportation Research Part F: Traffic Psychology and Behaviour, vol. 65, pp. 620–629, 2019, doi: 10.1016/j.trf.2018.09.013.

[2] World Health Organization, “Road traffic injuries,” World Health Organization Fact Sheets, 2023. [Online]. Available: https://www.who.int/news-room/fact-sheets/detail/road-traffic-injuries

[3] G. Zhang, K. K. W. Yau, X. Zhang, and Y. Li, “Traffic accidents involving fatigue driving and their extent of casualties,” Accident Analysis & Prevention, vol. 87, pp. 34–42, 2016, doi: 10.1016/j.aap.2015.10.033.

[4] N. Kamarudin, N. A. Jumadi, N. L. Mun, N. C. Keat, A. H. K. Ching, W. M. H. W. Mahmud, M. Morsin, and F. Mahmud, “Implementation of Haar Cascade Classifier and Eye Aspect Ratio for Driver Drowsiness Detection Using Raspberry Pi,” Universal Journal of Electrical and Electronic Engineering, vol. 6, no. 5B, pp. 67–75, 2019, doi: 10.13189/ujeee.2019.061609.

[5] V. U. Maheswari, R. Aluvalu, M. V. V. Prasad Kantipudi, K. K. Chennam, K. Kotecha, and J. R. Saini, “Driver Drowsiness Prediction Based on Multiple Aspects Using Image Processing Techniques,” IEEE Access, vol. 10, pp. 54980–54990, 2022, doi: 10.1109/ACCESS.2022.3176451.

[6] J. He, W. Choi, Y. Yang, J. Lu, X. Wu, and K. Peng, “Detection of driver drowsiness using wearable devices: A feasibility study of the proximity sensor,” Applied Ergonomics, vol. 65, pp. 473–480, 2017, doi: 10.1016/j.apergo.2017.02.016.

[7] P. K. Singh, A. Gupta, M. Upadhyay, A. Jain, M. Khari, and P. S. Lamba, “Multimodal Driver Drowsiness Detection From Video Frames,” Journal of Mobile Multimedia, vol. 19, no. 2, pp. 567–586, 2022, doi: 10.13052/jmm1550-4646.19210.

[8] T. Zhu, C. Zhang, T. Wu, Z. Ouyang, H. Li, X. Na, J. Liang, and W. Li, “Research on a Real-Time Driver Fatigue Detection Algorithm Based on Facial Video Sequences,” Applied Sciences, vol. 12, no. 4, Art. no. 2224, 2022, doi: 10.3390/app12042224..

[9] C. Lugaresi et al., “MediaPipe: A Framework for Building Perception Pipelines,” arXiv preprint arXiv:1906.08172, 2019, doi: 10.48550/arXiv.1906.08172.

[10] S. Ahmad, S. Malik, D.-H. Park, and D. Kim, “Design of Lightweight Driver-Assistance System for Safe Driving in Electric Vehicles,” Sensors, vol. 19, no. 21, Art. no. 4761, 2019, doi: 10.3390/s19214761.

[11] C. B. S. Maior, M. J. das C. Moura, J. M. M. Santana, and I. D. Lins, “Real-time classification for autonomous drowsiness detection using eye aspect ratio,” Expert Systems with Applications, vol. 158, Art. no. 113505, 2020, doi: 10.1016/j.eswa.2020.113505.

Refbacks

  • There are currently no refbacks.