Cargando…

A Machine Learning-Based Correlation Analysis between Driver Behaviour and Vital Signs: Approach and Case Study

Driving behaviour analysis has drawn much attention in recent years due to the dramatic increase in the number of traffic accidents and casualties, and based on many studies, there is a relationship between the driving environment or behaviour and the driver’s state. To the best of our knowledge, th...

Descripción completa

Detalles Bibliográficos
Autores principales: Othman, Walaa, Hamoud, Batol, Kashevnik, Alexey, Shilov, Nikolay, Ali, Ammar
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10490726/
https://www.ncbi.nlm.nih.gov/pubmed/37687842
http://dx.doi.org/10.3390/s23177387
_version_ 1785103907315253248
author Othman, Walaa
Hamoud, Batol
Kashevnik, Alexey
Shilov, Nikolay
Ali, Ammar
author_facet Othman, Walaa
Hamoud, Batol
Kashevnik, Alexey
Shilov, Nikolay
Ali, Ammar
author_sort Othman, Walaa
collection PubMed
description Driving behaviour analysis has drawn much attention in recent years due to the dramatic increase in the number of traffic accidents and casualties, and based on many studies, there is a relationship between the driving environment or behaviour and the driver’s state. To the best of our knowledge, these studies mostly investigate relationships between one vital sign and the driving circumstances either inside or outside the cabin. Hence, our paper provides an analysis of the correlation between the driver state (vital signs, eye state, and head pose) and both the vehicle maneuver actions (caused by the driver) and external events (carried out by other vehicles or pedestrians), including the proximity to other vehicles. Our methodology employs several models developed in our previous work to estimate respiratory rate, heart rate, blood pressure, oxygen saturation, head pose, eye state from in-cabin videos, and the distance to the nearest vehicle from out-cabin videos. Additionally, new models have been developed using Convolutional Neural Network (CNN) and Bidirectional Long Short-Term Memory (BiLSTM) to classify the external events from out-cabin videos, as well as a Decision Tree classifier to detect the driver’s maneuver using accelerometer and gyroscope sensor data. The dataset used includes synchronized in-cabin/out-cabin videos and sensor data, allowing for the estimation of the driver state, proximity to other vehicles and detection of external events, and driver maneuvers. Therefore, the correlation matrix was calculated between all variables to be analysed. The results indicate that there is a weak correlation connecting both the maneuver action and the overtaking external event on one side and the heart rate and the blood pressure (systolic and diastolic) on the other side. In addition, the findings suggest a correlation between the yaw angle of the head and the overtaking event and a negative correlation between the systolic blood pressure and the distance to the nearest vehicle. Our findings align with our initial hypotheses, particularly concerning the impact of performing a maneuver or experiencing a cautious event, such as overtaking, on heart rate and blood pressure due to the agitation and tension resulting from such events. These results can be the key to implementing a sophisticated safety system aimed at maintaining the driver’s stable state when aggressive external events or maneuvers occur.
format Online
Article
Text
id pubmed-10490726
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-104907262023-09-09 A Machine Learning-Based Correlation Analysis between Driver Behaviour and Vital Signs: Approach and Case Study Othman, Walaa Hamoud, Batol Kashevnik, Alexey Shilov, Nikolay Ali, Ammar Sensors (Basel) Article Driving behaviour analysis has drawn much attention in recent years due to the dramatic increase in the number of traffic accidents and casualties, and based on many studies, there is a relationship between the driving environment or behaviour and the driver’s state. To the best of our knowledge, these studies mostly investigate relationships between one vital sign and the driving circumstances either inside or outside the cabin. Hence, our paper provides an analysis of the correlation between the driver state (vital signs, eye state, and head pose) and both the vehicle maneuver actions (caused by the driver) and external events (carried out by other vehicles or pedestrians), including the proximity to other vehicles. Our methodology employs several models developed in our previous work to estimate respiratory rate, heart rate, blood pressure, oxygen saturation, head pose, eye state from in-cabin videos, and the distance to the nearest vehicle from out-cabin videos. Additionally, new models have been developed using Convolutional Neural Network (CNN) and Bidirectional Long Short-Term Memory (BiLSTM) to classify the external events from out-cabin videos, as well as a Decision Tree classifier to detect the driver’s maneuver using accelerometer and gyroscope sensor data. The dataset used includes synchronized in-cabin/out-cabin videos and sensor data, allowing for the estimation of the driver state, proximity to other vehicles and detection of external events, and driver maneuvers. Therefore, the correlation matrix was calculated between all variables to be analysed. The results indicate that there is a weak correlation connecting both the maneuver action and the overtaking external event on one side and the heart rate and the blood pressure (systolic and diastolic) on the other side. In addition, the findings suggest a correlation between the yaw angle of the head and the overtaking event and a negative correlation between the systolic blood pressure and the distance to the nearest vehicle. Our findings align with our initial hypotheses, particularly concerning the impact of performing a maneuver or experiencing a cautious event, such as overtaking, on heart rate and blood pressure due to the agitation and tension resulting from such events. These results can be the key to implementing a sophisticated safety system aimed at maintaining the driver’s stable state when aggressive external events or maneuvers occur. MDPI 2023-08-24 /pmc/articles/PMC10490726/ /pubmed/37687842 http://dx.doi.org/10.3390/s23177387 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Othman, Walaa
Hamoud, Batol
Kashevnik, Alexey
Shilov, Nikolay
Ali, Ammar
A Machine Learning-Based Correlation Analysis between Driver Behaviour and Vital Signs: Approach and Case Study
title A Machine Learning-Based Correlation Analysis between Driver Behaviour and Vital Signs: Approach and Case Study
title_full A Machine Learning-Based Correlation Analysis between Driver Behaviour and Vital Signs: Approach and Case Study
title_fullStr A Machine Learning-Based Correlation Analysis between Driver Behaviour and Vital Signs: Approach and Case Study
title_full_unstemmed A Machine Learning-Based Correlation Analysis between Driver Behaviour and Vital Signs: Approach and Case Study
title_short A Machine Learning-Based Correlation Analysis between Driver Behaviour and Vital Signs: Approach and Case Study
title_sort machine learning-based correlation analysis between driver behaviour and vital signs: approach and case study
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10490726/
https://www.ncbi.nlm.nih.gov/pubmed/37687842
http://dx.doi.org/10.3390/s23177387
work_keys_str_mv AT othmanwalaa amachinelearningbasedcorrelationanalysisbetweendriverbehaviourandvitalsignsapproachandcasestudy
AT hamoudbatol amachinelearningbasedcorrelationanalysisbetweendriverbehaviourandvitalsignsapproachandcasestudy
AT kashevnikalexey amachinelearningbasedcorrelationanalysisbetweendriverbehaviourandvitalsignsapproachandcasestudy
AT shilovnikolay amachinelearningbasedcorrelationanalysisbetweendriverbehaviourandvitalsignsapproachandcasestudy
AT aliammar amachinelearningbasedcorrelationanalysisbetweendriverbehaviourandvitalsignsapproachandcasestudy
AT othmanwalaa machinelearningbasedcorrelationanalysisbetweendriverbehaviourandvitalsignsapproachandcasestudy
AT hamoudbatol machinelearningbasedcorrelationanalysisbetweendriverbehaviourandvitalsignsapproachandcasestudy
AT kashevnikalexey machinelearningbasedcorrelationanalysisbetweendriverbehaviourandvitalsignsapproachandcasestudy
AT shilovnikolay machinelearningbasedcorrelationanalysisbetweendriverbehaviourandvitalsignsapproachandcasestudy
AT aliammar machinelearningbasedcorrelationanalysisbetweendriverbehaviourandvitalsignsapproachandcasestudy