Cargando…

Convolutional Neural Network-Based Classification of Driver’s Emotion during Aggressive and Smooth Driving Using Multi-Modal Camera Sensors

Because aggressive driving often causes large-scale loss of life and property, techniques for advance detection of adverse driver emotional states have become important for the prevention of aggressive driving behaviors. Previous studies have primarily focused on systems for detecting aggressive dri...

Descripción completa

Detalles Bibliográficos
Autores principales: Lee, Kwan Woo, Yoon, Hyo Sik, Song, Jong Min, Park, Kang Ryoung
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5948584/
https://www.ncbi.nlm.nih.gov/pubmed/29570678
http://dx.doi.org/10.3390/s18040957
_version_ 1783322582936715264
author Lee, Kwan Woo
Yoon, Hyo Sik
Song, Jong Min
Park, Kang Ryoung
author_facet Lee, Kwan Woo
Yoon, Hyo Sik
Song, Jong Min
Park, Kang Ryoung
author_sort Lee, Kwan Woo
collection PubMed
description Because aggressive driving often causes large-scale loss of life and property, techniques for advance detection of adverse driver emotional states have become important for the prevention of aggressive driving behaviors. Previous studies have primarily focused on systems for detecting aggressive driver emotion via smart-phone accelerometers and gyro-sensors, or they focused on methods of detecting physiological signals using electroencephalography (EEG) or electrocardiogram (ECG) sensors. Because EEG and ECG sensors cause discomfort to drivers and can be detached from the driver’s body, it becomes difficult to focus on bio-signals to determine their emotional state. Gyro-sensors and accelerometers depend on the performance of GPS receivers and cannot be used in areas where GPS signals are blocked. Moreover, if driving on a mountain road with many quick turns, a driver’s emotional state can easily be misrecognized as that of an aggressive driver. To resolve these problems, we propose a convolutional neural network (CNN)-based method of detecting emotion to identify aggressive driving using input images of the driver’s face, obtained using near-infrared (NIR) light and thermal camera sensors. In this research, we conducted an experiment using our own database, which provides a high classification accuracy for detecting driver emotion leading to either aggressive or smooth (i.e., relaxed) driving. Our proposed method demonstrates better performance than existing methods.
format Online
Article
Text
id pubmed-5948584
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-59485842018-05-17 Convolutional Neural Network-Based Classification of Driver’s Emotion during Aggressive and Smooth Driving Using Multi-Modal Camera Sensors Lee, Kwan Woo Yoon, Hyo Sik Song, Jong Min Park, Kang Ryoung Sensors (Basel) Article Because aggressive driving often causes large-scale loss of life and property, techniques for advance detection of adverse driver emotional states have become important for the prevention of aggressive driving behaviors. Previous studies have primarily focused on systems for detecting aggressive driver emotion via smart-phone accelerometers and gyro-sensors, or they focused on methods of detecting physiological signals using electroencephalography (EEG) or electrocardiogram (ECG) sensors. Because EEG and ECG sensors cause discomfort to drivers and can be detached from the driver’s body, it becomes difficult to focus on bio-signals to determine their emotional state. Gyro-sensors and accelerometers depend on the performance of GPS receivers and cannot be used in areas where GPS signals are blocked. Moreover, if driving on a mountain road with many quick turns, a driver’s emotional state can easily be misrecognized as that of an aggressive driver. To resolve these problems, we propose a convolutional neural network (CNN)-based method of detecting emotion to identify aggressive driving using input images of the driver’s face, obtained using near-infrared (NIR) light and thermal camera sensors. In this research, we conducted an experiment using our own database, which provides a high classification accuracy for detecting driver emotion leading to either aggressive or smooth (i.e., relaxed) driving. Our proposed method demonstrates better performance than existing methods. MDPI 2018-03-23 /pmc/articles/PMC5948584/ /pubmed/29570678 http://dx.doi.org/10.3390/s18040957 Text en © 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Lee, Kwan Woo
Yoon, Hyo Sik
Song, Jong Min
Park, Kang Ryoung
Convolutional Neural Network-Based Classification of Driver’s Emotion during Aggressive and Smooth Driving Using Multi-Modal Camera Sensors
title Convolutional Neural Network-Based Classification of Driver’s Emotion during Aggressive and Smooth Driving Using Multi-Modal Camera Sensors
title_full Convolutional Neural Network-Based Classification of Driver’s Emotion during Aggressive and Smooth Driving Using Multi-Modal Camera Sensors
title_fullStr Convolutional Neural Network-Based Classification of Driver’s Emotion during Aggressive and Smooth Driving Using Multi-Modal Camera Sensors
title_full_unstemmed Convolutional Neural Network-Based Classification of Driver’s Emotion during Aggressive and Smooth Driving Using Multi-Modal Camera Sensors
title_short Convolutional Neural Network-Based Classification of Driver’s Emotion during Aggressive and Smooth Driving Using Multi-Modal Camera Sensors
title_sort convolutional neural network-based classification of driver’s emotion during aggressive and smooth driving using multi-modal camera sensors
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5948584/
https://www.ncbi.nlm.nih.gov/pubmed/29570678
http://dx.doi.org/10.3390/s18040957
work_keys_str_mv AT leekwanwoo convolutionalneuralnetworkbasedclassificationofdriversemotionduringaggressiveandsmoothdrivingusingmultimodalcamerasensors
AT yoonhyosik convolutionalneuralnetworkbasedclassificationofdriversemotionduringaggressiveandsmoothdrivingusingmultimodalcamerasensors
AT songjongmin convolutionalneuralnetworkbasedclassificationofdriversemotionduringaggressiveandsmoothdrivingusingmultimodalcamerasensors
AT parkkangryoung convolutionalneuralnetworkbasedclassificationofdriversemotionduringaggressiveandsmoothdrivingusingmultimodalcamerasensors