Cargando…

A Conceptual Multi-Layer Framework for the Detection of Nighttime Pedestrian in Autonomous Vehicles Using Deep Reinforcement Learning

The major challenge faced by autonomous vehicles today is driving through busy roads without getting into an accident, especially with a pedestrian. To avoid collision with pedestrians, the vehicle requires the ability to communicate with a pedestrian to understand their actions. The most challengin...

Descripción completa

Detalles Bibliográficos
Autores principales: Farooq, Muhammad Shoaib, Khalid, Haris, Arooj, Ansif, Umer, Tariq, Asghar, Aamer Bilal, Rasheed, Jawad, Shubair, Raed M., Yahyaoui, Amani
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9858197/
https://www.ncbi.nlm.nih.gov/pubmed/36673276
http://dx.doi.org/10.3390/e25010135
_version_ 1784874038862020608
author Farooq, Muhammad Shoaib
Khalid, Haris
Arooj, Ansif
Umer, Tariq
Asghar, Aamer Bilal
Rasheed, Jawad
Shubair, Raed M.
Yahyaoui, Amani
author_facet Farooq, Muhammad Shoaib
Khalid, Haris
Arooj, Ansif
Umer, Tariq
Asghar, Aamer Bilal
Rasheed, Jawad
Shubair, Raed M.
Yahyaoui, Amani
author_sort Farooq, Muhammad Shoaib
collection PubMed
description The major challenge faced by autonomous vehicles today is driving through busy roads without getting into an accident, especially with a pedestrian. To avoid collision with pedestrians, the vehicle requires the ability to communicate with a pedestrian to understand their actions. The most challenging task in research on computer vision is to detect pedestrian activities, especially at nighttime. The Advanced Driver-Assistance Systems (ADAS) has been developed for driving and parking support for vehicles to visualize sense, send and receive information from the environment but it lacks to detect nighttime pedestrian actions. This article proposes a framework based on Deep Reinforcement Learning (DRL) using Scale Invariant Faster Region-based Convolutional Neural Networks (SIFRCNN) technologies to efficiently detect pedestrian operations through which the vehicle, as agents train themselves from the environment and are forced to maximize the reward. The SIFRCNN has reduced the running time of detecting pedestrian operations from road images by incorporating Region Proposal Network (RPN) computation. Furthermore, we have used Reinforcement Learning (RL) for optimizing the Q-values and training itself to maximize the reward after getting the state from the SIFRCNN. In addition, the latest incarnation of SIFRCNN achieves near-real-time object detection from road images. The proposed SIFRCNN has been tested on KAIST, City Person, and Caltech datasets. The experimental results show an average improvement of 2.3% miss rate of pedestrian detection at nighttime compared to the other CNN-based pedestrian detectors.
format Online
Article
Text
id pubmed-9858197
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-98581972023-01-21 A Conceptual Multi-Layer Framework for the Detection of Nighttime Pedestrian in Autonomous Vehicles Using Deep Reinforcement Learning Farooq, Muhammad Shoaib Khalid, Haris Arooj, Ansif Umer, Tariq Asghar, Aamer Bilal Rasheed, Jawad Shubair, Raed M. Yahyaoui, Amani Entropy (Basel) Article The major challenge faced by autonomous vehicles today is driving through busy roads without getting into an accident, especially with a pedestrian. To avoid collision with pedestrians, the vehicle requires the ability to communicate with a pedestrian to understand their actions. The most challenging task in research on computer vision is to detect pedestrian activities, especially at nighttime. The Advanced Driver-Assistance Systems (ADAS) has been developed for driving and parking support for vehicles to visualize sense, send and receive information from the environment but it lacks to detect nighttime pedestrian actions. This article proposes a framework based on Deep Reinforcement Learning (DRL) using Scale Invariant Faster Region-based Convolutional Neural Networks (SIFRCNN) technologies to efficiently detect pedestrian operations through which the vehicle, as agents train themselves from the environment and are forced to maximize the reward. The SIFRCNN has reduced the running time of detecting pedestrian operations from road images by incorporating Region Proposal Network (RPN) computation. Furthermore, we have used Reinforcement Learning (RL) for optimizing the Q-values and training itself to maximize the reward after getting the state from the SIFRCNN. In addition, the latest incarnation of SIFRCNN achieves near-real-time object detection from road images. The proposed SIFRCNN has been tested on KAIST, City Person, and Caltech datasets. The experimental results show an average improvement of 2.3% miss rate of pedestrian detection at nighttime compared to the other CNN-based pedestrian detectors. MDPI 2023-01-09 /pmc/articles/PMC9858197/ /pubmed/36673276 http://dx.doi.org/10.3390/e25010135 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Farooq, Muhammad Shoaib
Khalid, Haris
Arooj, Ansif
Umer, Tariq
Asghar, Aamer Bilal
Rasheed, Jawad
Shubair, Raed M.
Yahyaoui, Amani
A Conceptual Multi-Layer Framework for the Detection of Nighttime Pedestrian in Autonomous Vehicles Using Deep Reinforcement Learning
title A Conceptual Multi-Layer Framework for the Detection of Nighttime Pedestrian in Autonomous Vehicles Using Deep Reinforcement Learning
title_full A Conceptual Multi-Layer Framework for the Detection of Nighttime Pedestrian in Autonomous Vehicles Using Deep Reinforcement Learning
title_fullStr A Conceptual Multi-Layer Framework for the Detection of Nighttime Pedestrian in Autonomous Vehicles Using Deep Reinforcement Learning
title_full_unstemmed A Conceptual Multi-Layer Framework for the Detection of Nighttime Pedestrian in Autonomous Vehicles Using Deep Reinforcement Learning
title_short A Conceptual Multi-Layer Framework for the Detection of Nighttime Pedestrian in Autonomous Vehicles Using Deep Reinforcement Learning
title_sort conceptual multi-layer framework for the detection of nighttime pedestrian in autonomous vehicles using deep reinforcement learning
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9858197/
https://www.ncbi.nlm.nih.gov/pubmed/36673276
http://dx.doi.org/10.3390/e25010135
work_keys_str_mv AT farooqmuhammadshoaib aconceptualmultilayerframeworkforthedetectionofnighttimepedestrianinautonomousvehiclesusingdeepreinforcementlearning
AT khalidharis aconceptualmultilayerframeworkforthedetectionofnighttimepedestrianinautonomousvehiclesusingdeepreinforcementlearning
AT aroojansif aconceptualmultilayerframeworkforthedetectionofnighttimepedestrianinautonomousvehiclesusingdeepreinforcementlearning
AT umertariq aconceptualmultilayerframeworkforthedetectionofnighttimepedestrianinautonomousvehiclesusingdeepreinforcementlearning
AT asgharaamerbilal aconceptualmultilayerframeworkforthedetectionofnighttimepedestrianinautonomousvehiclesusingdeepreinforcementlearning
AT rasheedjawad aconceptualmultilayerframeworkforthedetectionofnighttimepedestrianinautonomousvehiclesusingdeepreinforcementlearning
AT shubairraedm aconceptualmultilayerframeworkforthedetectionofnighttimepedestrianinautonomousvehiclesusingdeepreinforcementlearning
AT yahyaouiamani aconceptualmultilayerframeworkforthedetectionofnighttimepedestrianinautonomousvehiclesusingdeepreinforcementlearning
AT farooqmuhammadshoaib conceptualmultilayerframeworkforthedetectionofnighttimepedestrianinautonomousvehiclesusingdeepreinforcementlearning
AT khalidharis conceptualmultilayerframeworkforthedetectionofnighttimepedestrianinautonomousvehiclesusingdeepreinforcementlearning
AT aroojansif conceptualmultilayerframeworkforthedetectionofnighttimepedestrianinautonomousvehiclesusingdeepreinforcementlearning
AT umertariq conceptualmultilayerframeworkforthedetectionofnighttimepedestrianinautonomousvehiclesusingdeepreinforcementlearning
AT asgharaamerbilal conceptualmultilayerframeworkforthedetectionofnighttimepedestrianinautonomousvehiclesusingdeepreinforcementlearning
AT rasheedjawad conceptualmultilayerframeworkforthedetectionofnighttimepedestrianinautonomousvehiclesusingdeepreinforcementlearning
AT shubairraedm conceptualmultilayerframeworkforthedetectionofnighttimepedestrianinautonomousvehiclesusingdeepreinforcementlearning
AT yahyaouiamani conceptualmultilayerframeworkforthedetectionofnighttimepedestrianinautonomousvehiclesusingdeepreinforcementlearning