Cargando…

A Context-Aware, Computer-Vision-Based Approach for the Detection of Taxi Street-Hailing Scenes from Video Streams

With the increasing deployment of autonomous taxis in different cities around the world, recent studies have stressed the importance of developing new methods, models and tools for intuitive human–autonomous taxis interactions (HATIs). Street hailing is one example, where passengers would hail an au...

Descripción completa

Detalles Bibliográficos
Autores principales: Mastouri, Mahmoud, Bouyahia, Zied, Haddad, Hedi, Horchani, Leila, Jabeur, Nafaa
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10224332/
https://www.ncbi.nlm.nih.gov/pubmed/37430711
http://dx.doi.org/10.3390/s23104796
_version_ 1785050152114847744
author Mastouri, Mahmoud
Bouyahia, Zied
Haddad, Hedi
Horchani, Leila
Jabeur, Nafaa
author_facet Mastouri, Mahmoud
Bouyahia, Zied
Haddad, Hedi
Horchani, Leila
Jabeur, Nafaa
author_sort Mastouri, Mahmoud
collection PubMed
description With the increasing deployment of autonomous taxis in different cities around the world, recent studies have stressed the importance of developing new methods, models and tools for intuitive human–autonomous taxis interactions (HATIs). Street hailing is one example, where passengers would hail an autonomous taxi by simply waving a hand, exactly like they do for manned taxis. However, automated taxi street-hailing recognition has been explored to a very limited extent. In order to address this gap, in this paper, we propose a new method for the detection of taxi street hailing based on computer vision techniques. Our method is inspired by a quantitative study that we conducted with 50 experienced taxi drivers in the city of Tunis (Tunisia) in order to understand how they recognize street-hailing cases. Based on the interviews with taxi drivers, we distinguish between explicit and implicit street-hailing cases. Given a traffic scene, explicit street hailing is detected using three elements of visual information: the hailing gesture, the person’s relative position to the road and the person’s head orientation. Any person who is standing close to the road, looking towards the taxi and making a hailing gesture is automatically recognized as a taxi-hailing passenger. If some elements of the visual information are not detected, we use contextual information (such as space, time and weather) in order to evaluate the existence of implicit street-hailing cases. For example, a person who is standing on the roadside in the heat, looking towards the taxi but not waving his hand is still considered a potential passenger. Hence, the new method that we propose integrates both visual and contextual information in a computer-vision pipeline that we designed to detect taxi street-hailing cases from video streams collected by capturing devices mounted on moving taxis. We tested our pipeline using a dataset that we collected with a taxi on the roads of Tunis. Considering both explicit and implicit hailing scenarios, our method yields satisfactory results in relatively realistic settings, with an accuracy of 80%, a precision of 84% and a recall of 84%.
format Online
Article
Text
id pubmed-10224332
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-102243322023-05-28 A Context-Aware, Computer-Vision-Based Approach for the Detection of Taxi Street-Hailing Scenes from Video Streams Mastouri, Mahmoud Bouyahia, Zied Haddad, Hedi Horchani, Leila Jabeur, Nafaa Sensors (Basel) Article With the increasing deployment of autonomous taxis in different cities around the world, recent studies have stressed the importance of developing new methods, models and tools for intuitive human–autonomous taxis interactions (HATIs). Street hailing is one example, where passengers would hail an autonomous taxi by simply waving a hand, exactly like they do for manned taxis. However, automated taxi street-hailing recognition has been explored to a very limited extent. In order to address this gap, in this paper, we propose a new method for the detection of taxi street hailing based on computer vision techniques. Our method is inspired by a quantitative study that we conducted with 50 experienced taxi drivers in the city of Tunis (Tunisia) in order to understand how they recognize street-hailing cases. Based on the interviews with taxi drivers, we distinguish between explicit and implicit street-hailing cases. Given a traffic scene, explicit street hailing is detected using three elements of visual information: the hailing gesture, the person’s relative position to the road and the person’s head orientation. Any person who is standing close to the road, looking towards the taxi and making a hailing gesture is automatically recognized as a taxi-hailing passenger. If some elements of the visual information are not detected, we use contextual information (such as space, time and weather) in order to evaluate the existence of implicit street-hailing cases. For example, a person who is standing on the roadside in the heat, looking towards the taxi but not waving his hand is still considered a potential passenger. Hence, the new method that we propose integrates both visual and contextual information in a computer-vision pipeline that we designed to detect taxi street-hailing cases from video streams collected by capturing devices mounted on moving taxis. We tested our pipeline using a dataset that we collected with a taxi on the roads of Tunis. Considering both explicit and implicit hailing scenarios, our method yields satisfactory results in relatively realistic settings, with an accuracy of 80%, a precision of 84% and a recall of 84%. MDPI 2023-05-16 /pmc/articles/PMC10224332/ /pubmed/37430711 http://dx.doi.org/10.3390/s23104796 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Mastouri, Mahmoud
Bouyahia, Zied
Haddad, Hedi
Horchani, Leila
Jabeur, Nafaa
A Context-Aware, Computer-Vision-Based Approach for the Detection of Taxi Street-Hailing Scenes from Video Streams
title A Context-Aware, Computer-Vision-Based Approach for the Detection of Taxi Street-Hailing Scenes from Video Streams
title_full A Context-Aware, Computer-Vision-Based Approach for the Detection of Taxi Street-Hailing Scenes from Video Streams
title_fullStr A Context-Aware, Computer-Vision-Based Approach for the Detection of Taxi Street-Hailing Scenes from Video Streams
title_full_unstemmed A Context-Aware, Computer-Vision-Based Approach for the Detection of Taxi Street-Hailing Scenes from Video Streams
title_short A Context-Aware, Computer-Vision-Based Approach for the Detection of Taxi Street-Hailing Scenes from Video Streams
title_sort context-aware, computer-vision-based approach for the detection of taxi street-hailing scenes from video streams
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10224332/
https://www.ncbi.nlm.nih.gov/pubmed/37430711
http://dx.doi.org/10.3390/s23104796
work_keys_str_mv AT mastourimahmoud acontextawarecomputervisionbasedapproachforthedetectionoftaxistreethailingscenesfromvideostreams
AT bouyahiazied acontextawarecomputervisionbasedapproachforthedetectionoftaxistreethailingscenesfromvideostreams
AT haddadhedi acontextawarecomputervisionbasedapproachforthedetectionoftaxistreethailingscenesfromvideostreams
AT horchanileila acontextawarecomputervisionbasedapproachforthedetectionoftaxistreethailingscenesfromvideostreams
AT jabeurnafaa acontextawarecomputervisionbasedapproachforthedetectionoftaxistreethailingscenesfromvideostreams
AT mastourimahmoud contextawarecomputervisionbasedapproachforthedetectionoftaxistreethailingscenesfromvideostreams
AT bouyahiazied contextawarecomputervisionbasedapproachforthedetectionoftaxistreethailingscenesfromvideostreams
AT haddadhedi contextawarecomputervisionbasedapproachforthedetectionoftaxistreethailingscenesfromvideostreams
AT horchanileila contextawarecomputervisionbasedapproachforthedetectionoftaxistreethailingscenesfromvideostreams
AT jabeurnafaa contextawarecomputervisionbasedapproachforthedetectionoftaxistreethailingscenesfromvideostreams