Cargando…
A Context-Aware, Computer-Vision-Based Approach for the Detection of Taxi Street-Hailing Scenes from Video Streams
With the increasing deployment of autonomous taxis in different cities around the world, recent studies have stressed the importance of developing new methods, models and tools for intuitive human–autonomous taxis interactions (HATIs). Street hailing is one example, where passengers would hail an au...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10224332/ https://www.ncbi.nlm.nih.gov/pubmed/37430711 http://dx.doi.org/10.3390/s23104796 |
_version_ | 1785050152114847744 |
---|---|
author | Mastouri, Mahmoud Bouyahia, Zied Haddad, Hedi Horchani, Leila Jabeur, Nafaa |
author_facet | Mastouri, Mahmoud Bouyahia, Zied Haddad, Hedi Horchani, Leila Jabeur, Nafaa |
author_sort | Mastouri, Mahmoud |
collection | PubMed |
description | With the increasing deployment of autonomous taxis in different cities around the world, recent studies have stressed the importance of developing new methods, models and tools for intuitive human–autonomous taxis interactions (HATIs). Street hailing is one example, where passengers would hail an autonomous taxi by simply waving a hand, exactly like they do for manned taxis. However, automated taxi street-hailing recognition has been explored to a very limited extent. In order to address this gap, in this paper, we propose a new method for the detection of taxi street hailing based on computer vision techniques. Our method is inspired by a quantitative study that we conducted with 50 experienced taxi drivers in the city of Tunis (Tunisia) in order to understand how they recognize street-hailing cases. Based on the interviews with taxi drivers, we distinguish between explicit and implicit street-hailing cases. Given a traffic scene, explicit street hailing is detected using three elements of visual information: the hailing gesture, the person’s relative position to the road and the person’s head orientation. Any person who is standing close to the road, looking towards the taxi and making a hailing gesture is automatically recognized as a taxi-hailing passenger. If some elements of the visual information are not detected, we use contextual information (such as space, time and weather) in order to evaluate the existence of implicit street-hailing cases. For example, a person who is standing on the roadside in the heat, looking towards the taxi but not waving his hand is still considered a potential passenger. Hence, the new method that we propose integrates both visual and contextual information in a computer-vision pipeline that we designed to detect taxi street-hailing cases from video streams collected by capturing devices mounted on moving taxis. We tested our pipeline using a dataset that we collected with a taxi on the roads of Tunis. Considering both explicit and implicit hailing scenarios, our method yields satisfactory results in relatively realistic settings, with an accuracy of 80%, a precision of 84% and a recall of 84%. |
format | Online Article Text |
id | pubmed-10224332 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-102243322023-05-28 A Context-Aware, Computer-Vision-Based Approach for the Detection of Taxi Street-Hailing Scenes from Video Streams Mastouri, Mahmoud Bouyahia, Zied Haddad, Hedi Horchani, Leila Jabeur, Nafaa Sensors (Basel) Article With the increasing deployment of autonomous taxis in different cities around the world, recent studies have stressed the importance of developing new methods, models and tools for intuitive human–autonomous taxis interactions (HATIs). Street hailing is one example, where passengers would hail an autonomous taxi by simply waving a hand, exactly like they do for manned taxis. However, automated taxi street-hailing recognition has been explored to a very limited extent. In order to address this gap, in this paper, we propose a new method for the detection of taxi street hailing based on computer vision techniques. Our method is inspired by a quantitative study that we conducted with 50 experienced taxi drivers in the city of Tunis (Tunisia) in order to understand how they recognize street-hailing cases. Based on the interviews with taxi drivers, we distinguish between explicit and implicit street-hailing cases. Given a traffic scene, explicit street hailing is detected using three elements of visual information: the hailing gesture, the person’s relative position to the road and the person’s head orientation. Any person who is standing close to the road, looking towards the taxi and making a hailing gesture is automatically recognized as a taxi-hailing passenger. If some elements of the visual information are not detected, we use contextual information (such as space, time and weather) in order to evaluate the existence of implicit street-hailing cases. For example, a person who is standing on the roadside in the heat, looking towards the taxi but not waving his hand is still considered a potential passenger. Hence, the new method that we propose integrates both visual and contextual information in a computer-vision pipeline that we designed to detect taxi street-hailing cases from video streams collected by capturing devices mounted on moving taxis. We tested our pipeline using a dataset that we collected with a taxi on the roads of Tunis. Considering both explicit and implicit hailing scenarios, our method yields satisfactory results in relatively realistic settings, with an accuracy of 80%, a precision of 84% and a recall of 84%. MDPI 2023-05-16 /pmc/articles/PMC10224332/ /pubmed/37430711 http://dx.doi.org/10.3390/s23104796 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Mastouri, Mahmoud Bouyahia, Zied Haddad, Hedi Horchani, Leila Jabeur, Nafaa A Context-Aware, Computer-Vision-Based Approach for the Detection of Taxi Street-Hailing Scenes from Video Streams |
title | A Context-Aware, Computer-Vision-Based Approach for the Detection of Taxi Street-Hailing Scenes from Video Streams |
title_full | A Context-Aware, Computer-Vision-Based Approach for the Detection of Taxi Street-Hailing Scenes from Video Streams |
title_fullStr | A Context-Aware, Computer-Vision-Based Approach for the Detection of Taxi Street-Hailing Scenes from Video Streams |
title_full_unstemmed | A Context-Aware, Computer-Vision-Based Approach for the Detection of Taxi Street-Hailing Scenes from Video Streams |
title_short | A Context-Aware, Computer-Vision-Based Approach for the Detection of Taxi Street-Hailing Scenes from Video Streams |
title_sort | context-aware, computer-vision-based approach for the detection of taxi street-hailing scenes from video streams |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10224332/ https://www.ncbi.nlm.nih.gov/pubmed/37430711 http://dx.doi.org/10.3390/s23104796 |
work_keys_str_mv | AT mastourimahmoud acontextawarecomputervisionbasedapproachforthedetectionoftaxistreethailingscenesfromvideostreams AT bouyahiazied acontextawarecomputervisionbasedapproachforthedetectionoftaxistreethailingscenesfromvideostreams AT haddadhedi acontextawarecomputervisionbasedapproachforthedetectionoftaxistreethailingscenesfromvideostreams AT horchanileila acontextawarecomputervisionbasedapproachforthedetectionoftaxistreethailingscenesfromvideostreams AT jabeurnafaa acontextawarecomputervisionbasedapproachforthedetectionoftaxistreethailingscenesfromvideostreams AT mastourimahmoud contextawarecomputervisionbasedapproachforthedetectionoftaxistreethailingscenesfromvideostreams AT bouyahiazied contextawarecomputervisionbasedapproachforthedetectionoftaxistreethailingscenesfromvideostreams AT haddadhedi contextawarecomputervisionbasedapproachforthedetectionoftaxistreethailingscenesfromvideostreams AT horchanileila contextawarecomputervisionbasedapproachforthedetectionoftaxistreethailingscenesfromvideostreams AT jabeurnafaa contextawarecomputervisionbasedapproachforthedetectionoftaxistreethailingscenesfromvideostreams |