Cargando…

A LiDAR-Camera-Inertial-GNSS Apparatus for 3D Multimodal Dataset Collection in Woodland Scenarios

Forestry operations have become of great importance for a sustainable environment in the past few decades due to the increasing toll induced by rural abandonment and climate change. Robotics presents a promising solution to this problem; however, gathering the necessary data for developing and testi...

Descripción completa

Detalles Bibliográficos
Autores principales: Cristóvão, Mário P., Portugal, David, Carvalho , Afonso E., Ferreira , João Filipe
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10422363/
https://www.ncbi.nlm.nih.gov/pubmed/37571461
http://dx.doi.org/10.3390/s23156676
_version_ 1785089191052312576
author Cristóvão, Mário P.
Portugal, David
Carvalho , Afonso E.
Ferreira , João Filipe
author_facet Cristóvão, Mário P.
Portugal, David
Carvalho , Afonso E.
Ferreira , João Filipe
author_sort Cristóvão, Mário P.
collection PubMed
description Forestry operations have become of great importance for a sustainable environment in the past few decades due to the increasing toll induced by rural abandonment and climate change. Robotics presents a promising solution to this problem; however, gathering the necessary data for developing and testing algorithms can be challenging. This work proposes a portable multi-sensor apparatus to collect relevant data generated by several onboard sensors. The system incorporates Laser Imaging, Detection and Ranging (LiDAR), two stereo depth cameras and a dedicated inertial measurement unit (IMU) to obtain environmental data, which are coupled with an Android app that extracts Global Navigation Satellite System (GNSS) information from a cell phone. Acquired data can then be used for a myriad of perception-based applications, such as localization and mapping, flammable material identification, traversability analysis, path planning and/or semantic segmentation toward (semi-)automated forestry actuation. The modular architecture proposed is built on Robot Operating System (ROS) and Docker to facilitate data collection and the upgradability of the system. We validate the apparatus’ effectiveness in collecting datasets and its flexibility by carrying out a case study for Simultaneous Localization and Mapping (SLAM) in a challenging woodland environment, thus allowing us to compare fundamentally different methods with the multimodal system proposed.
format Online
Article
Text
id pubmed-10422363
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-104223632023-08-13 A LiDAR-Camera-Inertial-GNSS Apparatus for 3D Multimodal Dataset Collection in Woodland Scenarios Cristóvão, Mário P. Portugal, David Carvalho , Afonso E. Ferreira , João Filipe Sensors (Basel) Article Forestry operations have become of great importance for a sustainable environment in the past few decades due to the increasing toll induced by rural abandonment and climate change. Robotics presents a promising solution to this problem; however, gathering the necessary data for developing and testing algorithms can be challenging. This work proposes a portable multi-sensor apparatus to collect relevant data generated by several onboard sensors. The system incorporates Laser Imaging, Detection and Ranging (LiDAR), two stereo depth cameras and a dedicated inertial measurement unit (IMU) to obtain environmental data, which are coupled with an Android app that extracts Global Navigation Satellite System (GNSS) information from a cell phone. Acquired data can then be used for a myriad of perception-based applications, such as localization and mapping, flammable material identification, traversability analysis, path planning and/or semantic segmentation toward (semi-)automated forestry actuation. The modular architecture proposed is built on Robot Operating System (ROS) and Docker to facilitate data collection and the upgradability of the system. We validate the apparatus’ effectiveness in collecting datasets and its flexibility by carrying out a case study for Simultaneous Localization and Mapping (SLAM) in a challenging woodland environment, thus allowing us to compare fundamentally different methods with the multimodal system proposed. MDPI 2023-07-26 /pmc/articles/PMC10422363/ /pubmed/37571461 http://dx.doi.org/10.3390/s23156676 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Cristóvão, Mário P.
Portugal, David
Carvalho , Afonso E.
Ferreira , João Filipe
A LiDAR-Camera-Inertial-GNSS Apparatus for 3D Multimodal Dataset Collection in Woodland Scenarios
title A LiDAR-Camera-Inertial-GNSS Apparatus for 3D Multimodal Dataset Collection in Woodland Scenarios
title_full A LiDAR-Camera-Inertial-GNSS Apparatus for 3D Multimodal Dataset Collection in Woodland Scenarios
title_fullStr A LiDAR-Camera-Inertial-GNSS Apparatus for 3D Multimodal Dataset Collection in Woodland Scenarios
title_full_unstemmed A LiDAR-Camera-Inertial-GNSS Apparatus for 3D Multimodal Dataset Collection in Woodland Scenarios
title_short A LiDAR-Camera-Inertial-GNSS Apparatus for 3D Multimodal Dataset Collection in Woodland Scenarios
title_sort lidar-camera-inertial-gnss apparatus for 3d multimodal dataset collection in woodland scenarios
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10422363/
https://www.ncbi.nlm.nih.gov/pubmed/37571461
http://dx.doi.org/10.3390/s23156676
work_keys_str_mv AT cristovaomariop alidarcamerainertialgnssapparatusfor3dmultimodaldatasetcollectioninwoodlandscenarios
AT portugaldavid alidarcamerainertialgnssapparatusfor3dmultimodaldatasetcollectioninwoodlandscenarios
AT carvalhoafonsoe alidarcamerainertialgnssapparatusfor3dmultimodaldatasetcollectioninwoodlandscenarios
AT ferreirajoaofilipe alidarcamerainertialgnssapparatusfor3dmultimodaldatasetcollectioninwoodlandscenarios
AT cristovaomariop lidarcamerainertialgnssapparatusfor3dmultimodaldatasetcollectioninwoodlandscenarios
AT portugaldavid lidarcamerainertialgnssapparatusfor3dmultimodaldatasetcollectioninwoodlandscenarios
AT carvalhoafonsoe lidarcamerainertialgnssapparatusfor3dmultimodaldatasetcollectioninwoodlandscenarios
AT ferreirajoaofilipe lidarcamerainertialgnssapparatusfor3dmultimodaldatasetcollectioninwoodlandscenarios