Cargando…
A LiDAR-Camera-Inertial-GNSS Apparatus for 3D Multimodal Dataset Collection in Woodland Scenarios
Forestry operations have become of great importance for a sustainable environment in the past few decades due to the increasing toll induced by rural abandonment and climate change. Robotics presents a promising solution to this problem; however, gathering the necessary data for developing and testi...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10422363/ https://www.ncbi.nlm.nih.gov/pubmed/37571461 http://dx.doi.org/10.3390/s23156676 |
_version_ | 1785089191052312576 |
---|---|
author | Cristóvão, Mário P. Portugal, David Carvalho , Afonso E. Ferreira , João Filipe |
author_facet | Cristóvão, Mário P. Portugal, David Carvalho , Afonso E. Ferreira , João Filipe |
author_sort | Cristóvão, Mário P. |
collection | PubMed |
description | Forestry operations have become of great importance for a sustainable environment in the past few decades due to the increasing toll induced by rural abandonment and climate change. Robotics presents a promising solution to this problem; however, gathering the necessary data for developing and testing algorithms can be challenging. This work proposes a portable multi-sensor apparatus to collect relevant data generated by several onboard sensors. The system incorporates Laser Imaging, Detection and Ranging (LiDAR), two stereo depth cameras and a dedicated inertial measurement unit (IMU) to obtain environmental data, which are coupled with an Android app that extracts Global Navigation Satellite System (GNSS) information from a cell phone. Acquired data can then be used for a myriad of perception-based applications, such as localization and mapping, flammable material identification, traversability analysis, path planning and/or semantic segmentation toward (semi-)automated forestry actuation. The modular architecture proposed is built on Robot Operating System (ROS) and Docker to facilitate data collection and the upgradability of the system. We validate the apparatus’ effectiveness in collecting datasets and its flexibility by carrying out a case study for Simultaneous Localization and Mapping (SLAM) in a challenging woodland environment, thus allowing us to compare fundamentally different methods with the multimodal system proposed. |
format | Online Article Text |
id | pubmed-10422363 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-104223632023-08-13 A LiDAR-Camera-Inertial-GNSS Apparatus for 3D Multimodal Dataset Collection in Woodland Scenarios Cristóvão, Mário P. Portugal, David Carvalho , Afonso E. Ferreira , João Filipe Sensors (Basel) Article Forestry operations have become of great importance for a sustainable environment in the past few decades due to the increasing toll induced by rural abandonment and climate change. Robotics presents a promising solution to this problem; however, gathering the necessary data for developing and testing algorithms can be challenging. This work proposes a portable multi-sensor apparatus to collect relevant data generated by several onboard sensors. The system incorporates Laser Imaging, Detection and Ranging (LiDAR), two stereo depth cameras and a dedicated inertial measurement unit (IMU) to obtain environmental data, which are coupled with an Android app that extracts Global Navigation Satellite System (GNSS) information from a cell phone. Acquired data can then be used for a myriad of perception-based applications, such as localization and mapping, flammable material identification, traversability analysis, path planning and/or semantic segmentation toward (semi-)automated forestry actuation. The modular architecture proposed is built on Robot Operating System (ROS) and Docker to facilitate data collection and the upgradability of the system. We validate the apparatus’ effectiveness in collecting datasets and its flexibility by carrying out a case study for Simultaneous Localization and Mapping (SLAM) in a challenging woodland environment, thus allowing us to compare fundamentally different methods with the multimodal system proposed. MDPI 2023-07-26 /pmc/articles/PMC10422363/ /pubmed/37571461 http://dx.doi.org/10.3390/s23156676 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Cristóvão, Mário P. Portugal, David Carvalho , Afonso E. Ferreira , João Filipe A LiDAR-Camera-Inertial-GNSS Apparatus for 3D Multimodal Dataset Collection in Woodland Scenarios |
title | A LiDAR-Camera-Inertial-GNSS Apparatus for 3D Multimodal Dataset Collection in Woodland Scenarios |
title_full | A LiDAR-Camera-Inertial-GNSS Apparatus for 3D Multimodal Dataset Collection in Woodland Scenarios |
title_fullStr | A LiDAR-Camera-Inertial-GNSS Apparatus for 3D Multimodal Dataset Collection in Woodland Scenarios |
title_full_unstemmed | A LiDAR-Camera-Inertial-GNSS Apparatus for 3D Multimodal Dataset Collection in Woodland Scenarios |
title_short | A LiDAR-Camera-Inertial-GNSS Apparatus for 3D Multimodal Dataset Collection in Woodland Scenarios |
title_sort | lidar-camera-inertial-gnss apparatus for 3d multimodal dataset collection in woodland scenarios |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10422363/ https://www.ncbi.nlm.nih.gov/pubmed/37571461 http://dx.doi.org/10.3390/s23156676 |
work_keys_str_mv | AT cristovaomariop alidarcamerainertialgnssapparatusfor3dmultimodaldatasetcollectioninwoodlandscenarios AT portugaldavid alidarcamerainertialgnssapparatusfor3dmultimodaldatasetcollectioninwoodlandscenarios AT carvalhoafonsoe alidarcamerainertialgnssapparatusfor3dmultimodaldatasetcollectioninwoodlandscenarios AT ferreirajoaofilipe alidarcamerainertialgnssapparatusfor3dmultimodaldatasetcollectioninwoodlandscenarios AT cristovaomariop lidarcamerainertialgnssapparatusfor3dmultimodaldatasetcollectioninwoodlandscenarios AT portugaldavid lidarcamerainertialgnssapparatusfor3dmultimodaldatasetcollectioninwoodlandscenarios AT carvalhoafonsoe lidarcamerainertialgnssapparatusfor3dmultimodaldatasetcollectioninwoodlandscenarios AT ferreirajoaofilipe lidarcamerainertialgnssapparatusfor3dmultimodaldatasetcollectioninwoodlandscenarios |