Cargando…

High-precision plant height measurement by drone with RTK-GNSS and single camera for real-time processing

Conventional crop height measurements performed using aerial drone images require 3D reconstruction results of several aerial images obtained through structure from motion. Therefore, they require extensive computation time and their measurement accuracy is not high; if the 3D reconstruction result...

Descripción completa

Detalles Bibliográficos
Autores principales: Matsuura, Yuta, Heming, Zhang, Nakao, Kousuke, Qiong, Chang, Firmansyah, Iman, Kawai, Shin, Yamaguchi, Yoshiki, Maruyama, Tsutomu, Hayashi, Hisayoshi, Nobuhara, Hajime
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10113379/
https://www.ncbi.nlm.nih.gov/pubmed/37072434
http://dx.doi.org/10.1038/s41598-023-32167-6
_version_ 1785027827595214848
author Matsuura, Yuta
Heming, Zhang
Nakao, Kousuke
Qiong, Chang
Firmansyah, Iman
Kawai, Shin
Yamaguchi, Yoshiki
Maruyama, Tsutomu
Hayashi, Hisayoshi
Nobuhara, Hajime
author_facet Matsuura, Yuta
Heming, Zhang
Nakao, Kousuke
Qiong, Chang
Firmansyah, Iman
Kawai, Shin
Yamaguchi, Yoshiki
Maruyama, Tsutomu
Hayashi, Hisayoshi
Nobuhara, Hajime
author_sort Matsuura, Yuta
collection PubMed
description Conventional crop height measurements performed using aerial drone images require 3D reconstruction results of several aerial images obtained through structure from motion. Therefore, they require extensive computation time and their measurement accuracy is not high; if the 3D reconstruction result fails, several aerial photos must be captured again. To overcome these challenges, this study proposes a high-precision measurement method that uses a drone equipped with a monocular camera and real-time kinematic global navigation satellite system (RTK-GNSS) for real-time processing. This method performs high-precision stereo matching based on long-baseline lengths (approximately 1 m) during the flight by linking the RTK-GNSS and aerial image capture points. As the baseline length of a typical stereo camera is fixed, once the camera is calibrated on the ground, it does not need to be calibrated again during the flight. However, the proposed system requires quick calibration in flight because the baseline length is not fixed. A new calibration method that is based on zero-mean normalized cross-correlation and two stages least square method, is proposed to further improve the accuracy and stereo matching speed. The proposed method was compared with two conventional methods in natural world environments. It was observed that error rates reduced by 62.2% and 69.4%, for flight altitudes between 10 and 20 m respectively. Moreover, a depth resolution of 1.6 mm and reduction of 44.4% and 63.0% in the error rates were achieved at an altitude of 4.1 m, and the execution time was 88 ms for images with a size of 5472 × 3468 pixels, which is sufficiently fast for real-time measurement.
format Online
Article
Text
id pubmed-10113379
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-101133792023-04-20 High-precision plant height measurement by drone with RTK-GNSS and single camera for real-time processing Matsuura, Yuta Heming, Zhang Nakao, Kousuke Qiong, Chang Firmansyah, Iman Kawai, Shin Yamaguchi, Yoshiki Maruyama, Tsutomu Hayashi, Hisayoshi Nobuhara, Hajime Sci Rep Article Conventional crop height measurements performed using aerial drone images require 3D reconstruction results of several aerial images obtained through structure from motion. Therefore, they require extensive computation time and their measurement accuracy is not high; if the 3D reconstruction result fails, several aerial photos must be captured again. To overcome these challenges, this study proposes a high-precision measurement method that uses a drone equipped with a monocular camera and real-time kinematic global navigation satellite system (RTK-GNSS) for real-time processing. This method performs high-precision stereo matching based on long-baseline lengths (approximately 1 m) during the flight by linking the RTK-GNSS and aerial image capture points. As the baseline length of a typical stereo camera is fixed, once the camera is calibrated on the ground, it does not need to be calibrated again during the flight. However, the proposed system requires quick calibration in flight because the baseline length is not fixed. A new calibration method that is based on zero-mean normalized cross-correlation and two stages least square method, is proposed to further improve the accuracy and stereo matching speed. The proposed method was compared with two conventional methods in natural world environments. It was observed that error rates reduced by 62.2% and 69.4%, for flight altitudes between 10 and 20 m respectively. Moreover, a depth resolution of 1.6 mm and reduction of 44.4% and 63.0% in the error rates were achieved at an altitude of 4.1 m, and the execution time was 88 ms for images with a size of 5472 × 3468 pixels, which is sufficiently fast for real-time measurement. Nature Publishing Group UK 2023-04-18 /pmc/articles/PMC10113379/ /pubmed/37072434 http://dx.doi.org/10.1038/s41598-023-32167-6 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Matsuura, Yuta
Heming, Zhang
Nakao, Kousuke
Qiong, Chang
Firmansyah, Iman
Kawai, Shin
Yamaguchi, Yoshiki
Maruyama, Tsutomu
Hayashi, Hisayoshi
Nobuhara, Hajime
High-precision plant height measurement by drone with RTK-GNSS and single camera for real-time processing
title High-precision plant height measurement by drone with RTK-GNSS and single camera for real-time processing
title_full High-precision plant height measurement by drone with RTK-GNSS and single camera for real-time processing
title_fullStr High-precision plant height measurement by drone with RTK-GNSS and single camera for real-time processing
title_full_unstemmed High-precision plant height measurement by drone with RTK-GNSS and single camera for real-time processing
title_short High-precision plant height measurement by drone with RTK-GNSS and single camera for real-time processing
title_sort high-precision plant height measurement by drone with rtk-gnss and single camera for real-time processing
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10113379/
https://www.ncbi.nlm.nih.gov/pubmed/37072434
http://dx.doi.org/10.1038/s41598-023-32167-6
work_keys_str_mv AT matsuurayuta highprecisionplantheightmeasurementbydronewithrtkgnssandsinglecameraforrealtimeprocessing
AT hemingzhang highprecisionplantheightmeasurementbydronewithrtkgnssandsinglecameraforrealtimeprocessing
AT nakaokousuke highprecisionplantheightmeasurementbydronewithrtkgnssandsinglecameraforrealtimeprocessing
AT qiongchang highprecisionplantheightmeasurementbydronewithrtkgnssandsinglecameraforrealtimeprocessing
AT firmansyahiman highprecisionplantheightmeasurementbydronewithrtkgnssandsinglecameraforrealtimeprocessing
AT kawaishin highprecisionplantheightmeasurementbydronewithrtkgnssandsinglecameraforrealtimeprocessing
AT yamaguchiyoshiki highprecisionplantheightmeasurementbydronewithrtkgnssandsinglecameraforrealtimeprocessing
AT maruyamatsutomu highprecisionplantheightmeasurementbydronewithrtkgnssandsinglecameraforrealtimeprocessing
AT hayashihisayoshi highprecisionplantheightmeasurementbydronewithrtkgnssandsinglecameraforrealtimeprocessing
AT nobuharahajime highprecisionplantheightmeasurementbydronewithrtkgnssandsinglecameraforrealtimeprocessing