Cargando…

Identification of Turtle-Shell Growth Year Using Hyperspectral Imaging Combined with an Enhanced Spatial–Spectral Attention 3DCNN and a Transformer

Turtle shell (Chinemys reecesii) is a prized traditional Chinese dietary therapy, and the growth year of turtle shell has a significant impact on its quality attributes. In this study, a hyperspectral imaging (HSI) technique combined with a proposed deep learning (DL) network algorithm was investiga...

Descripción completa

Detalles Bibliográficos
Autores principales: Wang, Tingting, Xu, Zhenyu, Hu, Huiqiang, Xu, Huaxing, Zhao, Yuping, Mao, Xiaobo
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10490299/
https://www.ncbi.nlm.nih.gov/pubmed/37687257
http://dx.doi.org/10.3390/molecules28176427
_version_ 1785103811912663040
author Wang, Tingting
Xu, Zhenyu
Hu, Huiqiang
Xu, Huaxing
Zhao, Yuping
Mao, Xiaobo
author_facet Wang, Tingting
Xu, Zhenyu
Hu, Huiqiang
Xu, Huaxing
Zhao, Yuping
Mao, Xiaobo
author_sort Wang, Tingting
collection PubMed
description Turtle shell (Chinemys reecesii) is a prized traditional Chinese dietary therapy, and the growth year of turtle shell has a significant impact on its quality attributes. In this study, a hyperspectral imaging (HSI) technique combined with a proposed deep learning (DL) network algorithm was investigated for the objective determination of the growth year of turtle shells. The acquisition of hyperspectral images was carried out in the near-infrared range (948.72–2512.97 nm) from samples spanning five different growth years. To fully exploit the spatial and spectral information while reducing redundancy in hyperspectral data simultaneously, three modules were developed. First, the spectral–spatial attention (SSA) module was developed to better protect the spectral correlation among spectral bands and capture fine-grained spatial information of hyperspectral images. Second, the 3D convolutional neural network (CNN), more suitable for the extracted 3D feature map, was employed to facilitate the joint spatial–spectral feature representation. Thirdly, to overcome the constraints of convolution kernels as well as better capture long-range correlation between spectral bands, the transformer encoder (TE) module was further designed. These modules were harmoniously orchestrated, driven by the need to effectively leverage both spatial and spectral information within hyperspectral data. They collectively enhance the model’s capacity to extract joint spatial and spectral features to discern growth years accurately. Experimental studies demonstrated that the proposed model (named SSA–3DTE) achieved superior classification accuracy, with 98.94% on average for five-category classification, outperforming traditional machine learning methods using only spectral information and representative deep learning methods. Also, ablation experiments confirmed the effectiveness of each module to improve performance. The encouraging results of this study revealed the potentiality of HSI combined with the DL algorithm as an efficient and non-destructive method for the quality control of turtle shells.
format Online
Article
Text
id pubmed-10490299
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-104902992023-09-09 Identification of Turtle-Shell Growth Year Using Hyperspectral Imaging Combined with an Enhanced Spatial–Spectral Attention 3DCNN and a Transformer Wang, Tingting Xu, Zhenyu Hu, Huiqiang Xu, Huaxing Zhao, Yuping Mao, Xiaobo Molecules Article Turtle shell (Chinemys reecesii) is a prized traditional Chinese dietary therapy, and the growth year of turtle shell has a significant impact on its quality attributes. In this study, a hyperspectral imaging (HSI) technique combined with a proposed deep learning (DL) network algorithm was investigated for the objective determination of the growth year of turtle shells. The acquisition of hyperspectral images was carried out in the near-infrared range (948.72–2512.97 nm) from samples spanning five different growth years. To fully exploit the spatial and spectral information while reducing redundancy in hyperspectral data simultaneously, three modules were developed. First, the spectral–spatial attention (SSA) module was developed to better protect the spectral correlation among spectral bands and capture fine-grained spatial information of hyperspectral images. Second, the 3D convolutional neural network (CNN), more suitable for the extracted 3D feature map, was employed to facilitate the joint spatial–spectral feature representation. Thirdly, to overcome the constraints of convolution kernels as well as better capture long-range correlation between spectral bands, the transformer encoder (TE) module was further designed. These modules were harmoniously orchestrated, driven by the need to effectively leverage both spatial and spectral information within hyperspectral data. They collectively enhance the model’s capacity to extract joint spatial and spectral features to discern growth years accurately. Experimental studies demonstrated that the proposed model (named SSA–3DTE) achieved superior classification accuracy, with 98.94% on average for five-category classification, outperforming traditional machine learning methods using only spectral information and representative deep learning methods. Also, ablation experiments confirmed the effectiveness of each module to improve performance. The encouraging results of this study revealed the potentiality of HSI combined with the DL algorithm as an efficient and non-destructive method for the quality control of turtle shells. MDPI 2023-09-04 /pmc/articles/PMC10490299/ /pubmed/37687257 http://dx.doi.org/10.3390/molecules28176427 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Wang, Tingting
Xu, Zhenyu
Hu, Huiqiang
Xu, Huaxing
Zhao, Yuping
Mao, Xiaobo
Identification of Turtle-Shell Growth Year Using Hyperspectral Imaging Combined with an Enhanced Spatial–Spectral Attention 3DCNN and a Transformer
title Identification of Turtle-Shell Growth Year Using Hyperspectral Imaging Combined with an Enhanced Spatial–Spectral Attention 3DCNN and a Transformer
title_full Identification of Turtle-Shell Growth Year Using Hyperspectral Imaging Combined with an Enhanced Spatial–Spectral Attention 3DCNN and a Transformer
title_fullStr Identification of Turtle-Shell Growth Year Using Hyperspectral Imaging Combined with an Enhanced Spatial–Spectral Attention 3DCNN and a Transformer
title_full_unstemmed Identification of Turtle-Shell Growth Year Using Hyperspectral Imaging Combined with an Enhanced Spatial–Spectral Attention 3DCNN and a Transformer
title_short Identification of Turtle-Shell Growth Year Using Hyperspectral Imaging Combined with an Enhanced Spatial–Spectral Attention 3DCNN and a Transformer
title_sort identification of turtle-shell growth year using hyperspectral imaging combined with an enhanced spatial–spectral attention 3dcnn and a transformer
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10490299/
https://www.ncbi.nlm.nih.gov/pubmed/37687257
http://dx.doi.org/10.3390/molecules28176427
work_keys_str_mv AT wangtingting identificationofturtleshellgrowthyearusinghyperspectralimagingcombinedwithanenhancedspatialspectralattention3dcnnandatransformer
AT xuzhenyu identificationofturtleshellgrowthyearusinghyperspectralimagingcombinedwithanenhancedspatialspectralattention3dcnnandatransformer
AT huhuiqiang identificationofturtleshellgrowthyearusinghyperspectralimagingcombinedwithanenhancedspatialspectralattention3dcnnandatransformer
AT xuhuaxing identificationofturtleshellgrowthyearusinghyperspectralimagingcombinedwithanenhancedspatialspectralattention3dcnnandatransformer
AT zhaoyuping identificationofturtleshellgrowthyearusinghyperspectralimagingcombinedwithanenhancedspatialspectralattention3dcnnandatransformer
AT maoxiaobo identificationofturtleshellgrowthyearusinghyperspectralimagingcombinedwithanenhancedspatialspectralattention3dcnnandatransformer