Cargando…
Identification of Turtle-Shell Growth Year Using Hyperspectral Imaging Combined with an Enhanced Spatial–Spectral Attention 3DCNN and a Transformer
Turtle shell (Chinemys reecesii) is a prized traditional Chinese dietary therapy, and the growth year of turtle shell has a significant impact on its quality attributes. In this study, a hyperspectral imaging (HSI) technique combined with a proposed deep learning (DL) network algorithm was investiga...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10490299/ https://www.ncbi.nlm.nih.gov/pubmed/37687257 http://dx.doi.org/10.3390/molecules28176427 |
_version_ | 1785103811912663040 |
---|---|
author | Wang, Tingting Xu, Zhenyu Hu, Huiqiang Xu, Huaxing Zhao, Yuping Mao, Xiaobo |
author_facet | Wang, Tingting Xu, Zhenyu Hu, Huiqiang Xu, Huaxing Zhao, Yuping Mao, Xiaobo |
author_sort | Wang, Tingting |
collection | PubMed |
description | Turtle shell (Chinemys reecesii) is a prized traditional Chinese dietary therapy, and the growth year of turtle shell has a significant impact on its quality attributes. In this study, a hyperspectral imaging (HSI) technique combined with a proposed deep learning (DL) network algorithm was investigated for the objective determination of the growth year of turtle shells. The acquisition of hyperspectral images was carried out in the near-infrared range (948.72–2512.97 nm) from samples spanning five different growth years. To fully exploit the spatial and spectral information while reducing redundancy in hyperspectral data simultaneously, three modules were developed. First, the spectral–spatial attention (SSA) module was developed to better protect the spectral correlation among spectral bands and capture fine-grained spatial information of hyperspectral images. Second, the 3D convolutional neural network (CNN), more suitable for the extracted 3D feature map, was employed to facilitate the joint spatial–spectral feature representation. Thirdly, to overcome the constraints of convolution kernels as well as better capture long-range correlation between spectral bands, the transformer encoder (TE) module was further designed. These modules were harmoniously orchestrated, driven by the need to effectively leverage both spatial and spectral information within hyperspectral data. They collectively enhance the model’s capacity to extract joint spatial and spectral features to discern growth years accurately. Experimental studies demonstrated that the proposed model (named SSA–3DTE) achieved superior classification accuracy, with 98.94% on average for five-category classification, outperforming traditional machine learning methods using only spectral information and representative deep learning methods. Also, ablation experiments confirmed the effectiveness of each module to improve performance. The encouraging results of this study revealed the potentiality of HSI combined with the DL algorithm as an efficient and non-destructive method for the quality control of turtle shells. |
format | Online Article Text |
id | pubmed-10490299 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-104902992023-09-09 Identification of Turtle-Shell Growth Year Using Hyperspectral Imaging Combined with an Enhanced Spatial–Spectral Attention 3DCNN and a Transformer Wang, Tingting Xu, Zhenyu Hu, Huiqiang Xu, Huaxing Zhao, Yuping Mao, Xiaobo Molecules Article Turtle shell (Chinemys reecesii) is a prized traditional Chinese dietary therapy, and the growth year of turtle shell has a significant impact on its quality attributes. In this study, a hyperspectral imaging (HSI) technique combined with a proposed deep learning (DL) network algorithm was investigated for the objective determination of the growth year of turtle shells. The acquisition of hyperspectral images was carried out in the near-infrared range (948.72–2512.97 nm) from samples spanning five different growth years. To fully exploit the spatial and spectral information while reducing redundancy in hyperspectral data simultaneously, three modules were developed. First, the spectral–spatial attention (SSA) module was developed to better protect the spectral correlation among spectral bands and capture fine-grained spatial information of hyperspectral images. Second, the 3D convolutional neural network (CNN), more suitable for the extracted 3D feature map, was employed to facilitate the joint spatial–spectral feature representation. Thirdly, to overcome the constraints of convolution kernels as well as better capture long-range correlation between spectral bands, the transformer encoder (TE) module was further designed. These modules were harmoniously orchestrated, driven by the need to effectively leverage both spatial and spectral information within hyperspectral data. They collectively enhance the model’s capacity to extract joint spatial and spectral features to discern growth years accurately. Experimental studies demonstrated that the proposed model (named SSA–3DTE) achieved superior classification accuracy, with 98.94% on average for five-category classification, outperforming traditional machine learning methods using only spectral information and representative deep learning methods. Also, ablation experiments confirmed the effectiveness of each module to improve performance. The encouraging results of this study revealed the potentiality of HSI combined with the DL algorithm as an efficient and non-destructive method for the quality control of turtle shells. MDPI 2023-09-04 /pmc/articles/PMC10490299/ /pubmed/37687257 http://dx.doi.org/10.3390/molecules28176427 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Wang, Tingting Xu, Zhenyu Hu, Huiqiang Xu, Huaxing Zhao, Yuping Mao, Xiaobo Identification of Turtle-Shell Growth Year Using Hyperspectral Imaging Combined with an Enhanced Spatial–Spectral Attention 3DCNN and a Transformer |
title | Identification of Turtle-Shell Growth Year Using Hyperspectral Imaging Combined with an Enhanced Spatial–Spectral Attention 3DCNN and a Transformer |
title_full | Identification of Turtle-Shell Growth Year Using Hyperspectral Imaging Combined with an Enhanced Spatial–Spectral Attention 3DCNN and a Transformer |
title_fullStr | Identification of Turtle-Shell Growth Year Using Hyperspectral Imaging Combined with an Enhanced Spatial–Spectral Attention 3DCNN and a Transformer |
title_full_unstemmed | Identification of Turtle-Shell Growth Year Using Hyperspectral Imaging Combined with an Enhanced Spatial–Spectral Attention 3DCNN and a Transformer |
title_short | Identification of Turtle-Shell Growth Year Using Hyperspectral Imaging Combined with an Enhanced Spatial–Spectral Attention 3DCNN and a Transformer |
title_sort | identification of turtle-shell growth year using hyperspectral imaging combined with an enhanced spatial–spectral attention 3dcnn and a transformer |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10490299/ https://www.ncbi.nlm.nih.gov/pubmed/37687257 http://dx.doi.org/10.3390/molecules28176427 |
work_keys_str_mv | AT wangtingting identificationofturtleshellgrowthyearusinghyperspectralimagingcombinedwithanenhancedspatialspectralattention3dcnnandatransformer AT xuzhenyu identificationofturtleshellgrowthyearusinghyperspectralimagingcombinedwithanenhancedspatialspectralattention3dcnnandatransformer AT huhuiqiang identificationofturtleshellgrowthyearusinghyperspectralimagingcombinedwithanenhancedspatialspectralattention3dcnnandatransformer AT xuhuaxing identificationofturtleshellgrowthyearusinghyperspectralimagingcombinedwithanenhancedspatialspectralattention3dcnnandatransformer AT zhaoyuping identificationofturtleshellgrowthyearusinghyperspectralimagingcombinedwithanenhancedspatialspectralattention3dcnnandatransformer AT maoxiaobo identificationofturtleshellgrowthyearusinghyperspectralimagingcombinedwithanenhancedspatialspectralattention3dcnnandatransformer |