Cargando…

Representation Learning Method for Circular Seal Based on Modified MLP-Mixer

This study proposes Stamp-MLP, an enhanced seal impression representation learning technique based on MLP-Mixer. Instead of using the patch linear mapping preprocessing method, this technique uses circular seal remapping, which reserves the seals’ underlying pixel-level information. In the proposed...

Descripción completa

Detalles Bibliográficos
Autores principales: Cao, Yuan, Zhou, You, Zhang, Zhiwen, Yao, Enyi
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10670150/
https://www.ncbi.nlm.nih.gov/pubmed/37998213
http://dx.doi.org/10.3390/e25111521
_version_ 1785139856071983104
author Cao, Yuan
Zhou, You
Zhang, Zhiwen
Yao, Enyi
author_facet Cao, Yuan
Zhou, You
Zhang, Zhiwen
Yao, Enyi
author_sort Cao, Yuan
collection PubMed
description This study proposes Stamp-MLP, an enhanced seal impression representation learning technique based on MLP-Mixer. Instead of using the patch linear mapping preprocessing method, this technique uses circular seal remapping, which reserves the seals’ underlying pixel-level information. In the proposed Stamp-MLP, the average pooling is replaced by a global pooling of attention to extract the information more comprehensively. There were three classification tasks in our proposed method: categorizing the seal surface, identifying the product type, and distinguishing individual seals. The three tasks shared an identical dataset comprising 81 seals, encompassing 16 distinct seal surfaces, with each surface featuring six diverse product types. The experiment results showed that, in comparison to MLP-Mixer, VGG16, and ResNet50, the proposed Stamp-MLP achieved the highest classification accuracy (89.61%) in seal surface classification tasks with fewer training samples. Meanwhile, Stamp-MLP outperformed the others with accuracy rates of 90.68% and 91.96% in the product type and seal impression classification tasks, respectively. Moreover, Stamp-MLP had the fewest model parameters (2.67 M).
format Online
Article
Text
id pubmed-10670150
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-106701502023-11-06 Representation Learning Method for Circular Seal Based on Modified MLP-Mixer Cao, Yuan Zhou, You Zhang, Zhiwen Yao, Enyi Entropy (Basel) Article This study proposes Stamp-MLP, an enhanced seal impression representation learning technique based on MLP-Mixer. Instead of using the patch linear mapping preprocessing method, this technique uses circular seal remapping, which reserves the seals’ underlying pixel-level information. In the proposed Stamp-MLP, the average pooling is replaced by a global pooling of attention to extract the information more comprehensively. There were three classification tasks in our proposed method: categorizing the seal surface, identifying the product type, and distinguishing individual seals. The three tasks shared an identical dataset comprising 81 seals, encompassing 16 distinct seal surfaces, with each surface featuring six diverse product types. The experiment results showed that, in comparison to MLP-Mixer, VGG16, and ResNet50, the proposed Stamp-MLP achieved the highest classification accuracy (89.61%) in seal surface classification tasks with fewer training samples. Meanwhile, Stamp-MLP outperformed the others with accuracy rates of 90.68% and 91.96% in the product type and seal impression classification tasks, respectively. Moreover, Stamp-MLP had the fewest model parameters (2.67 M). MDPI 2023-11-06 /pmc/articles/PMC10670150/ /pubmed/37998213 http://dx.doi.org/10.3390/e25111521 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Cao, Yuan
Zhou, You
Zhang, Zhiwen
Yao, Enyi
Representation Learning Method for Circular Seal Based on Modified MLP-Mixer
title Representation Learning Method for Circular Seal Based on Modified MLP-Mixer
title_full Representation Learning Method for Circular Seal Based on Modified MLP-Mixer
title_fullStr Representation Learning Method for Circular Seal Based on Modified MLP-Mixer
title_full_unstemmed Representation Learning Method for Circular Seal Based on Modified MLP-Mixer
title_short Representation Learning Method for Circular Seal Based on Modified MLP-Mixer
title_sort representation learning method for circular seal based on modified mlp-mixer
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10670150/
https://www.ncbi.nlm.nih.gov/pubmed/37998213
http://dx.doi.org/10.3390/e25111521
work_keys_str_mv AT caoyuan representationlearningmethodforcircularsealbasedonmodifiedmlpmixer
AT zhouyou representationlearningmethodforcircularsealbasedonmodifiedmlpmixer
AT zhangzhiwen representationlearningmethodforcircularsealbasedonmodifiedmlpmixer
AT yaoenyi representationlearningmethodforcircularsealbasedonmodifiedmlpmixer