Cargando…

Text Recognition Model Based on Multi-Scale Fusion CRNN

Scene text recognition is a crucial area of research in computer vision. However, current mainstream scene text recognition models suffer from incomplete feature extraction due to the small downsampling scale used to extract features and obtain more features. This limitation hampers their ability to...

Descripción completa

Detalles Bibliográficos
Autores principales: Zou, Le, He, Zhihuang, Wang, Kai, Wu, Zhize, Wang, Yifan, Zhang, Guanhong, Wang, Xiaofeng
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10459494/
https://www.ncbi.nlm.nih.gov/pubmed/37631571
http://dx.doi.org/10.3390/s23167034
_version_ 1785097424860086272
author Zou, Le
He, Zhihuang
Wang, Kai
Wu, Zhize
Wang, Yifan
Zhang, Guanhong
Wang, Xiaofeng
author_facet Zou, Le
He, Zhihuang
Wang, Kai
Wu, Zhize
Wang, Yifan
Zhang, Guanhong
Wang, Xiaofeng
author_sort Zou, Le
collection PubMed
description Scene text recognition is a crucial area of research in computer vision. However, current mainstream scene text recognition models suffer from incomplete feature extraction due to the small downsampling scale used to extract features and obtain more features. This limitation hampers their ability to extract complete features of each character in the image, resulting in lower accuracy in the text recognition process. To address this issue, a novel text recognition model based on multi-scale fusion and the convolutional recurrent neural network (CRNN) has been proposed in this paper. The proposed model has a convolutional layer, a feature fusion layer, a recurrent layer, and a transcription layer. The convolutional layer uses two scales of feature extraction, which enables it to derive two distinct outputs for the input text image. The feature fusion layer fuses the different scales of features and forms a new feature. The recurrent layer learns contextual features from the input sequence of features. The transcription layer outputs the final result. The proposed model not only expands the recognition field but also learns more image features at different scales; thus, it extracts a more complete set of features and achieving better recognition of text. The results of experiments are then presented to demonstrate that the proposed model outperforms the CRNN model on text datasets, such as Street View Text, IIIT-5K, ICDAR2003, and ICDAR2013 scenes, in terms of text recognition accuracy.
format Online
Article
Text
id pubmed-10459494
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-104594942023-08-27 Text Recognition Model Based on Multi-Scale Fusion CRNN Zou, Le He, Zhihuang Wang, Kai Wu, Zhize Wang, Yifan Zhang, Guanhong Wang, Xiaofeng Sensors (Basel) Article Scene text recognition is a crucial area of research in computer vision. However, current mainstream scene text recognition models suffer from incomplete feature extraction due to the small downsampling scale used to extract features and obtain more features. This limitation hampers their ability to extract complete features of each character in the image, resulting in lower accuracy in the text recognition process. To address this issue, a novel text recognition model based on multi-scale fusion and the convolutional recurrent neural network (CRNN) has been proposed in this paper. The proposed model has a convolutional layer, a feature fusion layer, a recurrent layer, and a transcription layer. The convolutional layer uses two scales of feature extraction, which enables it to derive two distinct outputs for the input text image. The feature fusion layer fuses the different scales of features and forms a new feature. The recurrent layer learns contextual features from the input sequence of features. The transcription layer outputs the final result. The proposed model not only expands the recognition field but also learns more image features at different scales; thus, it extracts a more complete set of features and achieving better recognition of text. The results of experiments are then presented to demonstrate that the proposed model outperforms the CRNN model on text datasets, such as Street View Text, IIIT-5K, ICDAR2003, and ICDAR2013 scenes, in terms of text recognition accuracy. MDPI 2023-08-08 /pmc/articles/PMC10459494/ /pubmed/37631571 http://dx.doi.org/10.3390/s23167034 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Zou, Le
He, Zhihuang
Wang, Kai
Wu, Zhize
Wang, Yifan
Zhang, Guanhong
Wang, Xiaofeng
Text Recognition Model Based on Multi-Scale Fusion CRNN
title Text Recognition Model Based on Multi-Scale Fusion CRNN
title_full Text Recognition Model Based on Multi-Scale Fusion CRNN
title_fullStr Text Recognition Model Based on Multi-Scale Fusion CRNN
title_full_unstemmed Text Recognition Model Based on Multi-Scale Fusion CRNN
title_short Text Recognition Model Based on Multi-Scale Fusion CRNN
title_sort text recognition model based on multi-scale fusion crnn
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10459494/
https://www.ncbi.nlm.nih.gov/pubmed/37631571
http://dx.doi.org/10.3390/s23167034
work_keys_str_mv AT zoule textrecognitionmodelbasedonmultiscalefusioncrnn
AT hezhihuang textrecognitionmodelbasedonmultiscalefusioncrnn
AT wangkai textrecognitionmodelbasedonmultiscalefusioncrnn
AT wuzhize textrecognitionmodelbasedonmultiscalefusioncrnn
AT wangyifan textrecognitionmodelbasedonmultiscalefusioncrnn
AT zhangguanhong textrecognitionmodelbasedonmultiscalefusioncrnn
AT wangxiaofeng textrecognitionmodelbasedonmultiscalefusioncrnn