Cargando…
Text Recognition Model Based on Multi-Scale Fusion CRNN
Scene text recognition is a crucial area of research in computer vision. However, current mainstream scene text recognition models suffer from incomplete feature extraction due to the small downsampling scale used to extract features and obtain more features. This limitation hampers their ability to...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10459494/ https://www.ncbi.nlm.nih.gov/pubmed/37631571 http://dx.doi.org/10.3390/s23167034 |
_version_ | 1785097424860086272 |
---|---|
author | Zou, Le He, Zhihuang Wang, Kai Wu, Zhize Wang, Yifan Zhang, Guanhong Wang, Xiaofeng |
author_facet | Zou, Le He, Zhihuang Wang, Kai Wu, Zhize Wang, Yifan Zhang, Guanhong Wang, Xiaofeng |
author_sort | Zou, Le |
collection | PubMed |
description | Scene text recognition is a crucial area of research in computer vision. However, current mainstream scene text recognition models suffer from incomplete feature extraction due to the small downsampling scale used to extract features and obtain more features. This limitation hampers their ability to extract complete features of each character in the image, resulting in lower accuracy in the text recognition process. To address this issue, a novel text recognition model based on multi-scale fusion and the convolutional recurrent neural network (CRNN) has been proposed in this paper. The proposed model has a convolutional layer, a feature fusion layer, a recurrent layer, and a transcription layer. The convolutional layer uses two scales of feature extraction, which enables it to derive two distinct outputs for the input text image. The feature fusion layer fuses the different scales of features and forms a new feature. The recurrent layer learns contextual features from the input sequence of features. The transcription layer outputs the final result. The proposed model not only expands the recognition field but also learns more image features at different scales; thus, it extracts a more complete set of features and achieving better recognition of text. The results of experiments are then presented to demonstrate that the proposed model outperforms the CRNN model on text datasets, such as Street View Text, IIIT-5K, ICDAR2003, and ICDAR2013 scenes, in terms of text recognition accuracy. |
format | Online Article Text |
id | pubmed-10459494 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-104594942023-08-27 Text Recognition Model Based on Multi-Scale Fusion CRNN Zou, Le He, Zhihuang Wang, Kai Wu, Zhize Wang, Yifan Zhang, Guanhong Wang, Xiaofeng Sensors (Basel) Article Scene text recognition is a crucial area of research in computer vision. However, current mainstream scene text recognition models suffer from incomplete feature extraction due to the small downsampling scale used to extract features and obtain more features. This limitation hampers their ability to extract complete features of each character in the image, resulting in lower accuracy in the text recognition process. To address this issue, a novel text recognition model based on multi-scale fusion and the convolutional recurrent neural network (CRNN) has been proposed in this paper. The proposed model has a convolutional layer, a feature fusion layer, a recurrent layer, and a transcription layer. The convolutional layer uses two scales of feature extraction, which enables it to derive two distinct outputs for the input text image. The feature fusion layer fuses the different scales of features and forms a new feature. The recurrent layer learns contextual features from the input sequence of features. The transcription layer outputs the final result. The proposed model not only expands the recognition field but also learns more image features at different scales; thus, it extracts a more complete set of features and achieving better recognition of text. The results of experiments are then presented to demonstrate that the proposed model outperforms the CRNN model on text datasets, such as Street View Text, IIIT-5K, ICDAR2003, and ICDAR2013 scenes, in terms of text recognition accuracy. MDPI 2023-08-08 /pmc/articles/PMC10459494/ /pubmed/37631571 http://dx.doi.org/10.3390/s23167034 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Zou, Le He, Zhihuang Wang, Kai Wu, Zhize Wang, Yifan Zhang, Guanhong Wang, Xiaofeng Text Recognition Model Based on Multi-Scale Fusion CRNN |
title | Text Recognition Model Based on Multi-Scale Fusion CRNN |
title_full | Text Recognition Model Based on Multi-Scale Fusion CRNN |
title_fullStr | Text Recognition Model Based on Multi-Scale Fusion CRNN |
title_full_unstemmed | Text Recognition Model Based on Multi-Scale Fusion CRNN |
title_short | Text Recognition Model Based on Multi-Scale Fusion CRNN |
title_sort | text recognition model based on multi-scale fusion crnn |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10459494/ https://www.ncbi.nlm.nih.gov/pubmed/37631571 http://dx.doi.org/10.3390/s23167034 |
work_keys_str_mv | AT zoule textrecognitionmodelbasedonmultiscalefusioncrnn AT hezhihuang textrecognitionmodelbasedonmultiscalefusioncrnn AT wangkai textrecognitionmodelbasedonmultiscalefusioncrnn AT wuzhize textrecognitionmodelbasedonmultiscalefusioncrnn AT wangyifan textrecognitionmodelbasedonmultiscalefusioncrnn AT zhangguanhong textrecognitionmodelbasedonmultiscalefusioncrnn AT wangxiaofeng textrecognitionmodelbasedonmultiscalefusioncrnn |