Cargando…

Multi-Step Structure Image Inpainting Model with Attention Mechanism

The proliferation of deep learning has propelled image inpainting to an important research field. Although the current image inpainting model has made remarkable achievements, the two-stage image inpainting method is easy to produce structural errors in the rough stage because of insufficient treatm...

Descripción completa

Detalles Bibliográficos
Autores principales: Ran, Cai, Li, Xinfu, Yang, Fang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9959622/
https://www.ncbi.nlm.nih.gov/pubmed/36850914
http://dx.doi.org/10.3390/s23042316
_version_ 1784895322837745664
author Ran, Cai
Li, Xinfu
Yang, Fang
author_facet Ran, Cai
Li, Xinfu
Yang, Fang
author_sort Ran, Cai
collection PubMed
description The proliferation of deep learning has propelled image inpainting to an important research field. Although the current image inpainting model has made remarkable achievements, the two-stage image inpainting method is easy to produce structural errors in the rough stage because of insufficient treatment of the rough inpainting stage. To address this problem, we propose a multi-step structured image inpainting model combining attention mechanisms. Different from the previous two-stage inpainting model, we divide the damaged area into four sub-areas, calculate the priority of each area according to the priority, specify the inpainting order, and complete the rough inpainting stage several times. The stability of the model is enhanced by the multi-step method. The structural attention mechanism strengthens the expression of structural features and improves the quality of structure and contour reconstruction. Experimental evaluation of benchmark data sets shows that our method effectively reduces structural errors and improves the effect of image inpainting.
format Online
Article
Text
id pubmed-9959622
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-99596222023-02-26 Multi-Step Structure Image Inpainting Model with Attention Mechanism Ran, Cai Li, Xinfu Yang, Fang Sensors (Basel) Article The proliferation of deep learning has propelled image inpainting to an important research field. Although the current image inpainting model has made remarkable achievements, the two-stage image inpainting method is easy to produce structural errors in the rough stage because of insufficient treatment of the rough inpainting stage. To address this problem, we propose a multi-step structured image inpainting model combining attention mechanisms. Different from the previous two-stage inpainting model, we divide the damaged area into four sub-areas, calculate the priority of each area according to the priority, specify the inpainting order, and complete the rough inpainting stage several times. The stability of the model is enhanced by the multi-step method. The structural attention mechanism strengthens the expression of structural features and improves the quality of structure and contour reconstruction. Experimental evaluation of benchmark data sets shows that our method effectively reduces structural errors and improves the effect of image inpainting. MDPI 2023-02-19 /pmc/articles/PMC9959622/ /pubmed/36850914 http://dx.doi.org/10.3390/s23042316 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Ran, Cai
Li, Xinfu
Yang, Fang
Multi-Step Structure Image Inpainting Model with Attention Mechanism
title Multi-Step Structure Image Inpainting Model with Attention Mechanism
title_full Multi-Step Structure Image Inpainting Model with Attention Mechanism
title_fullStr Multi-Step Structure Image Inpainting Model with Attention Mechanism
title_full_unstemmed Multi-Step Structure Image Inpainting Model with Attention Mechanism
title_short Multi-Step Structure Image Inpainting Model with Attention Mechanism
title_sort multi-step structure image inpainting model with attention mechanism
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9959622/
https://www.ncbi.nlm.nih.gov/pubmed/36850914
http://dx.doi.org/10.3390/s23042316
work_keys_str_mv AT rancai multistepstructureimageinpaintingmodelwithattentionmechanism
AT lixinfu multistepstructureimageinpaintingmodelwithattentionmechanism
AT yangfang multistepstructureimageinpaintingmodelwithattentionmechanism