Cargando…
Multi-Step Structure Image Inpainting Model with Attention Mechanism
The proliferation of deep learning has propelled image inpainting to an important research field. Although the current image inpainting model has made remarkable achievements, the two-stage image inpainting method is easy to produce structural errors in the rough stage because of insufficient treatm...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9959622/ https://www.ncbi.nlm.nih.gov/pubmed/36850914 http://dx.doi.org/10.3390/s23042316 |
_version_ | 1784895322837745664 |
---|---|
author | Ran, Cai Li, Xinfu Yang, Fang |
author_facet | Ran, Cai Li, Xinfu Yang, Fang |
author_sort | Ran, Cai |
collection | PubMed |
description | The proliferation of deep learning has propelled image inpainting to an important research field. Although the current image inpainting model has made remarkable achievements, the two-stage image inpainting method is easy to produce structural errors in the rough stage because of insufficient treatment of the rough inpainting stage. To address this problem, we propose a multi-step structured image inpainting model combining attention mechanisms. Different from the previous two-stage inpainting model, we divide the damaged area into four sub-areas, calculate the priority of each area according to the priority, specify the inpainting order, and complete the rough inpainting stage several times. The stability of the model is enhanced by the multi-step method. The structural attention mechanism strengthens the expression of structural features and improves the quality of structure and contour reconstruction. Experimental evaluation of benchmark data sets shows that our method effectively reduces structural errors and improves the effect of image inpainting. |
format | Online Article Text |
id | pubmed-9959622 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-99596222023-02-26 Multi-Step Structure Image Inpainting Model with Attention Mechanism Ran, Cai Li, Xinfu Yang, Fang Sensors (Basel) Article The proliferation of deep learning has propelled image inpainting to an important research field. Although the current image inpainting model has made remarkable achievements, the two-stage image inpainting method is easy to produce structural errors in the rough stage because of insufficient treatment of the rough inpainting stage. To address this problem, we propose a multi-step structured image inpainting model combining attention mechanisms. Different from the previous two-stage inpainting model, we divide the damaged area into four sub-areas, calculate the priority of each area according to the priority, specify the inpainting order, and complete the rough inpainting stage several times. The stability of the model is enhanced by the multi-step method. The structural attention mechanism strengthens the expression of structural features and improves the quality of structure and contour reconstruction. Experimental evaluation of benchmark data sets shows that our method effectively reduces structural errors and improves the effect of image inpainting. MDPI 2023-02-19 /pmc/articles/PMC9959622/ /pubmed/36850914 http://dx.doi.org/10.3390/s23042316 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Ran, Cai Li, Xinfu Yang, Fang Multi-Step Structure Image Inpainting Model with Attention Mechanism |
title | Multi-Step Structure Image Inpainting Model with Attention Mechanism |
title_full | Multi-Step Structure Image Inpainting Model with Attention Mechanism |
title_fullStr | Multi-Step Structure Image Inpainting Model with Attention Mechanism |
title_full_unstemmed | Multi-Step Structure Image Inpainting Model with Attention Mechanism |
title_short | Multi-Step Structure Image Inpainting Model with Attention Mechanism |
title_sort | multi-step structure image inpainting model with attention mechanism |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9959622/ https://www.ncbi.nlm.nih.gov/pubmed/36850914 http://dx.doi.org/10.3390/s23042316 |
work_keys_str_mv | AT rancai multistepstructureimageinpaintingmodelwithattentionmechanism AT lixinfu multistepstructureimageinpaintingmodelwithattentionmechanism AT yangfang multistepstructureimageinpaintingmodelwithattentionmechanism |