Cargando…
Film and Video Quality Optimization Using Attention Mechanism-Embedded Lightweight Neural Network Model
In filming, the collected video may be blurred due to camera shake and object movement, causing the target edge to be unclear or deforming the targets. In order to solve these problems and deeply optimize the quality of movie videos, this work proposes a video deblurring (VD) algorithm based on neur...
Autor principal: | |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Hindawi
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9200523/ https://www.ncbi.nlm.nih.gov/pubmed/35720938 http://dx.doi.org/10.1155/2022/8229580 |
_version_ | 1784728079344599040 |
---|---|
author | Ma, Youwen |
author_facet | Ma, Youwen |
author_sort | Ma, Youwen |
collection | PubMed |
description | In filming, the collected video may be blurred due to camera shake and object movement, causing the target edge to be unclear or deforming the targets. In order to solve these problems and deeply optimize the quality of movie videos, this work proposes a video deblurring (VD) algorithm based on neural network (NN) model and attention mechanism (AM). Based on the scale recurrent network, Haar planar wavelet transform (WT) is introduced to preprocess the video image and to deblur the video image in the wavelet domain. Additionally, the spatial and channel AMs are fused into the overall network framework to improve the feature expression ability. Further, the residual inception spatial-channel attention (RISCA) mechanism is introduced to extract the multiscale feature information from video images. Meanwhile, skip spatial-channel attention (SSCA) accelerates the network training time to achieve a better VD effect. Finally, relevant experiments are designed, factoring in peak signal-to-noise ratio (PSNR) and structural similarity (SSI). The experimental findings corroborate that the proposed Haar and attention video deblurring (HAVD) outperforms multisize network Haar (MSNH) in PSNR and structural similarity (SSIM), improved by 0.10 dB and 0.005, respectively. Therefore, embedding the dual AMs can improve the model performance and optimize the video quality. This work provides technical support for solving the video distortion problems. |
format | Online Article Text |
id | pubmed-9200523 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Hindawi |
record_format | MEDLINE/PubMed |
spelling | pubmed-92005232022-06-16 Film and Video Quality Optimization Using Attention Mechanism-Embedded Lightweight Neural Network Model Ma, Youwen Comput Intell Neurosci Research Article In filming, the collected video may be blurred due to camera shake and object movement, causing the target edge to be unclear or deforming the targets. In order to solve these problems and deeply optimize the quality of movie videos, this work proposes a video deblurring (VD) algorithm based on neural network (NN) model and attention mechanism (AM). Based on the scale recurrent network, Haar planar wavelet transform (WT) is introduced to preprocess the video image and to deblur the video image in the wavelet domain. Additionally, the spatial and channel AMs are fused into the overall network framework to improve the feature expression ability. Further, the residual inception spatial-channel attention (RISCA) mechanism is introduced to extract the multiscale feature information from video images. Meanwhile, skip spatial-channel attention (SSCA) accelerates the network training time to achieve a better VD effect. Finally, relevant experiments are designed, factoring in peak signal-to-noise ratio (PSNR) and structural similarity (SSI). The experimental findings corroborate that the proposed Haar and attention video deblurring (HAVD) outperforms multisize network Haar (MSNH) in PSNR and structural similarity (SSIM), improved by 0.10 dB and 0.005, respectively. Therefore, embedding the dual AMs can improve the model performance and optimize the video quality. This work provides technical support for solving the video distortion problems. Hindawi 2022-06-08 /pmc/articles/PMC9200523/ /pubmed/35720938 http://dx.doi.org/10.1155/2022/8229580 Text en Copyright © 2022 Youwen Ma. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Research Article Ma, Youwen Film and Video Quality Optimization Using Attention Mechanism-Embedded Lightweight Neural Network Model |
title | Film and Video Quality Optimization Using Attention Mechanism-Embedded Lightweight Neural Network Model |
title_full | Film and Video Quality Optimization Using Attention Mechanism-Embedded Lightweight Neural Network Model |
title_fullStr | Film and Video Quality Optimization Using Attention Mechanism-Embedded Lightweight Neural Network Model |
title_full_unstemmed | Film and Video Quality Optimization Using Attention Mechanism-Embedded Lightweight Neural Network Model |
title_short | Film and Video Quality Optimization Using Attention Mechanism-Embedded Lightweight Neural Network Model |
title_sort | film and video quality optimization using attention mechanism-embedded lightweight neural network model |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9200523/ https://www.ncbi.nlm.nih.gov/pubmed/35720938 http://dx.doi.org/10.1155/2022/8229580 |
work_keys_str_mv | AT mayouwen filmandvideoqualityoptimizationusingattentionmechanismembeddedlightweightneuralnetworkmodel |