Cargando…

Film and Video Quality Optimization Using Attention Mechanism-Embedded Lightweight Neural Network Model

In filming, the collected video may be blurred due to camera shake and object movement, causing the target edge to be unclear or deforming the targets. In order to solve these problems and deeply optimize the quality of movie videos, this work proposes a video deblurring (VD) algorithm based on neur...

Descripción completa

Detalles Bibliográficos
Autor principal: Ma, Youwen
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Hindawi 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9200523/
https://www.ncbi.nlm.nih.gov/pubmed/35720938
http://dx.doi.org/10.1155/2022/8229580
_version_ 1784728079344599040
author Ma, Youwen
author_facet Ma, Youwen
author_sort Ma, Youwen
collection PubMed
description In filming, the collected video may be blurred due to camera shake and object movement, causing the target edge to be unclear or deforming the targets. In order to solve these problems and deeply optimize the quality of movie videos, this work proposes a video deblurring (VD) algorithm based on neural network (NN) model and attention mechanism (AM). Based on the scale recurrent network, Haar planar wavelet transform (WT) is introduced to preprocess the video image and to deblur the video image in the wavelet domain. Additionally, the spatial and channel AMs are fused into the overall network framework to improve the feature expression ability. Further, the residual inception spatial-channel attention (RISCA) mechanism is introduced to extract the multiscale feature information from video images. Meanwhile, skip spatial-channel attention (SSCA) accelerates the network training time to achieve a better VD effect. Finally, relevant experiments are designed, factoring in peak signal-to-noise ratio (PSNR) and structural similarity (SSI). The experimental findings corroborate that the proposed Haar and attention video deblurring (HAVD) outperforms multisize network Haar (MSNH) in PSNR and structural similarity (SSIM), improved by 0.10 dB and 0.005, respectively. Therefore, embedding the dual AMs can improve the model performance and optimize the video quality. This work provides technical support for solving the video distortion problems.
format Online
Article
Text
id pubmed-9200523
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Hindawi
record_format MEDLINE/PubMed
spelling pubmed-92005232022-06-16 Film and Video Quality Optimization Using Attention Mechanism-Embedded Lightweight Neural Network Model Ma, Youwen Comput Intell Neurosci Research Article In filming, the collected video may be blurred due to camera shake and object movement, causing the target edge to be unclear or deforming the targets. In order to solve these problems and deeply optimize the quality of movie videos, this work proposes a video deblurring (VD) algorithm based on neural network (NN) model and attention mechanism (AM). Based on the scale recurrent network, Haar planar wavelet transform (WT) is introduced to preprocess the video image and to deblur the video image in the wavelet domain. Additionally, the spatial and channel AMs are fused into the overall network framework to improve the feature expression ability. Further, the residual inception spatial-channel attention (RISCA) mechanism is introduced to extract the multiscale feature information from video images. Meanwhile, skip spatial-channel attention (SSCA) accelerates the network training time to achieve a better VD effect. Finally, relevant experiments are designed, factoring in peak signal-to-noise ratio (PSNR) and structural similarity (SSI). The experimental findings corroborate that the proposed Haar and attention video deblurring (HAVD) outperforms multisize network Haar (MSNH) in PSNR and structural similarity (SSIM), improved by 0.10 dB and 0.005, respectively. Therefore, embedding the dual AMs can improve the model performance and optimize the video quality. This work provides technical support for solving the video distortion problems. Hindawi 2022-06-08 /pmc/articles/PMC9200523/ /pubmed/35720938 http://dx.doi.org/10.1155/2022/8229580 Text en Copyright © 2022 Youwen Ma. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Ma, Youwen
Film and Video Quality Optimization Using Attention Mechanism-Embedded Lightweight Neural Network Model
title Film and Video Quality Optimization Using Attention Mechanism-Embedded Lightweight Neural Network Model
title_full Film and Video Quality Optimization Using Attention Mechanism-Embedded Lightweight Neural Network Model
title_fullStr Film and Video Quality Optimization Using Attention Mechanism-Embedded Lightweight Neural Network Model
title_full_unstemmed Film and Video Quality Optimization Using Attention Mechanism-Embedded Lightweight Neural Network Model
title_short Film and Video Quality Optimization Using Attention Mechanism-Embedded Lightweight Neural Network Model
title_sort film and video quality optimization using attention mechanism-embedded lightweight neural network model
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9200523/
https://www.ncbi.nlm.nih.gov/pubmed/35720938
http://dx.doi.org/10.1155/2022/8229580
work_keys_str_mv AT mayouwen filmandvideoqualityoptimizationusingattentionmechanismembeddedlightweightneuralnetworkmodel