Cargando…

Automatic Image Processing Algorithm for Light Environment Optimization Based on Multimodal Neural Network Model

In this paper, we conduct an in-depth study and analysis of the automatic image processing algorithm based on a multimodal Recurrent Neural Network (m-RNN) for light environment optimization. By analyzing the structure of m-RNN and combining the current research frontiers of image processing and nat...

Descripción completa

Detalles Bibliográficos
Autor principal: Chen, Mujun
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Hindawi 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9187444/
https://www.ncbi.nlm.nih.gov/pubmed/35694600
http://dx.doi.org/10.1155/2022/5156532
_version_ 1784725170902007808
author Chen, Mujun
author_facet Chen, Mujun
author_sort Chen, Mujun
collection PubMed
description In this paper, we conduct an in-depth study and analysis of the automatic image processing algorithm based on a multimodal Recurrent Neural Network (m-RNN) for light environment optimization. By analyzing the structure of m-RNN and combining the current research frontiers of image processing and natural language processing, we find out the problem of the ineffectiveness of m-RNN for some image generation descriptions, starting from both the image feature extraction part and text sequence data processing. Unlike traditional image automatic processing algorithms, this algorithm does not need to add complex rules manually. Still, it evaluates and filters through the training image collection and finally generates image automatic processing models by m-RNN. An image semantic segmentation algorithm is proposed based on multimodal attention and adaptive feature fusion. The main idea of the algorithm is to combine adaptive and feature fusion and then introduce data enhancement for small-scale multimodal light environment datasets by extracting the importance between images through multimodal attention. The model proposed in this paper can span the semantic differences of different modalities and construct feature relationships between different modalities to achieve an inferable, interpretable, and scalable feature representation of multimodal data. The automatic processing of light environment images using multimodal neural networks based on traditional algorithms eliminates manual processing and greatly reduces the time and effort of image processing.
format Online
Article
Text
id pubmed-9187444
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Hindawi
record_format MEDLINE/PubMed
spelling pubmed-91874442022-06-11 Automatic Image Processing Algorithm for Light Environment Optimization Based on Multimodal Neural Network Model Chen, Mujun Comput Intell Neurosci Research Article In this paper, we conduct an in-depth study and analysis of the automatic image processing algorithm based on a multimodal Recurrent Neural Network (m-RNN) for light environment optimization. By analyzing the structure of m-RNN and combining the current research frontiers of image processing and natural language processing, we find out the problem of the ineffectiveness of m-RNN for some image generation descriptions, starting from both the image feature extraction part and text sequence data processing. Unlike traditional image automatic processing algorithms, this algorithm does not need to add complex rules manually. Still, it evaluates and filters through the training image collection and finally generates image automatic processing models by m-RNN. An image semantic segmentation algorithm is proposed based on multimodal attention and adaptive feature fusion. The main idea of the algorithm is to combine adaptive and feature fusion and then introduce data enhancement for small-scale multimodal light environment datasets by extracting the importance between images through multimodal attention. The model proposed in this paper can span the semantic differences of different modalities and construct feature relationships between different modalities to achieve an inferable, interpretable, and scalable feature representation of multimodal data. The automatic processing of light environment images using multimodal neural networks based on traditional algorithms eliminates manual processing and greatly reduces the time and effort of image processing. Hindawi 2022-06-03 /pmc/articles/PMC9187444/ /pubmed/35694600 http://dx.doi.org/10.1155/2022/5156532 Text en Copyright © 2022 Mujun Chen. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Chen, Mujun
Automatic Image Processing Algorithm for Light Environment Optimization Based on Multimodal Neural Network Model
title Automatic Image Processing Algorithm for Light Environment Optimization Based on Multimodal Neural Network Model
title_full Automatic Image Processing Algorithm for Light Environment Optimization Based on Multimodal Neural Network Model
title_fullStr Automatic Image Processing Algorithm for Light Environment Optimization Based on Multimodal Neural Network Model
title_full_unstemmed Automatic Image Processing Algorithm for Light Environment Optimization Based on Multimodal Neural Network Model
title_short Automatic Image Processing Algorithm for Light Environment Optimization Based on Multimodal Neural Network Model
title_sort automatic image processing algorithm for light environment optimization based on multimodal neural network model
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9187444/
https://www.ncbi.nlm.nih.gov/pubmed/35694600
http://dx.doi.org/10.1155/2022/5156532
work_keys_str_mv AT chenmujun automaticimageprocessingalgorithmforlightenvironmentoptimizationbasedonmultimodalneuralnetworkmodel