Cargando…

The multi-modal fusion in visual question answering: a review of attention mechanisms

Visual Question Answering (VQA) is a significant cross-disciplinary issue in the fields of computer vision and natural language processing that requires a computer to output a natural language answer based on pictures and questions posed based on the pictures. This requires simultaneous processing o...

Descripción completa

Detalles Bibliográficos
Autores principales:	Lu, Siyu, Liu, Mingzhe, Yin, Lirong, Yin, Zhengtong, Liu, Xuan, Zheng, Wenfeng
Formato:	Online Artículo Texto
Lenguaje:	English
Publicado:	PeerJ Inc. 2023
Materias:	Artificial Intelligence
Acceso en línea:	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10280591/ https://www.ncbi.nlm.nih.gov/pubmed/37346665 http://dx.doi.org/10.7717/peerj-cs.1400

Ejemplares similares

Characterization inference based on joint-optimization of multi-layer semantics and deep fusion matching network
por: Zheng, Wenfeng, et al.
Publicado: (2022)

Recognition of multi-modal fusion images with irregular interference
por: Wang, Yawei, et al.
Publicado: (2022)

A data-centric way to improve entity linking in knowledge-based question answering
por: Liu, Shuo, et al.
Publicado: (2023)

A knowledge graph based question answering method for medical domain
por: Huang, Xiaofeng, et al.
Publicado: (2021)

Deep learning-based approach for Arabic open domain question answering
por: Alsubhi, Kholoud, et al.
Publicado: (2022)

Real-time airplane detection using multi-dimensional attention and feature fusion
por: Li, Li, et al.
Publicado: (2023)

On solving textual ambiguities and semantic vagueness in MRC based question answering using generative pre-trained transformers
por: Ahmed, Muzamil, et al.
Publicado: (2023)

A novel few-shot learning based multi-modality fusion model for COVID-19 rumor detection from online social media
por: Lu, Heng-yang, et al.
Publicado: (2021)

SeedSortNet: a rapid and highly effificient lightweight CNN based on visual attention for seed sorting
por: Li, Chunlei, et al.
Publicado: (2021)

Multi-Modal Explicit Sparse Attention Networks for Visual Question Answering
por: Guo, Zihan, et al.
Publicado: (2020)

A pan-sharpening network using multi-resolution transformer and two-stage feature fusion
por: Fan, Wensheng, et al.
Publicado: (2023)

Multi-supervised bidirectional fusion network for road-surface condition recognition
por: Zhang, Hongbin, et al.
Publicado: (2023)

Design of oral English teaching model based on multi-modal perception of the Internet of Things and improved conventional neural networks
por: Qin, Haitao
Publicado: (2023)

Image classification model based on large kernel attention mechanism and relative position self-attention mechanism
por: Liu, Siqi, et al.
Publicado: (2023)

Unanswerable Questions About Images and Texts
por: Davis, Ernest
Publicado: (2020)

SVA-SSD: saliency visual attention single shot detector for building detection in low contrast high-resolution satellite images
por: Shahin, Ahmed I., et al.
Publicado: (2021)

Semantic Integration of Multi-Modal Data and Derived Neuroimaging Results Using the Platform for Imaging in Precision Medicine (PRISM) in the Arkansas Imaging Enterprise System (ARIES)
por: Bona, Jonathan, et al.
Publicado: (2022)

An artificial intelligence based news feature mining system based on the Internet of Things and multi-sensor fusion
por: Xie, Zhuozheng, et al.
Publicado: (2023)

Lightweight and efficient neural network with SPSA attention for wheat ear detection
por: Dong, Yan, et al.
Publicado: (2022)

Improving the Robustness of Object Detection Through a Multi-Camera–Based Fusion Algorithm Using Fuzzy Logic
por: Khan, Md Nazmuzzaman, et al.
Publicado: (2021)

Ethical Questions Raised by AI-Supported Mentoring in Higher Education
por: Köbis, Laura, et al.
Publicado: (2021)

Double attention recurrent convolution neural network for answer selection
por: Bao, Ganchao, et al.
Publicado: (2020)

Improving Adversarial Robustness via Attention and Adversarial Logit Pairing
por: Li, Xingjian, et al.
Publicado: (2022)

CAPN: a Combine Attention Partial Network for glove detection
por: Yu, Feng, et al.
Publicado: (2023)

Exploring neural question generation for formal pragmatics: Data set and model evaluation
por: De Kuthy, Kordula, et al.
Publicado: (2022)

Hierarchical semantic interaction-based deep hashing network for cross-modal retrieval
por: Chen, Shubai, et al.
Publicado: (2021)

LOANet: a lightweight network using object attention for extracting buildings and roads from UAV aerial remote sensing images
por: Han, Xiaoxiang, et al.
Publicado: (2023)

A hybrid model of modal decomposition and gated recurrent units for short-term load forecasting
por: Wang, Chun-Hua, et al.
Publicado: (2023)

Substation equipment temperature prediction based on multivariate information fusion and deep learning network
por: Sun, Lijie, et al.
Publicado: (2022)

Self-supervised recurrent depth estimation with attention mechanisms
por: Makarov, Ilya, et al.
Publicado: (2022)

Stochastic attentions and context learning for person re-identification
por: Perwaiz, Nazia, et al.
Publicado: (2021)

Paragraph-level attention based deep model for chapter segmentation
por: Virameteekul, Paveen
Publicado: (2022)

Identifying geopolitical event precursors using attention-based LSTMs
por: Hossain, K. S. M. Tozammel, et al.
Publicado: (2022)

Explainable Model Fusion for Customer Journey Mapping
por: Okazaki, Kotaro, et al.
Publicado: (2022)

Educational Automatic Question Generation Improves Reading Comprehension in Non-native Speakers: A Learner-Centric Case Study
por: Steuer, Tim, et al.
Publicado: (2022)

Enhanced mechanisms of pooling and channel attention for deep learning feature maps
por: Li, Hengyi, et al.
Publicado: (2022)

Design of news recommendation model based on sub-attention news encoder
por: Zhang, Wenting
Publicado: (2023)

Improved YOLOv4-tiny based on attention mechanism for skin detection
por: Li, Ping, et al.
Publicado: (2023)

Distributed search and fusion for wine label image retrieval
por: Li, Xiaoqing, et al.
Publicado: (2022)

Online supervised attention-based recurrent depth estimation from monocular video
por: Maslov, Dmitrii, et al.
Publicado: (2020)

Cannot write session to /tmp/vufind_sessions/sess_45ti2rstpima8j9st5qrblit57