Cargando…

Backpropagation-Based Decoding for Multimodal Machine Translation

People are able to describe images using thousands of languages, but languages share only one visual world. The aim of this work is to use the learned intermediate visual representations from a deep convolutional neural network to transfer information across languages for which paired data is not av...

Descripción completa

Detalles Bibliográficos
Autores principales:	Yang, Ziyan, Pinto-Alva, Leticia, Dernoncourt, Franck, Ordonez, Vicente
Formato:	Online Artículo Texto
Lenguaje:	English
Publicado:	Frontiers Media S.A. 2022
Materias:	Artificial Intelligence
Acceso en línea:	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8801934/ https://www.ncbi.nlm.nih.gov/pubmed/35112079 http://dx.doi.org/10.3389/frai.2021.736722

Ejemplares similares

Leveraging Guided Backpropagation to Select Convolutional Neural Networks for Plant Classification
por: Mostafa, Sakib, et al.
Publicado: (2022)

Machine translation and foreign language education
por: Urlaub, Per, et al.
Publicado: (2022)

Editorial: Multimodal communication and multimodal computing
por: Mehler, Alexander, et al.
Publicado: (2023)

Decoding of the neural representation of the visual RGB color model
por: Wu, Yijia, et al.
Publicado: (2023)

The neural machine translation models for the low-resource Kazakh–English language pair
por: Karyukin, Vladislav, et al.
Publicado: (2023)

AmericasNLI: Machine translation and natural language inference systems for Indigenous languages of the Americas
por: Kann, Katharina, et al.
Publicado: (2022)

Multi-level pooling encoder–decoder convolution neural network for MRI reconstruction
por: Karnjanapreechakorn, Sarattha, et al.
Publicado: (2022)

Face-voice based multimodal biometric authentication system via FaceNet and GMM
por: Alharbi, Bayan, et al.
Publicado: (2023)

Remarks on Multimodality: Grammatical Interactions in the Parallel Architecture
por: Cohn, Neil, et al.
Publicado: (2022)

The effects of anthropomorphism and multimodal biometric authentication on the user experience of voice intelligence
por: de Kloet, Mels, et al.
Publicado: (2022)

An Explainable Multimodal Neural Network Architecture for Predicting Epilepsy Comorbidities Based on Administrative Claims Data
por: Linden, Thomas, et al.
Publicado: (2021)

Image–text coherence and its implications for multimodal AI
por: Alikhani, Malihe, et al.
Publicado: (2023)

Grounding human-object interaction to affordance behavior in multimodal datasets
por: Henlein, Alexander, et al.
Publicado: (2023)

Collocations in Parsing and Translation
por: Wehrli, Eric
Publicado: (2022)

Understanding image-text relations and news values for multimodal news analysis
por: Cheema, Gullal S., et al.
Publicado: (2023)

Multimodal deep learning for liver cancer applications: a scoping review
por: Siam, Aisha, et al.
Publicado: (2023)

Improving Robotic Hand Prosthesis Control With Eye Tracking and Computer Vision: A Multimodal Approach Based on the Visuomotor Behavior of Grasping
por: Cognolato, Matteo, et al.
Publicado: (2022)

Masking important information to assess the robustness of a multimodal classifier for emotion recognition
por: Cohen, Dror, et al.
Publicado: (2023)

Predictions of bitcoin prices through machine learning based frameworks
por: Cocco, Luisanna, et al.
Publicado: (2021)

Using the DiCoT framework for integrated multimodal analysis in mixed-reality training environments
por: Vatral, Caleb, et al.
Publicado: (2022)

Intersemiotic translation of contracts into digital environments
por: Loddo, Olimpia Giuliana, et al.
Publicado: (2022)

A Straightforward HPV16 Lineage Classification Based on Machine Learning
por: Asensio-Puig, Laura, et al.
Publicado: (2022)

The ReIMAGINE Multimodal Warehouse: Using Artificial Intelligence for Accurate Risk Stratification of Prostate Cancer
por: Santaolalla, Aida, et al.
Publicado: (2021)

CycleStyleGAN-Based Knowledge Transfer for a Machining Digital Twin
por: Zotov, Evgeny, et al.
Publicado: (2021)

The Moral Choice Machine
por: Schramowski, Patrick, et al.
Publicado: (2020)

Improving Crowdsourcing-Based Image Classification Through Expanded Input Elicitation and Machine Learning
por: Yasmin, Romena, et al.
Publicado: (2022)

A field-based recommender system for crop disease detection using machine learning
por: Omara, Jonathan, et al.
Publicado: (2023)

Convolutional neural networks approach for multimodal biometric identification system using the fusion of fingerprint, finger-vein and face images
por: Cherrat, El mehdi, et al.
Publicado: (2020)

Zero-shot style transfer for gesture animation driven by text and speech using adversarial disentanglement of multimodal style encoding
por: Fares, Mireille, et al.
Publicado: (2023)

A mathematical formulation and an NSGA-II algorithm for minimizing the makespan and energy cost under time-of-use electricity price in an unrelated parallel machine scheduling
por: Rego, Marcelo F., et al.
Publicado: (2022)

A Genetic Folding Strategy Based Support Vector Machine to Optimize Lung Cancer Classification
por: Mezher, Mohammad A., et al.
Publicado: (2022)

Toward fault tolerant modelling for SCADA based electricity distribution networks, machine learning approach
por: Masri, Aladdin, et al.
Publicado: (2021)

Early breast cancer detection and differentiation tool based on tissue impedance characteristics and machine learning
por: Salem, Soumaya Ben, et al.
Publicado: (2023)

Application of Video-to-Video Translation Networks to Computational Fluid Dynamics
por: Kigure, Hiromitsu
Publicado: (2021)

Kernel Conversion for Robust Quantitative Measurements of Archived Chest Computed Tomography Using Deep Learning-Based Image-to-Image Translation
por: Tanabe, Naoya, et al.
Publicado: (2022)

Editorial: Theory of Mind in Humans and in Machines
por: Langley, Christelle, et al.
Publicado: (2022)

Editorial: Machine Learning for Water Resources
por: Mariethoz, Gregoire, et al.
Publicado: (2021)

Opportunities for human factors in machine learning
por: Baweja, Jessica A., et al.
Publicado: (2023)

Fake review identification and utility evaluation model using machine learning
por: Choi, Wonil, et al.
Publicado: (2023)

DPWSS: differentially private working set selection for training support vector machines
por: Sun, Zhenlong, et al.
Publicado: (2021)

Cannot write session to /tmp/vufind_sessions/sess_fdh10cr5e89qvfrt22uoqgro0e