Cargando…

Multimodal interaction enhanced representation learning for video emotion recognition

Video emotion recognition aims to infer human emotional states from the audio, visual, and text modalities. Previous approaches are centered around designing sophisticated fusion mechanisms, but usually ignore the fact that text contains global semantic information, while speech and face video show...

Descripción completa

Detalles Bibliográficos
Autores principales:	Xia, Xiaohan, Zhao, Yong, Jiang, Dongmei
Formato:	Online Artículo Texto
Lenguaje:	English
Publicado:	Frontiers Media S.A. 2022
Materias:	Neuroscience
Acceso en línea:	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9806211/ https://www.ncbi.nlm.nih.gov/pubmed/36601594 http://dx.doi.org/10.3389/fnins.2022.1086380

Ejemplares similares

Multimodal Recognition of Emotions in Music and Facial Expressions
por: Proverbio, Alice Mado, et al.
Publicado: (2020)

Contrastive self-supervised representation learning without negative samples for multimodal human action recognition
por: Yang, Huaigang, et al.
Publicado: (2023)

Multimodal transformer augmented fusion for speech emotion recognition
por: Wang, Yuanyuan, et al.
Publicado: (2023)

Embodied Object Representation Learning and Recognition
por: Van de Maele, Toon, et al.
Publicado: (2022)

Unimodal statistical learning produces multimodal object-like representations
por: Lengyel, Gábor, et al.
Publicado: (2019)

Hierarchical Attention-Based Multimodal Fusion Network for Video Emotion Recognition
por: Liu, Xiaodong, et al.
Publicado: (2021)

MindLink-Eumpy: An Open-Source Python Toolbox for Multimodal Emotion Recognition
por: Li, Ruixin, et al.
Publicado: (2021)

A novel feature fusion network for multimodal emotion recognition from EEG and eye movement signals
por: Fu, Baole, et al.
Publicado: (2023)

Corrigendum: A novel feature fusion network for multimodal emotion recognition from EEG and eye movement signals
por: Fu, Baole, et al.
Publicado: (2023)

Learning joints relation graphs for video action recognition
por: Liu, Xiaodong, et al.
Publicado: (2022)

Vector learning representation for generalized speech emotion recognition
por: Singkul, Sattaya, et al.
Publicado: (2022)

Deep-Learning-Based Multimodal Emotion Classification for Music Videos
por: Pandeya, Yagya Raj, et al.
Publicado: (2021)

Deep Learning Based Emotion Recognition and Visualization of Figural Representation
por: Lu, Xiaofeng
Publicado: (2022)

Multimodal Emotion Recognition on RAVDESS Dataset Using Transfer Learning
por: Luna-Jiménez, Cristina, et al.
Publicado: (2021)

Multimodal Representation Learning for Place Recognition Using Deep Hebbian Predictive Coding
por: Pearson, Martin J., et al.
Publicado: (2021)

Integrating audio and visual modalities for multimodal personality trait recognition via hybrid deep learning
por: Zhao, Xiaoming, et al.
Publicado: (2023)

Neural processing of emotion in multimodal settings
por: Klasen, Martin, et al.
Publicado: (2014)

An Investigation of Deep Learning Models for EEG-Based Emotion Recognition
por: Zhang, Yaqing, et al.
Publicado: (2020)

Hybrid transfer learning strategy for cross-subject EEG emotion recognition
por: Lu, Wei, et al.
Publicado: (2023)

Neural Representations that Support Invariant Object Recognition
por: Goris, Robbe L. T., et al.
Publicado: (2009)

Deep learning-based self-induced emotion recognition using EEG
por: Ji, Yerim, et al.
Publicado: (2022)

Emotion recognition based on multi-modal physiological signals and transfer learning
por: Fu, Zhongzheng, et al.
Publicado: (2022)

Multimodal Emotion Recognition Based on Cascaded Multichannel and Hierarchical Fusion
por: Liu, Xia, et al.
Publicado: (2023)

A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face
por: Lian, Hailun, et al.
Publicado: (2023)

Enhanced Data Representation by Kernel Metric Learning for Dementia Diagnosis
por: Cárdenas-Peña, David, et al.
Publicado: (2017)

Fusion Graph Representation of EEG for Emotion Recognition
por: Li, Menghang, et al.
Publicado: (2023)

Applying Self-Supervised Representation Learning for Emotion Recognition Using Physiological Signals
por: Montero Quispe, Kevin G., et al.
Publicado: (2022)

An Assessment of In-the-Wild Datasets for Multimodal Emotion Recognition
por: Aguilera, Ana, et al.
Publicado: (2023)

Possibilistic Clustering-Promoting Semi-Supervised Learning for EEG-Based Emotion Recognition
por: Dan, Yufang, et al.
Publicado: (2021)

A neuromorphic system for video object recognition
por: Khosla, Deepak, et al.
Publicado: (2014)

High-Order Laplacian Regularized Low-Rank Representation for Multimodal Dementia Diagnosis
por: Dong, Aimei, et al.
Publicado: (2021)

Stress diminishes outcome but enhances response representations during instrumental learning
por: Meier, Jacqueline Katharina, et al.
Publicado: (2022)

A Multi-Task Representation Learning Architecture for Enhanced Graph Classification
por: Xie, Yu, et al.
Publicado: (2020)

Multimodal interaction in image and video applications
por: Sappa, Angel D, et al.
Publicado: (2013)

FLGR: Fixed Length Gists Representation Learning for RNN-HMM Hybrid-Based Neuromorphic Continuous Gesture Recognition
por: Chen, Guang, et al.
Publicado: (2019)

How facial masks alter the interaction of gaze direction, head orientation, and emotion recognition
por: Thomas, Lea, et al.
Publicado: (2022)

Multi-Model Adaptation Learning With Possibilistic Clustering Assumption for EEG-Based Emotion Recognition
por: Dan, Yufang, et al.
Publicado: (2022)

Recognition of Emotion According to the Physical Elements of the Video
por: Zhang, Jing, et al.
Publicado: (2020)

Multi-Modal Fusion Emotion Recognition Method of Speech Expression Based on Deep Learning
por: Liu, Dong, et al.
Publicado: (2021)

On the similarities of representations in artificial and brain neural networks for speech recognition
por: Wingfield, Cai, et al.
Publicado: (2022)

Cannot write session to /tmp/vufind_sessions/sess_fopql29vnptpg14udlursk7pie