Cargando…

Multimodal Emotion Recognition on RAVDESS Dataset Using Transfer Learning

Emotion Recognition is attracting the attention of the research community due to the multiple areas where it can be applied, such as in healthcare or in road safety systems. In this paper, we propose a multimodal emotion recognition system that relies on speech and facial information. For the speech...

Descripción completa

Detalles Bibliográficos
Autores principales:	Luna-Jiménez, Cristina, Griol, David, Callejas, Zoraida, Kleinlein, Ricardo, Montero, Juan M., Fernández-Martínez, Fernando
Formato:	Online Artículo Texto
Lenguaje:	English
Publicado:	MDPI 2021
Materias:	Article
Acceso en línea:	https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8618559/ https://www.ncbi.nlm.nih.gov/pubmed/34833739 http://dx.doi.org/10.3390/s21227665

Ejemplares similares

Detection of Emotion of Speech for RAVDESS Audio Using Hybrid Convolution Neural Network
por: Puri, Tanvi, et al.
Publicado: (2022)

Retracted: Detection of Emotion of Speech for RAVDESS Audio Using Hybrid Convolution Neural Network
por: Healthcare Engineering, Journal of
Publicado: (2023)

The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American English
por: Livingstone, Steven R., et al.
Publicado: (2018)

ChatSubs: A dataset of dialogues in Spanish, Catalan, Basque and Galician extracted from movie subtitles for developing advanced conversational models
por: Kharitonova, Ksenia, et al.
Publicado: (2023)

A Neural Network Approach to Intention Modeling for User-Adapted Conversational Agents
por: Griol, David, et al.
Publicado: (2016)

An Assessment of In-the-Wild Datasets for Multimodal Emotion Recognition
por: Aguilera, Ana, et al.
Publicado: (2023)

The conversational interface: talking to smart devices
por: McTear, Michael, et al.
Publicado: (2016)

K-EmoCon, a multimodal sensor dataset for continuous emotion recognition in naturalistic conversations
por: Park, Cheul Young, et al.
Publicado: (2020)

Comparing supervised and unsupervised approaches to multimodal emotion recognition
por: Fernández Carbonell, Marcos, et al.
Publicado: (2021)

Multimodal interaction enhanced representation learning for video emotion recognition
por: Xia, Xiaohan, et al.
Publicado: (2022)

Multimodal Recognition of Emotions in Music and Facial Expressions
por: Proverbio, Alice Mado, et al.
Publicado: (2020)

A uniform human multimodal dataset for emotion perception and judgment
por: Sun, Sai, et al.
Publicado: (2023)

Fusion of Facial Expressions and EEG for Multimodal Emotion Recognition
por: Huang, Yongrui, et al.
Publicado: (2017)

Multimodal transformer augmented fusion for speech emotion recognition
por: Wang, Yuanyuan, et al.
Publicado: (2023)

Advances in Multimodal Emotion Recognition Based on Brain–Computer Interfaces
por: He, Zhipeng, et al.
Publicado: (2020)

Multimodal Approach for Emotion Recognition Based on Simulated Flight Experiments
por: César Cavalcanti Roza, Válber, et al.
Publicado: (2019)

Multimodal Emotion Recognition Based on Cascaded Multichannel and Hierarchical Fusion
por: Liu, Xia, et al.
Publicado: (2023)

Identifying multimodal misinformation leveraging novelty detection and emotion recognition
por: Kumari, Rina, et al.
Publicado: (2023)

Enhancing Mouth-Based Emotion Recognition Using Transfer Learning
por: Franzoni, Valentina, et al.
Publicado: (2020)

A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face
por: Lian, Hailun, et al.
Publicado: (2023)

A multimodal psychological, physiological and behavioural dataset for human emotions in driving tasks
por: Li, Wenbo, et al.
Publicado: (2022)

Multimodal and Spectral Degradation Effects on Speech and Emotion Recognition in Adult Listeners
por: Ritter, Chantel, et al.
Publicado: (2018)

Effects of aging on emotion recognition from dynamic multimodal expressions and vocalizations
por: Cortes, Diana S., et al.
Publicado: (2021)

Hierarchical Attention-Based Multimodal Fusion Network for Video Emotion Recognition
por: Liu, Xiaodong, et al.
Publicado: (2021)

Multimodal Emotion Recognition from Art Using Sequential Co-Attention
por: Tashu, Tsegaye Misikir, et al.
Publicado: (2021)

Emotion recognition based on multi-modal physiological signals and transfer learning
por: Fu, Zhongzheng, et al.
Publicado: (2022)

Hybrid transfer learning strategy for cross-subject EEG emotion recognition
por: Lu, Wei, et al.
Publicado: (2023)

Judging the emotional states of customer service staff in the workplace: A multimodal dataset analysis
por: Liu, Ping, et al.
Publicado: (2022)

Emotion Recognition Using Different Sensors, Emotion Models, Methods and Datasets: A Comprehensive Review
por: Cai, Yujian, et al.
Publicado: (2023)

BanglaSER: A speech emotion recognition dataset for the Bangla language
por: Das, Rakesh Kumar, et al.
Publicado: (2022)

MindLink-Eumpy: An Open-Source Python Toolbox for Multimodal Emotion Recognition
por: Li, Ruixin, et al.
Publicado: (2021)

Training Emotion Recognition Accuracy: Results for Multimodal Expressions and Facial Micro Expressions
por: Döllinger, Lillian, et al.
Publicado: (2021)

Robust Multimodal Emotion Recognition from Conversation with Transformer-Based Crossmodality Fusion
por: Xie, Baijun, et al.
Publicado: (2021)

Wireless Sensing Technology Combined with Facial Expression to Realize Multimodal Emotion Recognition
por: Dang, Xiaochao, et al.
Publicado: (2022)

Masking important information to assess the robustness of a multimodal classifier for emotion recognition
por: Cohen, Dror, et al.
Publicado: (2023)

Elder emotion classification through multimodal fusion of intermediate layers and cross-modal transfer learning
por: Sreevidya, P., et al.
Publicado: (2022)

Emotional Effects on University Choice Behavior: The Influence of Experienced Narrators and Their Characteristics
por: Callejas-Albiñana, Ana I., et al.
Publicado: (2016)

BIRAFFE2, a multimodal dataset for emotion-based personalization in rich affective game environments
por: Kutt, Krzysztof, et al.
Publicado: (2022)

KBES: A dataset for realistic Bangla speech emotion recognition with intensity level
por: Billah, Md. Masum, et al.
Publicado: (2023)

Expression EEG Multimodal Emotion Recognition Method Based on the Bidirectional LSTM and Attention Mechanism
por: Zhao, Yifeng, et al.
Publicado: (2021)

Cannot write session to /tmp/vufind_sessions/sess_v0ufltsu8j5hupi901dflqv1ut