Cargando…

Depression Detection Based on Hybrid Deep Learning SSCL Framework Using Self-Attention Mechanism: An Application to Social Networking Data

In today’s world, mental health diseases have become highly prevalent, and depression is one of the mental health problems that has become widespread. According to WHO reports, depression is the second-leading cause of the global burden of diseases. In the proliferation of such issues, social media...

Descripción completa

Detalles Bibliográficos
Autores principales: Nadeem, Aleena, Naveed, Muhammad, Islam Satti, Muhammad, Afzal, Hammad, Ahmad, Tanveer, Kim, Ki-Il
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9782829/
https://www.ncbi.nlm.nih.gov/pubmed/36560144
http://dx.doi.org/10.3390/s22249775
_version_ 1784857431647453184
author Nadeem, Aleena
Naveed, Muhammad
Islam Satti, Muhammad
Afzal, Hammad
Ahmad, Tanveer
Kim, Ki-Il
author_facet Nadeem, Aleena
Naveed, Muhammad
Islam Satti, Muhammad
Afzal, Hammad
Ahmad, Tanveer
Kim, Ki-Il
author_sort Nadeem, Aleena
collection PubMed
description In today’s world, mental health diseases have become highly prevalent, and depression is one of the mental health problems that has become widespread. According to WHO reports, depression is the second-leading cause of the global burden of diseases. In the proliferation of such issues, social media has proven to be a great platform for people to express themselves. Thus, a user’s social media can speak a great deal about his/her emotional state and mental health. Considering the high pervasiveness of the disease, this paper presents a novel framework for depression detection from textual data, employing Natural Language Processing and deep learning techniques. For this purpose, a dataset consisting of tweets was created, which were then manually annotated by the domain experts to capture the implicit and explicit depression context. Two variations of the dataset were created, on having binary and one ternary labels, respectively. Ultimately, a deep-learning-based hybrid Sequence, Semantic, Context Learning (SSCL) classification framework with a self-attention mechanism is proposed that utilizes GloVe (pre-trained word embeddings) for feature extraction; LSTM and CNN were used to capture the sequence and semantics of tweets; finally, the GRUs and self-attention mechanism were used, which focus on contextual and implicit information in the tweets. The framework outperformed the existing techniques in detecting the explicit and implicit context, with an accuracy of 97.4 for binary labeled data and 82.9 for ternary labeled data. We further tested our proposed SSCL framework on unseen data (random tweets), for which an F1-score of 94.4 was achieved. Furthermore, in order to showcase the strengths of the proposed framework, we validated it on the “News Headline Data set” for sarcasm detection, considering a dataset from a different domain. It also outmatched the performance of existing techniques in cross-domain validation.
format Online
Article
Text
id pubmed-9782829
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-97828292022-12-24 Depression Detection Based on Hybrid Deep Learning SSCL Framework Using Self-Attention Mechanism: An Application to Social Networking Data Nadeem, Aleena Naveed, Muhammad Islam Satti, Muhammad Afzal, Hammad Ahmad, Tanveer Kim, Ki-Il Sensors (Basel) Article In today’s world, mental health diseases have become highly prevalent, and depression is one of the mental health problems that has become widespread. According to WHO reports, depression is the second-leading cause of the global burden of diseases. In the proliferation of such issues, social media has proven to be a great platform for people to express themselves. Thus, a user’s social media can speak a great deal about his/her emotional state and mental health. Considering the high pervasiveness of the disease, this paper presents a novel framework for depression detection from textual data, employing Natural Language Processing and deep learning techniques. For this purpose, a dataset consisting of tweets was created, which were then manually annotated by the domain experts to capture the implicit and explicit depression context. Two variations of the dataset were created, on having binary and one ternary labels, respectively. Ultimately, a deep-learning-based hybrid Sequence, Semantic, Context Learning (SSCL) classification framework with a self-attention mechanism is proposed that utilizes GloVe (pre-trained word embeddings) for feature extraction; LSTM and CNN were used to capture the sequence and semantics of tweets; finally, the GRUs and self-attention mechanism were used, which focus on contextual and implicit information in the tweets. The framework outperformed the existing techniques in detecting the explicit and implicit context, with an accuracy of 97.4 for binary labeled data and 82.9 for ternary labeled data. We further tested our proposed SSCL framework on unseen data (random tweets), for which an F1-score of 94.4 was achieved. Furthermore, in order to showcase the strengths of the proposed framework, we validated it on the “News Headline Data set” for sarcasm detection, considering a dataset from a different domain. It also outmatched the performance of existing techniques in cross-domain validation. MDPI 2022-12-13 /pmc/articles/PMC9782829/ /pubmed/36560144 http://dx.doi.org/10.3390/s22249775 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Nadeem, Aleena
Naveed, Muhammad
Islam Satti, Muhammad
Afzal, Hammad
Ahmad, Tanveer
Kim, Ki-Il
Depression Detection Based on Hybrid Deep Learning SSCL Framework Using Self-Attention Mechanism: An Application to Social Networking Data
title Depression Detection Based on Hybrid Deep Learning SSCL Framework Using Self-Attention Mechanism: An Application to Social Networking Data
title_full Depression Detection Based on Hybrid Deep Learning SSCL Framework Using Self-Attention Mechanism: An Application to Social Networking Data
title_fullStr Depression Detection Based on Hybrid Deep Learning SSCL Framework Using Self-Attention Mechanism: An Application to Social Networking Data
title_full_unstemmed Depression Detection Based on Hybrid Deep Learning SSCL Framework Using Self-Attention Mechanism: An Application to Social Networking Data
title_short Depression Detection Based on Hybrid Deep Learning SSCL Framework Using Self-Attention Mechanism: An Application to Social Networking Data
title_sort depression detection based on hybrid deep learning sscl framework using self-attention mechanism: an application to social networking data
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9782829/
https://www.ncbi.nlm.nih.gov/pubmed/36560144
http://dx.doi.org/10.3390/s22249775
work_keys_str_mv AT nadeemaleena depressiondetectionbasedonhybriddeeplearningssclframeworkusingselfattentionmechanismanapplicationtosocialnetworkingdata
AT naveedmuhammad depressiondetectionbasedonhybriddeeplearningssclframeworkusingselfattentionmechanismanapplicationtosocialnetworkingdata
AT islamsattimuhammad depressiondetectionbasedonhybriddeeplearningssclframeworkusingselfattentionmechanismanapplicationtosocialnetworkingdata
AT afzalhammad depressiondetectionbasedonhybriddeeplearningssclframeworkusingselfattentionmechanismanapplicationtosocialnetworkingdata
AT ahmadtanveer depressiondetectionbasedonhybriddeeplearningssclframeworkusingselfattentionmechanismanapplicationtosocialnetworkingdata
AT kimkiil depressiondetectionbasedonhybriddeeplearningssclframeworkusingselfattentionmechanismanapplicationtosocialnetworkingdata