Cargando…

On the rise of fear speech in online social media

Recently, social media platforms are heavily moderated to prevent the spread of online hate speech, which is usually fertile in toxic words and is directed toward an individual or a community. Owing to such heavy moderation, newer and more subtle techniques are being deployed. One of the most striki...

Descripción completa

Detalles Bibliográficos
Autores principales: Saha, Punyajoy, Garimella, Kiran, Kalyan, Narla Komal, Pandey, Saurabh Kumar, Meher, Pauras Mangesh, Mathew, Binny, Mukherjee, Animesh
Formato: Online Artículo Texto
Lenguaje:English
Publicado: National Academy of Sciences 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10089164/
https://www.ncbi.nlm.nih.gov/pubmed/36877833
http://dx.doi.org/10.1073/pnas.2212270120
_version_ 1785022712281825280
author Saha, Punyajoy
Garimella, Kiran
Kalyan, Narla Komal
Pandey, Saurabh Kumar
Meher, Pauras Mangesh
Mathew, Binny
Mukherjee, Animesh
author_facet Saha, Punyajoy
Garimella, Kiran
Kalyan, Narla Komal
Pandey, Saurabh Kumar
Meher, Pauras Mangesh
Mathew, Binny
Mukherjee, Animesh
author_sort Saha, Punyajoy
collection PubMed
description Recently, social media platforms are heavily moderated to prevent the spread of online hate speech, which is usually fertile in toxic words and is directed toward an individual or a community. Owing to such heavy moderation, newer and more subtle techniques are being deployed. One of the most striking among these is fear speech. Fear speech, as the name suggests, attempts to incite fear about a target community. Although subtle, it might be highly effective, often pushing communities toward a physical conflict. Therefore, understanding their prevalence in social media is of paramount importance. This article presents a large-scale study to understand the prevalence of 400K fear speech and over 700K hate speech posts collected from Gab.com. Remarkably, users posting a large number of fear speech accrue more followers and occupy more central positions in social networks than users posting a large number of hate speech. They can also reach out to benign users more effectively than hate speech users through replies, reposts, and mentions. This connects to the fact that, unlike hate speech, fear speech has almost zero toxic content, making it look plausible. Moreover, while fear speech topics mostly portray a community as a perpetrator using a (fake) chain of argumentation, hate speech topics hurl direct multitarget insults, thus pointing to why general users could be more gullible to fear speech. Our findings transcend even to other platforms (Twitter and Facebook) and thus necessitate using sophisticated moderation policies and mass awareness to combat fear speech.
format Online
Article
Text
id pubmed-10089164
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher National Academy of Sciences
record_format MEDLINE/PubMed
spelling pubmed-100891642023-09-06 On the rise of fear speech in online social media Saha, Punyajoy Garimella, Kiran Kalyan, Narla Komal Pandey, Saurabh Kumar Meher, Pauras Mangesh Mathew, Binny Mukherjee, Animesh Proc Natl Acad Sci U S A Physical Sciences Recently, social media platforms are heavily moderated to prevent the spread of online hate speech, which is usually fertile in toxic words and is directed toward an individual or a community. Owing to such heavy moderation, newer and more subtle techniques are being deployed. One of the most striking among these is fear speech. Fear speech, as the name suggests, attempts to incite fear about a target community. Although subtle, it might be highly effective, often pushing communities toward a physical conflict. Therefore, understanding their prevalence in social media is of paramount importance. This article presents a large-scale study to understand the prevalence of 400K fear speech and over 700K hate speech posts collected from Gab.com. Remarkably, users posting a large number of fear speech accrue more followers and occupy more central positions in social networks than users posting a large number of hate speech. They can also reach out to benign users more effectively than hate speech users through replies, reposts, and mentions. This connects to the fact that, unlike hate speech, fear speech has almost zero toxic content, making it look plausible. Moreover, while fear speech topics mostly portray a community as a perpetrator using a (fake) chain of argumentation, hate speech topics hurl direct multitarget insults, thus pointing to why general users could be more gullible to fear speech. Our findings transcend even to other platforms (Twitter and Facebook) and thus necessitate using sophisticated moderation policies and mass awareness to combat fear speech. National Academy of Sciences 2023-03-06 2023-03-14 /pmc/articles/PMC10089164/ /pubmed/36877833 http://dx.doi.org/10.1073/pnas.2212270120 Text en Copyright © 2023 the Author(s). Published by PNAS. https://creativecommons.org/licenses/by-nc-nd/4.0/This article is distributed under Creative Commons Attribution-NonCommercial-NoDerivatives License 4.0 (CC BY-NC-ND) (https://creativecommons.org/licenses/by-nc-nd/4.0/) .
spellingShingle Physical Sciences
Saha, Punyajoy
Garimella, Kiran
Kalyan, Narla Komal
Pandey, Saurabh Kumar
Meher, Pauras Mangesh
Mathew, Binny
Mukherjee, Animesh
On the rise of fear speech in online social media
title On the rise of fear speech in online social media
title_full On the rise of fear speech in online social media
title_fullStr On the rise of fear speech in online social media
title_full_unstemmed On the rise of fear speech in online social media
title_short On the rise of fear speech in online social media
title_sort on the rise of fear speech in online social media
topic Physical Sciences
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10089164/
https://www.ncbi.nlm.nih.gov/pubmed/36877833
http://dx.doi.org/10.1073/pnas.2212270120
work_keys_str_mv AT sahapunyajoy ontheriseoffearspeechinonlinesocialmedia
AT garimellakiran ontheriseoffearspeechinonlinesocialmedia
AT kalyannarlakomal ontheriseoffearspeechinonlinesocialmedia
AT pandeysaurabhkumar ontheriseoffearspeechinonlinesocialmedia
AT meherpaurasmangesh ontheriseoffearspeechinonlinesocialmedia
AT mathewbinny ontheriseoffearspeechinonlinesocialmedia
AT mukherjeeanimesh ontheriseoffearspeechinonlinesocialmedia