Cargando…

Zero-shot stance detection: Paradigms and challenges

A major challenge in stance detection is the large (potentially infinite) and diverse set of stance topics. Collecting data for such a set is unrealistic due to both the expense of annotation and the continuous creation of new real-world topics (e.g., a new politician runs for office). Furthermore,...

Descripción completa

Detalles Bibliográficos
Autores principales: Allaway, Emily, McKeown, Kathleen
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9880531/
https://www.ncbi.nlm.nih.gov/pubmed/36714207
http://dx.doi.org/10.3389/frai.2022.1070429
_version_ 1784878933798289408
author Allaway, Emily
McKeown, Kathleen
author_facet Allaway, Emily
McKeown, Kathleen
author_sort Allaway, Emily
collection PubMed
description A major challenge in stance detection is the large (potentially infinite) and diverse set of stance topics. Collecting data for such a set is unrealistic due to both the expense of annotation and the continuous creation of new real-world topics (e.g., a new politician runs for office). Furthermore, stancetaking occurs in a wide range of languages and genres (e.g., Twitter, news articles). While zero-shot stance detection in English, where evaluation is on topics not seen during training, has received increasing attention, we argue that this attention should be expanded to multilingual and multi-genre settings. We discuss two paradigms for English zero-shot stance detection evaluation, as well as recent work in this area. We then discuss recent work on multilingual and multi-genre stance detection, which has focused primarily on non-zero-shot settings. We argue that this work should be expanded to multilingual and multi-genre zero-shot stance detection and propose best practices to systematize and stimulate future work in this direction. While domain adaptation techniques are well-suited for work in these settings, we argue that increased care should be taken to improve model explainability and to conduct robust evaluations, considering not only empirical generalization ability but also the understanding of complex language and inferences.
format Online
Article
Text
id pubmed-9880531
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-98805312023-01-28 Zero-shot stance detection: Paradigms and challenges Allaway, Emily McKeown, Kathleen Front Artif Intell Artificial Intelligence A major challenge in stance detection is the large (potentially infinite) and diverse set of stance topics. Collecting data for such a set is unrealistic due to both the expense of annotation and the continuous creation of new real-world topics (e.g., a new politician runs for office). Furthermore, stancetaking occurs in a wide range of languages and genres (e.g., Twitter, news articles). While zero-shot stance detection in English, where evaluation is on topics not seen during training, has received increasing attention, we argue that this attention should be expanded to multilingual and multi-genre settings. We discuss two paradigms for English zero-shot stance detection evaluation, as well as recent work in this area. We then discuss recent work on multilingual and multi-genre stance detection, which has focused primarily on non-zero-shot settings. We argue that this work should be expanded to multilingual and multi-genre zero-shot stance detection and propose best practices to systematize and stimulate future work in this direction. While domain adaptation techniques are well-suited for work in these settings, we argue that increased care should be taken to improve model explainability and to conduct robust evaluations, considering not only empirical generalization ability but also the understanding of complex language and inferences. Frontiers Media S.A. 2023-01-13 /pmc/articles/PMC9880531/ /pubmed/36714207 http://dx.doi.org/10.3389/frai.2022.1070429 Text en Copyright © 2023 Allaway and McKeown. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Artificial Intelligence
Allaway, Emily
McKeown, Kathleen
Zero-shot stance detection: Paradigms and challenges
title Zero-shot stance detection: Paradigms and challenges
title_full Zero-shot stance detection: Paradigms and challenges
title_fullStr Zero-shot stance detection: Paradigms and challenges
title_full_unstemmed Zero-shot stance detection: Paradigms and challenges
title_short Zero-shot stance detection: Paradigms and challenges
title_sort zero-shot stance detection: paradigms and challenges
topic Artificial Intelligence
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9880531/
https://www.ncbi.nlm.nih.gov/pubmed/36714207
http://dx.doi.org/10.3389/frai.2022.1070429
work_keys_str_mv AT allawayemily zeroshotstancedetectionparadigmsandchallenges
AT mckeownkathleen zeroshotstancedetectionparadigmsandchallenges