Cargando…
Zero-shot stance detection: Paradigms and challenges
A major challenge in stance detection is the large (potentially infinite) and diverse set of stance topics. Collecting data for such a set is unrealistic due to both the expense of annotation and the continuous creation of new real-world topics (e.g., a new politician runs for office). Furthermore,...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9880531/ https://www.ncbi.nlm.nih.gov/pubmed/36714207 http://dx.doi.org/10.3389/frai.2022.1070429 |
_version_ | 1784878933798289408 |
---|---|
author | Allaway, Emily McKeown, Kathleen |
author_facet | Allaway, Emily McKeown, Kathleen |
author_sort | Allaway, Emily |
collection | PubMed |
description | A major challenge in stance detection is the large (potentially infinite) and diverse set of stance topics. Collecting data for such a set is unrealistic due to both the expense of annotation and the continuous creation of new real-world topics (e.g., a new politician runs for office). Furthermore, stancetaking occurs in a wide range of languages and genres (e.g., Twitter, news articles). While zero-shot stance detection in English, where evaluation is on topics not seen during training, has received increasing attention, we argue that this attention should be expanded to multilingual and multi-genre settings. We discuss two paradigms for English zero-shot stance detection evaluation, as well as recent work in this area. We then discuss recent work on multilingual and multi-genre stance detection, which has focused primarily on non-zero-shot settings. We argue that this work should be expanded to multilingual and multi-genre zero-shot stance detection and propose best practices to systematize and stimulate future work in this direction. While domain adaptation techniques are well-suited for work in these settings, we argue that increased care should be taken to improve model explainability and to conduct robust evaluations, considering not only empirical generalization ability but also the understanding of complex language and inferences. |
format | Online Article Text |
id | pubmed-9880531 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-98805312023-01-28 Zero-shot stance detection: Paradigms and challenges Allaway, Emily McKeown, Kathleen Front Artif Intell Artificial Intelligence A major challenge in stance detection is the large (potentially infinite) and diverse set of stance topics. Collecting data for such a set is unrealistic due to both the expense of annotation and the continuous creation of new real-world topics (e.g., a new politician runs for office). Furthermore, stancetaking occurs in a wide range of languages and genres (e.g., Twitter, news articles). While zero-shot stance detection in English, where evaluation is on topics not seen during training, has received increasing attention, we argue that this attention should be expanded to multilingual and multi-genre settings. We discuss two paradigms for English zero-shot stance detection evaluation, as well as recent work in this area. We then discuss recent work on multilingual and multi-genre stance detection, which has focused primarily on non-zero-shot settings. We argue that this work should be expanded to multilingual and multi-genre zero-shot stance detection and propose best practices to systematize and stimulate future work in this direction. While domain adaptation techniques are well-suited for work in these settings, we argue that increased care should be taken to improve model explainability and to conduct robust evaluations, considering not only empirical generalization ability but also the understanding of complex language and inferences. Frontiers Media S.A. 2023-01-13 /pmc/articles/PMC9880531/ /pubmed/36714207 http://dx.doi.org/10.3389/frai.2022.1070429 Text en Copyright © 2023 Allaway and McKeown. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Artificial Intelligence Allaway, Emily McKeown, Kathleen Zero-shot stance detection: Paradigms and challenges |
title | Zero-shot stance detection: Paradigms and challenges |
title_full | Zero-shot stance detection: Paradigms and challenges |
title_fullStr | Zero-shot stance detection: Paradigms and challenges |
title_full_unstemmed | Zero-shot stance detection: Paradigms and challenges |
title_short | Zero-shot stance detection: Paradigms and challenges |
title_sort | zero-shot stance detection: paradigms and challenges |
topic | Artificial Intelligence |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9880531/ https://www.ncbi.nlm.nih.gov/pubmed/36714207 http://dx.doi.org/10.3389/frai.2022.1070429 |
work_keys_str_mv | AT allawayemily zeroshotstancedetectionparadigmsandchallenges AT mckeownkathleen zeroshotstancedetectionparadigmsandchallenges |