Cargando…
Integrating topic modeling and word embedding to characterize violent deaths
There is an escalating need for methods to identify latent patterns in text data from many domains. We introduce a method to identify topics in a corpus and represent documents as topic sequences. Discourse atom topic modeling (DATM) draws on advances in theoretical machine learning to integrate top...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
National Academy of Sciences
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8915886/ https://www.ncbi.nlm.nih.gov/pubmed/35239440 http://dx.doi.org/10.1073/pnas.2108801119 |
_version_ | 1784668155929427968 |
---|---|
author | Arseniev-Koehler, Alina Cochran, Susan D. Mays, Vickie M. Chang, Kai-Wei Foster, Jacob G. |
author_facet | Arseniev-Koehler, Alina Cochran, Susan D. Mays, Vickie M. Chang, Kai-Wei Foster, Jacob G. |
author_sort | Arseniev-Koehler, Alina |
collection | PubMed |
description | There is an escalating need for methods to identify latent patterns in text data from many domains. We introduce a method to identify topics in a corpus and represent documents as topic sequences. Discourse atom topic modeling (DATM) draws on advances in theoretical machine learning to integrate topic modeling and word embedding, capitalizing on their distinct capabilities. We first identify a set of vectors (“discourse atoms”) that provide a sparse representation of an embedding space. Discourse atoms can be interpreted as latent topics; through a generative model, atoms map onto distributions over words. We can also infer the topic that generated a sequence of words. We illustrate our method with a prominent example of underutilized text: the US National Violent Death Reporting System (NVDRS). The NVDRS summarizes violent death incidents with structured variables and unstructured narratives. We identify 225 latent topics in the narratives (e.g., preparation for death and physical aggression); many of these topics are not captured by existing structured variables. Motivated by known patterns in suicide and homicide by gender and recent research on gender biases in semantic space, we identify the gender bias of our topics (e.g., a topic about pain medication is feminine). We then compare the gender bias of topics to their prevalence in narratives of female versus male victims. Results provide a detailed quantitative picture of reporting about lethal violence and its gendered nature. Our method offers a flexible and broadly applicable approach to model topics in text data. |
format | Online Article Text |
id | pubmed-8915886 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | National Academy of Sciences |
record_format | MEDLINE/PubMed |
spelling | pubmed-89158862022-03-12 Integrating topic modeling and word embedding to characterize violent deaths Arseniev-Koehler, Alina Cochran, Susan D. Mays, Vickie M. Chang, Kai-Wei Foster, Jacob G. Proc Natl Acad Sci U S A Social Sciences There is an escalating need for methods to identify latent patterns in text data from many domains. We introduce a method to identify topics in a corpus and represent documents as topic sequences. Discourse atom topic modeling (DATM) draws on advances in theoretical machine learning to integrate topic modeling and word embedding, capitalizing on their distinct capabilities. We first identify a set of vectors (“discourse atoms”) that provide a sparse representation of an embedding space. Discourse atoms can be interpreted as latent topics; through a generative model, atoms map onto distributions over words. We can also infer the topic that generated a sequence of words. We illustrate our method with a prominent example of underutilized text: the US National Violent Death Reporting System (NVDRS). The NVDRS summarizes violent death incidents with structured variables and unstructured narratives. We identify 225 latent topics in the narratives (e.g., preparation for death and physical aggression); many of these topics are not captured by existing structured variables. Motivated by known patterns in suicide and homicide by gender and recent research on gender biases in semantic space, we identify the gender bias of our topics (e.g., a topic about pain medication is feminine). We then compare the gender bias of topics to their prevalence in narratives of female versus male victims. Results provide a detailed quantitative picture of reporting about lethal violence and its gendered nature. Our method offers a flexible and broadly applicable approach to model topics in text data. National Academy of Sciences 2022-03-03 2022-03-08 /pmc/articles/PMC8915886/ /pubmed/35239440 http://dx.doi.org/10.1073/pnas.2108801119 Text en Copyright © 2022 the Author(s). Published by PNAS. https://creativecommons.org/licenses/by/4.0/This open access article is distributed under Creative Commons Attribution License 4.0 (CC BY) (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Social Sciences Arseniev-Koehler, Alina Cochran, Susan D. Mays, Vickie M. Chang, Kai-Wei Foster, Jacob G. Integrating topic modeling and word embedding to characterize violent deaths |
title | Integrating topic modeling and word embedding to characterize violent deaths |
title_full | Integrating topic modeling and word embedding to characterize violent deaths |
title_fullStr | Integrating topic modeling and word embedding to characterize violent deaths |
title_full_unstemmed | Integrating topic modeling and word embedding to characterize violent deaths |
title_short | Integrating topic modeling and word embedding to characterize violent deaths |
title_sort | integrating topic modeling and word embedding to characterize violent deaths |
topic | Social Sciences |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8915886/ https://www.ncbi.nlm.nih.gov/pubmed/35239440 http://dx.doi.org/10.1073/pnas.2108801119 |
work_keys_str_mv | AT arsenievkoehleralina integratingtopicmodelingandwordembeddingtocharacterizeviolentdeaths AT cochransusand integratingtopicmodelingandwordembeddingtocharacterizeviolentdeaths AT maysvickiem integratingtopicmodelingandwordembeddingtocharacterizeviolentdeaths AT changkaiwei integratingtopicmodelingandwordembeddingtocharacterizeviolentdeaths AT fosterjacobg integratingtopicmodelingandwordembeddingtocharacterizeviolentdeaths |