Visualizing attention zones in machine reading comprehension models

The attention mechanism plays an important role in the machine reading comprehension (MRC) model. Here, we describe a pipeline for building an MRC model with a pretrained language model and visualizing the effect of each attention zone in different layers, which can indicate the explainability of th...

Descripción completa

Detalles Bibliográficos
Autores principales: Cui, Yiming, Zhang, Wei-Nan, Liu, Ting
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Elsevier 2022
Materias:
Protocol
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9234076/
https://www.ncbi.nlm.nih.gov/pubmed/35769927
http://dx.doi.org/10.1016/j.xpro.2022.101481

Internet

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9234076/
https://www.ncbi.nlm.nih.gov/pubmed/35769927
http://dx.doi.org/10.1016/j.xpro.2022.101481

Ejemplares similares