Cargando…
BERT for Evidence Retrieval and Claim Verification
We investigate BERT in an evidence retrieval and claim verification pipeline for the task of evidence-based claim verification. To this end, we propose to use two BERT models, one for retrieving evidence sentences supporting or rejecting claims, and another for verifying claims based on the retrieve...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7148011/ http://dx.doi.org/10.1007/978-3-030-45442-5_45 |
_version_ | 1783520510970167296 |
---|---|
author | Soleimani, Amir Monz, Christof Worring, Marcel |
author_facet | Soleimani, Amir Monz, Christof Worring, Marcel |
author_sort | Soleimani, Amir |
collection | PubMed |
description | We investigate BERT in an evidence retrieval and claim verification pipeline for the task of evidence-based claim verification. To this end, we propose to use two BERT models, one for retrieving evidence sentences supporting or rejecting claims, and another for verifying claims based on the retrieved evidence sentences. To train the BERT retrieval system, we use pointwise and pairwise loss functions and examine the effect of hard negative mining. Our system achieves a new state of the art recall of 87.1 for retrieving evidence sentences out of the FEVER dataset 50K Wikipedia pages, and scores second in the leaderboard with the FEVER score of 69.7. |
format | Online Article Text |
id | pubmed-7148011 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
record_format | MEDLINE/PubMed |
spelling | pubmed-71480112020-04-13 BERT for Evidence Retrieval and Claim Verification Soleimani, Amir Monz, Christof Worring, Marcel Advances in Information Retrieval Article We investigate BERT in an evidence retrieval and claim verification pipeline for the task of evidence-based claim verification. To this end, we propose to use two BERT models, one for retrieving evidence sentences supporting or rejecting claims, and another for verifying claims based on the retrieved evidence sentences. To train the BERT retrieval system, we use pointwise and pairwise loss functions and examine the effect of hard negative mining. Our system achieves a new state of the art recall of 87.1 for retrieving evidence sentences out of the FEVER dataset 50K Wikipedia pages, and scores second in the leaderboard with the FEVER score of 69.7. 2020-03-24 /pmc/articles/PMC7148011/ http://dx.doi.org/10.1007/978-3-030-45442-5_45 Text en © Springer Nature Switzerland AG 2020 This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic. |
spellingShingle | Article Soleimani, Amir Monz, Christof Worring, Marcel BERT for Evidence Retrieval and Claim Verification |
title | BERT for Evidence Retrieval and Claim Verification |
title_full | BERT for Evidence Retrieval and Claim Verification |
title_fullStr | BERT for Evidence Retrieval and Claim Verification |
title_full_unstemmed | BERT for Evidence Retrieval and Claim Verification |
title_short | BERT for Evidence Retrieval and Claim Verification |
title_sort | bert for evidence retrieval and claim verification |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7148011/ http://dx.doi.org/10.1007/978-3-030-45442-5_45 |
work_keys_str_mv | AT soleimaniamir bertforevidenceretrievalandclaimverification AT monzchristof bertforevidenceretrievalandclaimverification AT worringmarcel bertforevidenceretrievalandclaimverification |