Cargando…
An iterative approach for the global estimation of sentence similarity
Measuring the similarity between two sentences is often difficult due to their small lexical overlap. Instead of focusing on the sets of features in two given sentences between which we must measure similarity, we propose a sentence similarity method that considers two types of constraints that must...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2017
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5595307/ https://www.ncbi.nlm.nih.gov/pubmed/28898242 http://dx.doi.org/10.1371/journal.pone.0180885 |
_version_ | 1783263348045905920 |
---|---|
author | Kajiwara, Tomoyuki Bollegala, Danushka Yoshida, Yuichi Kawarabayashi, Ken-ichi |
author_facet | Kajiwara, Tomoyuki Bollegala, Danushka Yoshida, Yuichi Kawarabayashi, Ken-ichi |
author_sort | Kajiwara, Tomoyuki |
collection | PubMed |
description | Measuring the similarity between two sentences is often difficult due to their small lexical overlap. Instead of focusing on the sets of features in two given sentences between which we must measure similarity, we propose a sentence similarity method that considers two types of constraints that must be satisfied by all pairs of sentences in a given corpus. Namely, (a) if two sentences share many features in common, then it is likely that the remaining features in each sentence are also related, and (b) if two sentences contain many related features, then those two sentences are themselves similar. The two constraints are utilized in an iterative bootstrapping procedure that simultaneously updates both word and sentence similarity scores. Experimental results on SemEval 2015 Task 2 dataset show that the proposed iterative approach for measuring sentence semantic similarity is significantly better than the non-iterative counterparts. |
format | Online Article Text |
id | pubmed-5595307 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2017 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-55953072017-09-15 An iterative approach for the global estimation of sentence similarity Kajiwara, Tomoyuki Bollegala, Danushka Yoshida, Yuichi Kawarabayashi, Ken-ichi PLoS One Research Article Measuring the similarity between two sentences is often difficult due to their small lexical overlap. Instead of focusing on the sets of features in two given sentences between which we must measure similarity, we propose a sentence similarity method that considers two types of constraints that must be satisfied by all pairs of sentences in a given corpus. Namely, (a) if two sentences share many features in common, then it is likely that the remaining features in each sentence are also related, and (b) if two sentences contain many related features, then those two sentences are themselves similar. The two constraints are utilized in an iterative bootstrapping procedure that simultaneously updates both word and sentence similarity scores. Experimental results on SemEval 2015 Task 2 dataset show that the proposed iterative approach for measuring sentence semantic similarity is significantly better than the non-iterative counterparts. Public Library of Science 2017-09-12 /pmc/articles/PMC5595307/ /pubmed/28898242 http://dx.doi.org/10.1371/journal.pone.0180885 Text en © 2017 Kajiwara et al http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
spellingShingle | Research Article Kajiwara, Tomoyuki Bollegala, Danushka Yoshida, Yuichi Kawarabayashi, Ken-ichi An iterative approach for the global estimation of sentence similarity |
title | An iterative approach for the global estimation of sentence similarity |
title_full | An iterative approach for the global estimation of sentence similarity |
title_fullStr | An iterative approach for the global estimation of sentence similarity |
title_full_unstemmed | An iterative approach for the global estimation of sentence similarity |
title_short | An iterative approach for the global estimation of sentence similarity |
title_sort | iterative approach for the global estimation of sentence similarity |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5595307/ https://www.ncbi.nlm.nih.gov/pubmed/28898242 http://dx.doi.org/10.1371/journal.pone.0180885 |
work_keys_str_mv | AT kajiwaratomoyuki aniterativeapproachfortheglobalestimationofsentencesimilarity AT bollegaladanushka aniterativeapproachfortheglobalestimationofsentencesimilarity AT yoshidayuichi aniterativeapproachfortheglobalestimationofsentencesimilarity AT kawarabayashikenichi aniterativeapproachfortheglobalestimationofsentencesimilarity AT kajiwaratomoyuki iterativeapproachfortheglobalestimationofsentencesimilarity AT bollegaladanushka iterativeapproachfortheglobalestimationofsentencesimilarity AT yoshidayuichi iterativeapproachfortheglobalestimationofsentencesimilarity AT kawarabayashikenichi iterativeapproachfortheglobalestimationofsentencesimilarity |