Cargando…
Beyond Readability: Investigating Coherence of Clinical Text for Consumers
BACKGROUND: A basic tenet of consumer health informatics is that understandable health resources empower the public. Text comprehension holds great promise for helping to characterize consumer problems in understanding health texts. The need for efficient ways to assess consumer-oriented health text...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Gunther Eysenbach
2011
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3278090/ https://www.ncbi.nlm.nih.gov/pubmed/22138127 http://dx.doi.org/10.2196/jmir.1842 |
_version_ | 1782223530803331072 |
---|---|
author | Smith, Catherine Arnott Hetzel, Scott Dalrymple, Prudence Keselman, Alla |
author_facet | Smith, Catherine Arnott Hetzel, Scott Dalrymple, Prudence Keselman, Alla |
author_sort | Smith, Catherine Arnott |
collection | PubMed |
description | BACKGROUND: A basic tenet of consumer health informatics is that understandable health resources empower the public. Text comprehension holds great promise for helping to characterize consumer problems in understanding health texts. The need for efficient ways to assess consumer-oriented health texts and the availability of computationally supported tools led us to explore the effect of various text characteristics on readers’ understanding of health texts, as well as to develop novel approaches to assessing these characteristics. OBJECTIVE: The goal of this study was to compare the impact of two different approaches to enhancing readability, and three interventions, on individuals’ comprehension of short, complex passages of health text. METHODS: Participants were 80 university staff, faculty, or students. Each participant was asked to “retell” the content of two health texts: one a clinical trial in the domain of diabetes mellitus, and the other typical Visit Notes. These texts were transformed for the intervention arms of the study. Two interventions provided terminology support via (1) standard dictionary or (2) contextualized vocabulary definitions. The third intervention provided coherence improvement. We assessed participants’ comprehension of the clinical texts through propositional analysis, an open-ended questionnaire, and analysis of the number of errors made. RESULTS: For the clinical trial text, the effect of text condition was not significant in any of the comparisons, suggesting no differences in recall, despite the varying levels of support (P = .84). For the Visit Note, however, the difference in the median total propositions recalled between the Coherent and the (Original + Dictionary) conditions was significant (P = .04). This suggests that participants in the Coherent condition recalled more of the original Visit Notes content than did participants in the Original and the Dictionary conditions combined. However, no difference was seen between (Original + Dictionary) and Vocabulary (P = .36) nor Coherent and Vocabulary (P = .62). No statistically significant effect of any document transformation was found either in the open-ended questionnaire (clinical trial: P = .86, Visit Note: P = .20) or in the error rate (clinical trial: P = .47, Visit Note: P = .25). However, post hoc power analysis suggested that increasing the sample size by approximately 6 participants per condition would result in a significant difference for the Visit Note, but not for the clinical trial text. CONCLUSIONS: Statistically, the results of this study attest that improving coherence has a small effect on consumer comprehension of clinical text, but the task is extremely labor intensive and not scalable. Further research is needed using texts from more diverse clinical domains and more heterogeneous participants, including actual patients. Since comprehensibility of clinical text appears difficult to automate, informatics support tools may most productively support the health care professionals tasked with making clinical information understandable to patients. |
format | Online Article Text |
id | pubmed-3278090 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2011 |
publisher | Gunther Eysenbach |
record_format | MEDLINE/PubMed |
spelling | pubmed-32780902012-02-13 Beyond Readability: Investigating Coherence of Clinical Text for Consumers Smith, Catherine Arnott Hetzel, Scott Dalrymple, Prudence Keselman, Alla J Med Internet Res Original Paper BACKGROUND: A basic tenet of consumer health informatics is that understandable health resources empower the public. Text comprehension holds great promise for helping to characterize consumer problems in understanding health texts. The need for efficient ways to assess consumer-oriented health texts and the availability of computationally supported tools led us to explore the effect of various text characteristics on readers’ understanding of health texts, as well as to develop novel approaches to assessing these characteristics. OBJECTIVE: The goal of this study was to compare the impact of two different approaches to enhancing readability, and three interventions, on individuals’ comprehension of short, complex passages of health text. METHODS: Participants were 80 university staff, faculty, or students. Each participant was asked to “retell” the content of two health texts: one a clinical trial in the domain of diabetes mellitus, and the other typical Visit Notes. These texts were transformed for the intervention arms of the study. Two interventions provided terminology support via (1) standard dictionary or (2) contextualized vocabulary definitions. The third intervention provided coherence improvement. We assessed participants’ comprehension of the clinical texts through propositional analysis, an open-ended questionnaire, and analysis of the number of errors made. RESULTS: For the clinical trial text, the effect of text condition was not significant in any of the comparisons, suggesting no differences in recall, despite the varying levels of support (P = .84). For the Visit Note, however, the difference in the median total propositions recalled between the Coherent and the (Original + Dictionary) conditions was significant (P = .04). This suggests that participants in the Coherent condition recalled more of the original Visit Notes content than did participants in the Original and the Dictionary conditions combined. However, no difference was seen between (Original + Dictionary) and Vocabulary (P = .36) nor Coherent and Vocabulary (P = .62). No statistically significant effect of any document transformation was found either in the open-ended questionnaire (clinical trial: P = .86, Visit Note: P = .20) or in the error rate (clinical trial: P = .47, Visit Note: P = .25). However, post hoc power analysis suggested that increasing the sample size by approximately 6 participants per condition would result in a significant difference for the Visit Note, but not for the clinical trial text. CONCLUSIONS: Statistically, the results of this study attest that improving coherence has a small effect on consumer comprehension of clinical text, but the task is extremely labor intensive and not scalable. Further research is needed using texts from more diverse clinical domains and more heterogeneous participants, including actual patients. Since comprehensibility of clinical text appears difficult to automate, informatics support tools may most productively support the health care professionals tasked with making clinical information understandable to patients. Gunther Eysenbach 2011-12-02 /pmc/articles/PMC3278090/ /pubmed/22138127 http://dx.doi.org/10.2196/jmir.1842 Text en ©Catherine Arnott Smith, Scott Hetzel, Prudence Dalrymple, Alla Keselman. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 02.12.2011. http://creativecommons.org/licenses/by/2.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included. |
spellingShingle | Original Paper Smith, Catherine Arnott Hetzel, Scott Dalrymple, Prudence Keselman, Alla Beyond Readability: Investigating Coherence of Clinical Text for Consumers |
title | Beyond Readability: Investigating Coherence of Clinical Text for Consumers |
title_full | Beyond Readability: Investigating Coherence of Clinical Text for Consumers |
title_fullStr | Beyond Readability: Investigating Coherence of Clinical Text for Consumers |
title_full_unstemmed | Beyond Readability: Investigating Coherence of Clinical Text for Consumers |
title_short | Beyond Readability: Investigating Coherence of Clinical Text for Consumers |
title_sort | beyond readability: investigating coherence of clinical text for consumers |
topic | Original Paper |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3278090/ https://www.ncbi.nlm.nih.gov/pubmed/22138127 http://dx.doi.org/10.2196/jmir.1842 |
work_keys_str_mv | AT smithcatherinearnott beyondreadabilityinvestigatingcoherenceofclinicaltextforconsumers AT hetzelscott beyondreadabilityinvestigatingcoherenceofclinicaltextforconsumers AT dalrympleprudence beyondreadabilityinvestigatingcoherenceofclinicaltextforconsumers AT keselmanalla beyondreadabilityinvestigatingcoherenceofclinicaltextforconsumers |