Cargando…

A Health Information Quality Assessment Tool for Korean Online Newspaper Articles: Development Study

BACKGROUND: Concern regarding the reliability and accuracy of the health-related information provided by online newspaper articles has increased. Numerous criteria and items have been proposed and published regarding the quality assessment of online information, but there is no standard quality asse...

Descripción completa

Detalles Bibliográficos
Autores principales: Lee, Naae, Oh, Seung-Won, Cho, Belong, Myung, Seung-Kwon, Hwang, Seung-Sik, Yoon, Goo Hyeon
Formato: Online Artículo Texto
Lenguaje:English
Publicado: JMIR Publications 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8367132/
https://www.ncbi.nlm.nih.gov/pubmed/34326038
http://dx.doi.org/10.2196/24436
_version_ 1783739016848343040
author Lee, Naae
Oh, Seung-Won
Cho, Belong
Myung, Seung-Kwon
Hwang, Seung-Sik
Yoon, Goo Hyeon
author_facet Lee, Naae
Oh, Seung-Won
Cho, Belong
Myung, Seung-Kwon
Hwang, Seung-Sik
Yoon, Goo Hyeon
author_sort Lee, Naae
collection PubMed
description BACKGROUND: Concern regarding the reliability and accuracy of the health-related information provided by online newspaper articles has increased. Numerous criteria and items have been proposed and published regarding the quality assessment of online information, but there is no standard quality assessment tool available for online newspapers. OBJECTIVE: This study aimed to develop the Health Information Quality Assessment Tool (HIQUAL) for online newspaper articles. METHODS: We reviewed previous health information quality assessment tools and related studies and accordingly developed and customized new criteria. The interrater agreement for the new assessment tool was assessed for 3 newspaper articles on different subjects (colorectal cancer, obesity genetic testing, and hypertension diagnostic criteria) using the Fleiss κ and Gwet agreement coefficient. To compare the quality scores generated by each pair of tools, convergent validity was measured using the Kendall τ ranked correlation. RESULTS: Overall, the HIQUAL for newspaper articles comprised 10 items across 5 domains: reliability, usefulness, understandability, sufficiency, and transparency. The interrater agreement for the article on colorectal cancer was in the moderate to substantial range (Fleiss κ=0.48, SE 0.11; Gwet agreement coefficient=0.74, SE 0.13), while for the article introducing obesity genetic testing it was in the substantial range, with values of 0.63 (SE 0.28) and 0.86 (SE 0.10) for the two measures, respectively. There was relatively low agreement for the article on hypertension diagnostic criteria at 0.20 (SE 0.10) and 0.75 (SE 0.13), respectively. Validity of the correlation assessed with the Kendall τ showed good correlation between tools (HIQUAL vs DISCERN=0.72, HIQUAL vs QUEST [Quality Evaluation Scoring Tool]=0.69). CONCLUSIONS: We developed a new assessment tool to evaluate the quality of health information in online newspaper articles, to help consumers discern accurate sources of health information. The HIQUAL can help increase the accuracy and quality of online health information in Korea.
format Online
Article
Text
id pubmed-8367132
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher JMIR Publications
record_format MEDLINE/PubMed
spelling pubmed-83671322021-08-24 A Health Information Quality Assessment Tool for Korean Online Newspaper Articles: Development Study Lee, Naae Oh, Seung-Won Cho, Belong Myung, Seung-Kwon Hwang, Seung-Sik Yoon, Goo Hyeon J Med Internet Res Original Paper BACKGROUND: Concern regarding the reliability and accuracy of the health-related information provided by online newspaper articles has increased. Numerous criteria and items have been proposed and published regarding the quality assessment of online information, but there is no standard quality assessment tool available for online newspapers. OBJECTIVE: This study aimed to develop the Health Information Quality Assessment Tool (HIQUAL) for online newspaper articles. METHODS: We reviewed previous health information quality assessment tools and related studies and accordingly developed and customized new criteria. The interrater agreement for the new assessment tool was assessed for 3 newspaper articles on different subjects (colorectal cancer, obesity genetic testing, and hypertension diagnostic criteria) using the Fleiss κ and Gwet agreement coefficient. To compare the quality scores generated by each pair of tools, convergent validity was measured using the Kendall τ ranked correlation. RESULTS: Overall, the HIQUAL for newspaper articles comprised 10 items across 5 domains: reliability, usefulness, understandability, sufficiency, and transparency. The interrater agreement for the article on colorectal cancer was in the moderate to substantial range (Fleiss κ=0.48, SE 0.11; Gwet agreement coefficient=0.74, SE 0.13), while for the article introducing obesity genetic testing it was in the substantial range, with values of 0.63 (SE 0.28) and 0.86 (SE 0.10) for the two measures, respectively. There was relatively low agreement for the article on hypertension diagnostic criteria at 0.20 (SE 0.10) and 0.75 (SE 0.13), respectively. Validity of the correlation assessed with the Kendall τ showed good correlation between tools (HIQUAL vs DISCERN=0.72, HIQUAL vs QUEST [Quality Evaluation Scoring Tool]=0.69). CONCLUSIONS: We developed a new assessment tool to evaluate the quality of health information in online newspaper articles, to help consumers discern accurate sources of health information. The HIQUAL can help increase the accuracy and quality of online health information in Korea. JMIR Publications 2021-07-29 /pmc/articles/PMC8367132/ /pubmed/34326038 http://dx.doi.org/10.2196/24436 Text en ©Naae Lee, Seung-Won Oh, Belong Cho, Seung-Kwon Myung, Seung-Sik Hwang, Goo Hyeon Yoon. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 29.07.2021. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.
spellingShingle Original Paper
Lee, Naae
Oh, Seung-Won
Cho, Belong
Myung, Seung-Kwon
Hwang, Seung-Sik
Yoon, Goo Hyeon
A Health Information Quality Assessment Tool for Korean Online Newspaper Articles: Development Study
title A Health Information Quality Assessment Tool for Korean Online Newspaper Articles: Development Study
title_full A Health Information Quality Assessment Tool for Korean Online Newspaper Articles: Development Study
title_fullStr A Health Information Quality Assessment Tool for Korean Online Newspaper Articles: Development Study
title_full_unstemmed A Health Information Quality Assessment Tool for Korean Online Newspaper Articles: Development Study
title_short A Health Information Quality Assessment Tool for Korean Online Newspaper Articles: Development Study
title_sort health information quality assessment tool for korean online newspaper articles: development study
topic Original Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8367132/
https://www.ncbi.nlm.nih.gov/pubmed/34326038
http://dx.doi.org/10.2196/24436
work_keys_str_mv AT leenaae ahealthinformationqualityassessmenttoolforkoreanonlinenewspaperarticlesdevelopmentstudy
AT ohseungwon ahealthinformationqualityassessmenttoolforkoreanonlinenewspaperarticlesdevelopmentstudy
AT chobelong ahealthinformationqualityassessmenttoolforkoreanonlinenewspaperarticlesdevelopmentstudy
AT myungseungkwon ahealthinformationqualityassessmenttoolforkoreanonlinenewspaperarticlesdevelopmentstudy
AT hwangseungsik ahealthinformationqualityassessmenttoolforkoreanonlinenewspaperarticlesdevelopmentstudy
AT yoongoohyeon ahealthinformationqualityassessmenttoolforkoreanonlinenewspaperarticlesdevelopmentstudy
AT leenaae healthinformationqualityassessmenttoolforkoreanonlinenewspaperarticlesdevelopmentstudy
AT ohseungwon healthinformationqualityassessmenttoolforkoreanonlinenewspaperarticlesdevelopmentstudy
AT chobelong healthinformationqualityassessmenttoolforkoreanonlinenewspaperarticlesdevelopmentstudy
AT myungseungkwon healthinformationqualityassessmenttoolforkoreanonlinenewspaperarticlesdevelopmentstudy
AT hwangseungsik healthinformationqualityassessmenttoolforkoreanonlinenewspaperarticlesdevelopmentstudy
AT yoongoohyeon healthinformationqualityassessmenttoolforkoreanonlinenewspaperarticlesdevelopmentstudy