Cargando…

Risk Estimates From an Online Risk Calculator Are More Believable and Recalled Better When Expressed as Integers

BACKGROUND: Online risk calculators offer different levels of precision in their risk estimates. People interpret numbers in varying ways depending on how they are presented, and we do not know how the number of decimal places displayed might influence perceptions of risk estimates. OBJECTIVE: The o...

Descripción completa

Detalles Bibliográficos
Autores principales: Witteman, Holly O, Zikmund-Fisher, Brian J, Waters, Erika A, Gavaruzzi, Teresa, Fagerlin, Angela
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Gunther Eysenbach 2011
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3222170/
https://www.ncbi.nlm.nih.gov/pubmed/21908265
http://dx.doi.org/10.2196/jmir.1656
_version_ 1782217177481347072
author Witteman, Holly O
Zikmund-Fisher, Brian J
Waters, Erika A
Gavaruzzi, Teresa
Fagerlin, Angela
author_facet Witteman, Holly O
Zikmund-Fisher, Brian J
Waters, Erika A
Gavaruzzi, Teresa
Fagerlin, Angela
author_sort Witteman, Holly O
collection PubMed
description BACKGROUND: Online risk calculators offer different levels of precision in their risk estimates. People interpret numbers in varying ways depending on how they are presented, and we do not know how the number of decimal places displayed might influence perceptions of risk estimates. OBJECTIVE: The objective of our study was to determine whether precision (ie, number of decimals) in risk estimates offered by an online risk calculator influences users’ ratings of (1) how believable the estimate is, (2) risk magnitude (ie, how large or small the risk feels to them), and (3) how well they can recall the risk estimate after a brief delay. METHODS: We developed two mock risk calculator websites that offered hypothetical percentage estimates of participants’ lifetime risk of kidney cancer. Participants were randomly assigned to a condition where the risk estimate value rose with increasing precision (2, 2.1, 2.13, 2.133) or the risk estimate value fell with increasing precision (2, 1.9, 1.87, 1.867). Within each group, participants were randomly assigned one of the four numbers as their first risk estimate, and later received one of the remaining three as a comparison. RESULTS: Participants who completed the experiment (N = 3422) were a demographically diverse online sample, approximately representative of the US adult population on age, gender, and race. Participants whose risk estimates had no decimal places gave the highest ratings of believability (F (3,3384) = 2.94, P = .03) and the lowest ratings of risk magnitude (F (3,3384) = 4.70, P = .003). Compared to estimates with decimal places, integer estimates were judged as highly believable by 7%–10% more participants (χ(2) (3) =17.8, P < .001). When comparing two risk estimates with different levels of precision, large majorities of participants reported that the numbers seemed equivalent across all measures. Both exact and approximate recall were highest for estimates with zero decimals. Odds ratios (OR) for correct approximate recall (defined as being within 50% of the original estimate) were, for one decimal place, OR = 0.65 (95% CI 0.49–0.86), for two decimal places, OR = 0.70 (95% CI 0.53–0.94), and for three decimal places, 0.61 (95% CI 0.45–0.81). Exact recall showed a similar pattern, with larger effects. CONCLUSIONS: There are subtle but measurable differences in how people interpret risk estimates of varying precision. Adding decimal places in risk calculators offers little to no benefit and some cost. Rounding to the nearest integer is likely preferable for communicating risk estimates via risk calculators so that they might be remembered correctly and judged as believable.
format Online
Article
Text
id pubmed-3222170
institution National Center for Biotechnology Information
language English
publishDate 2011
publisher Gunther Eysenbach
record_format MEDLINE/PubMed
spelling pubmed-32221702011-11-22 Risk Estimates From an Online Risk Calculator Are More Believable and Recalled Better When Expressed as Integers Witteman, Holly O Zikmund-Fisher, Brian J Waters, Erika A Gavaruzzi, Teresa Fagerlin, Angela J Med Internet Res Original Paper BACKGROUND: Online risk calculators offer different levels of precision in their risk estimates. People interpret numbers in varying ways depending on how they are presented, and we do not know how the number of decimal places displayed might influence perceptions of risk estimates. OBJECTIVE: The objective of our study was to determine whether precision (ie, number of decimals) in risk estimates offered by an online risk calculator influences users’ ratings of (1) how believable the estimate is, (2) risk magnitude (ie, how large or small the risk feels to them), and (3) how well they can recall the risk estimate after a brief delay. METHODS: We developed two mock risk calculator websites that offered hypothetical percentage estimates of participants’ lifetime risk of kidney cancer. Participants were randomly assigned to a condition where the risk estimate value rose with increasing precision (2, 2.1, 2.13, 2.133) or the risk estimate value fell with increasing precision (2, 1.9, 1.87, 1.867). Within each group, participants were randomly assigned one of the four numbers as their first risk estimate, and later received one of the remaining three as a comparison. RESULTS: Participants who completed the experiment (N = 3422) were a demographically diverse online sample, approximately representative of the US adult population on age, gender, and race. Participants whose risk estimates had no decimal places gave the highest ratings of believability (F (3,3384) = 2.94, P = .03) and the lowest ratings of risk magnitude (F (3,3384) = 4.70, P = .003). Compared to estimates with decimal places, integer estimates were judged as highly believable by 7%–10% more participants (χ(2) (3) =17.8, P < .001). When comparing two risk estimates with different levels of precision, large majorities of participants reported that the numbers seemed equivalent across all measures. Both exact and approximate recall were highest for estimates with zero decimals. Odds ratios (OR) for correct approximate recall (defined as being within 50% of the original estimate) were, for one decimal place, OR = 0.65 (95% CI 0.49–0.86), for two decimal places, OR = 0.70 (95% CI 0.53–0.94), and for three decimal places, 0.61 (95% CI 0.45–0.81). Exact recall showed a similar pattern, with larger effects. CONCLUSIONS: There are subtle but measurable differences in how people interpret risk estimates of varying precision. Adding decimal places in risk calculators offers little to no benefit and some cost. Rounding to the nearest integer is likely preferable for communicating risk estimates via risk calculators so that they might be remembered correctly and judged as believable. Gunther Eysenbach 2011-09-07 /pmc/articles/PMC3222170/ /pubmed/21908265 http://dx.doi.org/10.2196/jmir.1656 Text en ©Holly O Witteman, Brian J Zikmund-Fisher, Erika A Waters, Teresa Gavaruzzi, Angela Fagerlin. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 07.09.2011. http://creativecommons.org/licenses/by/2.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.
spellingShingle Original Paper
Witteman, Holly O
Zikmund-Fisher, Brian J
Waters, Erika A
Gavaruzzi, Teresa
Fagerlin, Angela
Risk Estimates From an Online Risk Calculator Are More Believable and Recalled Better When Expressed as Integers
title Risk Estimates From an Online Risk Calculator Are More Believable and Recalled Better When Expressed as Integers
title_full Risk Estimates From an Online Risk Calculator Are More Believable and Recalled Better When Expressed as Integers
title_fullStr Risk Estimates From an Online Risk Calculator Are More Believable and Recalled Better When Expressed as Integers
title_full_unstemmed Risk Estimates From an Online Risk Calculator Are More Believable and Recalled Better When Expressed as Integers
title_short Risk Estimates From an Online Risk Calculator Are More Believable and Recalled Better When Expressed as Integers
title_sort risk estimates from an online risk calculator are more believable and recalled better when expressed as integers
topic Original Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3222170/
https://www.ncbi.nlm.nih.gov/pubmed/21908265
http://dx.doi.org/10.2196/jmir.1656
work_keys_str_mv AT wittemanhollyo riskestimatesfromanonlineriskcalculatoraremorebelievableandrecalledbetterwhenexpressedasintegers
AT zikmundfisherbrianj riskestimatesfromanonlineriskcalculatoraremorebelievableandrecalledbetterwhenexpressedasintegers
AT waterserikaa riskestimatesfromanonlineriskcalculatoraremorebelievableandrecalledbetterwhenexpressedasintegers
AT gavaruzziteresa riskestimatesfromanonlineriskcalculatoraremorebelievableandrecalledbetterwhenexpressedasintegers
AT fagerlinangela riskestimatesfromanonlineriskcalculatoraremorebelievableandrecalledbetterwhenexpressedasintegers