Cargando…
Development and validation of algorithms to classify type 1 and 2 diabetes according to age at diagnosis using electronic health records
BACKGROUND: Validated algorithms to classify type 1 and 2 diabetes (T1D, T2D) are mostly limited to white pediatric populations. We conducted a large study in Hong Kong among children and adults with diabetes to develop and validate algorithms using electronic health records (EHRs) to classify diabe...
Autores principales: | , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
BioMed Central
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7038546/ https://www.ncbi.nlm.nih.gov/pubmed/32093635 http://dx.doi.org/10.1186/s12874-020-00921-3 |
_version_ | 1783500665163612160 |
---|---|
author | Ke, Calvin Stukel, Thérèse A. Luk, Andrea Shah, Baiju R. Jha, Prabhat Lau, Eric Ma, Ronald C. W. So, Wing-Yee Kong, Alice P. Chow, Elaine Chan, Juliana C. N. |
author_facet | Ke, Calvin Stukel, Thérèse A. Luk, Andrea Shah, Baiju R. Jha, Prabhat Lau, Eric Ma, Ronald C. W. So, Wing-Yee Kong, Alice P. Chow, Elaine Chan, Juliana C. N. |
author_sort | Ke, Calvin |
collection | PubMed |
description | BACKGROUND: Validated algorithms to classify type 1 and 2 diabetes (T1D, T2D) are mostly limited to white pediatric populations. We conducted a large study in Hong Kong among children and adults with diabetes to develop and validate algorithms using electronic health records (EHRs) to classify diabetes type against clinical assessment as the reference standard, and to evaluate performance by age at diagnosis. METHODS: We included all people with diabetes (age at diagnosis 1.5–100 years during 2002–15) in the Hong Kong Diabetes Register and randomized them to derivation and validation cohorts. We developed candidate algorithms to identify diabetes types using encounter codes, prescriptions, and combinations of these criteria (“combination algorithms”). We identified 3 algorithms with the highest sensitivity, positive predictive value (PPV), and kappa coefficient, and evaluated performance by age at diagnosis in the validation cohort. RESULTS: There were 10,196 (T1D n = 60, T2D n = 10,136) and 5101 (T1D n = 43, T2D n = 5058) people in the derivation and validation cohorts (mean age at diagnosis 22.7, 55.9 years; 53.3, 43.9% female; for T1D and T2D respectively). Algorithms using codes or prescriptions classified T1D well for age at diagnosis < 20 years, but sensitivity and PPV dropped for older ages at diagnosis. Combination algorithms maximized sensitivity or PPV, but not both. The “high sensitivity for type 1” algorithm (ratio of type 1 to type 2 codes ≥ 4, or at least 1 insulin prescription within 90 days) had a sensitivity of 95.3% (95% confidence interval 84.2–99.4%; PPV 12.8%, 9.3–16.9%), while the “high PPV for type 1” algorithm (ratio of type 1 to type 2 codes ≥ 4, and multiple daily injections with no other glucose-lowering medication prescription) had a PPV of 100.0% (79.4–100.0%; sensitivity 37.2%, 23.0–53.3%), and the “optimized” algorithm (ratio of type 1 to type 2 codes ≥ 4, and at least 1 insulin prescription within 90 days) had a sensitivity of 65.1% (49.1–79.0%) and PPV of 75.7% (58.8–88.2%) across all ages. Accuracy of T2D classification was high for all algorithms. CONCLUSIONS: Our validated set of algorithms accurately classifies T1D and T2D using EHRs for Hong Kong residents enrolled in a diabetes register. The choice of algorithm should be tailored to the unique requirements of each study question. |
format | Online Article Text |
id | pubmed-7038546 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | BioMed Central |
record_format | MEDLINE/PubMed |
spelling | pubmed-70385462020-03-02 Development and validation of algorithms to classify type 1 and 2 diabetes according to age at diagnosis using electronic health records Ke, Calvin Stukel, Thérèse A. Luk, Andrea Shah, Baiju R. Jha, Prabhat Lau, Eric Ma, Ronald C. W. So, Wing-Yee Kong, Alice P. Chow, Elaine Chan, Juliana C. N. BMC Med Res Methodol Research Article BACKGROUND: Validated algorithms to classify type 1 and 2 diabetes (T1D, T2D) are mostly limited to white pediatric populations. We conducted a large study in Hong Kong among children and adults with diabetes to develop and validate algorithms using electronic health records (EHRs) to classify diabetes type against clinical assessment as the reference standard, and to evaluate performance by age at diagnosis. METHODS: We included all people with diabetes (age at diagnosis 1.5–100 years during 2002–15) in the Hong Kong Diabetes Register and randomized them to derivation and validation cohorts. We developed candidate algorithms to identify diabetes types using encounter codes, prescriptions, and combinations of these criteria (“combination algorithms”). We identified 3 algorithms with the highest sensitivity, positive predictive value (PPV), and kappa coefficient, and evaluated performance by age at diagnosis in the validation cohort. RESULTS: There were 10,196 (T1D n = 60, T2D n = 10,136) and 5101 (T1D n = 43, T2D n = 5058) people in the derivation and validation cohorts (mean age at diagnosis 22.7, 55.9 years; 53.3, 43.9% female; for T1D and T2D respectively). Algorithms using codes or prescriptions classified T1D well for age at diagnosis < 20 years, but sensitivity and PPV dropped for older ages at diagnosis. Combination algorithms maximized sensitivity or PPV, but not both. The “high sensitivity for type 1” algorithm (ratio of type 1 to type 2 codes ≥ 4, or at least 1 insulin prescription within 90 days) had a sensitivity of 95.3% (95% confidence interval 84.2–99.4%; PPV 12.8%, 9.3–16.9%), while the “high PPV for type 1” algorithm (ratio of type 1 to type 2 codes ≥ 4, and multiple daily injections with no other glucose-lowering medication prescription) had a PPV of 100.0% (79.4–100.0%; sensitivity 37.2%, 23.0–53.3%), and the “optimized” algorithm (ratio of type 1 to type 2 codes ≥ 4, and at least 1 insulin prescription within 90 days) had a sensitivity of 65.1% (49.1–79.0%) and PPV of 75.7% (58.8–88.2%) across all ages. Accuracy of T2D classification was high for all algorithms. CONCLUSIONS: Our validated set of algorithms accurately classifies T1D and T2D using EHRs for Hong Kong residents enrolled in a diabetes register. The choice of algorithm should be tailored to the unique requirements of each study question. BioMed Central 2020-02-24 /pmc/articles/PMC7038546/ /pubmed/32093635 http://dx.doi.org/10.1186/s12874-020-00921-3 Text en © The Author(s) 2020 Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated. |
spellingShingle | Research Article Ke, Calvin Stukel, Thérèse A. Luk, Andrea Shah, Baiju R. Jha, Prabhat Lau, Eric Ma, Ronald C. W. So, Wing-Yee Kong, Alice P. Chow, Elaine Chan, Juliana C. N. Development and validation of algorithms to classify type 1 and 2 diabetes according to age at diagnosis using electronic health records |
title | Development and validation of algorithms to classify type 1 and 2 diabetes according to age at diagnosis using electronic health records |
title_full | Development and validation of algorithms to classify type 1 and 2 diabetes according to age at diagnosis using electronic health records |
title_fullStr | Development and validation of algorithms to classify type 1 and 2 diabetes according to age at diagnosis using electronic health records |
title_full_unstemmed | Development and validation of algorithms to classify type 1 and 2 diabetes according to age at diagnosis using electronic health records |
title_short | Development and validation of algorithms to classify type 1 and 2 diabetes according to age at diagnosis using electronic health records |
title_sort | development and validation of algorithms to classify type 1 and 2 diabetes according to age at diagnosis using electronic health records |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7038546/ https://www.ncbi.nlm.nih.gov/pubmed/32093635 http://dx.doi.org/10.1186/s12874-020-00921-3 |
work_keys_str_mv | AT kecalvin developmentandvalidationofalgorithmstoclassifytype1and2diabetesaccordingtoageatdiagnosisusingelectronichealthrecords AT stukeltheresea developmentandvalidationofalgorithmstoclassifytype1and2diabetesaccordingtoageatdiagnosisusingelectronichealthrecords AT lukandrea developmentandvalidationofalgorithmstoclassifytype1and2diabetesaccordingtoageatdiagnosisusingelectronichealthrecords AT shahbaijur developmentandvalidationofalgorithmstoclassifytype1and2diabetesaccordingtoageatdiagnosisusingelectronichealthrecords AT jhaprabhat developmentandvalidationofalgorithmstoclassifytype1and2diabetesaccordingtoageatdiagnosisusingelectronichealthrecords AT laueric developmentandvalidationofalgorithmstoclassifytype1and2diabetesaccordingtoageatdiagnosisusingelectronichealthrecords AT maronaldcw developmentandvalidationofalgorithmstoclassifytype1and2diabetesaccordingtoageatdiagnosisusingelectronichealthrecords AT sowingyee developmentandvalidationofalgorithmstoclassifytype1and2diabetesaccordingtoageatdiagnosisusingelectronichealthrecords AT kongalicep developmentandvalidationofalgorithmstoclassifytype1and2diabetesaccordingtoageatdiagnosisusingelectronichealthrecords AT chowelaine developmentandvalidationofalgorithmstoclassifytype1and2diabetesaccordingtoageatdiagnosisusingelectronichealthrecords AT chanjulianacn developmentandvalidationofalgorithmstoclassifytype1and2diabetesaccordingtoageatdiagnosisusingelectronichealthrecords |