Cargando…

Application of Mixed Effects Limits of Agreement in the Presence of Multiple Sources of Variability: Exemplar from the Comparison of Several Devices to Measure Respiratory Rate in COPD Patients

INTRODUCTION: The Bland-Altman limits of agreement method is widely used to assess how well the measurements produced by two raters, devices or systems agree with each other. However, mixed effects versions of the method which take into account multiple sources of variability are less well described...

Descripción completa

Detalles Bibliográficos
Autores principales: Parker, Richard A., Weir, Christopher J., Rubio, Noah, Rabinovich, Roberto, Pinnock, Hilary, Hanley, Janet, McCloughan, Lucy, Drost, Ellen M., Mantoani, Leandro C., MacNee, William, McKinstry, Brian
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2016
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5156413/
https://www.ncbi.nlm.nih.gov/pubmed/27973556
http://dx.doi.org/10.1371/journal.pone.0168321
_version_ 1782475177518432256
author Parker, Richard A.
Weir, Christopher J.
Rubio, Noah
Rabinovich, Roberto
Pinnock, Hilary
Hanley, Janet
McCloughan, Lucy
Drost, Ellen M.
Mantoani, Leandro C.
MacNee, William
McKinstry, Brian
author_facet Parker, Richard A.
Weir, Christopher J.
Rubio, Noah
Rabinovich, Roberto
Pinnock, Hilary
Hanley, Janet
McCloughan, Lucy
Drost, Ellen M.
Mantoani, Leandro C.
MacNee, William
McKinstry, Brian
author_sort Parker, Richard A.
collection PubMed
description INTRODUCTION: The Bland-Altman limits of agreement method is widely used to assess how well the measurements produced by two raters, devices or systems agree with each other. However, mixed effects versions of the method which take into account multiple sources of variability are less well described in the literature. We address the practical challenges of applying mixed effects limits of agreement to the comparison of several devices to measure respiratory rate in patients with chronic obstructive pulmonary disease (COPD). METHODS: Respiratory rate was measured in 21 people with a range of severity of COPD. Participants were asked to perform eleven different activities representative of daily life during a laboratory-based standardised protocol of 57 minutes. A mixed effects limits of agreement method was used to assess the agreement of five commercially available monitors (Camera, Photoplethysmography (PPG), Impedance, Accelerometer, and Chest-band) with the current gold standard device for measuring respiratory rate. RESULTS: Results produced using mixed effects limits of agreement were compared to results from a fixed effects method based on analysis of variance (ANOVA) and were found to be similar. The Accelerometer and Chest-band devices produced the narrowest limits of agreement (-8.63 to 4.27 and -9.99 to 6.80 respectively) with mean bias -2.18 and -1.60 breaths per minute. These devices also had the lowest within-participant and overall standard deviations (3.23 and 3.29 for Accelerometer and 4.17 and 4.28 for Chest-band respectively). CONCLUSIONS: The mixed effects limits of agreement analysis enabled us to answer the question of which devices showed the strongest agreement with the gold standard device with respect to measuring respiratory rates. In particular, the estimated within-participant and overall standard deviations of the differences, which are easily obtainable from the mixed effects model results, gave a clear indication that the Accelerometer and Chest-band devices performed best.
format Online
Article
Text
id pubmed-5156413
institution National Center for Biotechnology Information
language English
publishDate 2016
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-51564132016-12-28 Application of Mixed Effects Limits of Agreement in the Presence of Multiple Sources of Variability: Exemplar from the Comparison of Several Devices to Measure Respiratory Rate in COPD Patients Parker, Richard A. Weir, Christopher J. Rubio, Noah Rabinovich, Roberto Pinnock, Hilary Hanley, Janet McCloughan, Lucy Drost, Ellen M. Mantoani, Leandro C. MacNee, William McKinstry, Brian PLoS One Research Article INTRODUCTION: The Bland-Altman limits of agreement method is widely used to assess how well the measurements produced by two raters, devices or systems agree with each other. However, mixed effects versions of the method which take into account multiple sources of variability are less well described in the literature. We address the practical challenges of applying mixed effects limits of agreement to the comparison of several devices to measure respiratory rate in patients with chronic obstructive pulmonary disease (COPD). METHODS: Respiratory rate was measured in 21 people with a range of severity of COPD. Participants were asked to perform eleven different activities representative of daily life during a laboratory-based standardised protocol of 57 minutes. A mixed effects limits of agreement method was used to assess the agreement of five commercially available monitors (Camera, Photoplethysmography (PPG), Impedance, Accelerometer, and Chest-band) with the current gold standard device for measuring respiratory rate. RESULTS: Results produced using mixed effects limits of agreement were compared to results from a fixed effects method based on analysis of variance (ANOVA) and were found to be similar. The Accelerometer and Chest-band devices produced the narrowest limits of agreement (-8.63 to 4.27 and -9.99 to 6.80 respectively) with mean bias -2.18 and -1.60 breaths per minute. These devices also had the lowest within-participant and overall standard deviations (3.23 and 3.29 for Accelerometer and 4.17 and 4.28 for Chest-band respectively). CONCLUSIONS: The mixed effects limits of agreement analysis enabled us to answer the question of which devices showed the strongest agreement with the gold standard device with respect to measuring respiratory rates. In particular, the estimated within-participant and overall standard deviations of the differences, which are easily obtainable from the mixed effects model results, gave a clear indication that the Accelerometer and Chest-band devices performed best. Public Library of Science 2016-12-14 /pmc/articles/PMC5156413/ /pubmed/27973556 http://dx.doi.org/10.1371/journal.pone.0168321 Text en © 2016 Parker et al http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Parker, Richard A.
Weir, Christopher J.
Rubio, Noah
Rabinovich, Roberto
Pinnock, Hilary
Hanley, Janet
McCloughan, Lucy
Drost, Ellen M.
Mantoani, Leandro C.
MacNee, William
McKinstry, Brian
Application of Mixed Effects Limits of Agreement in the Presence of Multiple Sources of Variability: Exemplar from the Comparison of Several Devices to Measure Respiratory Rate in COPD Patients
title Application of Mixed Effects Limits of Agreement in the Presence of Multiple Sources of Variability: Exemplar from the Comparison of Several Devices to Measure Respiratory Rate in COPD Patients
title_full Application of Mixed Effects Limits of Agreement in the Presence of Multiple Sources of Variability: Exemplar from the Comparison of Several Devices to Measure Respiratory Rate in COPD Patients
title_fullStr Application of Mixed Effects Limits of Agreement in the Presence of Multiple Sources of Variability: Exemplar from the Comparison of Several Devices to Measure Respiratory Rate in COPD Patients
title_full_unstemmed Application of Mixed Effects Limits of Agreement in the Presence of Multiple Sources of Variability: Exemplar from the Comparison of Several Devices to Measure Respiratory Rate in COPD Patients
title_short Application of Mixed Effects Limits of Agreement in the Presence of Multiple Sources of Variability: Exemplar from the Comparison of Several Devices to Measure Respiratory Rate in COPD Patients
title_sort application of mixed effects limits of agreement in the presence of multiple sources of variability: exemplar from the comparison of several devices to measure respiratory rate in copd patients
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5156413/
https://www.ncbi.nlm.nih.gov/pubmed/27973556
http://dx.doi.org/10.1371/journal.pone.0168321
work_keys_str_mv AT parkerricharda applicationofmixedeffectslimitsofagreementinthepresenceofmultiplesourcesofvariabilityexemplarfromthecomparisonofseveraldevicestomeasurerespiratoryrateincopdpatients
AT weirchristopherj applicationofmixedeffectslimitsofagreementinthepresenceofmultiplesourcesofvariabilityexemplarfromthecomparisonofseveraldevicestomeasurerespiratoryrateincopdpatients
AT rubionoah applicationofmixedeffectslimitsofagreementinthepresenceofmultiplesourcesofvariabilityexemplarfromthecomparisonofseveraldevicestomeasurerespiratoryrateincopdpatients
AT rabinovichroberto applicationofmixedeffectslimitsofagreementinthepresenceofmultiplesourcesofvariabilityexemplarfromthecomparisonofseveraldevicestomeasurerespiratoryrateincopdpatients
AT pinnockhilary applicationofmixedeffectslimitsofagreementinthepresenceofmultiplesourcesofvariabilityexemplarfromthecomparisonofseveraldevicestomeasurerespiratoryrateincopdpatients
AT hanleyjanet applicationofmixedeffectslimitsofagreementinthepresenceofmultiplesourcesofvariabilityexemplarfromthecomparisonofseveraldevicestomeasurerespiratoryrateincopdpatients
AT mccloughanlucy applicationofmixedeffectslimitsofagreementinthepresenceofmultiplesourcesofvariabilityexemplarfromthecomparisonofseveraldevicestomeasurerespiratoryrateincopdpatients
AT drostellenm applicationofmixedeffectslimitsofagreementinthepresenceofmultiplesourcesofvariabilityexemplarfromthecomparisonofseveraldevicestomeasurerespiratoryrateincopdpatients
AT mantoanileandroc applicationofmixedeffectslimitsofagreementinthepresenceofmultiplesourcesofvariabilityexemplarfromthecomparisonofseveraldevicestomeasurerespiratoryrateincopdpatients
AT macneewilliam applicationofmixedeffectslimitsofagreementinthepresenceofmultiplesourcesofvariabilityexemplarfromthecomparisonofseveraldevicestomeasurerespiratoryrateincopdpatients
AT mckinstrybrian applicationofmixedeffectslimitsofagreementinthepresenceofmultiplesourcesofvariabilityexemplarfromthecomparisonofseveraldevicestomeasurerespiratoryrateincopdpatients