Cargando…

Can surveys of women accurately track indicators of maternal and newborn care? A validity and reliability study in Kenya

BACKGROUND: Tracking progress on maternal and newborn survival requires accurate information on the coverage of essential interventions. Despite widespread use, most indicators measuring maternal and newborn intervention coverage have not been validated. This study assessed the ability of women deli...

Descripción completa

Detalles Bibliográficos
Autores principales: McCarthy, Katharine J, Blanc, Ann K, Warren, Charlotte E, Kimani, James, Mdawida, Brian, Ndwidga, Charity
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Edinburgh University Global Health Society 2016
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5012235/
https://www.ncbi.nlm.nih.gov/pubmed/27606061
http://dx.doi.org/10.7189/jogh.06.020502
_version_ 1782451969673134080
author McCarthy, Katharine J
Blanc, Ann K
Warren, Charlotte E
Kimani, James
Mdawida, Brian
Ndwidga, Charity
author_facet McCarthy, Katharine J
Blanc, Ann K
Warren, Charlotte E
Kimani, James
Mdawida, Brian
Ndwidga, Charity
author_sort McCarthy, Katharine J
collection PubMed
description BACKGROUND: Tracking progress on maternal and newborn survival requires accurate information on the coverage of essential interventions. Despite widespread use, most indicators measuring maternal and newborn intervention coverage have not been validated. This study assessed the ability of women delivering in two Kenyan hospitals to recall critical elements of care received during the intrapartum and immediate postnatal period at two time points: hospital discharge and 13–15 months following delivery. METHODS: Women’s reports of received care were compared against observations by trained third party observers. Indicators selected for validation were either currently in use or have the potential to be included in population–based surveys. We used a mixed–methods approach to validate women’s reporting ability. We calculated individual–reporting accuracy using the area under the receiver operating curve (AUC), population–level accuracy using the inflation factor (IF), and compared the accuracy of women’s reporting at baseline and follow–up. We also assessed the consistency of women’s reporting over time. We used in–depth interviews with a sub–set of women (n = 20) to assess their understanding of key survey terms. RESULTS: Of 606 women who participated at baseline and agreed to follow–up, 515 were re–interviewed. Thirty–eight indicators had sufficient sample size for validation analysis; ten met criteria for high or moderate reporting accuracy (0.60<AUC) alone and ten met criteria for low population–level bias alone (0.75<IF<1.25). There was a significant decline in the individual level reporting accuracy between baseline and follow–up for ten indicators. Seven indicators had moderate or higher (0.4≤r(phi)) consistency between self–reports at baseline and follow–up. Four indicators met all criteria at follow–up: support person was present during the birth, episiotomy, caesarean section, and low birthweight infant (<2500 g). CONCLUSION: The few indicators that women reported accurately at baseline were consistently recalled with accuracy at 13–15 months follow–up. Although there is deterioration in women’s recall in some indicators over time, the extent of deterioration does not appreciably compromise reporting accuracy for indicators with high baseline validity. Indicators related to initial client assessment and the immediate postnatal period have generally low accuracy and poor reporting consistency over time.
format Online
Article
Text
id pubmed-5012235
institution National Center for Biotechnology Information
language English
publishDate 2016
publisher Edinburgh University Global Health Society
record_format MEDLINE/PubMed
spelling pubmed-50122352016-09-07 Can surveys of women accurately track indicators of maternal and newborn care? A validity and reliability study in Kenya McCarthy, Katharine J Blanc, Ann K Warren, Charlotte E Kimani, James Mdawida, Brian Ndwidga, Charity J Glob Health Research Theme: Improving coverage measures for MNCH BACKGROUND: Tracking progress on maternal and newborn survival requires accurate information on the coverage of essential interventions. Despite widespread use, most indicators measuring maternal and newborn intervention coverage have not been validated. This study assessed the ability of women delivering in two Kenyan hospitals to recall critical elements of care received during the intrapartum and immediate postnatal period at two time points: hospital discharge and 13–15 months following delivery. METHODS: Women’s reports of received care were compared against observations by trained third party observers. Indicators selected for validation were either currently in use or have the potential to be included in population–based surveys. We used a mixed–methods approach to validate women’s reporting ability. We calculated individual–reporting accuracy using the area under the receiver operating curve (AUC), population–level accuracy using the inflation factor (IF), and compared the accuracy of women’s reporting at baseline and follow–up. We also assessed the consistency of women’s reporting over time. We used in–depth interviews with a sub–set of women (n = 20) to assess their understanding of key survey terms. RESULTS: Of 606 women who participated at baseline and agreed to follow–up, 515 were re–interviewed. Thirty–eight indicators had sufficient sample size for validation analysis; ten met criteria for high or moderate reporting accuracy (0.60<AUC) alone and ten met criteria for low population–level bias alone (0.75<IF<1.25). There was a significant decline in the individual level reporting accuracy between baseline and follow–up for ten indicators. Seven indicators had moderate or higher (0.4≤r(phi)) consistency between self–reports at baseline and follow–up. Four indicators met all criteria at follow–up: support person was present during the birth, episiotomy, caesarean section, and low birthweight infant (<2500 g). CONCLUSION: The few indicators that women reported accurately at baseline were consistently recalled with accuracy at 13–15 months follow–up. Although there is deterioration in women’s recall in some indicators over time, the extent of deterioration does not appreciably compromise reporting accuracy for indicators with high baseline validity. Indicators related to initial client assessment and the immediate postnatal period have generally low accuracy and poor reporting consistency over time. Edinburgh University Global Health Society 2016-12 2016-09-03 /pmc/articles/PMC5012235/ /pubmed/27606061 http://dx.doi.org/10.7189/jogh.06.020502 Text en Copyright © 2016 by the Journal of Global Health. All rights reserved. http://creativecommons.org/licenses/by/2.5/ This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Theme: Improving coverage measures for MNCH
McCarthy, Katharine J
Blanc, Ann K
Warren, Charlotte E
Kimani, James
Mdawida, Brian
Ndwidga, Charity
Can surveys of women accurately track indicators of maternal and newborn care? A validity and reliability study in Kenya
title Can surveys of women accurately track indicators of maternal and newborn care? A validity and reliability study in Kenya
title_full Can surveys of women accurately track indicators of maternal and newborn care? A validity and reliability study in Kenya
title_fullStr Can surveys of women accurately track indicators of maternal and newborn care? A validity and reliability study in Kenya
title_full_unstemmed Can surveys of women accurately track indicators of maternal and newborn care? A validity and reliability study in Kenya
title_short Can surveys of women accurately track indicators of maternal and newborn care? A validity and reliability study in Kenya
title_sort can surveys of women accurately track indicators of maternal and newborn care? a validity and reliability study in kenya
topic Research Theme: Improving coverage measures for MNCH
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5012235/
https://www.ncbi.nlm.nih.gov/pubmed/27606061
http://dx.doi.org/10.7189/jogh.06.020502
work_keys_str_mv AT mccarthykatharinej cansurveysofwomenaccuratelytrackindicatorsofmaternalandnewborncareavalidityandreliabilitystudyinkenya
AT blancannk cansurveysofwomenaccuratelytrackindicatorsofmaternalandnewborncareavalidityandreliabilitystudyinkenya
AT warrencharlottee cansurveysofwomenaccuratelytrackindicatorsofmaternalandnewborncareavalidityandreliabilitystudyinkenya
AT kimanijames cansurveysofwomenaccuratelytrackindicatorsofmaternalandnewborncareavalidityandreliabilitystudyinkenya
AT mdawidabrian cansurveysofwomenaccuratelytrackindicatorsofmaternalandnewborncareavalidityandreliabilitystudyinkenya
AT ndwidgacharity cansurveysofwomenaccuratelytrackindicatorsofmaternalandnewborncareavalidityandreliabilitystudyinkenya