Cargando…

Development and Testing of a Novel Measure to Assess Fidelity of Implementation: Example of the Mini-AFTERc Intervention

BACKGROUND: Fidelity of implementation (FOI) reflects whether an intervention was implemented in clinical practice according to the originally developed manual and is a key aspect in understanding intervention effectiveness. To illustrate this process of developing a fidelity measure, this study use...

Descripción completa

Detalles Bibliográficos
Autores principales: Brandt, Nathalie Georgia, McHale, Calum Thomas, Humphris, Gerald Michael
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7723987/
https://www.ncbi.nlm.nih.gov/pubmed/33324299
http://dx.doi.org/10.3389/fpsyg.2020.601813
_version_ 1783620458540695552
author Brandt, Nathalie Georgia
McHale, Calum Thomas
Humphris, Gerald Michael
author_facet Brandt, Nathalie Georgia
McHale, Calum Thomas
Humphris, Gerald Michael
author_sort Brandt, Nathalie Georgia
collection PubMed
description BACKGROUND: Fidelity of implementation (FOI) reflects whether an intervention was implemented in clinical practice according to the originally developed manual and is a key aspect in understanding intervention effectiveness. To illustrate this process of developing a fidelity measure, this study uses the Mini-AFTERc, a brief psychological intervention aimed at managing breast cancer patients’ fear of cancer recurrence, as an example. OBJECTIVES: To illustrate the development of an FOI measure through (1) applying this process to the Mini-AFTERc intervention, by including the design of a scoring system and rating criteria; (2) content validating the FOI measure using thematic framework analysis as a qualitative approach; (3) testing consistency of the FOI measure using interrater reliability. METHODS: The FOI measure was developed, its scoring system modified and the rating criteria defined. Thematic framework analysis was conducted to content validate the FOI measure using nine intervention discussions between four specialist cancer nurses and four breast cancer patients, and one simulated breast cancer patient. Intraclass-correlation was conducted to assess interrater reliability. RESULTS: The qualitative findings suggested that the Mini-AFTERc FOI measure has content validity as it was able to measure all five components of the Mini-AFTERc intervention. The interrater reliability suggested a moderate to excellent degree of reliability among three raters, r(ICC) = 0.84, 95% CI [0.51, 0.96]. CONCLUSION: The study has illustrated the steps that an FOI measure can be developed through a systematic approach applied to the Mini-AFTERc intervention. The FOI measure was found to have content validity and was consistently applied, independently, by three researchers familiar with the Mini-AFTERc intervention. Future studies should determine whether similar levels of interrater reliability can be obtained by distributing written and/or video instructions to researchers who are unfamiliar with the FOI measure, using a larger sample. Employing developed and validated FOI measures such as the one presented for the Mini-AFTERc would facilitate implementation of interventions in the FCR field in clinical practice as intended. CLINICAL TRIAL REGISTRATION: www.ClinicalTrials.gov, identifier: NCT03763825.
format Online
Article
Text
id pubmed-7723987
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-77239872020-12-14 Development and Testing of a Novel Measure to Assess Fidelity of Implementation: Example of the Mini-AFTERc Intervention Brandt, Nathalie Georgia McHale, Calum Thomas Humphris, Gerald Michael Front Psychol Psychology BACKGROUND: Fidelity of implementation (FOI) reflects whether an intervention was implemented in clinical practice according to the originally developed manual and is a key aspect in understanding intervention effectiveness. To illustrate this process of developing a fidelity measure, this study uses the Mini-AFTERc, a brief psychological intervention aimed at managing breast cancer patients’ fear of cancer recurrence, as an example. OBJECTIVES: To illustrate the development of an FOI measure through (1) applying this process to the Mini-AFTERc intervention, by including the design of a scoring system and rating criteria; (2) content validating the FOI measure using thematic framework analysis as a qualitative approach; (3) testing consistency of the FOI measure using interrater reliability. METHODS: The FOI measure was developed, its scoring system modified and the rating criteria defined. Thematic framework analysis was conducted to content validate the FOI measure using nine intervention discussions between four specialist cancer nurses and four breast cancer patients, and one simulated breast cancer patient. Intraclass-correlation was conducted to assess interrater reliability. RESULTS: The qualitative findings suggested that the Mini-AFTERc FOI measure has content validity as it was able to measure all five components of the Mini-AFTERc intervention. The interrater reliability suggested a moderate to excellent degree of reliability among three raters, r(ICC) = 0.84, 95% CI [0.51, 0.96]. CONCLUSION: The study has illustrated the steps that an FOI measure can be developed through a systematic approach applied to the Mini-AFTERc intervention. The FOI measure was found to have content validity and was consistently applied, independently, by three researchers familiar with the Mini-AFTERc intervention. Future studies should determine whether similar levels of interrater reliability can be obtained by distributing written and/or video instructions to researchers who are unfamiliar with the FOI measure, using a larger sample. Employing developed and validated FOI measures such as the one presented for the Mini-AFTERc would facilitate implementation of interventions in the FCR field in clinical practice as intended. CLINICAL TRIAL REGISTRATION: www.ClinicalTrials.gov, identifier: NCT03763825. Frontiers Media S.A. 2020-11-25 /pmc/articles/PMC7723987/ /pubmed/33324299 http://dx.doi.org/10.3389/fpsyg.2020.601813 Text en Copyright © 2020 Brandt, McHale and Humphris. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Psychology
Brandt, Nathalie Georgia
McHale, Calum Thomas
Humphris, Gerald Michael
Development and Testing of a Novel Measure to Assess Fidelity of Implementation: Example of the Mini-AFTERc Intervention
title Development and Testing of a Novel Measure to Assess Fidelity of Implementation: Example of the Mini-AFTERc Intervention
title_full Development and Testing of a Novel Measure to Assess Fidelity of Implementation: Example of the Mini-AFTERc Intervention
title_fullStr Development and Testing of a Novel Measure to Assess Fidelity of Implementation: Example of the Mini-AFTERc Intervention
title_full_unstemmed Development and Testing of a Novel Measure to Assess Fidelity of Implementation: Example of the Mini-AFTERc Intervention
title_short Development and Testing of a Novel Measure to Assess Fidelity of Implementation: Example of the Mini-AFTERc Intervention
title_sort development and testing of a novel measure to assess fidelity of implementation: example of the mini-afterc intervention
topic Psychology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7723987/
https://www.ncbi.nlm.nih.gov/pubmed/33324299
http://dx.doi.org/10.3389/fpsyg.2020.601813
work_keys_str_mv AT brandtnathaliegeorgia developmentandtestingofanovelmeasuretoassessfidelityofimplementationexampleoftheminiaftercintervention
AT mchalecalumthomas developmentandtestingofanovelmeasuretoassessfidelityofimplementationexampleoftheminiaftercintervention
AT humphrisgeraldmichael developmentandtestingofanovelmeasuretoassessfidelityofimplementationexampleoftheminiaftercintervention