Cargando…
Delivering Behaviour Change Interventions: Development of a Mode of Delivery Ontology
Background: Investigating and improving the effects of behaviour change interventions requires detailed and consistent specification of all aspects of interventions. An important feature of interventions is the way in which these are delivered, i.e. their mode of delivery. This paper describes an on...
Autores principales: | , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
F1000 Research Limited
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7993627/ https://www.ncbi.nlm.nih.gov/pubmed/33824909 http://dx.doi.org/10.12688/wellcomeopenres.15906.2 |
_version_ | 1783669593498189824 |
---|---|
author | Marques, Marta M. Carey, Rachel N. Norris, Emma Evans, Fiona Finnerty, Ailbhe N. Hastings, Janna Jenkins, Ella Johnston, Marie West, Robert Michie, Susan |
author_facet | Marques, Marta M. Carey, Rachel N. Norris, Emma Evans, Fiona Finnerty, Ailbhe N. Hastings, Janna Jenkins, Ella Johnston, Marie West, Robert Michie, Susan |
author_sort | Marques, Marta M. |
collection | PubMed |
description | Background: Investigating and improving the effects of behaviour change interventions requires detailed and consistent specification of all aspects of interventions. An important feature of interventions is the way in which these are delivered, i.e. their mode of delivery. This paper describes an ontology for specifying the mode of delivery of interventions, which forms part of the Behaviour Change Intervention Ontology, currently being developed in the Wellcome Trust funded Human Behaviour-Change Project. Methods: The Mode of Delivery Ontology was developed in an iterative process of annotating behaviour change interventions evaluation reports, and consulting with expert stakeholders. It consisted of seven steps: 1) annotation of 110 intervention reports to develop a preliminary classification of modes of delivery; 2) open review from international experts (n=25); 3) second round of annotations with 55 reports to test inter-rater reliability and identify limitations; 4) second round of expert review feedback (n=16); 5) final round of testing of the refined ontology by two annotators familiar and two annotators unfamiliar with the ontology; 6) specification of ontological relationships between entities; and 7) transformation into a machine-readable format using the Web Ontology Language (OWL) and publishing online. Results: The resulting ontology is a four-level hierarchical structure comprising 65 unique modes of delivery, organised by 15 upper-level classes: Informational , Environmental change, Somatic, Somatic alteration, Individual-based/ Pair-based /Group-based, Uni-directional/Interactional, Synchronous/ Asynchronous, Push/ Pull, Gamification, Arts feature. Relationships between entities consist of is_a. Inter-rater reliability of the Mode of Delivery Ontology for annotating intervention evaluation reports was a=0.80 (very good) for those familiar with the ontology and a= 0.58 (acceptable) for those unfamiliar with it. Conclusion: The ontology can be used for both annotating and writing behaviour change intervention evaluation reports in a consistent and coherent manner, thereby improving evidence comparison, synthesis, replication, and implementation of effective interventions. |
format | Online Article Text |
id | pubmed-7993627 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | F1000 Research Limited |
record_format | MEDLINE/PubMed |
spelling | pubmed-79936272021-04-05 Delivering Behaviour Change Interventions: Development of a Mode of Delivery Ontology Marques, Marta M. Carey, Rachel N. Norris, Emma Evans, Fiona Finnerty, Ailbhe N. Hastings, Janna Jenkins, Ella Johnston, Marie West, Robert Michie, Susan Wellcome Open Res Research Article Background: Investigating and improving the effects of behaviour change interventions requires detailed and consistent specification of all aspects of interventions. An important feature of interventions is the way in which these are delivered, i.e. their mode of delivery. This paper describes an ontology for specifying the mode of delivery of interventions, which forms part of the Behaviour Change Intervention Ontology, currently being developed in the Wellcome Trust funded Human Behaviour-Change Project. Methods: The Mode of Delivery Ontology was developed in an iterative process of annotating behaviour change interventions evaluation reports, and consulting with expert stakeholders. It consisted of seven steps: 1) annotation of 110 intervention reports to develop a preliminary classification of modes of delivery; 2) open review from international experts (n=25); 3) second round of annotations with 55 reports to test inter-rater reliability and identify limitations; 4) second round of expert review feedback (n=16); 5) final round of testing of the refined ontology by two annotators familiar and two annotators unfamiliar with the ontology; 6) specification of ontological relationships between entities; and 7) transformation into a machine-readable format using the Web Ontology Language (OWL) and publishing online. Results: The resulting ontology is a four-level hierarchical structure comprising 65 unique modes of delivery, organised by 15 upper-level classes: Informational , Environmental change, Somatic, Somatic alteration, Individual-based/ Pair-based /Group-based, Uni-directional/Interactional, Synchronous/ Asynchronous, Push/ Pull, Gamification, Arts feature. Relationships between entities consist of is_a. Inter-rater reliability of the Mode of Delivery Ontology for annotating intervention evaluation reports was a=0.80 (very good) for those familiar with the ontology and a= 0.58 (acceptable) for those unfamiliar with it. Conclusion: The ontology can be used for both annotating and writing behaviour change intervention evaluation reports in a consistent and coherent manner, thereby improving evidence comparison, synthesis, replication, and implementation of effective interventions. F1000 Research Limited 2021-02-26 /pmc/articles/PMC7993627/ /pubmed/33824909 http://dx.doi.org/10.12688/wellcomeopenres.15906.2 Text en Copyright: © 2021 Marques MM et al. http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Research Article Marques, Marta M. Carey, Rachel N. Norris, Emma Evans, Fiona Finnerty, Ailbhe N. Hastings, Janna Jenkins, Ella Johnston, Marie West, Robert Michie, Susan Delivering Behaviour Change Interventions: Development of a Mode of Delivery Ontology |
title | Delivering Behaviour Change Interventions: Development of a Mode of Delivery Ontology |
title_full | Delivering Behaviour Change Interventions: Development of a Mode of Delivery Ontology |
title_fullStr | Delivering Behaviour Change Interventions: Development of a Mode of Delivery Ontology |
title_full_unstemmed | Delivering Behaviour Change Interventions: Development of a Mode of Delivery Ontology |
title_short | Delivering Behaviour Change Interventions: Development of a Mode of Delivery Ontology |
title_sort | delivering behaviour change interventions: development of a mode of delivery ontology |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7993627/ https://www.ncbi.nlm.nih.gov/pubmed/33824909 http://dx.doi.org/10.12688/wellcomeopenres.15906.2 |
work_keys_str_mv | AT marquesmartam deliveringbehaviourchangeinterventionsdevelopmentofamodeofdeliveryontology AT careyracheln deliveringbehaviourchangeinterventionsdevelopmentofamodeofdeliveryontology AT norrisemma deliveringbehaviourchangeinterventionsdevelopmentofamodeofdeliveryontology AT evansfiona deliveringbehaviourchangeinterventionsdevelopmentofamodeofdeliveryontology AT finnertyailbhen deliveringbehaviourchangeinterventionsdevelopmentofamodeofdeliveryontology AT hastingsjanna deliveringbehaviourchangeinterventionsdevelopmentofamodeofdeliveryontology AT jenkinsella deliveringbehaviourchangeinterventionsdevelopmentofamodeofdeliveryontology AT johnstonmarie deliveringbehaviourchangeinterventionsdevelopmentofamodeofdeliveryontology AT westrobert deliveringbehaviourchangeinterventionsdevelopmentofamodeofdeliveryontology AT michiesusan deliveringbehaviourchangeinterventionsdevelopmentofamodeofdeliveryontology |