Cargando…

Streamlining Systematic Reviews: Harnessing Large Language Models for Quality Assessment and Risk-of-Bias Evaluation

This editorial explores the innovative application of large language Models (LLMs) in conducting systematic reviews, specifically focusing on quality assessment and risk-of-bias evaluation. As integral components of systematic reviews, these tasks traditionally require extensive human effort, subjec...

Descripción completa

Detalles Bibliográficos
Autores principales: Nashwan, Abdulqadir J, Jaradat, Jaber H
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Cureus 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10478591/
https://www.ncbi.nlm.nih.gov/pubmed/37674957
http://dx.doi.org/10.7759/cureus.43023
_version_ 1785101386847879168
author Nashwan, Abdulqadir J
Jaradat, Jaber H
author_facet Nashwan, Abdulqadir J
Jaradat, Jaber H
author_sort Nashwan, Abdulqadir J
collection PubMed
description This editorial explores the innovative application of large language Models (LLMs) in conducting systematic reviews, specifically focusing on quality assessment and risk-of-bias evaluation. As integral components of systematic reviews, these tasks traditionally require extensive human effort, subjectivity, and time. Integrating LLMs can revolutionize this process, providing an objective, consistent, and rapid methodology for quality assessment and risk-of-bias evaluation. With their ability to comprehend context, predict semantic relationships, and extract relevant information, LLMs can effectively appraise study quality and risk of bias. However, careful consideration must be given to potential risks and limitations associated with over-reliance on machine learning models and inherent biases in training data. An optimal balance and combination between human expertise and automated LLM evaluation might offer the most effective approach to advance and streamline the field of evidence synthesis.
format Online
Article
Text
id pubmed-10478591
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Cureus
record_format MEDLINE/PubMed
spelling pubmed-104785912023-09-06 Streamlining Systematic Reviews: Harnessing Large Language Models for Quality Assessment and Risk-of-Bias Evaluation Nashwan, Abdulqadir J Jaradat, Jaber H Cureus Healthcare Technology This editorial explores the innovative application of large language Models (LLMs) in conducting systematic reviews, specifically focusing on quality assessment and risk-of-bias evaluation. As integral components of systematic reviews, these tasks traditionally require extensive human effort, subjectivity, and time. Integrating LLMs can revolutionize this process, providing an objective, consistent, and rapid methodology for quality assessment and risk-of-bias evaluation. With their ability to comprehend context, predict semantic relationships, and extract relevant information, LLMs can effectively appraise study quality and risk of bias. However, careful consideration must be given to potential risks and limitations associated with over-reliance on machine learning models and inherent biases in training data. An optimal balance and combination between human expertise and automated LLM evaluation might offer the most effective approach to advance and streamline the field of evidence synthesis. Cureus 2023-08-06 /pmc/articles/PMC10478591/ /pubmed/37674957 http://dx.doi.org/10.7759/cureus.43023 Text en Copyright © 2023, Nashwan et al. https://creativecommons.org/licenses/by/3.0/This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Healthcare Technology
Nashwan, Abdulqadir J
Jaradat, Jaber H
Streamlining Systematic Reviews: Harnessing Large Language Models for Quality Assessment and Risk-of-Bias Evaluation
title Streamlining Systematic Reviews: Harnessing Large Language Models for Quality Assessment and Risk-of-Bias Evaluation
title_full Streamlining Systematic Reviews: Harnessing Large Language Models for Quality Assessment and Risk-of-Bias Evaluation
title_fullStr Streamlining Systematic Reviews: Harnessing Large Language Models for Quality Assessment and Risk-of-Bias Evaluation
title_full_unstemmed Streamlining Systematic Reviews: Harnessing Large Language Models for Quality Assessment and Risk-of-Bias Evaluation
title_short Streamlining Systematic Reviews: Harnessing Large Language Models for Quality Assessment and Risk-of-Bias Evaluation
title_sort streamlining systematic reviews: harnessing large language models for quality assessment and risk-of-bias evaluation
topic Healthcare Technology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10478591/
https://www.ncbi.nlm.nih.gov/pubmed/37674957
http://dx.doi.org/10.7759/cureus.43023
work_keys_str_mv AT nashwanabdulqadirj streamliningsystematicreviewsharnessinglargelanguagemodelsforqualityassessmentandriskofbiasevaluation
AT jaradatjaberh streamliningsystematicreviewsharnessinglargelanguagemodelsforqualityassessmentandriskofbiasevaluation