Cargando…

Ghost in the machine or monkey with a typewriter—generating titles for Christmas research articles in The BMJ using artificial intelligence: observational study

OBJECTIVE: To determine whether artificial intelligence (AI) can generate plausible and engaging titles for potential Christmas research articles in The BMJ. DESIGN: Observational study. SETTING: Europe, Australia, and Africa. PARTICIPANTS: 1 AI technology (Generative Pre-trained Transformer 3, GPT-...

Descripción completa

Detalles Bibliográficos
Autores principales: Marlow, Robin, Wood, Dora
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BMJ Publishing Group Ltd. 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8684048/
https://www.ncbi.nlm.nih.gov/pubmed/34911737
http://dx.doi.org/10.1136/bmj-2021-067732
_version_ 1784617537427734528
author Marlow, Robin
Wood, Dora
author_facet Marlow, Robin
Wood, Dora
author_sort Marlow, Robin
collection PubMed
description OBJECTIVE: To determine whether artificial intelligence (AI) can generate plausible and engaging titles for potential Christmas research articles in The BMJ. DESIGN: Observational study. SETTING: Europe, Australia, and Africa. PARTICIPANTS: 1 AI technology (Generative Pre-trained Transformer 3, GPT-3) and 25 humans. MAIN OUTCOME MEASURES: Plausibility, attractiveness, enjoyability, and educational value of titles for potential Christmas research articles in The BMJ generated by GPT-3 compared with historical controls. RESULTS: AI generated titles were rated at least as enjoyable (159/250 responses (64%) v 346/500 responses (69%); odds ratio 0.9, 95% confidence interval 0.7 to 1.2) and attractive (176/250 (70%) v 342/500 (68%); 1.1, 0.8 to 1.4) as real control titles, although the real titles were rated as more plausible (182/250 (73%) v 238/500 (48%); 3.1, 2.3 to 4.1). The AI generated titles overall were rated as having less scientific or educational merit than the real controls (146/250 (58%) v 193/500 (39%); 2.0, 1.5 to 2.6); this difference, however, became non-significant when humans curated the AI output (146/250 (58%) v 123/250 (49%); 1.3, 1.0 to 1.8). Of the AI generated titles, the most plausible was “The association between belief in conspiracy theories and the willingness to receive vaccinations,” and the highest rated was “The effects of free gourmet coffee on emergency department waiting times: an observational study.” CONCLUSIONS: AI can generate plausible, entertaining, and scientifically interesting titles for potential Christmas research articles in The BMJ; as in other areas of medicine, performance was enhanced by human intervention.
format Online
Article
Text
id pubmed-8684048
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher BMJ Publishing Group Ltd.
record_format MEDLINE/PubMed
spelling pubmed-86840482021-12-29 Ghost in the machine or monkey with a typewriter—generating titles for Christmas research articles in The BMJ using artificial intelligence: observational study Marlow, Robin Wood, Dora BMJ Research OBJECTIVE: To determine whether artificial intelligence (AI) can generate plausible and engaging titles for potential Christmas research articles in The BMJ. DESIGN: Observational study. SETTING: Europe, Australia, and Africa. PARTICIPANTS: 1 AI technology (Generative Pre-trained Transformer 3, GPT-3) and 25 humans. MAIN OUTCOME MEASURES: Plausibility, attractiveness, enjoyability, and educational value of titles for potential Christmas research articles in The BMJ generated by GPT-3 compared with historical controls. RESULTS: AI generated titles were rated at least as enjoyable (159/250 responses (64%) v 346/500 responses (69%); odds ratio 0.9, 95% confidence interval 0.7 to 1.2) and attractive (176/250 (70%) v 342/500 (68%); 1.1, 0.8 to 1.4) as real control titles, although the real titles were rated as more plausible (182/250 (73%) v 238/500 (48%); 3.1, 2.3 to 4.1). The AI generated titles overall were rated as having less scientific or educational merit than the real controls (146/250 (58%) v 193/500 (39%); 2.0, 1.5 to 2.6); this difference, however, became non-significant when humans curated the AI output (146/250 (58%) v 123/250 (49%); 1.3, 1.0 to 1.8). Of the AI generated titles, the most plausible was “The association between belief in conspiracy theories and the willingness to receive vaccinations,” and the highest rated was “The effects of free gourmet coffee on emergency department waiting times: an observational study.” CONCLUSIONS: AI can generate plausible, entertaining, and scientifically interesting titles for potential Christmas research articles in The BMJ; as in other areas of medicine, performance was enhanced by human intervention. BMJ Publishing Group Ltd. 2021-12-15 /pmc/articles/PMC8684048/ /pubmed/34911737 http://dx.doi.org/10.1136/bmj-2021-067732 Text en © Author(s) (or their employer(s)) 2019. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ. https://creativecommons.org/licenses/by-nc/4.0/This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/ (https://creativecommons.org/licenses/by-nc/4.0/) .
spellingShingle Research
Marlow, Robin
Wood, Dora
Ghost in the machine or monkey with a typewriter—generating titles for Christmas research articles in The BMJ using artificial intelligence: observational study
title Ghost in the machine or monkey with a typewriter—generating titles for Christmas research articles in The BMJ using artificial intelligence: observational study
title_full Ghost in the machine or monkey with a typewriter—generating titles for Christmas research articles in The BMJ using artificial intelligence: observational study
title_fullStr Ghost in the machine or monkey with a typewriter—generating titles for Christmas research articles in The BMJ using artificial intelligence: observational study
title_full_unstemmed Ghost in the machine or monkey with a typewriter—generating titles for Christmas research articles in The BMJ using artificial intelligence: observational study
title_short Ghost in the machine or monkey with a typewriter—generating titles for Christmas research articles in The BMJ using artificial intelligence: observational study
title_sort ghost in the machine or monkey with a typewriter—generating titles for christmas research articles in the bmj using artificial intelligence: observational study
topic Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8684048/
https://www.ncbi.nlm.nih.gov/pubmed/34911737
http://dx.doi.org/10.1136/bmj-2021-067732
work_keys_str_mv AT marlowrobin ghostinthemachineormonkeywithatypewritergeneratingtitlesforchristmasresearcharticlesinthebmjusingartificialintelligenceobservationalstudy
AT wooddora ghostinthemachineormonkeywithatypewritergeneratingtitlesforchristmasresearcharticlesinthebmjusingartificialintelligenceobservationalstudy