Cargando…
Ghost in the machine or monkey with a typewriter—generating titles for Christmas research articles in The BMJ using artificial intelligence: observational study
OBJECTIVE: To determine whether artificial intelligence (AI) can generate plausible and engaging titles for potential Christmas research articles in The BMJ. DESIGN: Observational study. SETTING: Europe, Australia, and Africa. PARTICIPANTS: 1 AI technology (Generative Pre-trained Transformer 3, GPT-...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
BMJ Publishing Group Ltd.
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8684048/ https://www.ncbi.nlm.nih.gov/pubmed/34911737 http://dx.doi.org/10.1136/bmj-2021-067732 |
_version_ | 1784617537427734528 |
---|---|
author | Marlow, Robin Wood, Dora |
author_facet | Marlow, Robin Wood, Dora |
author_sort | Marlow, Robin |
collection | PubMed |
description | OBJECTIVE: To determine whether artificial intelligence (AI) can generate plausible and engaging titles for potential Christmas research articles in The BMJ. DESIGN: Observational study. SETTING: Europe, Australia, and Africa. PARTICIPANTS: 1 AI technology (Generative Pre-trained Transformer 3, GPT-3) and 25 humans. MAIN OUTCOME MEASURES: Plausibility, attractiveness, enjoyability, and educational value of titles for potential Christmas research articles in The BMJ generated by GPT-3 compared with historical controls. RESULTS: AI generated titles were rated at least as enjoyable (159/250 responses (64%) v 346/500 responses (69%); odds ratio 0.9, 95% confidence interval 0.7 to 1.2) and attractive (176/250 (70%) v 342/500 (68%); 1.1, 0.8 to 1.4) as real control titles, although the real titles were rated as more plausible (182/250 (73%) v 238/500 (48%); 3.1, 2.3 to 4.1). The AI generated titles overall were rated as having less scientific or educational merit than the real controls (146/250 (58%) v 193/500 (39%); 2.0, 1.5 to 2.6); this difference, however, became non-significant when humans curated the AI output (146/250 (58%) v 123/250 (49%); 1.3, 1.0 to 1.8). Of the AI generated titles, the most plausible was “The association between belief in conspiracy theories and the willingness to receive vaccinations,” and the highest rated was “The effects of free gourmet coffee on emergency department waiting times: an observational study.” CONCLUSIONS: AI can generate plausible, entertaining, and scientifically interesting titles for potential Christmas research articles in The BMJ; as in other areas of medicine, performance was enhanced by human intervention. |
format | Online Article Text |
id | pubmed-8684048 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | BMJ Publishing Group Ltd. |
record_format | MEDLINE/PubMed |
spelling | pubmed-86840482021-12-29 Ghost in the machine or monkey with a typewriter—generating titles for Christmas research articles in The BMJ using artificial intelligence: observational study Marlow, Robin Wood, Dora BMJ Research OBJECTIVE: To determine whether artificial intelligence (AI) can generate plausible and engaging titles for potential Christmas research articles in The BMJ. DESIGN: Observational study. SETTING: Europe, Australia, and Africa. PARTICIPANTS: 1 AI technology (Generative Pre-trained Transformer 3, GPT-3) and 25 humans. MAIN OUTCOME MEASURES: Plausibility, attractiveness, enjoyability, and educational value of titles for potential Christmas research articles in The BMJ generated by GPT-3 compared with historical controls. RESULTS: AI generated titles were rated at least as enjoyable (159/250 responses (64%) v 346/500 responses (69%); odds ratio 0.9, 95% confidence interval 0.7 to 1.2) and attractive (176/250 (70%) v 342/500 (68%); 1.1, 0.8 to 1.4) as real control titles, although the real titles were rated as more plausible (182/250 (73%) v 238/500 (48%); 3.1, 2.3 to 4.1). The AI generated titles overall were rated as having less scientific or educational merit than the real controls (146/250 (58%) v 193/500 (39%); 2.0, 1.5 to 2.6); this difference, however, became non-significant when humans curated the AI output (146/250 (58%) v 123/250 (49%); 1.3, 1.0 to 1.8). Of the AI generated titles, the most plausible was “The association between belief in conspiracy theories and the willingness to receive vaccinations,” and the highest rated was “The effects of free gourmet coffee on emergency department waiting times: an observational study.” CONCLUSIONS: AI can generate plausible, entertaining, and scientifically interesting titles for potential Christmas research articles in The BMJ; as in other areas of medicine, performance was enhanced by human intervention. BMJ Publishing Group Ltd. 2021-12-15 /pmc/articles/PMC8684048/ /pubmed/34911737 http://dx.doi.org/10.1136/bmj-2021-067732 Text en © Author(s) (or their employer(s)) 2019. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ. https://creativecommons.org/licenses/by-nc/4.0/This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/ (https://creativecommons.org/licenses/by-nc/4.0/) . |
spellingShingle | Research Marlow, Robin Wood, Dora Ghost in the machine or monkey with a typewriter—generating titles for Christmas research articles in The BMJ using artificial intelligence: observational study |
title | Ghost in the machine or monkey with a typewriter—generating titles for Christmas research articles in The BMJ using artificial intelligence: observational study |
title_full | Ghost in the machine or monkey with a typewriter—generating titles for Christmas research articles in The BMJ using artificial intelligence: observational study |
title_fullStr | Ghost in the machine or monkey with a typewriter—generating titles for Christmas research articles in The BMJ using artificial intelligence: observational study |
title_full_unstemmed | Ghost in the machine or monkey with a typewriter—generating titles for Christmas research articles in The BMJ using artificial intelligence: observational study |
title_short | Ghost in the machine or monkey with a typewriter—generating titles for Christmas research articles in The BMJ using artificial intelligence: observational study |
title_sort | ghost in the machine or monkey with a typewriter—generating titles for christmas research articles in the bmj using artificial intelligence: observational study |
topic | Research |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8684048/ https://www.ncbi.nlm.nih.gov/pubmed/34911737 http://dx.doi.org/10.1136/bmj-2021-067732 |
work_keys_str_mv | AT marlowrobin ghostinthemachineormonkeywithatypewritergeneratingtitlesforchristmasresearcharticlesinthebmjusingartificialintelligenceobservationalstudy AT wooddora ghostinthemachineormonkeywithatypewritergeneratingtitlesforchristmasresearcharticlesinthebmjusingartificialintelligenceobservationalstudy |