Evaluating human ability to distinguish between ChatGPT-generated and original scientific abstracts

Liebrenz M, Schleifer R, Buadze A, Bhugra D, Smith A (2023) Generating scholarly content with ChatGPT: ethical challenges for medical publishing. The Lancet Digit Health 5(3):e105–e106

Article  CAS  PubMed  Google Scholar 

Yeadon W, Inyang O-O, Mizouri A, Peach A, Testrow CP (2023) The death of the short-form physics essay in the coming AI revolution. Phys Educ 58(3):035027

Article  Google Scholar 

T Susnjak (2022) ChatGPT: The end of online exam integrity? arXiv: 2212.09292

Kung TH et al (2023) Performance of ChatGPT on USMLE: potential for AI-assisted medical education using large language models. PLoS Digit Health 2(2):e0000198

Article  PubMed  PubMed Central  Google Scholar 

Stokel-Walker C (2023) ChatGPT listed as author on research papers: many scientists disapprove. Nature 613(7945):620–621

Article  CAS  PubMed  Google Scholar 

Gao CA et al (2023) Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers. NPJ Digit Med 6(1):75

Article  PubMed  PubMed Central  Google Scholar 

Hakam HT et al (2024) Human-written vs AI-generated texts in orthopedic academic literature: comparative qualitative analysis. JMIR Form Res 8:e52164. https://doi.org/10.2196/52164

Article  PubMed  PubMed Central  Google Scholar 

Qualtrics (2005) [Online]. Available: https://www.qualtrics.com

Ufnalska S, Hartley J (2009) How can we evaluate the quality of abstracts. Eur Sci Ed 35(3):69–72

Google Scholar 

Singh S, Djalilian A, Ali MJ (2023) ChatGPT and ophthalmology: exploring its potential with discharge summaries and operative notes. Seminars in ophthalmology. Taylor & Francis, London, pp 1–5

Google Scholar 

Ali MJ, Singh S (2023) ChatGPT and scientific abstract writing: pitfalls and caution. Graefe’s Archive Clin Exp Ophthalmol, pp 1–2

Babl FE, Babl MP (2023) Generative artificial intelligence: Can ChatGPT write a quality abstract?. Emergency Medicine Australasia

Ariyaratne S, Iyengar KP, Nischal N, Chitti Babu N, Botchu R (2023) “A comparison of ChatGPT-generated articles with human-written articles”. Skelet Radiol:1–4

Haque MA (2022) A brief analysis of “ChatGPT”–a revolutionary tool designed by OpenAI. EAI Endorsed Trans AI Robot 1(1):e15–e15

Article  Google Scholar 

He H (2023)"Robotgpt: from chatgpt to robot intelligence"

Paliwal S, Bharti V, Mishra AK (2020) “Ai chatbots: transforming the digital world.” Recent trends and advances in artificial intelligence and internet of things, pp 455–482

Gilburt I (2023) “A machine in the loop: the peculiar intervention of artificial intelligence in writer’s block.” New Writing, pp 1–12

AP IV (2023) "Major ChatGPT update: AI program no longer restricted to sept. 2021 knowledge cutoff after internet browser revamp." Forbes [Online]. Available: https://www.forbes.com/sites/antoniopequenoiv/2023/09/27/major-chatgpt-update-ai-program-no-longer-restricted-to-sept-2021-knowledge-cutoff-after-internet-browser-revamp/?sh=3e3f81e26e01

Sharma P (2023) Chatbots in medical research: advantages and limitations of artificial intelligence–enabled writing with a focus on ChatGPT as an author. Clin Nucl Med 48(9):838–839

Article  PubMed  Google Scholar 

Goto A, Katanoda K (2023) Should we acknowledge ChatGPT as an author? J Epidemiol, pp JE20230078

Akter S et al (2021) “Algorithmic bias in data-driven innovation in the age of AI,” vol. 60. Elsevier, Amsterdam, pp 102387

Crawford J, Cowling M, Ashton-Hay S, Kelder J-A, Middleton R, Wilson GS (2023) Artificial intelligence and authorship editor policy: ChatGPT, Bard Bing AI, and beyond. J Univ Teach Learn Pract 20(5):1

Google Scholar 

Rosenblatt K (2023) "ChatGPT passes MBA exam given by a Wharton professor,” vol 25, pp 2023

Else H (2023) Abstracts written by ChatGPT fool scientists. Nature 613(7944):423–423

Article  CAS  PubMed  Google Scholar 

Curtis N (2023) To ChatGPT or not to ChatGPT? The impact of artificial intelligence on academic publishing. Pediatr Infect Dis J 42(4):275

Article  PubMed  Google Scholar 

Veldhuizen GP (2022) “The advantages and challenges of leveraging large language models for research papers,” doi: https://doi.org/10.5281/zenodo.7394772.

Zhavoronkov A (2022) Rapamycin in the context of Pascal’s Wager: generative pre-trained transformer perspective. Oncoscience 9:82–84

Article  PubMed  PubMed Central  Google Scholar 

Dwivedi YK et al (2023) “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. Int J Inf Manage 71:102642

Article  Google Scholar 

Sankaran V (2023) Scientific journals ban ChatGPT use by researchers to author studies," Indepedent [Online]. Available: https://www.independent.co.uk/tech/chatgpt-ai-journals-ban-author-b2270334.html

Mollick E (2022) “ChatGPT is a tipping point for AI.” Harvard Business Review

Comments (0)

No login
gif