Choi JH, Hickman KE, Monahan A, Schwarcz D (2023) ChatGPT goes to law school. SSRN Electron J. 23(3)
Terwiesch C (2023) Would ChatGPT3 get a Wharton MBA? A prediction based on its performance in the operations management course. University of Pennsylvania, Philadelphia, PA
Kung TH, Cheatham M, Medenilla A et al (2023) Performance of ChatGPT on USMLE: potential for AI-assisted medical education using large language models. PLOS Digit Health 2(2):e0000138
Gan RK, Ogbodo JC, Wee YZ, Gan AZ, González PA (2024) Performance of google bard and ChatGPT in mass casualty incidents triage. Am J Emerg Med 75:72–78. https://doi.org/10.1016/j.ajem.2023.10.034
Graefen B, Fazal N (2023) Gpteacher: examining the efficacy of ChatGPT as a tool for public health education. Eur J Edu Stud. 520(8)
Frosolini A, Franz L, Benedetti S et al (2023) Assessing the accuracy of ChatGPT references in head and neck and ENT disciplines. Eur Arch Otorhinolaryngol 280(11):5129–5133. https://doi.org/10.1007/s00405-023-08205-4
Thirunavukarasu AJ, Ting DSJ, Elangovan K et al (2023) Large language models in medicine. Nat Med 29:1930–1940. https://doi.org/10.1038/s41591-023-02448-8
Article CAS PubMed Google Scholar
Liu J, Wang G, Liu S (2023) Utility of ChatGPT in clinical practice. J Med Internet Res 25:e48568. https://doi.org/10.2196/48568
Article PubMed PubMed Central Google Scholar
Akbasli IT, Bayracki B (2023) Balancing caution and innovation: exploring the potential of large language models in critical decision-making. Crit Care 27(4):172. https://doi.org/10.1186/s13054-023-04447-0
Article PubMed PubMed Central Google Scholar
Schukow C, Smith SC, Landgrebe E et al (2024) Application of ChatGPT in routine diagnostic pathology: promises, pitfalls, and potential future directions. Adv Anat Pathol 31(1):15–21. https://doi.org/10.1087/PAP.0000000000000406. (Epub 2023 Jul 27 PMID: 37501829)
Jeyaraman M, Ramasubramanian S, Balaji S et al (2023) ChatGPT in action: harnessing artificial intelligence potential and addressing ethical challenges in medicine, education, and scientific research. World J Methodol 13(8):170–178. https://doi.org/10.5662/wim.v13.4.170.PMID:37771867;PMCID:PMC10523250
Article PubMed PubMed Central Google Scholar
Vaira LA, Lechien JR, Abbate V et al (2023) Accuracy of ChatGPT-generated information on head and neck and oromaxillofacial surgery: a multicenter collaborative analysis. Otolaryngol Head Neck Surg 170:380–390. https://doi.org/10.1002/ohn.488
Lechien JR, Georgescu BM, Hans S, Chiesa-Estomba CM (2024) ChatGPT performance in laryngology and head and neck surgery: a clinical case series. Eur Arch Otorhinolaryngol 281(1):319–333. https://doi.org/10.1007/s00405-023-08282-5. (Epub 2023 Oct 24 PMID: 37874336)
Teixeira-Marques F, Medeiros N, Nazaré F et al (2024) Exploring the role of ChatGPT in clinical decision-making in otorhinolaryngology: a ChatGPT designed study. Eur Arch Otorhinolaryngol. https://doi.org/10.1007/s00405-024-08498-2
Saibene AM, Allevi F, Calvo-Henriquez C et al (2024) Reliability of large language models in managing odontogenic sinusitis clinical scenarios: a preliminary multidisciplinary evaluation. Eur Arch Otorhinolaryngol. https://doi.org/10.1007/s00405-023-08372-4
Article PubMed PubMed Central Google Scholar
Chiesa-Estomba CM, Lechien JR, Vaira LA et al (2023) Exploring the potential of ChatGPT as a supportive tool for sialendoscopy clinical decision making and patient information support. Eur Arch Otorhinolaryngol. https://doi.org/10.1007/s00405-023-08219-y
Puladi B, Gsaxner C, Kleesiek J et al (2024) The impact and opportunities of large language models like ChatGPT in oral and maxillofacial surgery: a narrative review. Int J Oral Maxillofac Surg 53(1):78–88. https://doi.org/10.1016/j.ijom.2023.09.005. (PMID: 37798200)
Article CAS PubMed Google Scholar
AO Surgery Reference (AO Foundation, Switzerland); available at https://surgeryreference.aofoundation.org/cmf/trauma. Accessed on 19 Feb 2025
ChatGPT (OpenAI, California, USA). Available at https://chatgpt.com. Accessed 24 Oct 2024
Google Bard (Google DeepMind, Mountain View, California, US). https://gemini.google.com. Accessed 24 Oct 2024
von Elm E, Altman DG, Egger M et al (2007) The strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. Lancet 370(9596):1453–1457. https://doi.org/10.1016/S0140-6736(07)61602-X
Vaira LA, Lechien JR, Abbate V, Gabriele G, Frosolini A, De Vito A, Maniaci A, Mayo-Yáñez M, Boscolo-Rizzo P, Saibene AM, Maglitto F, Salzano G, Califano G, Troise S, Chiesa-Estomba CM, De Riu G (2025) Enhancing AI Chatbot responses in health care: the SMART prompt structure in head and neck surgery. OTO Open 9(1):e70075. https://doi.org/10.1002/oto2.70075. (PMID:39822375; PMCID:PMC11736147)
Article PubMed PubMed Central Google Scholar
Lechien JR, Maniaci A, Gengler I, Hans S, Chiesa-Estomba CM, Vaira LA (2024) Validity and reliability of an instrument evaluating the performance of intelligent chatbot: the Artificial Intelligence Performance Instrument (AIPI). Eur Arch Otorhinolaryngol 281(4):2063–2079. https://doi.org/10.1007/s00405-023-08219-y. (Epub 2023 Sep 12 PMID: 37698703)
Vaira LA, Lechien JR, Abbate V, Allevi F, Audino G, Beltramini GA, Bergonzani M, Boscolo-Rizzo P, Califano G, Cammaroto G, Chiesa-Estomba CM, Committeri U, Crimi S, Curran NR, di Bello F, di Stadio A, Frosolini A, Gabriele G, Gengler IM, Lonardi F, Maglitto F, Mayo-Yáñez M, Petrocelli M, Pucci R, Saibene AM, Saponaro G, Tel A, Trabalzini F, Trecca EMC, Vellone V, Salzano G, De Riu G (2024) Validation of the Quality Analysis of Medical Artificial Intelligence (QAMAI) tool: a new tool to assess the quality of health information provided by AI platforms. Eur Arch Otorhinolaryngol 281(11):6123–6131. https://doi.org/10.1007/s00405-024-08710-0
Article PubMed PubMed Central Google Scholar
Al-Ashwal FY, Zawiah M, Gharaibeh L et al (2023) Evaluating the sensitivity, specificity, and accuracy of ChatGPT-3.5, ChatGPT-4, Bing AI, and Bard against conventional drug-drug interactions clinical tools. Drug Healthc Patient Saf 15:137–147. https://doi.org/10.2147/dhps.s425858
Article CAS PubMed PubMed Central Google Scholar
Frosolini A, Catarzi L, Benedetti S et al (2024) The role of large language models (LLMs) in providing triage for maxillofacial trauma cases: a preliminary study. Diagnostics (Basel) 14(8):839. https://doi.org/10.3390/diagnostics14080839
Duong D, Solomon BD (2023) Analysis of large-language model versus human performance for genetics questions. Eur J Hum Genet
Lechien JR, Briganti G, Vaira LA (2024) Accuracy of ChatGPT-3.5 and -4 in providing scientific references in otolaryngology-head and neck surgery. Eur Arch Otorhinolaryngol. https://doi.org/10.1007/s00405-023-08441-8
Article PubMed PubMed Central Google Scholar
Reddy S, Allan S, Coghlan S, Cooper P (2019) A governance model for the application of AI in health care. J Am Med Inform Assoc. https://doi.org/10.1093/jamia/ocz192
Article PubMed Central Google Scholar
Lee D, Yoon SN (2021) Application of artificial intelligence-based technologies in the healthcare industry: opportunities and challenges. Int J Environ Res Public Health 18:271. https://doi.org/10.3390/ijerph18010271
Article PubMed PubMed Central Google Scholar
Rubeis G (2022) The ethics of artificial intelligence and big data in mental healthcare. Internet Interv 28:100518. https://doi.org/10.1016/j.invent.2022.100518
Article PubMed PubMed Central Google Scholar
Bluemke DA (2018) Radiology in 2018: are you working with artificial intelligence or being replaced by artificial intelligence? Radiology 287(2):365–366. https://doi.org/10.1148/radiol.2018184007
McDougall RJ (2019) Computer knows best? The need for value-flexibility in medical artificial intelligence. J Med Ethics 45(3):156–160. https://doi.org/10.1136/medethics-2018-105118
Prakash S, Balaji JN, Joshi A et al (2022) Ethical conundrums in the application of artificial intelligence (AI) in healthcare: a scoping review of reviews. J Pers Med 12(11):1914. https://doi.org/10.3390/jpm12111914
Article PubMed PubMed Central Google Scholar
Balas M, Wadden JJ, Hébert PC et al (2024) Exploring the potential utility of AI large language models for medical ethics: an expert panel evaluation of GPT-4. J Med Ethics 50(2):90–96. https://doi.org/10.1136/jme-2023-109549
Comments (0)