A proof-of-concept study of surgical-VLM for surgical support in robotic surgery: contextual benchmarking against ChatGPT-5

Vasey B, Lippert KAN, Khan DZ, Ibrahim M, Koh CH, Layard Horsfall H, et al. Intraoperative applications of artificial intelligence in robotic surgery: a scoping review of current development stages and levels of autonomy. Ann Surg. 2023;278:896–903.

Article  PubMed  Google Scholar 

Erdem O, Canbak T, Acar A, Başak F. Beyond the hype: mapping the evolution of Artificial Intelligence in general surgery through two decades of bibliometrics. World J Surg. 2025;49:3402–9.

Article  PubMed  Google Scholar 

Furube T, Kawakubo H, Takeuchi M, Ikeda J, Matsuda S, Kitagawa Y. Real-time AI-based detection of excessive traction on the recurrent laryngeal nerve during robot-assisted minimally invasive esophagectomy: a proof-of-concept study. Int J Surg. 2025;111:7336–40.

Article  PubMed  PubMed Central  Google Scholar 

Takeuchi M, Collins T, Lipps C, Haller M, Uwineza J, Okamoto N, et al. Towards automatic verification of the critical view of the myopectineal orifice with Artificial Intelligence. Surg Endosc. 2023;37:4525–34.

Article  PubMed  Google Scholar 

Ikeda J, Takeuchi M, Kawakubo H, Yura M, Kinoshita T, Morito A, et al. Assessment of AI-driven anatomical recognition in robotic gastrectomy: a multicenter retrospective analysis. Surg Endosc. 2025;39:8349–56.

Article  PubMed  Google Scholar 

Nakamura T, Kobayashi N, Kumazu Y, Fukata K, Murakami M, Kohno S, et al. Precise highlighting of the pancreas by semantic segmentation during robot-assisted gastrectomy: visual assistance with Artificial Intelligence for surgeons. Gastric Cancer. 2024;27:869–75.

Article  PubMed  Google Scholar 

Kumazu Y, Kobayashi N, Kitamura N, Rayan E, Neculoiu P, Misumi T, et al. Automated segmentation by deep learning of loose connective tissue fibers to define safe dissection planes in robot-assisted gastrectomy. Sci Rep. 2021. https://doi.org/10.1038/s41598-021-00557-3.

Article  PubMed  PubMed Central  Google Scholar 

Takeuchi M, Collins T, Ndagijimana A, Kawakubo H, Kitagawa Y, Marescaux J, et al. Automatic surgical phase recognition in laparoscopic inguinal hernia repair with Artificial Intelligence. Hernia. 2022;26:1669–78.

Article  CAS  PubMed  Google Scholar 

Takeuchi M, Kawakubo H, Tsuji T, Maeda Y, Matsuda S, Fukuda K, et al. Evaluation of surgical complexity by automated surgical process recognition in robotic distal gastrectomy using Artificial Intelligence. Surg Endosc. 2023;37:4517–24.

Article  PubMed  PubMed Central  Google Scholar 

Tomita K, Takeuchi M, Maxwell JE, Snyder RA, Kim MP, Tran Cao HS, et al. Automated surgical phase recognition for robotic pancreatoduodenectomy using artificial intelligence. Br J Surg. 2025. https://doi.org/10.1093/bjs/znaf160.

Article  PubMed  Google Scholar 

Gomez-Cabello CA, Borna S, Pressman SM, Haider SA, Forte AJ. Large language models for intraoperative decision support in plastic surgery: a comparison between ChatGPT-4 and Gemini. Medicina (Kaunas). 2024. https://doi.org/10.3390/medicina60060957.

Article  PubMed  PubMed Central  Google Scholar 

Bereuter JP, Geissler ME, Klimova A, Steiner RP, Pfeiffer K, Kolbinger FR, et al. Benchmarking vision capabilities of Large Language Models in surgical examination questions. J Surg Educ. 2025;82:103442.

Article  PubMed  Google Scholar 

Yaoqian Li, Xikai Yang, Dunyuan Xu, Yang Yu, Litao Zhao, Xiaowei Hu, et al. SurgPub-Video: a comprehensive surgical video dataset forenhanced surgical intelligence in vision-language model. arxiv. 2025.

Zeng Z, Zhuo Z, Jia X, Zhang E, et al. SurgVLM: a large vision-language model and systematic evaluation benchmark for surgical intelligence. arxiv. 2025.

Stueker EH, Kolbinger FR, Saldanha OL, Digomann D, Pistorius S, Oehme F, et al. Vision-language models for automated video analysis and documentation in laparoscopic surgery: a proof-of-concept study. Int J Surg. 2025;111:7777–86.

Article  PubMed  PubMed Central  Google Scholar 

Tokunaga M, Yoshikawa T, Boku N, Nishida Y, Tanahashi T, Yamada T, et al. Impact of COVID-19 on gastric cancer treatment in Japanese high-volume centers: a JCOG stomach cancer study group survey. Surg Today. 2022;52:231–8.

Article  CAS  PubMed  Google Scholar 

Yoshikawa T, Katai H. Evidence of gastric cancer surgery established from the clinical trials of Japanese Clinical Oncology Group. Gan To Kagaku Ryoho. 2018;45:1396–9.

PubMed  Google Scholar 

Akiyama Y, Katai H, Kitabayashi R, Nunobe S, Koeda K, Yura M, et al. Frequency of lymph node metastasis according to tumor location in clinical T1 early gastric cancer: supplementary analysis of the Japan Clinical Oncology Group study (JCOG0912). J Gastroenterol. 2023;58:519–26.

Article  CAS  PubMed  Google Scholar 

Patel AK, Sethi NS, Park H. Gastric cancer: a review. JAMA. 2026;335:439–50.

Article  CAS  PubMed  Google Scholar 

Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15:155–63.

Article  PubMed  PubMed Central  Google Scholar 

Khaled S, Tao T, Wei-Hung W, Tanno R, David Stutz, Ellery Wulczyn, et al. Capabilities of Gemini Models in Medicine. arxiv. 2024.

Singhal K, Azizi S, Tu T, Mahdavi SS, Wei J, Chung HW, et al. Large language models encode clinical knowledge. Nature. 2023;620:172–80.

Article  CAS  PubMed  PubMed Central  Google Scholar 

Chen JH, Pradarelli AA, Evans J, Matusko N, Naughton NN, Phitayakorn R, et al. Barriers and facilitators to surgical trainee psychological safety. JAMA Netw Open. 2025;8:e2534462.

Article  PubMed  PubMed Central  Google Scholar 

Hartman V, Zhang X, Poddar R, McCarty M, Fortenko A, Sholle E, et al. Developing and evaluating large language model-generated emergency medicine handoff notes. JAMA Netw Open. 2024;7:e2448723.

Article  PubMed  PubMed Central  Google Scholar 

Yu E, Rosenberg GM, Udelsman BV, Harano T, Atay SM, Kim AW, et al. Narrative review of the ethics of artificial intelligence: are we ready for artificial intelligence in surgery? J Thorac Dis. 2026;18:173.

Article  PubMed  PubMed Central  Google Scholar 

Comments (0)

No login
gif