LinkedIn

 آمار

تعداد نشریات21
تعداد شماره‌ها1,304
تعداد مقالات11,933
تعداد مشاهده مقاله83,483,235
تعداد دریافت فایل اصل مقاله122,196,915
KAMBOOZIA, KIARASH, HANNANI, SEDIGHEH, SARRAF SHAHRI, NAZANIN, BARZEGAR, ZEYNAB, ZARIF GHASEMIAN, SAEID. (1405). Artificial Intelligence–Based Computer Vision Feedback to Improve Clinical Performance in Surgical Technology Education. سامانه مدیریت نشریات علمی, 14(4), 364-377. doi: 10.30476/jamp.2026.111362.2415
KIARASH KAMBOOZIA; SEDIGHEH HANNANI; NAZANIN SARRAF SHAHRI; ZEYNAB BARZEGAR; SAEID ZARIF GHASEMIAN. "Artificial Intelligence–Based Computer Vision Feedback to Improve Clinical Performance in Surgical Technology Education". سامانه مدیریت نشریات علمی, 14, 4, 1405, 364-377. doi: 10.30476/jamp.2026.111362.2415
KAMBOOZIA, KIARASH, HANNANI, SEDIGHEH, SARRAF SHAHRI, NAZANIN, BARZEGAR, ZEYNAB, ZARIF GHASEMIAN, SAEID. (1405). 'Artificial Intelligence–Based Computer Vision Feedback to Improve Clinical Performance in Surgical Technology Education', سامانه مدیریت نشریات علمی, 14(4), pp. 364-377. doi: 10.30476/jamp.2026.111362.2415
KAMBOOZIA, KIARASH, HANNANI, SEDIGHEH, SARRAF SHAHRI, NAZANIN, BARZEGAR, ZEYNAB, ZARIF GHASEMIAN, SAEID. Artificial Intelligence–Based Computer Vision Feedback to Improve Clinical Performance in Surgical Technology Education. سامانه مدیریت نشریات علمی, 1405; 14(4): 364-377. doi: 10.30476/jamp.2026.111362.2415

Artificial Intelligence–Based Computer Vision Feedback to Improve Clinical Performance in Surgical Technology Education

Journal of Advances in Medical Education & Professionalism
دوره 14، شماره 4، دی 2026، صفحه 364-377    اصل مقاله (1.71 M)
نوع مقاله: Original Article
شناسه دیجیتال (DOI): 10.30476/jamp.2026.111362.2415
نویسندگان
KIARASH KAMBOOZIA* 1؛ SEDIGHEH HANNANI1؛ NAZANIN SARRAF SHAHRI1، 2؛ ZEYNAB BARZEGAR3؛ SAEID ZARIF GHASEMIAN3
1Department of Operating Room, Faculty of Allied Health Medicine, Iran University of Medical Sciences, Tehran, Iran
2Center for Educational Research in Medical Science (CERMS), Department of Medical Education, School of Medicine, Iran University of Medical Sciences, Tehran, Iran
3Department of Artificial Intelligence in Medicine, Faculty of Advanced Technologies in Medicine, Iran University of Medical Sciences, Tehran, Iran
چکیده
Introduction: Advancements in artificial intelligence (AI) and computer vision offer new opportunities to improve clinical skills training. This study developed a real-time, AI-based computer vision system for detecting surgical instruments and evaluated its association with clinical performance among surgical technology students.
Methods: A quasi-experimental pre-test/post-test study with a control group was conducted among 48 eligible surgical technology students at Iran University of Medical Sciences during the 2025–2026 academic year. Participants who met the predefined inclusion criteria were enrolled using census sampling. Following ethics approval (IR.IUMS.REC.1403.928), the participants were allocated to an intervention group (n=31), which received immediate AI-generated visual feedback after each instrument arrangement task, and a control group (n=17), which received routine instructor-led training without AI feedback. A YOLOv8-based deep learning model was trained using transfer learning on annotated images of surgical table setups. Clinical performance was assessed using a validated observational checklist (CVI=0.90; Cronbach’s α=0.87). Data were analyzed using analysis of covariance (ANCOVA), the Wilcoxon signed-rank test, Spearman’s correlation, and the intraclass correlation coefficient (ICC) in SPSS version 27. All 48 participants completed the study (attrition rate=0%).
Results: The AI model achieved excellent object detection performance (precision=0.974, recall=0.979, mAP@0.5=0.981, mAP@0.5:0.95=0.808), with an average inference time of 1.6 seconds per image. Clinical performance was significantly higher following AI-assisted feedback (Wilcoxon signed-rank test, Z=−4.879, p<0.001, r=0.88). After adjustment for baseline performance using ANCOVA, AI-assisted feedback was associated with higher post-intervention performance scores than conventional training (F (1,45)=19.51, p<0.001, partial η²=0.302). Excellent agreement was observed between AI-generated assessments and expert human ratings (ICC=0.984).
Conclusions: Real-time, AI-based computer vision feedback was associated with improved surgical instrument arrangement performance among surgical technology students while providing an objective and reliable assessment of practical skills. The proposed system represents a promising proof-of-concept educational tool for simulation-based training and competency assessment and may complement conventional instructional approaches in surgical technology education.

تازه های تحقیق
کلیدواژه‌ها
Artificial intelligence؛ Surgical instrument؛ Medical education
مراجع
  1. Thacharodi A, Singh P, Meenatchi R, Ahmed ZHT, Kumar RSR, Neha V, et al. Revolutionizing healthcare and medicine: The impact of modern technologies for a healthier future-A comprehensive review. Health Care Sci. 2024;3(5):329-49.
  2. Jafari F, Keykha A, Taheriankalati A, Taghavi Monfared A. The Role of AI in Shaping Medical Education: Insights from an Umbrella Review of Review Studies. J Adv Med Educ Prof. 2025;13(4):270-93.
  3. Bohr A, Memarzadeh K. The rise of artificial intelligence in healthcare applications. Artificial Intelligence in Healthcare. 2020;26:25-60.
  4. Bhattacharya S, Reddy Maddikunta KP, Pham QV, Reddy Gadekallu T, Krishnan SRS, Chowdhary CL, et al. Deep learning and medical image processing for coronavirus (COVID-19) pandemic: A survey. Sustainable Cities and Society. 2021;65:102589.
  5. Ward TM, Mascagni P, Ban Y, Rosman G, Padoy N, Meireles O, et al. Computer vision in surgery. Surgery. 2021;169(5):1253-6.
  6. Kabir MM, Rahman A, Hasan MdN, Mridha MF. Computer vision algorithms in healthcare: Recent advancements and future challenges. Computers in Biology and Medicine. 2025;185:109531.
  7. Li J, Guan Z, Wang J, Cheung CY, Zheng Y, Lim LL, et al. Integrated image-based deep learning and language models for primary diabetes care. Nat Med. 2024;30:2886–96.
  8. Castillo-Segura P, Panadero CF, Alario-Hoyos C, Muñoz-Merino PJ, Kloos CD. Objective and automated assessment of surgical technical skills with IoT systems: A systematic literature review. Artificial Intelligence in Medicine. 2021;112:102007.
  9. Kostiuchik G, Lalith Sh, Benedikt M, Ivo W, Bernhard P, Sandy E. Surgical phase and instrument recognition: how to identify appropriate dataset splits. International Journal of Computer Assisted Radiology and Surgery. 2024;19:699-711.
  10. Graëff C, Padoy N, Liverneaux P, Lampert T. Introducing surgical workflow recognition in orthopaedic surgery with timestamp supervision. Comput Biol Med. 2025;197(Pt A):110995.
  11. Ramesh S, Dall’Alba D, Gonzalez C, Yu T, Mascagni P, Mutter D, et al. Weakly Supervised Temporal Convolutional Networks for Fine-Grained Surgical Activity Recognition. IEEE Transactions on Medical Imaging. 2023;10:1109.
  12. Yunlong L, Zhao Z, Li R, Li F. Deep learning for surgical workflow analysis: a survey of progresses, limitations, and trends. Artificial Intelligence Review. 2024;57:10.
  13. Oza RS, Mehta MA, Kotecha K, Lin JCW. Analytics of deep model-based spatiotemporal and spatial feature learning methods for surgical action classification. Multimedia Tools and Applications. 2024;83(17):52275-303.
  14. van Amsterdam B, Funke I, Edwards E, Speidel S, Collins J, Sridhar A, et al. Gesture Recognition in Robotic Surgery With Multimodal Attention. IEEE Trans Med Imaging. 2022;41(7):1677-87.
  15. Wang T, Jin M, Li M. Towards accurate and interpretable surgical skill assessment: a video-based method for skill score prediction and guiding feedback generation. International Journal of Computer Assisted Radiology and Surgery. 2021;16(9):1595-1605.
  16. Amirafzali Nasab M, Nouhi E. The impact of simulated operating rooms in a clinical skill center on operating room students’ skills and satisfaction: A semi experimental study. J Med Edu Dev. 2024;17(55):31-39.
  17. Hannani S, Sadati L, Sarraf shahri N, Arab Khazaei A, Arab Khazaei A, Kamboozia K, et al . Investigating the Effect of the Task-Based Educational Method on Operating Room Technologist Students Speed of Action in Iran University of Medical Sciences. Paramedical Sciences and Military Health. 2022;17(2):37-44.
  18. Seshabela HD, Shakwane S. Impact of anxiety-related conditions on nursing students' academic excellence. Curationis. 2024;47(1):e1-e10.
  19. Sadati L, Askarkhah A, Hannani S, Moazamfard M, Abedinzade M, Mohammad Alinejad P, et al. Assessment of Staff Performance in CSSD Unit by 360 Degree Evaluation Method. Asia Pacific Journal of Health Management. 2020;15:71-7.
  20. Elendu C, Amaechi DC, Okatta AU, Amaechi EC, Elendu TC, Ezeh CP, et al. The impact of simulation-based training in medical education: A review. Medicine (Baltimore). 2024;103(27):e38813.
  21. Aziz S, Hameed M, Azeez S, Omer Sh, Ameen K, Abdullah T, et al. Challenges in student assessment in medical and health sciences education in Northern Iraq. BMC Med Educ. 2025;25(1):1052.
  22. Khadivzadeh T, Farrokhi F. A study of the strengths and weaknesses of clinical education from the perspective of students of day and evening courses at the Faculty of Nursing and Midwifery of Mashhad in 2003. Iranian Journal of Education in Medical Sciences. 2003;3(Special Issue 10):67-68.
  23. Berg M, Dahlin LB, Kjellman M. Overview of surgical training and assessment of surgical skills: a narrative review. Front Surg. 2025;12:1605495.
  24. Guerrero JG, Alqarni AS, Estadilla LT, Benjamin LS, Rani VI. Raters and examinees training for objective structured clinical examination: comparing the effectiveness of three instructional methodologies. BMC Nurs. 2024;23(1):500.
  25. Hussein AA, Dibaj Sh, Hinata N, Field E, O'leary d K, Kuvshinoff B, et al. Development and Validation of a Quality Assurance Score for Robot-assisted Radical Cystectomy: A 10-year Analysis. Urology. 2016;97:124-9.
  26. Morineau T, Riffaud L, Morandi X, Villain J, Jannin P. Work domain constraints for modelling surgical performance. Int J Comput Assist Radiol Surg. 2015;10(10):1589-97.
  27. Zia A, Essa I. Automated surgical skill assessment in RMIS training. Int J Comput Assist Radiol Surg. 2018;13(5):731-9.
  28. Goh AC, Goldfarb DW, Sander JC, Miles BJ, Dunkin BJ. Global evaluative assessment of robotic skills: validation of a clinical assessment tool to measure robotic surgical skills. J Urol. 2012;187(1):247-52.
  29. Khan H, Kozlowski JD, Hussein AA, Sharif M, Ahmed Y, May P, et al. Use of Robotic Anastomosis Competency Evaluation (RACE) for assessment of surgical competency during urethrovesical anastomosis. Canadian Urological Association Journal. 2018;13(1):E10-E16.
  30. O'Regan DJ, Caddy C, Rajandram R, Barach P. A Scoping Review of the Objective Structured Assessment of Technical Surgical Skills (OSATS). J Surg Educ. 2026;83(6):103946.
  31. Stan C, Ujvary PL, Blebea C, Tănase MI, Tănase M, Pop SS, et al. Hand Motion Analysis Using Accelerometer-Based Sensors and Sheep's Head Model for Basic Training in Functional Endoscopic Sinus Surgery. Cureus. 2024;16(5):e59725.
  32. Roos LG, Slavich GM. Wearable technologies for health research: Opportunities, limitations, and practical and conceptual considerations. Brain Behav Immun. 2023;113:444-52.
  33. Canali S, Schiaffonati V, Aliverti A. Challenges and recommendations for wearable devices in digital health: Data quality, interoperability, health equity, fairness. PLOS Digit Health. 2022;1(10):e0000104.
  34. Pan M, Wang S, Li J, Li J, Yang X, Liang K. An Automated Skill Assessment Framework Based on Visual Motion Signals and a Deep Neural Network in Robot-Assisted Minimally Invasive Surgery. Sensors (Basel). 2023;23(9):4496.
  35. Zia A, Sharma Y, Bettadapura V, Sarin EL, Essa I. Video and accelerometer-based motion analysis for automated surgical skills assessment. Int J Comput Assist Radiol Surg. 2018;13(3):443-55.
  36. Hamza H, & Shabir D, Aboumarzouk O, Al-Ansari A, Shaban Kh, Navkar N. Automated skills assessment in open surgery: A scoping review. Engineering Applications of Artificial Intelligence. 2025;153:110893.
  37. Mukaka MM. Statistics Corner: A guide to appropriate use of Correlation coefficient in medical research. Malawi medical journal: the journal of Medical Association of Malawi. 2012;24(3):69-71.
  38. Barzegar M, Boushehri E, Amini M, Faghihi SA, Zarifsanaiey N, Daneshvar M. What Happened to Simulation-Based Education in Outpatient Setting in The 21stCentury: A Scoping Review. J Adv Med Educ Prof. 2024;12(2):69-78.
  39. Oh J. Artificial intelligence-driven real-time assistance in minimally invasive surgery: a technology-oriented narrative review. J Minim Invasive Surg. 2026;29(2):70-81.
  40. Choudhry O, Ali Sh, Biyani CS, Dominic J. Real-Time Tool Detection in Laparoscopic Datasets for Surgical Training in Low-Resource Settings. Healthcare Technology Letters. 2025;12(1):e70045.
  41. Wang Y, He G, Ahmed MF. A Real-Time Laparoscopic Surgical Instrument Detection System Based on YOLOv5. 2024 IEEE International Conference on Robotics and Biomimetics (ROBIO), China; 2024. pp. 1-6.
  42. Bajraktari F, Fleissner K, Pott P. A comparison of two CNN-based instrument detection approaches for automated surgical assistance systems. Current Directions in Biomedical Engineering. 2023;9:599-602.
  43. Gautier B, Tugal H, Tang B, Nabi Gh, Erden MS. Real-Time 3D Tracking of Laparoscopy Training Instruments for Assessment and Feedback. Front Robot AI. 2021;8:751741.
  44. Wiese L, Hinz L, Reithmeier E, Korn Ph, Neuhaus M. Detection of Surgical Instruments Based on Synthetic Training Data. Computers. 2025;14(2):69.
  45. Hashimoto DA, Rosman G, Rus D, Meireles OR. Artificial Intelligence in Surgery: Promises and Perils. Ann Surg. 2018;268(1):70-6.
  46. Fukuta A, Yamashita Sh, Maniwa J, Tamaki A, Kondo T, Kawakubo N, et al. Artificial intelligence facilitates the potential of simulator training: An innovative laparoscopic surgical skill validation system using artificial intelligence technology. Int J Comput Assist Radiol Surg. 2025;20(3):597-603.
  47. Hannani S, Salehi M, Amiri F, Ali Azadi N. Design and Effect of Neurosurgical Educational Software Using Gamification on Students' Learning and Motivation. J Adv Med Educ Prof. 2024;12(3):189-98.
  48. Ghasemi S, Imani B, Jafarkhani A, Hosseinefard H. Roles of Two Learning Methods in the Perceived Competence of Surgery and Quality of Teaching: A Quasi-experimental Study among Operating Room Nursing Students. J Adv Med Educ Prof. 2024;12(3):180-88.
آمار
تعداد مشاهده مقاله: 2
تعداد دریافت فایل اصل مقاله: 1


سامانه مدیریت نشریات علمی. قدرت گرفته از سیناوب