Design and implementation of assessment scales to improve the acquisition of basic skills in vascular microsurgery.
Abstract
Introduction: The level of competence measures the skills and abilities a student possesses to perform an activity. The objective of this study was to implement two OSATS (Objective Structured Assessment of Technical Skills) scales designed to evaluate micro-surgical competencies in surgical residents who completed a training program in basic microsurgery skills applicable in laboratory and simulation settings. Methodology: This was a descriptive, observational, cross-sectional study conducted between August 2018 and March 2019, including a sample of 29 residents. A formative methodology was used for the acquisition of technical microsurgical skills. Two evaluation scales (OSATS M1.5 and OSATS M2-0) were designed as measurement instruments and applied over five sessions: session 1 (diagnostic test), sessions 2, 3, and 4 (formative), and session 5 (final evaluation to assess the impact of the strategy on performance). Results: In session 1, 13.79% of residents showed low performance and 86.21% showed medium performance. During the formative sessions (2, 3, and 4), 68.97% achieved high performance, 31.03% medium, and there was no low performance. In session 5, 75.86% had high performance and 24.14% medium. The positive vascular patency test increased from 34.48% in session 1 to 79.31% in session 5. Conclusion: The creation and implementation of the OSATS evaluation scales allow effective monitoring of performance, demonstrating significant progress. This suggests that the model is applicable and useful for training programs in vascular microsurgery.
Downloads
Metrics
-
Abstract269
-
pdf (Español (España))326
-
pdf326
References
Tyagi S, Kumar S. Microsurgery: An important tool for reconstructive surgery a clinical review. Surgery Curr Res. 2014, 4(4), 1-4. https://ijpbs.net/abstract.php?article=Mzkz
Huentequeo-Molina C, Pino-Diaz Daniel, Moreno-Apablaza E, Alister JP Uribe F, Unibazo-Zuñiga A, et al. Colgajos Microvascularizados en Reconstrucción Maxilofacial: Avances de la Microcirugía. Int. J. Odontostomat. 2018, 12 (3), 309-319. http://dx.doi.org/10.4067/S0718-381X2018000300309
Camacho-Garcia F, Rojas-Galvis M. Determinación de los niveles de competencia para entrenamiento básico en microcirugía. Rev Colomb Cir. 2016, 31, 240-7. https://www.revistacirugia.org/index.php/cirugia/article/view/299/275
Acland R, Raja S. Acland's Practice Manual for Microvascular Surgery. Missouri: Mosby; 1980.
Lee Sang H, Manual of Microsurgery. St Luis, Ed. CRC Press; 1985.
Camacho-Garcia FJ, Rojas-Galvis MA, Ramírez-León JF, Cortés-Barré M. Curso básico de microcirugía. Guía para el estudiante. Bogotá: Editorial Fundación CLEMI; 2011.
Camacho-Garcia FJ, Rojas-Galvis MA, Ramírez-León JF, Cortés-Barré M, Cogua-Cogua LN. Guía de microcirugía en técnicas de entrenamiento en cirugía de mínima Rev. colomb. ortop. Traumatol. 2019, 33 (S2), 18-33. https://doi.org/10.1016/j.rccot.2019.07.007
Samprón MN, Marqués SC. Manual de microcirugía neurovascular. Ed: Comunicación OSI. 2017, Donostialdea p. 6 – 9. ISBN: SS-108–2017
Valencia-Castro JL, Tapia-Vallejo S, Olivares-Olivares SL. La simulación clínica como estrategia para el desarrollo del pensamiento crítico en estudiantes de medicina. Inv Ed Med. 2019; 8 (29):13-22. http://dx.doi.org/10.1016/j.riem.2016.08.003
Guinez-Molinos S, Maragano-Lizama P, Gomar-Sancho C. Simulación clínica colaborativa para el desarrollo de competencias de trabajo en equipo en estudiantes de medicina. Rev. méd. Chile. 2018, 146(5), 643-652. http://dx.doi.org/10.4067/s0034-98872018000500643
Díaz-Guio D, Cimadevilla-Calvo B. Educación basada en simulación: debriefing, sus fundamentos, bondades y dificultades. Simulación Clínica. 2019, 1, 95-103. https://doi.org/10.35366/RSC192F
Morales-Morgado E, García-Peñalvo F, Campos-Ortuño R, Astroza-Hidalgo C. Desarrollo de competencias a través de objetos de aprendizaje; Revista de educación a distancia (RED). 2013, (36). https://www.um.es/ead/red/36/morales.pdf
Garcia-Perdomo H. La educación quirúrgica actual como una herramienta para una práctica clínica más segura. Rev Colomb Cir. 2016, 31, 237-9. https://www.revistacirugia.org/index.php/cirugia/article/view/300/277
Kania K, Chang DK, Abu-Ghname A, Reece EM, Chu CK, Maricevich M, Buchanan EP, Winocour S. Microsurgery Training in Plastic Surgery. Plast Reconstr Surg Glob Open. 2020, 8(7), 1-9. https://doi.org/10.1097/gox.0000000000002898
Rojas-Galvis MA, López-Ríos AA. Implementación de las escalas de evaluación formativa OSATS en habilidades técnicas aplicadas en el laboratorio de microcirugía. Rev Colomb Cir. 2022, 37, 251-8. https://doi.org/10.30944/20117582.1070
Gaxiola-Garcia Ma, Kushida-Contreras Bh, Sanchez-Mendiola M. Enseñanza de habilidades quirúrgicas: teorías educativas relevantes (segunda parte). Investigación educ. Médica. 2022, 11 (42), 95-105. https://doi.org/10.22201/fm.20075057e.2022.42.22433.
Faulkner H, Regehr G, Martin J, Reznick R. Validation of an objective structured assessment of technical skill for surgical residents. Acad Med. 1996, 71, 1363-5. https://doi.org/10.1097/00001888-199612000-00023
Carsuzaa F, Payen C, Gallet P, Favier V. French translation and validation of the OSATS tool for the assessment of surgical skill, Journal of Visceral Surgery. 2023, 160 (6), 402-6. https://doi.org/10.1016/j.jviscsurg.2023.08.001
Martin JA, Regehr G, Reznick R. et al. Objective structured assessment of technical skills (OSATS) for surgical residents. Br J Surg. 1997, 84(2), 273–278. https://doi.org/10.1046/j.1365-2168.1997.02502.x
Reznick R, Regehr G, MacRae H, Martin J, McCulloch W. Testing technical skill via an innovative “bench station” examination. Am J Surg. 1997, 173(3), 226–230. https://doi.org/10.1016/S0002-9610(97)89597-9
Navarro-Subiabre F, Gabrielli-Nervi M, Varas-Cohen J. Evaluación objetiva de las habilidades técnicas en cirugía. ARS med. 2018; 43: 6 – 14. http://dx.doi.org/10.11565/arsmed.v43i3.1112
Ezra DG, Aggarwal R, Michaelides M et al Skills acquisition and assessment after a microsurgical skills course for ophthalmology residents. Ophthalmology. 2009, 116(2),257–262. https://doi.org/10.1016/j.ophtha.2008.09.038
Manzini JL. Declaración de Helsinki: principios éticos para la investigación médica sobre sujetos humanos. Acta Bioeth. 2000,6,321-34. http://dx.doi.org/10.4067/S1726-569X2000000200010
República de Colombia. Ministerio de Salud. Resolución 8430 de 1993 https://www.minsalud.gov.co/sites/rid/Lists/BibliotecaDigital/RIDE/DE/DIJ/RESOLUCION-8430-DE-1993.PDF
Muñoz-Cano J, Maldonado-Salazar T, Albarrán-Melzer J, Estrella-Gómez R. El constructivismo en la educación médica: perspectivas docentes. 2008, 36, 31-39. ISSN-e 0188-3313.
Bujan VK, Rekalde RI, Aramendi JP. La evaluación de competencias en la educación superior. Bogotá: Ediciones de la U, 2011. p. 87-96. IBSN 978-958-762-027-6.
Cruz-Rodríguez AM. El Modelo de las Competencias Profesionales Integradas como Paradigma Educativo. Hipoc Rev Med. 2011, 6(24), 2-3. http://www.medigraphic.com/pdfs/hipocrates/hip-2011/hip1124a.pdf
Salas Perea RS. Propuesta de estrategia para la evaluación del desempeño laboral de los médicos en Cuba. Revista Cubana de Educación Medica Superior. 2010, 24(3), 387-417. http://scielo.sld.cu/pdf/ems/v24n3/ems11310.pdf21412010000300011&lng=es&nrm=iso&tlng=es
Zambrano-Jerez L, Ramírez-Blanco M, Alarcón - Ariza D, Meléndez-Flores G, Pinzón-Pinilla L, Rodríguez-Santos M. Novel and easy curriculum with simulated models for microsurgeryfor plastic surgery residents: reducing animal use. European Journal of Plastic Surgery. 2024, 47:36. doi:10.1007/s00238-024-02177-2
Sirimanna P, Boyce S, Gunanayagam P, Gladman M, Naganathan V. Development of a rating scale for objective assessment of performance in laparoscopic appendicectomy surgeryANZ J Surg. 2022, 92, 1724–30. https://doi.org/10.1111/ans.17601
Díaz-Guio D, Cimadevilla-Calvo B. Educación basada en simulación: debriefing, sus fundamentos, bondades y dificultades. Simulación Clínica. 2019, 1, 95-103. https://doi.org/10.35366/RSC192F
Aoun SG, Ahmadieh TY, Tecle NE, Daou MR, Adel JG, Park CS, Batjer, Bendok RB. A pilot study to assess the construct and face validity of the Northwestern Objective Microanastomosis Assessment Tool. J Neurosurg. 2015, 123, 103–109. https://doi.org/10.3171/2014.12.jns131814
Pehlivanovic B, Dina F, Emina A, Ziga Smajic N, Fahir B. Animal models in modern biomedical research. Eur J Pharm Med Res. 2019,6 (7), 35–8. https://www.researchgate.net/profile/Belma-Pehlivanovic/publication/334169930
Anderson DD, Long S, Thomas WG, Putnam MD, Bechtold EJ, Karam DM. Objective structured assessments of technical skills (OSATS) does not assess the quality of the surgical result effectively. Clin Orthop Relat Res. 2016, 474, 874–81 https://doi.org/10.1007/s11999-015-4603-4
Aoun SG, El Ahmadieh TY, El Tecle NE, Daou MR, Adel JG, Park CR, et al. A pilot study to assess the construct and face validity of the Northwestern objective microanastomosis assessment tool. J Neurosurg. 2015, 123, 103-9. https://doi.org/10.3171/2014.12.JNS131814
Camacho-Garcia F, Rojas-Galvis M. Errores ergonómicos en un curso básico de entrenamiento en microcirugía. Rev. Fac. Med. 2020, 68(4), 499-504. http://dx.doi.org/10.15446/revfacmed.v68n4.77256
Lakhiani, C, Fisher, SM, Janhofer, DE, Song, DH. Ergonomics in microsurgery. J Surg Oncol. 2018, 118, 840- 844. https://doi.org/10.1002/jso.25197
Vargas K, Acuña, J. El constructivismo en las concepciones pedagógicas y epistemológicas de los profesores. Revista Innova Educación, 2020, 2(4), 555–575. https://doi.org/10.35622/j.rie.2020.04.004
Abreu-Hernandez L, Infante-Castañeda C. La educación médica frente a los retos de la sociedad del conocimiento. Gac Med Méx 2004, 140-4. https://www.scielo.org.mx/scielo.php?script=sci_serial&pid=0016-3813&lng=es&nrm=iso
Cantrell MA. The importance of debriefing in clinical simulations. Clinical Simulation in Nursing. 2008, 4, 19-23. https://doi.org/10.1016/j.ecns.2008.06.006
Díaz-Guio D, Cimadevilla-Calvo B. Educación basada en simulación: debriefing, sus fundamentos, bondades y dificultades. Simulación Clínica. 2019, 1, 95-103. https://dx.doi.org/10.35366/RSC192F
Mukherjee P, Roy S, Ghosh D, Nandi SK. Role of animal models in biomedical research: a review. Laboratory Animal Research. 2022, (38), 2-17. https://doi.org/10.1186/s42826-022-00128-1
Matfield M. Animal experimentation: The continuing debate. Nat Rev Drug Discov. 2002, 1, 149-52. https://doi.org/10.1038/nrd727
Van Hove PD, Tuijthof GJ, Verdaasdonk EG, Stassen LP, Dankelman J. Objective assessment of technical surgical skills. Br J Surg. 2010, 97(7), 972–987. https://doi.org/10.1002/bjs.7115
Swift SE, Carter JF. Institution and validation of an observed structured assessment of technical skills (OSATS) for obstetrics and gynecology residents and faculty. Am J Obstet Gynecol. 2006, 195, 617–621. https://doi.org/10.1016/j.ajog.2006.05.032
VanBlaricom AL, Goff BA, Chinn M, Icasiano MM, Nielsen P, Mandel L. A new curriculum for hysteroscopy training as demonstrated by an objective structured assessment of technical skills (OSATS). Am J Obstet Gynecol. 2005, 193, 1856–1865. https://doi.org/10.1016/j.ajog.2005.07.057
Ribeiro de Oliveira M, Mosso Ramos T, Ferrarez CE, MD, Machado CJ, Vieira-Costa PH, Alvarenga DL, et. al. Development and validation of the Skills Assessment in Microsurgery for Brain Aneurysms (SAMBA) instrument for predicting proficiency in aneurysm surgery. J Neurosurg. 2020, 133, 190–196. https://doi.org/10.3171/2018.7.jns173007
Duarte-Pinto LO, Cunha-Silva R, Guerreiro de Barros L, Pampolha H, Bacelar H, Simone -Kietzer. Low-fidelity simulation models in urology resident’s microsurgery training. Acta Cir Bras. 2023, 38, 1 – 11. https://doi.org/10.1590/acb386523
Choi J, Kim J, Shin J. Evaluation of quality and educational effect of microsurgery videos on YouTube:a randomized controlled trial. Journal of plastic surgery and hand surgery. 2022, 56 (4), 242–248. https://doi.org/10.1080/2000656X.2021.1990936
Szasz P, Bonrath EM, Louridas M, Fecso AB, Howe B, Fehr A, et al. Setting performance standards for technical and non- technical competence in general surgery. Ann Surg. 2017,266 (1),1–7. https://doi.org/10.1097/SLA.0000000000001931
Acton RD, Chipman JG, Gilkeson J, Schmitz CC. Synthesis versus imitation: evaluation of a medical student simulation curricu- lum via objective structured assessment of technical skill. J Surg Educ. 2010,67(3),173–8. https://doi.org/10. 1016/j.jsurg.2010.02.011.
Marcela Velásquez-Salazara M, Gaitán-Buitragob MA, Becerra-Cardona DA. Habilidades técnicas en suturas evaluadas con OSATS, comparando diferentes métodos de instrucción y acompañamiento. Educación Médica. 2024, 25, 1-8. https://doi.org/10.1016/j.edumed.2024.100904
Copyright (c) 2025 Servicio de Publicaciones de la Universidad de Murcia
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
The works published in this magazine are subject to the following terms:
1. The Publications Service of the University of Murcia (the publisher) preserves the economic rights (copyright) of the published works and favors and allows them to be reused under the use license indicated in point 2.
2. The works are published under a Creative Commons Attribution-NonCommercial-NoDerivative 4.0 license.
3. Self-archiving conditions. Authors are allowed and encouraged to disseminate electronically the pre-print versions (version before being evaluated and sent to the journal) and / or post-print (version evaluated and accepted for publication) of their works before publication , since it favors its circulation and earlier diffusion and with it a possible increase in its citation and reach among the academic community.
