Pd60-06 a Novel Skills Assessment Tool to Assess Resident Competency During Ureteroscopy With Laser Lithotripsy

You have accessJournal of UrologyEducation Research III (PD60)1 May 2024PD60-06 A NOVEL SKILLS ASSESSMENT TOOL TO ASSESS RESIDENT COMPETENCY DURING URETEROSCOPY WITH LASER LITHOTRIPSY Shagnik Ray, Colin Kleinguetl, Mohammad Mohaghegh, Aliza Khuhro, Dairon Denis-Diaz, Hafsa Asif, Eric Riedinger, Matthew Lee, Geoffrey N. Box, Michael Sourial, Bodo Knudsen, and Tasha Posid Shagnik RayShagnik Ray , Colin KleinguetlColin Kleinguetl , Mohammad MohagheghMohammad Mohaghegh , Aliza KhuhroAliza Khuhro , Dairon Denis-DiazDairon Denis-Diaz , Hafsa AsifHafsa Asif , Eric RiedingerEric Riedinger , Matthew LeeMatthew Lee , Geoffrey N. BoxGeoffrey N. Box , Michael SourialMichael Sourial , Bodo KnudsenBodo Knudsen , and Tasha PosidTasha Posid View All Author Informationhttps://doi.org/10.1097/01.JU.0001009460.27205.df.06AboutPDF ToolsAdd to favoritesDownload CitationsTrack CitationsPermissionsReprints ShareFacebookLinked InTwitterEmail Abstract INTRODUCTION AND OBJECTIVE: With urological resident expressed concerns about readiness for practice as well as a renewed focus on competency based training during residency, there remains a need for a standardized and time-efficient method for resident evaluation and feedback. Mobile feedback applications have been proposed as a potential solution to this dilemma, but those in practice are relatively broad in scope with differences between institutional practice patterns not being accounted for. We sought to evaluate the feasibility of a customizable Qualtrics based mobile phone application to provide real-time feedback/evaluation of resident surgical skills and overall progression with ureteroscopy. METHODS: A Qualtrics procedure-based application detailing key steps of ureteroscopy and laser lithotripsy was created for both semi-rigid and flexible ureteroscopy. Residents were evaluated across 15 steps via Yes/No completion score or via Likert-scale (1–novice to 5–expert), with an additional modifier per case of case complexity (1-3, simple to complex). RESULTS: This pilot study included 15 residents (with 3 residents per year of residency training) for a total of 92 evaluations completed for flexible ureteroscopy, and 13 residents (4 PGY5s, 2 PGY4s, 3 PGY3s, 3 PGY2s, 1 PGY1) for a total of 33 evaluations for semi-rigid ureteroscopy. The average time for faculty to complete an evaluation was 119.0 seconds (SD=42.6). Data extracted from the survey tool allows for a program to highlight an individual resident's skills (Figure 1), an individual resident's improvement over time (Figure 2), cohort tracking by PGY level, and skill stratification by case complexity. CONCLUSIONS: The Qualtrics-based mobile phone application is an easy to create and use tool that allows for residency programs to evaluate residents with their preferred degree of granularity, and subsequently track that real-time resident performance improvement longitudinally for ureteroscopy. Download PPTDownload PPT Source of Funding: N/A © 2024 by American Urological Association Education and Research, Inc.FiguresReferencesRelatedDetails Volume 211Issue 5SMay 2024Page: e1275 Advertisement Copyright & Permissions© 2024 by American Urological Association Education and Research, Inc.Metrics Author Information Shagnik Ray More articles by this author Colin Kleinguetl More articles by this author Mohammad Mohaghegh More articles by this author Aliza Khuhro More articles by this author Dairon Denis-Diaz More articles by this author Hafsa Asif More articles by this author Eric Riedinger More articles by this author Matthew Lee More articles by this author Geoffrey N. Box More articles by this author Michael Sourial More articles by this author Bodo Knudsen More articles by this author Tasha Posid More articles by this author Expand All Advertisement PDF downloadLoading ...