Development of Operating Room Learning Environment Scale for Anaesthesiology Residents (ORLES-ANST): validity and reliability study

Existing instruments assess the operating room learning environment for anaesthesiology residents; however, evolving educational practices and workplace learning dynamics necessitate a context-specific instrument. Therefore, this study aimed to develop and evaluate the psychometric properties of the Operating Room Learning Environment Scale for Anaesthesiology Residents (ORLES-ANST). This methodological scale development study generated items based on the literature, workplace-based clinical learning and situated learning perspectives, and written reflections from anaesthesiology residents. Validity evidence based on test content was obtained through expert review. Ten anaesthesiology clinical educators evaluated the items using the Lawshe method, and item-level content validity ratios and a scale-level content validity index were calculated based on their ratings. Two experts in measurement and evaluation and one linguist also reviewed the items and provided qualitative feedback to improve item clarity and content representation. Validity evidence based on response processes was examined through cognitive pretesting. The study group consisted of 358 anaesthesiology residents from university hospitals and education and research hospitals across 23 cities in Türkiye between May 2023 and December 2023. Validity evidence based on internal structure was examined using exploratory factor analysis, whereas validity evidence based on relations to other variables was evaluated using the Operating Room Educational Climate Scale (ORECS). Internal consistency coefficients, test–retest reliability, and item discrimination analyses were also performed. Exploratory factor analysis identified a 25-item, five-factor structure explaining 54.3% of the total variance. The factors were Training Programme, Workload and Wellness, Physical Environment, Team Dynamics, and Training Resources. ORLES-ANST scores showed a moderate positive correlation with the ORECS Operating Room Infrastructure subscale. Cronbach’s alpha and McDonald’s omega coefficients demonstrated high internal consistency, the test–retest coefficient indicated strong score stability, and all items demonstrated adequate discrimination. ORLES-ANST is a 25-item, five-factor instrument developed and initially validated for assessing anaesthesiology residents’ perceptions of the operating room learning environment in Türkiye. The findings provide initial validity evidence and support the reliability of score interpretation in this context. Further studies are needed to confirm the factor structure and examine the generalisability of score interpretations across different institutional, cultural, and educational settings.