Large Language Models Outperform PGY-5 Residents on the Orthopaedic In-Training Examination: A Comparative Analysis of Six Cutting-Edge Large Language Models

ChatGPT consistently scored the highest in terms of accuracy across all metrics while also maintaining reasoning quality. Compared with resident averages, ChatGPT performed at a postgraduate year five level which indicates its potential for integration into orthopaedic clinics, electronic medical records, and surgical planning. Further development models would allow for better performance on difficult questions and creating orthopaedic focused models could enhance these results.