Key result
A direct observation of procedural skills assessment tool for ultrasound-guided regional anaesthesia demonstrated low inter-rater reliability among six expert assessors.
Observational (n=30)
The direct observation of procedural skills assessment tool for ultrasound-guided regional anaesthesia demonstrated moderate internal consistency and construct validity, but poor inter-rater reliability.
This is the authors' abstract. We don't add key points for this paper.
Assessment tools must be investigated for reliability, validity and feasibility before being implemented. In 2013, the Australian and New Zealand College of Anaesthetists introduced workplace-based assessments, including a direct observation of a procedural skills assessment tool. The objective of this study was to evaluate the psychometric properties of this assessment tool for ultrasound-guided regional anaesthesia. Six experts assessed 30 video-recorded trainee performances of ultrasound-guided regional anaesthesia. Inter-rater reliability, assessed using absolute agreement intraclass correlation coefficients, varied from 0.10 to 0.49 for the nine individual nine-point scale items, and was 0.25 for a 'total score' of all items. Internal consistency was measured by correlation between 'total score' and 'overall performance' scale item (r = 0.68, p < 0.001). Construct validity was demonstrated by the 'total score' correlating with trainee experience (r = 0.51, p = 0.004). The mean time taken to complete assessments was 6 min 35 s.
Answers are grounded in this paper and cite their sources.
Questions reliability of this DOPS tool for ultrasound-guided regional anaesthesia; leaves open development of assessments with higher inter-rater consistency.
No takes yet. Share an insight, caveat, or question.
Watson et al. (2014) conducted an observational in Ultrasound-guided regional anaesthesia (n=30). Direct observation of procedural skills assessment tool was evaluated on Inter-rater reliability (intraclass correlation coefficient for total score) (ICC 0.25). A direct observation of procedural skills assessment tool for ultrasound-guided regional anaesthesia demonstrated low inter-rater reliability among six expert assessors.
Synapse has enriched 10 related papers. Consider them for comparative context: