Why the study?
Does competency assessment improve the training and skills of trainee anaesthetists?
Does competency assessment improve the training and skills of trainee anaesthetists?
Competency assessment in anesthesia training provides structured objectives and standardizes clinical skills, though its effectiveness depends heavily on consistent implementation by trainers.
Answers are grounded in this paper and cite their sources.
May support structured objectives in anaesthesia training; leaves open its effect on trainee skills without consistent implementation.
Since 1 February 2001, all senior house officers (SHOs) taking up a post in anaesthesia have to follow the new training programme defined by ‘The CCST In Anaesthesia’ produced by the Royal College of Anaesthetists [1, 2]. This training programme required by the Specialist Training Authority is ‘competency based’. We examine first what is competency assessment; second, how it can improve training and skills, and finally the potential drawbacks to this philosophy. Competency assessment has two main methods. There is assessment by the Primary FRCA examination, which mainly tests knowledge base. There are now also workplace assessments, testing the clinical skills, attitudes and behaviour of SHOs, with assessment forms signed off by trainers. Both these methods need to be passed in order to be eligible to take up a Specialist Registrar post. In order for a novice trainee to progress to local or distant supervision, an ‘Initial Assessment of Clinical Competency’ must be passed at approximately 3 months. No variation is allowed in this assessment from the prescribed information. This has the advantage of allowing trainees who have reached this standard to progress, yet identifying those who may require further supernumerary training. Being solo on-call is a very critical time with huge implications for patients, trainers and trainees. Competency assessment integrates knowledge, skill and attitude into one final SHO Training Certificate. It is a certificate that is issued once a trainee has passed the Primary FRCA (or equivalent) and has had satisfactory workplace assessments, requiring signatures of the College tutor and other designated trainers from that particular School of Anaesthesia. It ensures that passing a postgraduate specialist exam does not equal a Specialist Registrar post. The primary SHO syllabus has been replaced by a competency-based training manual [2]. The content has been divided under the headings of knowledge, skills, attitudes and behaviour, and workplace training objectives. This allows clinical standards to be set and regulated. Trainees know what is expected of them, not only in terms of theoretical knowledge and clinical ability, but also the attitude towards each objective. There are now defined skills in most areas of anaesthesia, for example pre- and postoperative care, intensive care, obstetric anaesthesia, critical incidents, etc. It will allow the early detection of missing skills, a factor that may become more prevalent in the light of reduced junior doctors' hours and ‘hands on’ experience. Having predefined skills and objectives should make best use of training time. Theatre sessions and intensive care training can be optimised if both trainers and trainees know what is expected from each particular block, with workplace assessments being signed off after each one has been completed satisfactorily. It gives trainees an overall aim in their training. Many Schools of Anaesthesia have several sites between which trainees rotate and consistent assessment can occur from site to site. It allows continuity in training as well as highlighting any breaks. There should be reduced variability between trainees with a minimum standard that would be acceptable to other trainers. The same principle can be extended to trainers and what they expect of trainees. Both can be closely monitored with competency assessment. The Clinical Negligence Scheme for Trusts (CNST) requires that ‘all medical staff in training when taking up a new post are required to be given by their supervisor a list of the technical tasks they are expected to perform. The trainees must indicate their competence to perform the specific tasks’. Competency assessment fulfils these requirements. From a safety point of view, if a trainee has had a specific module signed off, they should be competent enough to perform the clinical skills required by that module. Logbooks can be subject to abuse and so this allows closer monitoring of trainees. Limitations of competency assessment also exist. It is impossible to break down every subcomponent of anaesthesia and not all skills can be clearly defined on paper. Skills such as decision making, response to events as they occur and attitude to patients cannot be reliably or accurately assessed. The caseload is not taken into account and this may lead to some trainees having an inadequate opportunity to complete the assessments. There is clearly no substitute for experience or ‘miles on the clock’. There is a variable rate of learning, which may not be compensated for by having set workplace assessments. The assessment forms can be too rigid to allow any latitude in what is required from a trainee and tick boxes can be impersonal. It is assumed that all trainers will have a similar, minimum standard that a trainee has to reach before being signed up. An unacceptable amount of interpersonal variation can occur in this process and this is an important limitation with workplace assessments. Equally, there may be a misinterpretation of the skills and attitudes required by both trainer and trainee. Trainees will be put under pressure to perform if they know they are being assessed, with some not showing what they are really capable of. The new system will be an extra burden for College tutors, trainers and trainees. This may lead to non-compliance or assessment forms completed retrospectively. In summary, competency assessment can be a powerful tool with an enormous potential. It defines the skills required and should optimise training time. Deficiencies in training of individuals should be highlighted, particularly with novice trainees. However, appropriate trainers are required for the system to work well and it does rely on trainers and trainees not abusing the workplace assessments. Constant review is required to ensure this does not happen, as well as regular feedback to the RCA Training Committee.
No takes yet. Share an insight, caveat, or question.
Patel et al. (2002) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: