Answers are grounded in this paper and cite their sources.
Pharmacology assessment in MBBS has been centered around formulations, traditional prescription writing for given conditions, and spotting. For many decades, grand viva was taken as the primary parameter for decision-making. The introduction of competency-based education and changes in assessment have necessitated the introduction of observation-based assessment methods for practical examinations. Objective structured practical examination (OSPE) is a method of examination which evaluates student’s wide range of skills uniformly and objectively.[1,2] Since, in MBBS, now all subjects are clinical sciences and division into basic/paraclinical/clinical is not recommended to be used, it is more imperative to use the word objective structured clinical examination (OSCE). OSPE fulfills most of the five requirements of a good assessment method. It is valid as it measures what it is supposed to measure. However, it is important to select single objective for each station. For appropriate content sampling for stations, the blueprint for practical examinations should be used. Reliability is related to results that are accurate and consistent. There are the same stations and agreed checklist, so interobserver variation is decreased to minimum. The difference in marks obtained in OSPE is because of the ability of the student, rather than extraneous factors. Case variability and examiner variability are eliminated thus increasing the validity of the examination. The number of stations must be 15 or more to improve reliability. Feasibility is many times seen as a challenge for OSPE. However, it is more related to designing stations than the actual conduct of OSPE. Acceptability is quite good as it happens in nonthreatening environment and the student performs up to full potential. Educational impact is beneficial if feedback is shared with students so that they know the areas for improvement and practice in those areas. The Objective Structured Clinical Examination Setup The OSCE setup consists of multiple “stations” that assess a student on a clinical/practical competency.[3,4] Each station is a task which the student is required to perform. The task may be designed so as to assess one specific competency expected of the examinee, e.g. psychomotor, communication, interpretation skills, etc., The examinee goes from one station to the next station performing each task. Stations may be of three types: Observer station This station would usually require the student to perform a clinical pharmacology-related skill on a real or standardized patient while an examiner observes the performance and marks the student on a predesigned validated checklist or a rating scale. The observer station may also be helpful to observe communication skills. Designing checklist for such observer stations is of vital importance. The checklist should be constructed with due weightage being given to the salient features of a particular station. Stations and checklists can thus be duly modified depending on the competency level being assessed. Response stations At this type of station, the examinee is presented with an analytical task, where he/she is expected to write an inference or answer. This is an unobserved station and can be designed with questions directed at a specific skill. It can include interpretation-type questions that help in assessing the higher-order thinking of the examinee. The caution to be taken here is not to include the questions that can be asked directly in theory examination, e.g., write two indications of the given drug. The distinction between spotting and OSPE must be kept in mind. Spotting is different from OSPE. In OSPE, we assess those components that cannot be assessed by other common assessment methods such as communication skills (a consult) and right technique to administer injections. If you are simply asking for indications, identify an instrument or adverse drug reactions (ADRs), then, it is spotting and not OSPE. Filling ADR form based on an ADR history is an example of OSPE station.[1] Rest station A rest station is a station without a task to be performed and is usually kept after a few stations to provide the student a time to relax as well as to utilize time to finish written tasks for an earlier task/station. Layout Plan OSPE should be conducted in a dedicated area. In pharmacology, computer-assisted learning laboratory can be used and there you can use computer screen for each station display if needed. Students should be acquainted with the way they need to go through the OSPE stations. Preferably, a layout/map should be displayed outside the hall or the area where OSPE is to be conducted [Figure 1]. Separate cubicles for each station would be desirable.Figure 1: Sample layout for objective structured practical examinationDesigning Material OSPE is a labor-intensive exercise. There is a lot of planning that needs to be done before the actual implementation of the OSPE. Clear instructions The instructions should be clearly given to students preferably in written form well before the OSCE starts. Similarly, observers and cases/subjects should also have clear instructions. Items requirements The number of stations should be 15–20 with each station/task for 3–5 min. While designing a task for an observer station, one must also design the checklist of items to be assessed by the observer with the marks to be allotted for each item. Care must be taken not to break down a single task into too many small items, otherwise they lose meaning. Furthermore, the weightage of each item can be varied depending upon the importance of the item in test performance. Make a list of items required for each station. Set up the stations a day before the conduct of the assessment. Observers and personnel should be identified. Pilot testing/dry run The whole setup should be pilot-tested using students and observers. Based on feedback, make changes as necessary. This is necessary as it ensures that the tasks are feasible, can be completed in the allotted time, is not too difficult or easy, and instructions can be understood. Feedback The OSPE is not just an exercise for student assessment; it is also an excellent teaching tool. At the end of an OSPE, students should be given feedback on their performance, pointing out gaps in their learning or understanding. This is possible in formative assessment. The OSPE checklist and rating scales can actually indicate to the assessor the area for improvement. Advantages The use of OSCE for formative assessment has great potential as the learners can gain insights into the elements making up competencies as well as feedback on personal strengths and weaknesses. The reliability, validity, objectivity, and practicability or feasibility of this examination are based on the number of stations, sampling of stations, quality of stations, and method of scoring (checklists and/or global scoring). Therefore, OSPE is reported to have certain advantages-its objective in nature, more number of areas can be assessed in a shorter period, more number of students can be assessed in a shorter period, the environment is nonthreatening, and examiner bias is minimal.[5,6] Challenges One of the major concerns in conducting an OSPE is the great amount of effort, time, and sometimes, monetary requirements in arranging the actual stations. Besides, the material needs, there is a need for faculty training in designing OSPE stations. Designing checklists is an important training exercise for the examiner as there is a tendency to break down tasks observed into the smallest items in an attempt to become more and more objective only undermining the validity of the tool. Where a larger number of students need to be assessed, simultaneous multiple OSPE can be run where possible. Every effort should be made to avoid duplication of tasks when the OSCE is repeated with two sets of students at different timings. Time assigned to each station is an important consideration. The longer the time given for an individual station, the greater the scope of assessment and it improves the content validity of the examination.[7] A number of institutes have started doing OSPE now in MBBS courses. The recent instructions also ask for OSPE in examinations. Over a period of time, you can develop OSPE bank and keep on updating your stations regularly. It is better to include higher levels of cognitive domains and psychomotor and attitudinal domains for testing in OSPE. Objective Structured Practical Examination in Pharmacology-examples Station 1-Demonstrate the use of the provided inhaler (MDI). The students come and demonstrate the use of inhalers. The observer marks on the checklist. Checklist has marking options roll number-wise [Table 1]. There is no verbal communication between students and observers.Table 1: Checklist for station 1Station 2-Explain the preparation and use of WHO oral rehydration solution to the mother of a 1-year-old infant with diarrhea. Grade the performance of the student using rating scale [Table 2].Table 2: Rating Scale for station 2In addition to the above points, OSPE ensures integration of teaching and evaluation. Variety maintains student’s interest. There is increased faculty–student interaction. OSCE is adaptable to local needs. A large number of students can be tested within a relatively short time. Hence, in nutshell, OSPE is a form of practical examination which is objective and which owes its objectivity to a structured marking scheme.
No takes yet. Share an insight, caveat, or question.
Dinesh Badyal (2024) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: