Key points are not available for this paper at this time.
During medical school, students are taught the knowledge, skills, and attitudes required to become competent physicians. Knowledge and skills are rigorously evaluated by written and oral exams, standardized patient scenarios, and ward evaluations. However, evaluation of behaviors, including professionalism, is often implicit, unsystematic and, therefore, inadequate. This is problematic for several reasons. First, medical schools are doing a disservice to future postgraduate training programs, as well as to society, by not explicitly and accurately evaluating this area during medical school. It is recognized that more complaints against physicians to medical societies relate to unprofessional conduct than to lack of knowledge or poor technical skills.1 Yet students who display unprofessional behavior may not be identified in the current system, and will be promoted academically on the basis of adequate performance on tests of knowledge and skills alone.2,3 Second, we are doing a disservice to our students by not providing explicit feedback in this domain, thereby missing valuable opportunities to bring about awareness and improvement. The American Board of Internal Medicine, in its report “Project Professionalism,” discussed the problem of erosion of professionalism during medical training. While knowledge and skills improve markedly over the four years of medical school, there is ample anecdotal evidence, and substantial quantitative evidence, that professional behaviors can diminish over this period.4,5,6 There appears to be an unrealistic expectation that students will arrive at medical school lacking in knowledge and skills, but with a full complement of appropriate behaviors that require no further attention. However, all students are vulnerable to lapses in professional behavior and can benefit from explicit, systematic attention in this domain. The focus of medical education in the past century was on knowledge and skills. For the future of medicine, attention to the teaching and evaluation of professionalism is vital. While this need to evaluate professionalism effectively has been recognized for some time, traditional methods of addressing the problem have not been particularly successful, for several reasons. The traditional approach to this issue has involved the identification and definition of the attitudes and concepts that comprise the concept of professionalism (such as altruism, accountability, excellence, duty, honor, integrity, and respect). Evaluation methods that rely on such abstract and idealized definitions lead us to discuss people, rather than their behaviors, as being honest or dishonest, professional or unprofessional. This implies that professionalism represents a set of stable traits. Interestingly, a large literature exists that suggests the opposite. Many studies in personality psychology have shown that the presence of specific personality traits does not predict behavior.7,8. For example, in one study of psychiatry residents, Minnesota Multiphasic Personality Inventory testing revealed serious personality disorders in the two individuals who eventually lost their licenses for professional misconduct.7 However, several other participants showed the same personality traits, yet had no difficulty reported in 15 years of follow up. Thus, evidence suggests that the identification of specific traits does not allow us to predict an individual's behavior. There are several reasons why this issue is important when discussing the evaluation of professionalism. Stable trait measures do not take into account a recognition that behaviors enacted often involves an effort at resolving a conflict between two (or more) equally worthy professional or personal values. For example, it is easy to say that one must always tell the truth, and that one must always protect patient confidentiality. However, these values may occasionally come into conflict, and the ultimate choice the student makes will depend on the specifics of the situation.9,10 In addition, professional behaviors are known to be highly context-dependent.10,11 One can imagine a basically honest person lying to a patient given a particular context. This does not automatically mean that that person is dishonest, and therefore unprofessional. Certainly in social situations, a decision to always tell the full truth would be considered highly inappropriate. Although the issues of conflict and context are separate at a theoretical level, in day-to-day practice they are likely to interact. One study has shown that 87% of physicians surveyed indicated that deception is acceptable on rare occasions, for example, if the patient would be harmed by knowing the truth, in order to circumvent “ridiculous rules,” or to protect confidentiality.12 Yet, when two specific professional values are in conflict, it is not always predictable which of the two values will take precedence. For example, while it is sometimes appropriate to lie in order to protect patient confidentiality, there are circumstances in which it would be considered more appropriate to break confidentiality rather than tell a lie. As one participant stated, honesty is “usually” the best policy, but everything is taken on a case-by-case basis, and any actions taken depend on the specifics of the people and the situation.12 Traditional ways of evaluating professionalism do not make allowances for these gray areas. Another element of evaluating professionalism involves the process of resolving the conflict. The ultimate choice an individual makes, manifested as the behavior witnessed, does not tell us how he or she arrived at the decision. We know nothing of whether the student recognized the professional “values” that were in conflict, or why the student chose to act in that particular way. So while focusing on behaviors rather than personality or character traits is important, we must also attempt to understand the process that led to the behavior. Thus, if we do not include conflict, context, and the process of resolution in our evaluation methods, we might not be able to conduct the most reliable, valid, and appropriate evaluation of these behaviors. Another reason for the lack of success of traditional approaches is that evaluators have not been willing to identify an individual as unprofessional for actions that appear to be relatively minor. Thus, lapses in professional behavior tend to be ignored or suppressed, due to an understandable reluctance to apply the broad, harsh label of “unprofessional.”13 In one study, clinician supervisors admitted and demonstrated their reluctance to give negative feedback regarding unprofessional behavior, even though in interviews they had stated strongly that they would do so.14 Even if faculty have this willingness, they have been found to have “difficulty in identifying problems, an inability to verify problems, and fear of litigation” that inhibit their reporting of behavioral problems.2 This outcome arises, in part, from the fact that educators and researchers have traditionally focused on this problem from an abstract perspective. The definitions and subcategories of the broader concept of professionalism describe the idealized person, the “consummate professional,” with no room for mistakes. With this theoretical basis, if someone tells a lie, even for a “good” reason, he or she could be suddenly labeled “dishonest,” and therefore, “unprofessional.” The only thing left for the evaluator to decide, then, is how unprofessional the individual is. This top-down focus on professionalism as an abstraction rather than a bottom-up focus on professionalism as a set of actions in context, therefore, is flawed. This paper elaborates on the issues around this problem. First, we review the literature on the types of evaluation instruments used for measuring professionalism in medical education. We then outline fundamental conceptual deficiencies that exist in this literature. We argue that the three most important missing components are: consideration of the contexts in which unprofessional behaviors occur, the conflicts that lead to these lapses, and the reasons students make the choices they make. We then propose strategies for resolving these issues. Method We conducted searches through Medline, Psychlit, and ERIC for literature published over the past 20 years. We included studies that contained original research on the topic of assessment or evaluation of professionalism in medical education, or included instruments to measure professional behavior, professionalism, humanism, behaviors, values, and attitudes. After initial articles were identified, bibliographies were used to identify additional references, and experts in the field were consulted for missing but relevant papers. This process uncovered few studies addressing specific efforts to evaluate professionalism. There was an abundance of articles calling for new and better methods of evaluation, and arguments for why this is so important and neglected. Some papers dealt with certain aspects of professionalism, for example, ethics, communication skills, interpersonal skills, and humanistic behavior, but they did so without extrapolation to the larger notion of professionalism. These studies were included if they highlighted difficulties in evaluating professionalism or provided new insights or solutions, and contained original research. Results Evaluations by Faculty Supervisors. In 1979, the AAMC interviewed approximately 500 clerkship directors about “problem students.” They identified 21 types of problem students, and then asked how often each type of problem was seen, and how difficult the problem was. Among the results from the University of Washington School of Medicine, researchers found that “noncognitive” issues (e.g., bright but poor interpersonal skills) were “frequent and difficult,” but that the very disturbing ones (e.g., cannot be trusted, manipulative) were seen only infrequently.15 Though this survey was done many years ago, it provides an early glimpse of faculty's concerns about the professional behaviors of students. Since then, various other studies have analyzed approaches used by faculty in the evaluation of professionalism, including global rating scales, intraining evaluations, and encounter cards. Ward rating forms, completed by the physician-supervisor, are the most commonly used instruments. In addition to assessing medical knowledge and clinical skills, many of these forms have a single global item to assess professional behavior, which may be subject to extensive rater bias.16,17 A study by Woolliscroft et al. highlights some of the problems of using this type of assessment. The authors found that using a questionnaire, faculty could assess the humanistic qualities of internal medicine residents, at least for the item “doctor-patient relationships.”18 However, it would take 20–50 faculty members per resident to achieve acceptable reproducibility, which calls into question the utility of this instrument. This also suggests that the trait doctor-patient relationships is probably not stable, but rather may be subject to context bias. Different evaluators might see behaviors or make In a study, found that and of highly with to all the assessment of humanistic further the of for the problem of have been that the and of the of medical on a or This for the assessment of knowledge, skills, or professional behaviors with and early and However, in a study of encounter in the evaluation of residents, negative by only of the were found to be about unprofessional who these negative were only as by their their all had and on highlights the difficulties faculty have in unprofessional behavior. Faculty in be to accurately and assess specific behaviors. One a assessment of a very specific set of humanistic skills (e.g., to the the from the by faculty to of with However, even if faculty can identify problematic behavior in a they are often to using a demonstrated that faculty have a reluctance to to behaviors that negative attitudes In faculty stated that they would not of and would the if such behavior were However, in practice they did not at or did so in such a as to require by the The feedback can then be to be As for this reported their for the as well as the educators can for negative such as teaching and being to personal and They that if the behavior is only a and the is feedback might or the for residents, feedback is seen as methods that exist for faculty evaluation of professional behavior are Evaluations cannot be on or these have poor in various contexts need to be but physicians are for only a of the In addition, even when lapses in professional behavior are identified, there is reluctance to report and Some of the reluctance faculty have in evaluating professional behavior results from conflict in their as and such as or may not be subject to these In addition, these other may see the students and more often and in study included of and the were not reliable, and it would have required to to achieve a of professional with to 20 per but this may be professional behavior is so it is not that only to exist between by these and may of that could their reporting of unprofessional for example, a patient may be to the of a with a even though it is In addition to some of the difficulties in evaluating professional behavior, Woolliscroft et study provides a of an attempt to results as a measure of are in a to evaluate each professional behaviors of and Thus, the of assessment of professional behaviors may many of the problems for faculty's assessment. However, several problems and some new problems may through the of assessment. a there is some that medical may be the best measures of interpersonal skills et al. reported a study of review in training using a The on the into two and which included humanistic behaviors. particular is this that of a well with faculty of the same of a that students to their on certain of professionalism has been The authors that such a identification of the of the but it is not in the the students were asked for only on the the other to have a difficult the abstract of professionalism from each other and from other skills. For example, in a study of assessment of professional found very internal the a in the of the separate were highly with more measures such as Board of and and that other than professionalism were also to the as with faculty it would appear that a large of are to stable measures Interestingly, the of negative in the the of faculty in each This yet of the of context and social in assessment In the social of assessing may have negative while some studies report of report to evaluation even though the were and for research found that medical students were more of than were students, who in the of the found that that the process would their and personal In for evaluating professionalism. However, they are likely to be very many of the same problems faculty's evaluation of professionalism will have to be and evaluation must be that will the reluctance of to one early studies were conducted that involved of during medical training. these students reported in certain such as were more about or that their had become or Some attitudes as for example, for and in medical of personal and found that more than in of the These studies that our of some of which may aspects of can benefit from However, these studies are and not assessing the qualities of The utility of for these might be more studies of in medicine focus on the assessment of knowledge and skills rather than on professional behavior, but they that is physicians are at in relatively (e.g., they are likely to have even difficulty in a such as professionalism, which is well and more A of for example, a of as the in which each participant a set of skills to each other from the that the most to the one that the some success as a in the relatively of skills, the was when to of the components of a ward assessment In this context, the authors that were willing to say they need most with their skills, or to improve their knowledge all that they least in It appears that when are and abstract in issues of the of social is and and It is that the of in the evaluation of professionalism is The methods used do not take context into a could be that included only of professionalism, such as interpersonal skills, communication skills, and However, it would be for a student to say he or she more with behaviors rather than abstract definitions would need to be to this further research is done to better understand the of its utility for assessing professional behaviors is likely to be to and the of personal There is an extensive of literature on clinical and standardized and their in the evaluation of clinical skills. There is no literature specific to the of in the evaluation of professionalism or professional behaviors there are in which issues of professionalism and professional behaviors are on an of the American Board of Internal et al. found that could identify some of the professional of the doctor-patient including using understandable and to et al. asked to assess interpersonal skills, and patient on a used in a and found that to 20 were to the research conducted using to assess skills in with issues that would be required to achieve even if the were to one specific least in part, the difficulty with using is the with which the concepts are on the evaluation For example, one set of forms used such as problems in or in to with the and taken may the In behaviors are not and is left to the a suggests that the as it does not between of a problem and communication Another issue with assessment is the problem of for example, reported on the with a that standardized patient in a as well as in were asked to interpersonal skills during each with the the had a and were to be This may the that students in this might act as they rather than as they the other one study has reported several professional lapses in the context of a psychiatry most a a in a for the of et al. argue that if are more they may very well effectively in of professional et al. that were highly and when with would be to make regarding the behaviors they it is that context is of assessment that are more to may be more than that may be that there is a professionalism and with actions they are on the It would be to include values conflicts in to assess the awareness of the professional values that are and to evaluate their In such a there may be more than one so the about their actions may be more important than the behaviors they The of even when to specific of professionalism, is and many authors have that the utility of this type of assessment may be in the evaluation of students. researchers have for assessing professionalism that are by the of problematic student The evaluation is a specific that is completed by a clerkship or faculty when a student unprofessional behavior during a more than one has been completed for a specific a between an and the student and is These are on the concept that professional behaviors must be clinical studies this evaluation have been of that are in and further and studies are are very a lack of evaluation, and may well for identifying students with lapses in professional behavior. However, in their they may not as as a of evaluating all students. The important these authors have is their that a student as a negative than of unprofessional behavior. in the Evaluation of It be from the that evaluating professionalism in medical students and has to be a difficult The abstract of about professionalism a for apply a harsh or the We know from research that faculty are more likely to the which effectively and at the other evaluation methods that behaviors, rather than as professional or unprofessional become and would be more likely to by faculty and students. The studies reported by et al. and et al. two of such these methods will faculty's reluctance to report behaviors that lead to this can only in professional As these evaluation forms are to identify and serious lapses in professional behavior, which in only a few students. research might focus on ways to make these forms in the evaluation of all students. However, it is likely that some to their would for example, faculty would have to a or These might be if the behavior is in a context the person, the the to a process of review is and is any decision would be and well and a of the behavioral and abstract in their by behavioral (such as have seen to in to abstract of professionalism (such as which is an in this We have also that professional behavior is more than has been physicians are to that their to act and medical students and are no In they may be more vulnerable to lapses in professional behavior of the of their training and It is to be of the specific context in which a behavior to evaluate For example, et al. found that the teaching students had on to lack and more to the context of a which were to a They highlighted the conflicts between education, patient to be a and fear of a poor One was the of students lack it and are of which often into conflict. It may be to study these behaviors in context more to their and Since we know that students, and all see aspects of professionalism in students, it would be important to the of each of these in order to be One could be to each of these in to they to be professional and unprofessional behaviors. would in the of instruments used in all forms of student assessment. Another could be to an encounter to from students, residents, and about behaviors are This may us with a more set of behaviors on which to future evaluation has also been identified as a of professional and is found as a element in some measures of professional Although such instruments are by their some researchers have found that professional behavior can best be identified at the that students are with these One of this is that students could be in a that involves a conflict of values, for example, with a standardized The behaviors the students on the choices they could be might be even more is an evaluation of the process a student through to arrive at or ultimate students could be asked to about professional conflicts they have The or from these could be to or to the values of individual students and how these values the resolution of professional and studies a to how the of medical attitudes and The authors that a of can relationships between the to tell about and the they make about how to act on of and in to studies in a the of this However, the that students may from the same of that and research in this area would have to be to take this issue into It is unrealistic to that one evaluation could all that is important in the of professionalism. As with all evaluations, which in on is student a on or knowledge of from a no student a on professionalism without adequate of the domain. Some of the measures have large and are likely to be more evaluation, encounter while rely on a single report or a few scenarios, ward While the may be for the are more for the larger of students who only lapses in professional behavior. It is certain that more than one would need to be and the may from results from efforts at professionalism, and future methods of evaluating professionalism, must focus on behaviors rather than personality traits or concepts of and evaluation must include context and conflict in order to be relevant and methods of evaluation include of assessment and which are required in the professional of all physicians. we attempt to understand students to lapses in professional behavior, in order to teaching and in this domain.
Ginsburg et al. (Sun,) studied this question.