Introducing Evidence-Based Medicine to Plastic and Reconstructive Surgery

An effective health care system is one in which health care spending provides acceptable returns in terms of health outcomes and broad coverage for its citizens. By this measure, the United States health care system unfortunately falls short. Tremendous pressure for improvement has given rise to several initiatives designed to decrease health care expenditure and improve outcomes, access, and quality of care. The outcomes movement, which is revolutionary in American medicine, has heightened awareness about the need to critically examine our treatment outcomes. However, the early euphoria surrounding the outcomes movement was met with restraint at the realization of its limitations. Although the outcomes movement has verified the effectiveness of many existing treatments in plastic surgery, most of the investments in these projects unfortunately have resulted in few, if any, positive changes for the patient, physician, or health care system.1 The U.S. health care system is now moving toward the adoption of evidence-based medicine (EBM), which may potentially be another revolution in American health care.2 WHAT IS EVIDENCE-BASED MEDICINE? In a nutshell, “Evidence-based medicine is the integration of best research evidence with clinical expertise and patient values.”3 Evidence-based medicine integrates scientific principles and clinical care experiences to provide rational decision-making tools in the care of patients. In contrast with a tradition that has long been adhered to of treating patients with practices based on rigidly held protocols learned in residency training or opinions presented by leaders in the field, evidence-based medicine challenges these unscientific methods of healthcare delivery and strives to remove the uncertainty of these “expert” opinions. It carefully scrutinizes existing treatments by identifying the best available evidence.4,5Table 1 lists the five basic ideas of evidence-based medicine. The genesis of evidence-based medicine was credited to Archie Cochrane, who advocated randomized controlled trials in the early 1900s to support treatment decisions made by clinicians.6 Cochrane was quite disturbed by the unscientific approaches for many of the treatment decisions of his time, which not only occasionally harmed patients but also promoted technology that was unproven.Table 1: The Five Basic Ideas of Evidence-Based MedicineThe United States is a huge consumer of new technology, with daily introduction of the newest diagnostic tests, cancer treatments, and implants. The marketing fervor for new technology overrides rational consideration about whether the latest innovation is supported by better outcomes over the conventional treatment or justifies the higher costs for these new technologies. In the field of plastic surgery, which continuously strives for innovation, the increased cost must be backed by better outcomes. By bringing outcomes and cost into the equation, the new evidence-based medicine model promotes economic analysis, an important component in evaluating the overall effectiveness of health care delivery.7 LEVELS OF EVIDENCE AND EVIDENCE-BASED MEDICINE The lack of high-level evidence in the plastic surgery literature should be concerning to our specialty. As payers start demanding evidence that supports the use of expensive new products, such as dermal substitutes for breast reconstruction or fillers for reconstructive purposes, the need for evidence clearly affects plastic surgeons’ ability to justify the reimbursement for these essential devices. Although many may argue that the art of plastic surgery cannot be evaluated by the scientific method and certainly that the artistry of this specialty may not be captured by p values or power analyses, it is important to remember that it will be difficult to differentiate plastic surgery from other wannabe specialties encroaching on this field when the broad research literature in plastic surgery is devoid of high-level scientific content. Only through promotion of evidence-based medicine and introspective scrutiny of our practices can plastic surgery lend a strong voice when advocating for patient welfare. Rather than having level V studies based on expert opinions, or level IV studies, which rely on retrospective chart reviews of cases series, plastic surgeons must start performing level III retrospective studies with control groups. The vision of Plastic and Reconstructive Surgery is to think ahead and start planning level II prospective cohort studies, which follow cohorts of patients for long periods of time, or better yet, randomized controlled studies that can scientifically answer important questions in this specialty. Table 2 presents the levels of evidence chart, and Table 3 presents the grades of practice recommendations.Table 2: Levels of Evidence Rating Scale for Therapeutic StudiesTable 3: Scale for Grading Practice RecommendationsThe lack of evidence in medicine was recently demonstrated in an article by Gina Kolata, health columnist for The New York Times, discussing the evidence surrounding beta-carotene and its use as a dietary supplement to protect against cancer. It seems rather intuitive that eating more fruits and vegetables containing beta-carotene, an orange-red organic compound that is a precursor to vitamin A, should make one healthier. After all, our mothers have known all along the wonderful antioxidant effect of beta-carotene, and they have been encouraging us to eat more carrots and broccoli because these vegetables are healthful foods that can make us stronger and run faster, and potentially protect us against ailments. To demonstrate this point, several promising observational studies have shown that people who eat more fruits and vegetables have lower cancer risk,8–10 and laboratory studies have demonstrated the positive effects of beta-carotene on the immune system of the rat.11 Therefore, not only does eating more beta-carotene–containing foods or consuming beta-carotene supplements appear logical, this belief is also supported by level II and level III studies that corroborated the beneficial effects of beta-carotene. “Well, not so fast,” as stated by one of the football gurus in the college pregame show. Two randomized controlled trials in which study subjects took beta-carotene pills or placebos failed to demonstrate a protective effect against cancer and heart disease. In fact, these studies showed a statistically significant increase in lung cancer mortality of subjects taking high levels of beta-carotene over the subjects receiving placebo pills.12–14 Results of these trials dashed the hopes of millions of people who swore by this supplement. So how can this be, when all the cumulative evidence supports the effectiveness of this magic pill in protecting one from disastrous health problems? In addition, how valid is the evidence from the multiple observational and animal studies that showed the efficacy of beta-carotene? The answer lies in the basic epidemiology concept of confounding variables and biases. In these observational studies, the study subjects who took beta-carotene were very different from the subjects who did not take this dietary supplement. The subjects who took beta-carotene were potentially more motivated to be healthy; perhaps they exercised more, refrained from smoking, or ate less fatty food. Although an epidemiologist can usually account for potential confounding variables, unknown confounders can contribute to differences between two study groups. Because it is impossible for a statistician to control for unknown confounders and selection biases that can be introduced into the study unbeknownst to the investigators, observational studies are categorized as level II (prospective) or level III (retrospective) evidence studies. By contrast, in clinical trials, the study subjects are allocated randomly to either intervention or no-intervention groups.15 For example, the intervention group that underwent a surgical treatment or took a medication is compared with the control group that received an alternative surgical treatment or took the placebo pill. Therefore, the random allocation of intervention, provided that the sample size is sufficiently large, should balance out known and unknown confounders. Thus, in this strict experimental situation, level I evidence is produced that can potentially define whether the intervention is truly effective. Despite the allure of randomized controlled trials, there are certain perils with clinical trials (Table 4). For example, the results may not be generalizable to the entire population because they often are conducted in large academic settings under strict inclusion and exclusion criteria. Patients in these academic centers may be quite different from those in the general population, and the level of expertise in these centers may be higher than in some community hospitals. Therefore, randomized controlled trials are often considered as efficacy studies that are conducted under ideal situations, when compared with effectiveness studies that are conducted without randomization designs. In an effort to achieve generalizable results, the National Institutes of Health put forth a conscious effort to request inclusion of minority groups in National Institutes of Health–funded clinical trials to ensure that the results can be applicable to all racial groups and for various socioeconomic strata.Table 4: Randomized Controlled StudiesEVIDENCE-BASED MEDICINE, THE AMERICAN SOCIETY OF PLASTIC SURGEONS, AND PLASTIC AND RECONSTRUCTIVE SURGERY: A NEW INITIATIVE It is distressing when a long-held belief regarding a treatment’s effectiveness is dispelled by a more rigorous study design. However, striving for the highest level of evidence in clinical research is essential and will guide the decision-making process, to allow us to provide the best treatment for our patients. It is unnerving to challenge a long-established practice. For example, dextran is routinely used after free flap surgery, and its use may be justified if evidence shows that it can prevent free flap failure. However, because the risk of flap failure in high-volume centers is quite low, it will require the recruitment of thousands of subjects to reach adequate statistical power. The cost and effort associated with a dextran study may be prohibitive. Therefore, randomized controlled trials should be designed when the study question is so important that the results derived from level I evidence can have an important impact in changing practice patterns. Plastic and Reconstructive Surgery is embarking on an exciting initiative to promote evidence-based medicine. With more effort by researchers to conduct randomized controlled trials, we may witness the walls coming down on many of the sacrosanct practices that we have cherished. The demise of the beta-carotene mirage may serve as a guide, compelling us to seek high-level evidence in our own practices. The American Society of Plastic Surgeons (ASPS) has been spearheading evidence-based medicine through the work of three important committees: the Quality and Performance Measurement Committee, the Health Policy Committee, and the Patient Safety Committee. The premier journal of this specialty—Plastic and Reconstructive Surgery—plans to partner with the ASPS in this movement. The designation of Kevin C. Chung, M.D., M.S., as Section Editor for Outcomes and Evidence-Based Medicine will strive to introduce the concept of evidence-based medicine to our contributing authors and readers. Of course, presenting this concept cannot occur overnight and will require a major shift in how the specialty approaches scientific literature and how it applies evidence in decision-making and clinical care. Several of the proposed evidence-based medicine initiatives aim to: Critically appraise clinical studies with a preference to accept articles with higher levels of evidence. Highlight a key article in each issue of Plastic and Reconstructive Surgery that can serve as a model for an evidence-based medicine–type article. Provide tutorial guides on various aspects of evidence-based medicine such as how to craft practice guidelines, how to distill evidence based on statistical principles, and how to perform economic analysis projects. Invite discussions of selected evidence-based medicine articles by experts who are able to evaluate whether recommendations for new treatments have sufficient evidence to support adoption. Publish systematic reviews and, if possible, meta-analyses that summarize data from the literature and provide readers with an unbiased scientific critique of evidence for plastic surgery technologies and treatments. Collaborate with the ASPS in promoting high-level evidence studies (e.g., deriving evidence for deep venous thrombosis prophylaxis and analyzing outcomes of reconstruction for lower leg injuries). These are ambitious goals that may take several years to complete and involve many simultaneous and intense efforts. Plastic surgery must be more methodical in designing and conducting research, and even more critical in evaluating research publications; therefore, Plastic and Reconstructive Surgery will look for opportunities to capitalize on initiatives already underway that address these issues. For example, the Plastic Surgery Educational Foundation is partnering with the Research Council to hold an inaugural symposium, on May 30 and 31, 2009, following the Research Council meeting in Pittsburgh, which will include topics on how to conduct clinical studies. We will encourage organized plastic surgery to support high-impact research questions and grant applications that will attract a critical mass of clinical researchers who are capable of conducting evidence-based medicine research studies. These efforts will result in publication of higher level scientific evidence, thereby promoting the mission of plastic surgery to ensure the safety and best possible outcomes for our patients. The evidence-based medicine movement in plastic surgery is synergistic with advocacy efforts by the ASPS, which depend on sound scientific data to justify fair insurance-coverage criteria and adequate third-party payer reimbursement for plastic surgery procedures. Unless plastic surgery can provide rich data to support the global scope of plastic surgery practices, payers will continue to use imperfect and often skewed data to their advantage and thus continue to decrease reimbursement. Plastic surgery should lead in the evidence movement or others will be more than happy to lead us. Plastic surgery is a specialty of innovation and the challenge has been presented to us—we must engage and energize our specialty to produce publications of highest levels of evidence, thereby promoting plastic surgeons as the leading scientists in the surgical disciplines. ACKNOWLEDGMENTS Supported in part by a grant from the National Institute of Arthritis and Musculoskeletal and Skin Diseases (R01 AR047328) and a Midcareer Investigator Award in Patient-Oriented Research (K24 AR053120) (K.C.C.).