Answers are grounded in this paper and cite their sources.
Risk-adjusted mortality is a poor primary quality metric for PCI, and its use in public reporting should be modified to prevent risk aversion and ensure access to care for high-risk patients.
HomeCirculation: Cardiovascular Quality and OutcomesVol. 12, No. 5What Death After Percutaneous Coronary Intervention Cannot Teach Free AccessEditorialPDF/EPUBAboutView PDFView EPUBSections ToolsAdd to favoritesDownload citationsTrack citationsPermissions ShareShare onFacebookTwitterLinked InMendeleyReddit Jump toFree AccessEditorialPDF/EPUBWhat Death After Percutaneous Coronary Intervention Cannot TeachThe Inadequacy of Risk-Adjusted Mortality as the Primary Quality Metric for Percutaneous Coronary Intervention Frederic S. Resnic, MD, MSc and Arjun Majithia, MD Frederic S. ResnicFrederic S. Resnic Frederic S. Resnic, MD, MSc, Division of Cardiovascular Medicine, Lahey Hospital and Medical Center, 5 E, 41 Mall Rd, Burlington, MA 01805. Email E-mail Address: [email protected] Division of Cardiovascular Medicine, Lahey Hospital and Medical Center, Burlington, MA (F.S.R.). and Arjun MajithiaArjun Majithia Division of Cardiovascular Medicine, Brigham and Women's Hospital, Boston, MA (A.M.). Originally published20 May 2019https://doi.org/10.1161/CIRCOUTCOMES.119.005692Circulation: Cardiovascular Quality and Outcomes. 2019;12:e005692This article is a commentary on the followingCauses of Mortality After Percutaneous Coronary InterventionSee Article by Bricker et alState-mandated public reporting of outcomes after cardiovascular procedures was initiated nearly 20 years ago when the New York State Department of Public Health began collecting information on surgeon-specific mortality artery after coronary artery bypass grafting. Over the next several years, New York began collecting cardiologist-specific mortality after percutaneous coronary intervention (PCI) and was soon followed by Massachusetts and other states establishing similar programs.1 The existing policies in New York and Massachusetts have undergone significant refinements in light of a large body of evidence, suggesting that mandatory public reporting of outcomes after PCI is associated with aversion of high-risk patients and worse condition-specific (rather than the reported, procedure specific) outcomes.2 These findings have also led the interventional cardiology community, in both public reporting and nonreporting environments, to question the reliance on risk-adjusted mortality as the sole measure of reported procedural quality.In this issue of Circulation: Cardiovascular Quality and Outcomes, Bricker et al3 present their study detailing the causes of mortality after PCI within the Veterans Affairs healthcare system. For this study, the authors performed detailed chart reviews of 1674 patients who died within 30 days of their PCI procedure to determine whether the cause of death was cardiac versus noncardiac or undifferentiated. Cardiac deaths were further adjudicated as directly related to the PCI procedure or not related to the procedure. Overall, a minority of deaths that occurred within 30 days of PCI were definitively cardiovascular (28%), and only a small proportion of these (8%) was attributable directly to the procedure.The validity of the study findings relies heavily on accurate adjudication of the causes of mortality. The authors should be commended for reviewing a vast number of patient charts to ensure accurate assignment of cardiovascular and noncardiovascular mortality. Additionally, there was excellent agreement among reviewers in determining cardiac versus noncardiac deaths. Importantly, all cardiac deaths were reviewed by 2 authors to determine if the death was related to the PCI procedure, and a third reviewer was used to adjudicate discrepancies. It is worth noting that the study, conducted within the Veterans Affairs Clinical Assessment Reporting and Tracking Program database, comprised patients who were predominantly male and white, and, therefore, may not be generalizable to other populations. Additionally, the rates and severity of comorbidities among the Veterans Affairs population may differ from non-VA hospital patients and might affect generalizable estimates of mortality related to the procedure. Overall, the study findings are an important contribution to the ongoing discussion regarding the use of all-cause mortality as a primary metric of quality for PCI, given the low absolute mortality rate after PCI, and the large proportion of these deaths that seem unrelated to the procedure itself.The appeal of using mortality as an outcome is understandable—it is easily measurable and clinically important to both physicians and patients. However, there are several flaws and inadvertent consequences of using risk-adjusted mortality as a sole measure to assess PCI quality. As the study by Bricker et al3 demonstrates, mortality after PCI is infrequent and only weakly associated with the procedure. In fact, the vast majority of early deaths are noncardiac in origin, let alone attributable to the index procedure. Additionally, barring a catastrophic complication in the cardiac catheterization laboratory, it is exceedingly difficult to determine whether the cause of death after PCI is attributable to the procedure itself rather than a culmination of clinical events either leading to or subsequent to the procedure. Risk adjustment for comorbid conditions cannot fully capture these nuances or fully account for the severity of presentation. In other words, the association between an individual operator and mortality rates after PCI procedures likely remain heavily confounded.There are significant risks to implementing imprecise metrics to measure quality, and these issues are further magnified by state-mandated public reporting. Individual physicians and institutions are wary of existing risk-adjustment methods and the potential of being identified (and misidentified) as negative performance outliers. A recent study examining potential impacts of modifying the New York State reporting policy demonstrated similar rates of outlier identification in a model including patients with refractory shock and a model excluding shock. However, a significant proportion of physicians identified as outliers with one exclusion rule were not identified with the alternative model.4 Such findings are highly concerning to individual operators and institutions, because the consequences of being labeled a negative outlier are far-reaching. These fears are thought to lead to substantial risk aversion of high-risk patients.5 An operator or institution performing PCI in predominantly low-risk patients will appear to have excellent outcomes, but this will undoubtedly occur at the cost of high-risk patients (such as those with cardiogenic shock or cardiac arrest) not receiving treatment. Such high-risk patients certainly have a higher likelihood of mortality under the best of circumstances but also clearly derive a greater benefit from PCI than low-risk, stable patients. Finally, for low volume centers and individual operators, stable and reliable measures of PCI performance can be difficult to assess because a handful of cases may cause dramatic changes in rates of the outcomes being measured. Ultimately, the consequence of using a blunt measure of quality is erosion of patient and provider trust, misidentified outliers, cost, and risk to patients. Although mortality may be easy to measure, it remains a poor indicator of overall PCI quality.We must reconsider how to balance the tension between identifying metrics that are simple and easy to measure and those that more clearly capture overall procedural quality. The National Quality Forum suggests that in addition to outcomes, high-quality healthcare encompasses safety, timeliness, effectiveness, efficiency, equity, and patient-centeredness. Toward this holistic view of quality, a more comprehensive approach to assessment of PCI quality in both public reporting and nonreporting states would incorporate clinical outcomes, process measures, and indices of access to care for those patients who would most likely benefit from treatment. In addition to mortality, other easily measurable clinical variables, such as bleeding, vascular complications, contrast use, and subsequent kidney injury should be considered individually, or as part of a composite outcome including mortality. Additionally, access to care for high-risk and vulnerable patients, an evaluation of processes of care surrounding the procedure, and consideration of procedural appropriateness (both an assessment of appropriate and rarely appropriate procedures) should be included in a holistic assessment. Emphasis should be placed on patient satisfaction, including measures of the patient experience, as well as quality of life after the procedure. Most importantly, instead of focusing on procedure-specific mortality, a shift to condition-specific outcomes may help alleviate risk aversion and ensure appropriate access of care to the highest risk patients6.For states with mandatory public reporting programs, we support the continued collection and detailed analysis of all PCI cases but recommend exclusion of highest risk patients from the public report. These include all patients presenting in cardiogenic shock and those patients presenting with out-of-hospital cardiac arrest with impaired neurological status before PCI. Additional exceptions should be considered for patients with extremely high-risk anatomy in acute myocardial infarction and shock and for patients who are determined to be non–coronary artery bypass grafting candidates through a comprehensive heart team evaluation.We are fortunate to practice interventional cardiology during an era of rapid clinical and technological evolution that now allow us to offer potentially life-saving options to extremely sick patients. However, it is clear that risk-adjusted mortality after such interventions is inadequate as a sole measure to comprehensively represent the quality of care that is provided, and its use as the primary indicator of quality requires immediate modification.DisclosuresNone.FootnotesThe opinions expressed in this article are not necessarily those of the editors or of the American Heart Association.Frederic S. Resnic, MD, MSc, Division of Cardiovascular Medicine, Lahey Hospital and Medical Center, 5 E, 41 Mall Rd, Burlington, MA 01805. Email frederic.[email protected]orgReferences1. Wasfy JH, Borden WB, Secemsky EA, McCabe JM, Yeh RW. Public reporting in cardiovascular medicine: accountability, unintended consequences, and promise for improvement.Circulation. 2015; 131:1518–1527. doi: 10.1161/CIRCULATIONAHA.114.014118LinkGoogle Scholar2. Waldo SW, McCabe JM, O'Brien C, Kennedy KF, Joynt KE, Yeh RW. Association between public reporting of outcomes with procedural management and mortality for patients with acute myocardial infarction.J Am Coll Cardiol. 2015; 65:1119–1126. doi: 10.1016/j.jacc.2015.01.008CrossrefMedlineGoogle Scholar3. Bricker R, Valle JA, Plomondon ME, Armstrong EJ, Waldo SW. Causes of mortality after percutaneous coronary intervention: Insights from the VA Clinical Assessment, Reporting and Tracking program.Circ Cardiovasc Qual Outcomes2019; 12:e005355. doi: 10.1161/CIRCOUTCOMES.118.005355LinkGoogle Scholar4. Hannan EL, Zhong Y, Cozzens K, Gesten F, Friedrich M, Berger PB, Jacobs AK, Walford G, Ling FS, Venditti FJ, King SB. The impact of excluding shock patients on hospital and physician risk-adjusted mortality rates for percutaneous coronary interventions: the implications for public reporting.JACC Cardiovasc Interv. 2017; 10:224–231. doi: 10.1016/j.jcin.2016.10.040CrossrefMedlineGoogle Scholar5. McCabe JM, Joynt KE, Welt FG, Resnic FS. Impact of public reporting and outlier status identification on percutaneous coronary intervention case selection in Massachusetts.JACC Cardiovasc Interv. 2013; 6:625–630. doi: 10.1016/j.jcin.2013.01.140CrossrefMedlineGoogle Scholar6. Klein LW, Harjai KJ, Resnic F, Weintraub WS, Vernon Anderson H, Yeh RW, Feldman DN, Gigliotti OS, Rosenfeld K, Duffy P. 2016 revision of the SCAI position statement on public reporting.Catheter Cardiovasc Interv. 2017; 89:269–279. doi: 10.1002/ccd.26818CrossrefMedlineGoogle Scholar Previous Back to top Next FiguresReferencesRelatedDetailsCited ByMorrison J, Plomondon M, O'Donnell C, Giri J, Doll J, Valle J and Waldo S (2019) Perceptions of Public and Nonpublic Reporting of Interventional Cardiology Outcomes and Its Impact on Practice: Insights From the Veterans Affairs Clinical Assessment, Reporting, and Tracking Program, Journal of the American Heart Association, 8:22, Online publication date: 19-Nov-2019.Related articlesCauses of Mortality After Percutaneous Coronary InterventionRory S. Bricker, et al. Circulation: Cardiovascular Quality and Outcomes. 2019;12 May 2019Vol 12, Issue 5 Advertisement Article InformationMetrics © 2019 American Heart Association, Inc.https://doi.org/10.1161/CIRCOUTCOMES.119.005692PMID: 31104471 Originally publishedMay 20, 2019 KeywordsNew YorkEditorialspercutaneous coronary interventioncause of deathPDF download Advertisement SubjectsComplicationsQuality and Outcomes
No takes yet. Share an insight, caveat, or question.
Resnic et al. (2019) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: