Key result
Adding early performance scores to demographic models improves TV show predictive value by ~60%.
Why the study?
Prognostic models are a useful component of clinical assessment in cardiothoracic surgery but may be misapplied.
Prognostic models should be used cautiously and not rely solely on demographic data, as demonstrated by a model predicting outcomes of a television dance competition.
Answers are grounded in this paper and cite their sources.
Early performance data may refine prognostic models; leaves open applicability to cardiovascular outcomes.
OBJECTIVES: Prognostic models are widely used across medicine and within cardiothoracic surgery, where predictive tools such as EuroSCORE are commonplace. Such models are a useful component of clinical assessment but may be misapplied. In this article, we demonstrate some of the major issues with risk scores by using the popular BBC television programme Strictly Come Dancing (known as Dancing with the Stars in many other countries) as an example. METHODS: We generated a multivariable prognostic model using data from the then-completed 19 series of Strictly Come Dancing to predict prospectively the results of the 20th series. RESULTS: The initial model based solely on demographic data was limited in its predictive value (0.25, 0.22; R2 and Spearman's rank correlation, respectively) but was substantially improved following the introduction of early judges' scores deemed representative of whether contestants could actually dance (0.40, 0.30). We then utilize our model to discuss the difficulties and pitfalls in using and interpreting prognostic models in cardiothoracic surgery and beyond, particularly where these do not adequately capture potentially important prognostic information. CONCLUSION: Researchers and clinicians alike should use prognostic models cautiously and not extrapolate conclusions from demographic data alone.
No takes yet. Share an insight, caveat, or question.
Mawhinney et al. (2023) studied Prognostic models. Multivariable prognostic model including early judges' scores vs. Model based solely on demographic data was evaluated on Predictive value (R2). A multivariable prognostic model predicting TV show results improved its predictive value when early performance scores were added to demographic data.
Synapse has enriched 10 related papers. Consider them for comparative context: