Key result
Medico-administrative database model outperforms clinical database model for prognosis with an AUC of 0.80.
Why the study?
Certain prognostic factors cannot be taken into account in medico-administrative databases, so this study aimed to estimate the performance of models based on Epi-thor clinical versus medico-administrative databases.
Does a logistic regression model developed from a medico-administrative database perform as well as a model developed from a clinical database?
Observational (n=15,023)
Does a logistic regression model developed from a medico-administrative database perform as well as a model developed from a clinical database?
Answers are grounded in this paper and cite their sources.
A prognostic model developed from a medico-administrative database demonstrated good performance comparable to a clinical database model, despite lacking specific clinical variables.
In medico-administrative database, certain prognostic factors cannot be taken into account. The main objective was to estimate the performance of two models based on two databases: Epi-thor clinical and medico-administrative databases. For each of the two databases, we randomly sampled a development dataset with 70% of the data and a validation dataset with 30%. Performance of models was assessed by Brier score, the area under the receiver operating characteristic (AUC ROC) curve and the calibration of the model. For Epithor and medico-administrative databases, the development dataset included 10,516 patients (with resp. 227 (2.16%) and 283(2.7%) deaths) and the validation dataset included 4,507 patients (with resp. 93 (2%) and 119 (2.64%) deaths). 15 predictors were selected in the models (including FEV, Body Mass Index, ASA score and TNM stage for Epithor). The Brier score values were similar in the models of the two databases. For validation data, the AUC ROC curve was 0.73 [0.68-0.78] for Epithor and 0.8 [0.76-0.84] for medico-administrative databases. The slope of the calibration plot was less than 1 for the two databases. This work shows the good performances of a model developed from a medico-administrative database, despite the absence of clinical variables used in practice by surgeons, such as FEV1, ASA score or TNM stage.
No takes yet. Share an insight, caveat, or question.
Bernard et al. (2023) conducted an observational in Thoracic surgery (Epi-thor database) (n=15,023). Logistic regression model developed from a medico-administrative database vs. Logistic regression model developed from a clinical database (Epi-thor) was evaluated on Area under the receiver operating characteristic (AUC ROC) curve (95% CI 0.76-0.84). A logistic regression model developed from a medico-administrative database demonstrated good prognostic performance compared to a clinical database model.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: