Key result
In a review of 50 multicenter cardiovascular risk prediction studies, 39 (78%) ignored the clustered nature of the data in their statistical analysis.
Why the study?
Clinical prediction models built from multicenter databases present statistical challenges due to clustered data but offer opportunities for model generalizability.
Regression methods and validation strategies tailored to multicenter studies are underutilized in cardiovascular prediction research, and reporting on generalizability lacks transparency.
Answers are grounded in this paper and cite their sources.
Cardiovascular risk models from multicenter data may lack reliable performance; leaves open whether clustering-aware methods improve transportability.
BACKGROUND: Clinical prediction models are often constructed using multicenter databases. Such a data structure poses additional challenges for statistical analysis (clustered data) but offers opportunities for model generalizability to a broad range of centers. The purpose of this study was to describe properties, analysis, and reporting of multicenter studies in the Tufts PACE Clinical Prediction Model Registry and to illustrate consequences of common design and analyses choices. METHODS: Fifty randomly selected studies that are included in the Tufts registry as multicenter and published after 2000 underwent full-text screening. Simulated examples illustrate some key concepts relevant to multicenter prediction research. RESULTS: Multicenter studies differed widely in the number of participating centers (range 2 to 5473). Thirty-nine of 50 studies ignored the multicenter nature of data in the statistical analysis. In the others, clustering was resolved by developing the model on only one center, using mixed effects or stratified regression, or by using center-level characteristics as predictors. Twenty-three of 50 studies did not describe the clinical settings or type of centers from which data was obtained. Four of 50 studies discussed neither generalizability nor external validity of the developed model. CONCLUSIONS: Regression methods and validation strategies tailored to multicenter studies are underutilized. Reporting on generalizability and potential external validity of the model lacks transparency. Hence, multicenter prediction research has untapped potential. REGISTRATION: This review was not registered.
No takes yet. Share an insight, caveat, or question.
Wynants et al. (2019) conducted a review in Cardiovascular disease (n=50). In a review of 50 multicenter cardiovascular risk prediction studies, 39 (78%) ignored the clustered nature of the data in their statistical analysis.
Synapse has enriched 10 related papers. Consider them for comparative context: