Key result
Most clinical prediction rules lack prospective validation, with only ~3% testing clinical impact.
Why the study?
The quality and methodological standards of recently published clinical prediction rules needed review and improvement.
Systematic Review (n=30)
While clinical prediction rules generally comply with some methodological criteria, there is a significant need for better compliance regarding reproducibility and prospective measurement of clinical impact.
Answers are grounded in this paper and cite their sources.
Clinicians should apply most prediction rules cautiously; challenges routine adoption and extends standards for reproducibility and impact testing.
BACKGROUND: Clinical prediction rules are decision-making tools for clinicians, containing variables from the history, physical examination, or simple diagnostic tests. OBJECTIVE: To review the quality of recently published clinical prediction rules and to suggest methodological standards for their development and evaluation. DATA SOURCES: Four general medical journals were manually searched for clinical prediction rules published from 1991 through 1994. STUDY SELECTION: Four hundred sixty potentially eligible reports were identified, of which 30 were clinical prediction rules eligible for study. Most methodological standards could only be evaluated in 29 studies. DATA ABSTRACTION: Two investigators independently evaluated the quality of each report using a standard data sheet. Disagreements were resolved by consensus. DATA SYNTHESIS: The mathematical technique was used to develop the rule, and the results of the rule were described in 100% (29/29) of the reports. All the rules but 1 (97% [28/29]) were felt to be clinically sensible. The outcomes and predictive variables were clearly defined in 83% (24/29) and 59% (17/29) of the reports, respectively. Blind assessment of outcomes and predictive variables occurred in 41% (12/29) and 79% (23/29) of the reports, respectively, and the rules were prospectively validated in 79% (11/14). Reproducibility of predictive variables was assessed in only 3% (1/29) of the reports, and the effect of the rule on clinical use was prospectively measured in only 3% (1/30). Forty-one percent (12/29) of the rules were felt to be easy to use. CONCLUSIONS: Although clinical prediction rules comply with some methodological criteria, for other criteria, better compliance is needed.
No takes yet. Share an insight, caveat, or question.
Andreas Laupacis (1997) conducted a systematic review in Clinical prediction rules (n=30). Clinical prediction rules was evaluated on Compliance with methodological standards. In a review of 30 clinical prediction rules, although most were clinically sensible, only 3% assessed reproducibility of predictive variables or prospectively measured the effect on clinical use.
Synapse has enriched 10 related papers. Consider them for comparative context: