PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
August 23, 1995JAMA158 citations

Use of methodological standards in diagnostic test research. Getting better but still not good

View Full Paper
MRM. Carrington Reid

Key Points

  • To determine the frequency and temporal changes in the application of seven accepted methodological standards in published diagnostic test research.
  • Reviewed 112 eligible diagnostic test articles identified from 1,302 candidate studies across four major medical journals published between 1978 and 1993.
  • Assessed compliance with seven methodological standards, including patient spectrum specification, subgroup reporting, avoidance of workup and review bias, precision, indeterminate results handling, and test reproducibility.
  • Compliance was generally low across the seven standards: reporting test indexes for clinical subgroups (8%), providing numerical precision (11%), managing indeterminate results (22%), specifying reproducibility (23%), specifying patient spectrum (27%), avoiding review bias (38%), and avoiding workup bias (46%).
  • While compliance improved over time for six of seven standards (rising from 14%–31% in 1978–1981), only avoidance of workup bias was achieved by more than 50% of studies in the 1990–1993 period.

Abstract

Objective. —To determine the frequency and temporal changes in application of seven accepted methodological standards for the evaluation of diagnostic tests. Data Sources. —A search of the MEDLINE database yielded 1302 articles about diagnostic test studies, during a 16-year secular interval, 1978 through 1993, in four prominent general medical journals. Study Selection. —In the 112 eligible studies, the test was intended for clinical use, indexes of accuracy (sensitivity and specificity or likelihood ratios) were provided, and more than 10 patients were enrolled. Data Extraction. —Although each study was critically reviewed by one primary observer, a subset was independently evaluated for interrater consistency. Data Synthesis. —The percentage of studies that fulfilled criteria for each of the seven methodological standards are as follows: (1) specify spectrum of evaluated patients, 27%; (2) report test indexes for clinical subgroups, 8%; (3) avoid workup bias, 46%; (4) avoid review bias, 38%; (5) provide numerical precision for test indexes, 11%; (6) report frequency and management of indeterminate results when calculating test indexes, 22%; and (7) specify test reproducibility, 23%. Secular increases were found for six of the seven standards in ranges of use from 14% to 31% during 1978-1981 to 1990-1993. Nevertheless, only one standard, avoidance of workup bias, was fulfilled by more than 50% of studies in the most recent secular interval. Conclusions. —These results indicate that most diagnostic tests are still inadequately appraised. The routine demand for methodological standards could raise the quality of diagnostic test information, and the careful predissemination evaluation of diagnostic tests could eliminate useless tests before they receive widespread application. (JAMA. 1995;274:645-651)

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

M. Carrington Reid (1995) studied this question.

synapsesocial.com/papers/6a0ea810c12540356222957chttps://doi.org/10.1001/jama.274.8.645
Ask AI
Helpful
Bookmark
Share
View Full Paper