This is the authors' abstract. We don't add key points for this paper.
To The Editors: The US Food and Drug Administration (FDA) has held several meetings discussing clinical trial design for studies of acute otitis media (AOM), 1 including discussions of appropriate endpoints for such trials. The results of the study by Piglansky et al. 2 are based on bacteriologic outcomes as the primary endpoint. The premise of utilizing a bacteriologic outcome as the primary endpoint is based on an understanding of the correlation between clinical and bacteriologic outcomes. Although antimicrobials have a direct effect on microorganisms, this effect should ultimately translate into diminution of the symptoms of the infection for which patients seek treatment. In this study the investigators evaluated 50 children with AOM in a double tympanocentesis study using high dose amoxicillin (80 mg/kg/day 3 times a day for 10 days). The bacteriologic success rate at Day 4 to 6 was 72% (36 of 50), whereas the clinical success rate at Day 4 of 6 was 94% (47 of 50). This translates into a number of children designated as bacteriologic failures on the second tympanocentesis who were clinically cured. The paper does not provide a patient-by-patient listing relating each patient’s bacterial and clinical outcomes; however, there were three patients described as clinical failures who were also bacteriologic failures. Using these numbers we calculated the correlation between the bacteriologic and clinical outcomes (Table 1). 3 The kappa coefficient for the study was 0.28 with a standard deviation of 0.13, showing only fair agreement between the two endpoints.TABLE 1: Comparison of bacteriologic and clinical outcomes in three double tympanocentesis acute otitis media studiesAt a recent FDA meeting on clinical trial study considerations for AOM, 1 several presentations advocated the use of bacteriologic endpoints in double tympanocentesis studies as the primary endpoint. However, the kappa coefficient for the two studies 4, 5 discussed at the advisory meeting (kappa = 0.34 and kappa = 0.35) also showed less than substantial 3 correlation between bacteriologic and clinical endpoints. The cited studies supported a “correlation”4, 5 between children who clinically failed treatment and those who were culture-positive on the second tympanocentesis. To evaluate a true correlation, however, one must also look at the number of children who were clinical successes who remained culture-positive. In both studies as well as the current study by Piglansky et al., 2 substantial numbers of children were clinically cured despite positive cultures on the second tympanocentesis. The chi square test and the associated P value presented in these studies show an association of the two variables but do not provide a quantitative measure of the degree of the relationship between clinical and bacteriologic outcomes. The significant association of the two outcomes is driven by the high sensitivity (number of clinical and bacteriologic success patients/total bacteriologic success patients) of clinical failure for predicting bacteriologic failure. However, the specificity of bacteriologic failure for predicting clinical failure (number of clinical and bacteriologic failures/total bacteriologic failure patients) is too low for use in a clinical trial setting when attempting to differentiate outcomes between treatment arms (Table 1). Although high sensitivity is desirable in both clinical practice and clinical trials, high specificity is also important in clinical trials attempting to assess antimicrobial efficacy. Double tympanocentesis studies in clinical trials for AOM are important for assessment of the bacteriology and the natural history of the disease. However, the less than substantial correlation between bacteriologic and clinical outcomes raises significant questions about using bacteriologic outcomes as the sole measure of drug efficacy. Authors have claimed that clinical endpoints do not sufficiently discriminate between the efficacies of various therapies in AOM. 6 However, it may be that clinical resolution measured at a fixed time point well beyond the expected time of natural resolution of the disease (Day 10 or Day 28) may not provide the most useful information. Time-to-resolution of symptoms, used in other indications with high spontaneous cure rates, 7 may be more meaningful clinical endpoints in AOM clinical trials. Perhaps the intrapatient correlation between the two endpoints would be improved with use of such clinical endpoints. Rosemary Johann-Liang, M.D. Jyoti Zalkikar, Ph.D. John H. Powers, M.D.
Answers are grounded in this paper and cite their sources.
No takes yet. Share an insight, caveat, or question.
Johann‐Liang et al. (2003) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: