Problems in the Design and Reporting of Trials of Antifungal Agents Encountered During Meta-analysis

Meta-analyses may become biased if the reported data in the individual trials are biased and if overlap among trials cannot be identified. We describe the unanticipated problems we encountered in collecting data for a meta-analysis comparing a new antifungal agent, fluconazole, with amphotericin B in patients with cancer complicated by neutropenia. In 3 large trials that comprised 43% of the patients identified for the meta-analysis, results for amphotericin B were combined with results for nystatin in a "polyene" group. Because nystatin is recognized as an ineffective drug in these circumstances, this approach creates a bias in favor of fluconazole. Furthermore, 79% of the patients were randomized to receive oral amphotericin B, which is poorly absorbed and not an established treatment, in contrast to intravenous amphotericin B, which was administered in 4 of 5 placebo-controlled trials, or 86% of patients. It was unclear whether there was overlap among the "polyene" trials, and it is possible that results from single-center trials were included in multicenter trial reports. We were unable to obtain information to clarify these issues from the trial authors or the manufacturer of fluconazole. Two of 11 responding authors replied that the data were with the drug manufacturer and two indicated that they did not have access to their data because of change of affiliation. In the meta-analyses, fluconazole and amphotericin B (mostly given orally) had similar effects (13 trials), whereas nystatin was no better than placebo (3 trials). Since individual trials are rarely conclusive, investigators, institutions, and pharmaceutical companies should provide essential details about their work to ensure that meta-analyses can accurately reflect the studies conducted and that patients will realize maximum benefits from treatments. We recommend that investigators keep copies of their trial data to help facilitate accurate and unbiased meta-analyses.