Key result
Cognitive training meta-analyses detail search procedures but frequently omit specific analytic parameters and raw data.
Why the study?
Meta-analyses often present flexibility in methods that can impact results, motivating an assessment of transparency in meta-analyses examining the benefits of cognitive training amid ongoing controversy in the field.
Meta-analyses of cognitive training frequently lack transparency in reporting specific meta-analytic parameters, effect size formulas, and preregistration deviations, highlighting areas for improvement in future reviews.
Answers are grounded in this paper and cite their sources.
Clinicians should interpret cognitive training meta-analyses cautiously; challenges reporting standards and extends calls for full transparency in future syntheses.
Meta-analyses often present flexibility regarding their inclusion criteria, outcomes of interest, statistical analyses, and assessments of the primary studies. For this reason, it is necessary to transparently report all the information that could impact the results. In this meta-review, we aimed to assess the transparency of meta-analyses that examined the benefits of cognitive training, given the ongoing controversy that exists in this field. Ninety-seven meta-analytic reviews were included, which examined a wide range of populations with different clinical conditions and ages. Regarding the reporting, information about the search of the studies, screening procedure, or data collection was detailed by most reviews. However, authors usually failed to report other aspects such as the specific meta-analytic parameters, the formula used to compute the effect sizes, or the data from primary studies that were used to compute the effect sizes. Although some of these practices have improved over the years, others remained the same. Moreover, examining the eligibility criteria of the reviews revealed a great heterogeneity in aspects such as the training duration, age cut-offs, or study designs that were considered. Preregistered meta-analyses often specified poorly how they would deal with the multiplicity of data or assess publication bias in their protocols, and some contained non-disclosed deviations in their eligibility criteria or outcomes of interests. The findings shown here, although they do not question the benefits of cognitive training, illustrate important aspects that future reviews must consider.
No takes yet. Share an insight, caveat, or question.
Sandoval‐Lentisco et al. (2024) conducted a review in Cognitive training (n=97). Cognitive training meta-analyses was evaluated on Transparency of reporting information in meta-analyses. Most cognitive training meta-analyses detailed search and screening procedures, but frequently failed to report specific meta-analytic parameters, effect size formulas, and raw primary data.
Synapse has enriched 10 related papers. Consider them for comparative context: