Key result
Automated seizure forecasting algorithms achieve moderate predictive performance with a 0.71 mean AUC.
Why the study?
The study aimed to review proposed methodologies and reported performances of automated algorithms for seizure forecast.
What is the current state and performance of automated algorithms for seizure forecast in patients with epilepsy?
Meta-Analysis (n=419)
What is the current state and performance of automated algorithms for seizure forecast in patients with epilepsy?
Effect estimate: Mean AUC 0.71 (95% CI 0.68-0.75)
Automated seizure forecasting algorithms show reasonable discriminative performance (mean AUC 0.71) but only slight improvement over naive forecasting in probabilistic terms (mean BSS 0.13), highlighting the need for standardized evaluation.
This study aims to review the proposed methodologies and reported performances of automated algorithms for seizure forecast. A systematic review was conducted on studies reported up to May 10, 2024. Four databases and registers were searched, and studies were included when they proposed an original algorithm for automatic human epileptic seizure forecast that was patient specific, based on intraindividual cyclic distribution of events and/or surrogate measures of the preictal state and provided an evaluation of the performance. Two meta-analyses were performed, one evaluating area under the ROC curve (AUC) and another Brier Skill Score (BSS). Eighteen studies met the eligibility criteria, totaling 43 included algorithms. A total of 419 patients participated in the studies, and 19442 seizures were reported across studies. Of the analyzed algorithms, 23 were eligible for the meta-analysis with AUC and 12 with BSS. The overall mean AUC was 0.71, which was similar between the studies that relied solely on surrogate measures of the preictal state, on cyclic distributions of events, and on a combination of these. BSS was also similar for the three types of input data, with an overall mean BSS of 0.13. This study provides a characterization of the state of the art in seizure forecast algorithms along with their performances, setting a benchmark for future developments. It identified a considerable lack of standardization across study design and evaluation, leading to the proposal of guidelines for the design of seizure forecast solutions.
No takes yet. Share an insight, caveat, or question.
Carmo et al. (2024) conducted a meta-analysis in Epilepsy (n=419). Automated seizure forecast algorithms vs. Naive forecast was evaluated on Area under the ROC curve (AUC) (Mean AUC 0.71, 95% CI 0.68-0.75). Automated algorithms for seizure forecasting achieved an overall mean area under the ROC curve of 0.71, demonstrating moderate predictive performance.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: