How to successfully classify EEG in motor imagery BCI: a metrological analysis of the state of the art

Abstract Objective. Processing strategies are analyzed with respect to the classification of electroencephalographic signals related to brain-computer interfaces (BCIs) based on motor imagery (MI). A review of literature is carried out to understand the achievements in MI classification, the most promising trends, and the challenges in replicating these results. Main focus is placed on performance by means of a rigorous metrological analysis carried out in compliance with the international vocabulary of metrology. Hence, classification accuracy and its uncertainty are considered, as well as repeatability and reproducibility. Approach. The paper works included in the review concern the classification of electroencephalographic signals in motor-imagery-based BCIs. Article search was carried out in accordance with the Preferred Reporting Items for Systematic reviews and Meta-Analyses standard and 89 studies were included. Main results. Statistically-based analyses show that brain-inspired approaches are increasingly proposed, and that these are particularly successful in discriminating against multiple classes. Notably, many proposals involve convolutional neural networks. Instead, classical machine learning approaches are still effective for binary classifications. Many proposals combine common spatial pattern, least absolute shrinkage and selection operator, and support vector machines. Regarding reported classification accuracies, performance above the upper quartile is in the 85%–100% range for the binary case and in the 83%–93% range for multi-class one. Associated uncertainties are up to 6% while repeatability for a predetermined dataset is up to 8%. Reproducibility assessment was instead prevented by lack of standardization in experiments. Significance. By relying on the analyzed studies, the reader is guided towards the development of a successful processing strategy as a crucial part of a BCI. Moreover, it is suggested that future studies should extend these approaches on data from more subjects and with custom experiments, even by investigating online operation. This would also enable the quantification of the results reproducibility.