Single-Trial Cognitive Stress Classification Using Portable Wireless Electroencephalography

Figures

• 

  Figure 1. Scalp electrode locations (A) covered by the Emotiv Epoc system; and the Emotiv Epoc system as it would be worn by a subject (B). The electrode labeling convention follows the Modified Combinatorial 10–20 Standard [24].

• 

  Figure 2. Experimental design components: examples of congruent and incongruent Stroop color–word stimuli (A); schematic of modified arrow keys on a standard keyboard, used to record subject responses to Stroop stimuli (B); and diagram of the hardware and software configuration used for data collection (C).

• 

  Figure 3. Diagram illustrating the main computational techniques used to pre-process and classify the raw EEG data in the initial analysis methodology described in Section 2.2.1, Section 2.2.2, Section 2.2.3, Section 2.2.4, Section 2.2.5 and Section 2.2.6.

• 

  Figure 4. Box-and-whisker plots summarizing the distributions of reaction times for all 18 subjects to congruent and incongruent color–word stimuli. Values represented are median (across sessions) average reaction times relative to the onset of the color–word stimulus, with averages taken across the 24-word presentations in each session. Red lines indicate the medians of each distribution; blue boxes span the first to third quartiles; and whiskers extend to the extreme values.

• 

  Figure 5. Topographical plots of classification performance averaged across all 18 subjects for the: (A) logistic regression; (B) quadratic discriminant analysis; and (C) three-nearest neighbor classifiers. Values represented by the color maps are the proportion of correctly labeled examples. Values at non-electrode locations were obtained via biharmonic spline interpolation [33]. The electrode labeling convention follows the Modified Combinatorial 10–20 Standard [24].

• 

  Figure 6. Box plots summarizing the distributions of classification accuracies across all 18 subjects for the logistic regression (red); quadratic discriminant analysis (green); and three-nearest neighbor classifiers (blue), on three laterally symmetric pairs of frontal (F3 and F4), temporal (T7 and T8), and occipital (O1 and O2) electrodes. Medians are shown as black dots inside colored circles and boxes span the interquartile range. Values falling outside the interquartile range are plotted as unfilled circles to explicitly show the number of subjects at the extremes of each distribution.

• 

  Figure 7. Fused-feature classification mean accuracy across subjects for logistic regression (red), quadratic discriminant analysis (green), and 3-NN (blue), when 1-s feature extraction windows were triggered by the onset of the color–word stimulus (“Stim Locked”) and when 1-s feature extraction windows were taken at random times (“Random”). Error bars are two standard errors in length.

• 

  Figure 8. Summary of representative fused-feature classification results. Boxplots show the distribution of classifier accuracies across all 18 subjects for a chance logistic regression classifier formed by randomly permuting the congruent and incongruent labels (“Random Label”); a null logistic regression classifier formed by training to discriminate early versus late segments in congruent experimental sessions (“Early-Late”); and the actual logistic regression stress-state classifier trained to discriminate congruent from incongruent segments (“Stress State”).

• 

  Figure 9. First principal component loadings. Visualization of the average first principal component loadings for nine randomly selected subjects (one subject per row). Each row consists of 39 colored panels, one for each of the 39 electrode–RMS feature combinations used for classification. The panels are colored in proportion to the contribution of their corresponding feature to the first principal component; they are ordered in three blocks of 13 corresponding to the 13 analyzed electrodes, with the leftmost block representing the theta RMS feature, the middle block representing the alpha RMS feature, and the rightmost block representing the beta RMS feature. Within each block, the electrode ordering is as follows: F7, F3, Fc5, T7, P7, O1, O2, P8, T8, Fc6, F4, F8, and Af4. For example, the leftmost panel in all rows represents θ RMS on electrode F7 and the rightmost panel β RMS on Af4. Lighter color panels indicate electrode–RMS feature combinations with stronger positive weightings. The orange arrow indicates one particular combination that has relatively high-magnitude weight across subjects; the black arrow indicates one with relatively low-magnitude weight.

• 

  Figure 10. Histograms showing the distributions of RMS voltage across trials (color–word stimulus presentations) in one congruent (grey hatched) and one incongruent (white) experimental session pair, for one electrode–RMS feature combination that shows relatively good class separation (A) and one that shows relatively poor class separation (B). The electrode–RMS feature combinations illustrated in (A,B) correspond to the orange and black arrows, respectively, in Figure 9. Data in (A,B) are from two different subjects. Outliers in both panels are trimmed to avoid scaling issues that hamper visualization.