Construct validity, ecological validity and acceptance of self-administered online neuropsychological assessment in adults

Objective: The goal of this project was to explore the initial psychometric properties (construct and ecological validity) of self-administered online (SAO) neuropsychological assessment (using the www.testmybrain.org platform), compared to traditional testing, in a clinical sample, as well as to evaluate participant acceptance. SAO assessment has the potential to expand the reach of in-person neuropsychological assessment approaches.Method: Counterbalanced, within-subjects design comparing SAO performance to in-person performance in adults with diabetes with and without Chronic Kidney Disease (CKD). Forty-nine participants completed both assessment modalities (type 1 diabetes N = 14, type 2 diabetes N = 35; CKD N = 18).Results: Associations between SAO and analogous in-person tests were adequate to good (r = 0.49-0.66). Association strength between divergent cognitive tests did not differ between SAO versus in-person tests. SAO testing was more strongly associated with age than in-person testing (age R2=0.54 versus 0.23), while prediction of education, HbA1c, and estimated glomerular filtration rate (eGFR) did not differ significantly between test modalities (education R2=0.37 versus 0.30; HbA1c R2=0.20 versus 0.12; eGFR R2 = 0.41 versus 0.33). Associations with measures of everyday functioning were also similar (Functional Activities Questionnaire R2=0.08 versus 0.07; Neuro-QoL R2=0.14 versus 0.16; Diabetes Self-Management Questionnaire R2=0.19 versus 0.19).Conclusions: The selected SAO neuropsychological tests had acceptable construct validity (including divergent, convergent, and criterion-related validity), and similar ecological validity to that of traditional testing. These SAO assessments were acceptable to participants and appear appropriate for use in research applications, although further research is needed to better understand the strengths and weaknesses in other clinical populations.