Self-administered online neuropsychological assessments demonstrated adequate to good construct validity compared to traditional in-person tests (r = 0.49-0.66) and similar ecological validity.
Cross-Sectional (n=49)
Counterbalanced
Does self-administered online neuropsychological assessment have acceptable construct and ecological validity compared to traditional in-person testing in adults with diabetes?
Self-administered online neuropsychological tests demonstrate acceptable construct and ecological validity compared to traditional in-person testing in adults with diabetes.
Effect estimate: r = 0.49-0.66
Objective: The goal of this project was to explore the initial psychometric properties (construct and ecological validity) of self-administered online (SAO) neuropsychological assessment (using the www.testmybrain.org platform), compared to traditional testing, in a clinical sample, as well as to evaluate participant acceptance. SAO assessment has the potential to expand the reach of in-person neuropsychological assessment approaches.Method: Counterbalanced, within-subjects design comparing SAO performance to in-person performance in adults with diabetes with and without Chronic Kidney Disease (CKD). Forty-nine participants completed both assessment modalities (type 1 diabetes N = 14, type 2 diabetes N = 35; CKD N = 18).Results: Associations between SAO and analogous in-person tests were adequate to good (r = 0.49-0.66). Association strength between divergent cognitive tests did not differ between SAO versus in-person tests. SAO testing was more strongly associated with age than in-person testing (age R2=0.54 versus 0.23), while prediction of education, HbA1c, and estimated glomerular filtration rate (eGFR) did not differ significantly between test modalities (education R2=0.37 versus 0.30; HbA1c R2=0.20 versus 0.12; eGFR R2 = 0.41 versus 0.33). Associations with measures of everyday functioning were also similar (Functional Activities Questionnaire R2=0.08 versus 0.07; Neuro-QoL R2=0.14 versus 0.16; Diabetes Self-Management Questionnaire R2=0.19 versus 0.19).Conclusions: The selected SAO neuropsychological tests had acceptable construct validity (including divergent, convergent, and criterion-related validity), and similar ecological validity to that of traditional testing. These SAO assessments were acceptable to participants and appear appropriate for use in research applications, although further research is needed to better understand the strengths and weaknesses in other clinical populations.
Chaytor et al. (Thu,) conducted a cross-sectional in Diabetes with and without Chronic Kidney Disease (n=49). Self-administered online (SAO) neuropsychological assessment vs. Traditional in-person testing was evaluated on Associations between SAO and analogous in-person tests (r = 0.49-0.66). Self-administered online neuropsychological assessments demonstrated adequate to good construct validity compared to traditional in-person tests (r = 0.49-0.66) and similar ecological validity.