Collecting Digital Biomarkers on Cognitive Health Through Computer Vision and Gameplay: an Image Processing Toolkit for Card Games

Individuals suffering from cognitive impairment require early diagnosis and frequent follow-up. However, as the healthcare system is overburdened, contact moments with patients are sparse. Digital biomarkers are a form of non-intrusive continuous measurements of cognitive health, found in daily activities. They can help in the diagnosis and follow-up of cognitive impairments. Playing videogames is an example of these daily activities which requires cognitive effort, hence carrying cognitive information. However, extracting these digital biomarkers from commercial games tends to be challenging. To this end, we explored capturing digital biomarkers from existing card games through computer vision. A toolkit was designed for the standard Microsoft Solitaire Collection, allowing for unobtrusively measuring digital biomarkers. Results show that this technique allows for real-time processing of cognitive digital biomarkers. Digital biomarkers were captured from 44 participants in three age groups. An initial data exploration supports the promise of these digital biomarkers as bearers of cognitive information. Differences were seen amongst the age groups caused by age-related cognitive changes. These results suggest that digital biomarkers in commercial games can be used for unobtrusive long-term cognitive monitoring with minimal burden on patient and physician, potentially leading to a more complete, clear cognitive profile.