Multiarmed Bandits for Sleep Recognition of Elderly Living in Single-Resident Smart Homes

Sleep is an essential activity that affects an individual’s health and ability to perform Activities of Daily Living (ADL). Inadequate sleep reduces cognitive capacity and leads to health-related issues such as cardiovascular diseases. Sleep disorders are more prevalent in older adults. Therefore, it is essential to recognize sleep patterns and support older adults and their caregivers. In our study, we collect data in real-world unconstrained and non-intrusive environments. This paper presents a novel sleep activity recognition method using motion sensors for recognizing nighttime and daytime sleep, which can further enable the development of insightful healthcare applications. The research objectives are to evaluate the application of using Multi-Armed Bandit methods to (i) learn normal sleep patterns, (ii) evaluate sleep quality, and (iii) detect anomalies in sleep activity for 11 elderly participants living in single-resident smart homes. We evaluate the performance of Thompson Sampling, Random Selection, and Upper Confidence Bound MAB methods. Thompson Sampling outperformed the other two methods. Our findings show most elderly participants slept between 6 and 8 hours with 85% sleep efficiency and up to 3 awakenings per night.