Answers are grounded in this paper and cite their sources.
Experimental study demonstrates superior activity recognition and proactive assistance in home environments, indicating a viable framework for autonomous socially assistive robots.
A significant barrier to the long-term deployment of autonomous socially assistive robots is their inability to both perceive and assist with multiple activities of daily living (ADLs). In this paper, we present the first multimodal deep learning architecture, POVNet+, for multi-activity recognition for socially assistive robots to proactively initiate assistive behaviors. Our novel architecture introduces the use of both ADL, motion embedding spaces and a state estimation method to uniquely detect between a known ADL being performed, an unseen ADL, or a known ADL being performed atypically in order to assist people in real scenarios. Comparison experiments with state-of-the-art human activity recognition methods show our POVNet+ method has higher ADL classification accuracy. Human-robot interaction experiments in a cluttered living environment with multiple users and the socially assistive robot Leia using POVNet+ demonstrate the ability of our multi-modal ADL architecture in successfully identifying different seen and unseen ADLs, and ADLs being performed atypically, while initiating appropriate assistive human-robot interactions.
No takes yet. Share an insight, caveat, or question.
Pashangpour et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: