Answers are grounded in this paper and cite their sources.
Objective Computer-vision has been used for environmental classification during gait and is often used to inform control in assistive systems; however, the ability to predict how the foot will contact a changing environment is underexplored. Methods We evaluated the feasibility of forecasting the anterior-posterior foot center-of-pressure (COP) and time-of-impact (TOI) prior to foot-strike on a level-ground-to-stair-ascent transition. Eight subjects wore a camera that supplied paired grayscale stereo frames on their right shank and instrumented insoles in their shoes while performing level-ground-to-stair-ascent transitions in a controlled laboratory setting (~90 trials each). We trained one CNN-RNN base model for COP and another for TOI, then fine-tuned both for each subject to generate continuous forecasts (16.67 ms temporal resolution) within a 250 ms window prior to foot-strike, termed the forecast horizon (FH). Performance was evaluated on held-out trials from the same subject using leave-one-out-cross-validation (LOOCV). Results The COP mean absolute error (MAE) was 29.42, 26.82, and 23.72 mm, and the TOI MAE was 21.14, 20.08, and 17.73 ms, for FHs of 150, 100, and 50 ms, respectively. Torso velocity and toe-swing velocity prior to foot-strike were not significantly associated with prediction error in either the COP or TOI task. Further, more anterior foot-strikes were found to reduce COP prediction accuracy but did not affect the TOI prediction accuracy. In a separate live-camera frame-rate test, the image-preprocessing and inference pipeline ran both models simultaneously at approximately 60 processing cycles/s on a consumer-grade laptop and an edge computing device (i.e., Jetson Orin Nano). Conclusion This study demonstrates the feasibility of forecasting COP and TOI from pre-contact visual data for a level-ground-to-stair-ascent transition in a controlled laboratory setting. Significance This may have important implications for anticipatory control in legged systems.
No takes yet. Share an insight, caveat, or question.
Murray et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: