Key points are not available for this paper at this time.
Motion in-betweening, a fundamental task in character animation, consists of generating motion sequences that plausibly interpolate user-provided keyframe constraints. It has long been recognized as a labor-intensive and challenging process. We investigate the potential of diffusion models in generating diverse human motions guided by keyframes. Unlike previous inbetweening methods, we propose a simple unified model capable of generating precise and diverse motions that conform to a flexible range of user-specified spatial constraints, as well as text conditioning. To this end, we propose Conditional Motion Diffusion In-betweening (CondMDI) which allows for arbitrary dense-or-sparse keyframe placement and partial keyframe constraints while generating high-quality motions that are diverse and coherent with the given keyframes. We evaluate the performance of CondMDI on the text-conditioned HumanML3D dataset and demonstrate the versatility and efficacy of diffusion models for keyframe in-betweening. We further explore the use of guidance and imputation-based approaches for inference-time keyframing and compare CondMDI against these methods.
Building similarity graph...
Analyzing shared references across papers
Loading...
Setareh Cohan
Guy Tevet
Daniele Reda
University of British Columbia
Tel Aviv University
Simon Fraser University
Building similarity graph...
Analyzing shared references across papers
Loading...
Cohan et al. (Fri,) studied this question.
www.synapsesocial.com/papers/68e60785b6db64358759acdd — DOI: https://doi.org/10.1145/3641519.3657414