Deformable model-based shape and motion analysis from images using motion residual error

We present a novel method for the shape and motion estimation of a deformable model using error residuals from model-based motion analysis. The motion of the model is first estimated using a model-based least squares method. Using the residuals from the least squares solution, the non-rigid structure of the model can be better estimated by computing how changes in the shape of the model affect its motion parameterization. This method is implemented as a component in a deformable model-based framework that uses optical flow information and edges. This general model-based framework is applied to human face shape and motion estimation. We present experiments that demonstrate that this framework is a considerable improvement over a framework that uses only optical flow information and edges.