Dynamic 3-D scene analysis through synthesis feedback control

The analysis of 3-D scenes consisting of nonrigid moving objects using 2-D image sequences is discussed. A parametric description of dynamic objects is extracted, and the time-variant scene parameters are estimated throughout the sequence by employing an analysis-by-synthesis approach. Images are synthesized from the parametric scene description and compared with the original images input to the camera. Frame differences between the synthesized and original images are evaluated to obtain an estimated scene parameter update. The analysis method is applied to videophone scenes in the form of a data compression algorithm, whereby the scene parameters are transmitted and the output sequence is synthesized at the receiver.>