Simultaneous image formation and motion blur restoration via multiple capture

Advances in CMOS image sensors enable fast image capture, which makes it possible to capture multiple images within a normal exposure time. An algorithm that takes advantage of this capability by simultaneously constructing a high dynamic range image and performing motion blur restoration from multiple image captures is described. The algorithm comprises two main procedures-photocurrent estimation and motion/saturation detection. It operates completely locally-each pixel's final value is computed using only its captured values-and recursively, requiring the storage of only a constant number of values per pixel independent of the number of images captured. These modest computational and storage requirements make it feasible to integrate all needed memory and processing with the image sensor on a single CMOS chip. Simulation results demonstrate the enhanced SNR, dynamic range, and the motion blur restoration obtained using our algorithm.