Multiple perspective interactive video

We present our approach to Multiple Perspective Interactive (MPI) video. In MPI video, a viewer could view an event from multiple perspectives, even based on the contents of the events. Using strategically located multiple cameras a set of image sequences is obtained and used to build a 3-dimensional model of the important events in a scene. Considering the request of a user, the system decides the best camera at every time instant and edits image sequences from these camera, much like an editor in standard live sport events, to provide a user the video sequence of the episode from the user's desired perspective. Our system features automatic camera selection and interaction using three-dimensional cursors. We present results of a prototype which is a part of our early efforts to establish a framework of MPI video. Our prototype is a football video retrieval system. We present our results to concretely show the concept of the interactive video.