A collaboration support technique by integrating a shared virtual reality and a shared augmented reality

Proposes seamless view-mode switching, a novel technique for supporting spatial collaboration that integrates a shared virtual environment (SVE) and a shared augmented environment (SAE) in a natural way. The technique uses two view modes: a see-through mode and a blind mode, corresponding to an SAE and an SVE, respectively. In the initial state, the view mode is the see-through one. Whenever a user changes his/her location or scaling factor by using a 3D widget, the view mode is automatically switched to the blind one. In this mode, a computer-graphics human body (avatar), which includes a head and two arms, is displayed in place of a real partner. When a user chooses the see-through mode by using the widget, the position, orientation and scaling factor are gradually changed to those of the partner, and the view mode is switched back to the see-through one. In addition to this seamless view-mode switching, we also employ two techniques for collaboration support. First, the system optionally draws a line from the center of the partner's eyes in his/her viewing direction to enhance face direction information. Second, the system employs two methods for precise calibration: a look-up table-based mechanism for correcting the distorted magnetic field, and a Kalman filter for compensating the computational delay. Owing to these techniques, users of our system can smoothly perform spatial collaboration.