masterhead masterhead  masterhead

Synchronized Video: An Interface for Harmonizing Video with Body Movements


Synchronized Video is a video control technique that shows frames in synchronization with real-world actions. Suitable video content for this type of video interface includes learning forms of exercise and assembly of structural objects. In the proposed system, the user feels as if he or she is standing in front of a strange mirror where there is a virtual human performing the correct actions in synchronization. Also, the proposed technology is effective for projecting target images onto real-world objects serving as a screen, for recreating the same situation as in prepared video content.

Fig. 1 Metaphor of Synchronized Video

The synchronization in this proposed interface is achieved without the user performing any explicit operations. The state created in the real world by the user is what directly controls the video. This design allows transparent video control for users. The intended frames could be provided intuitively in a continuous form.

Fig. 2 Prototype configuration



  1. Yoshihiro Watanabe, Hiroaki Ohno, Takashi Komuro, Masatoshi Ishikawa: Synchronized Video: An Interface for Harmonizing Video with Body Movements, 22nd Symposium on User Interface Software and Technology (UIST2009) (Victoria, 2009.10.5) / Adjunct Proceedings, pp.75-76. [PDF]
Ishikawa Watanabe Laboratory, Department of Information Physics and Computing, Department of Creative Informatics,
Graduate School of Information Science and Technology, University of Tokyo
Ishikawa Watanabe Laboratory WWW admin:
Copyright © 2008 Ishikawa Watanabe Laboratory. All rights reserved.