masterhead masterhead masterhead

In-air Typing Interface for Mobile Devices


We propose vision-based interface for mobile devices by tracking 3D motion of a human fingertip using a single camera and by recognizing small input gestures in the air. Since the fingertip near the camera moves fast in the image, a high-frame-rate camera is used for stable tracking. In order to separate the click gesture from the others, frequency filter is applied to scale change in the fingertip images.


Related Research


  1. Takashi Komuro: Vision-based 3D Input Interface Technologies (invited), The 17th International Display Workshops (IDW '10) (Fukuoka, 2010.12.2) / Proceedings, pp. 1739-1742.[PDF]
  2. Takehiro Niikura, Yuki Hirobe, Alvaro Cassinelli, Yoshihiro Watanabe, Takashi Komuro, Masatoshi Ishikawa: In-air typing interface for mobile devices with vibration feedback, ACM International Conference on Computer Graphics and Interactive Techniques (SIGGRAPH 2010) (Los Angeles, 2010.7.25-29) / Proceedings. [PDF]
  3. Takehiro Niikura, Yuki Hirobe, Yoshihiro Watanabe, Takashi Komuro, Masatoshi Ishikawa: 3D Input Interface for Mobile Devices, 12th Virtual Reality International Conference (VRIC 2010/Laval Virtual) (Laval, 2010.4.7-11) / Proceedings, pp.297-298.
  4. Yuki Hirobe, Takehiro Niikura, Yoshihiro Watanabe, Takashi Komuro, Masatoshi Ishikawa: Vision-based Input Interface for Mobile Devices with High-speed Fingertip Tracking, 22nd ACM Symposium on User Interface Software and Technology (UIST2009) (Victoria, 2009.10.5) / Adjunct Proceedings, pp. 7-8.[PDF]
Ishikawa Oku Laboratory, Department of Information Physics and Computing, Department of Creative Informatics,
Graduate School of Information Science and Technology, University of Tokyo
Copyright(c)2008 Ishikawa Oku Laboratory. All rights reserved.
Ishikawa Oku Laboratory WWW admin: