masterhead masterhead  masterhead

In-air Typing Interface for Mobile Devices

Summary

We propose vision-based interface for mobile devices by tracking 3D motion of a human fingertip using a single camera and by recognizing small input gestures in the air. Since the fingertip near the camera moves fast in the image, a high-frame-rate camera is used for stable tracking. In order to separate the click gesture from the others, frequency filter is applied to scale change in the fingertip images.


Movies

Related Research

References

  1. Takehiro Niikura, Yoshihiro Watanabe, Takashi Komuro, Masatoshi Ishikawa: In-Air finger motion interface for mobile devices with vibration feedback, IEEJ Transactions on Electrical and Electronic Engineering, Vol.9, No.4, pp.375-383, 2014. [link]
  2. Takashi Komuro: Vision-based 3D Input Interface Technologies (invited), The 17th International Display Workshops (IDW '10) (Fukuoka, 2010.12.2) / Proceedings, pp. 1739-1742.[PDF]
  3. Takehiro Niikura, Yuki Hirobe, Alvaro Cassinelli, Yoshihiro Watanabe, Takashi Komuro, Masatoshi Ishikawa: In-air typing interface for mobile devices with vibration feedback, ACM International Conference on Computer Graphics and Interactive Techniques (SIGGRAPH 2010) (Los Angeles, 2010.7.25-29) / Proceedings. [PDF]
  4. Takehiro Niikura, Yuki Hirobe, Yoshihiro Watanabe, Takashi Komuro, Masatoshi Ishikawa: 3D Input Interface for Mobile Devices, 12th Virtual Reality International Conference (VRIC 2010/Laval Virtual) (Laval, 2010.4.7-11) / Proceedings, pp.297-298.
  5. Yuki Hirobe, Takehiro Niikura, Yoshihiro Watanabe, Takashi Komuro, Masatoshi Ishikawa: Vision-based Input Interface for Mobile Devices with High-speed Fingertip Tracking, 22nd ACM Symposium on User Interface Software and Technology (UIST2009) (Victoria, 2009.10.5) / Adjunct Proceedings, pp. 7-8.[PDF]
Ishikawa Watanabe Laboratory, Department of Information Physics and Computing, Department of Creative Informatics,
Graduate School of Information Science and Technology, University of Tokyo
Copyright(c)2008 Ishikawa Watanabe Laboratory. All rights reserved.
Ishikawa Watanabe Laboratory WWW admin: www-admin@k2.t.u-tokyo.ac.jp