masterhead masterhead  masterhead

In-air Typing Interface for Mobile Devices

Summary

We propose vision-based interface for mobile devices by tracking 3D motion of a human fingertip using a single camera and by recognizing small input gestures in the air. Since the fingertip near the camera moves fast in the image, a high-frame-rate camera is used for stable tracking. In order to separate the click gesture from the others, frequency filter is applied to scale change in the fingertip images.



Movies



  • Youtube [link, link2, link3]


  • Old version

    Related Research

    References

    1. Takehiro Niikura, Yoshihiro Watanabe, Takashi Komuro, Masatoshi Ishikawa: In-Air finger motion interface for mobile devices with vibration feedback, IEEJ Transactions on Electrical and Electronic Engineering, Vol.9, No.4, pp.375-383, 2014. [link]
    2. Takashi Komuro: Vision-based 3D Input Interface Technologies (invited), The 17th International Display Workshops (IDW '10) (Fukuoka, 2010.12.2) / Proceedings, pp. 1739-1742.[PDF]
    3. Takehiro Niikura, Yuki Hirobe, Alvaro Cassinelli, Yoshihiro Watanabe, Takashi Komuro, Masatoshi Ishikawa: In-air typing interface for mobile devices with vibration feedback, ACM International Conference on Computer Graphics and Interactive Techniques (SIGGRAPH 2010) (Los Angeles, 2010.7.25-29) / Proceedings. [PDF]
    4. Takehiro Niikura, Yuki Hirobe, Yoshihiro Watanabe, Takashi Komuro, Masatoshi Ishikawa: 3D Input Interface for Mobile Devices, 12th Virtual Reality International Conference (VRIC 2010/Laval Virtual) (Laval, 2010.4.7-11) / Proceedings, pp.297-298.
    5. Yuki Hirobe, Takehiro Niikura, Yoshihiro Watanabe, Takashi Komuro, Masatoshi Ishikawa: Vision-based Input Interface for Mobile Devices with High-speed Fingertip Tracking, 22nd ACM Symposium on User Interface Software and Technology (UIST2009) (Victoria, 2009.10.5) / Adjunct Proceedings, pp. 7-8.[PDF]
Ishikawa Watanabe Laboratory, Department of Information Physics and Computing, Department of Creative Informatics,
Graduate School of Information Science and Technology, University of Tokyo
Ishikawa Watanabe Laboratory WWW admin: www-admin@k2.t.u-tokyo.ac.jp
Copyright © 2008 Ishikawa Watanabe Laboratory. All rights reserved.