• Sensor Fusion
• Dynamic Image Control
• Vision Architecture
• Meta-Perception

Sensory-Motor Fusion System

• Throwing and Batting robot system (2009-)
• High-speed Catching System (exhibited in National Museum of Emerging Science and Innovation since 2005)
• Lightweight High-Speed Multifingered Hand System (2002-)
• High-speed Manipulation System (2000-)
• Column Parallel Vision System (CPV) (2000-)

Grasping/Manipulation

• High-speed Catching Based on Inverse Motion Approach (2010-)
• Dynamic Folding of a Cloth using Dual High-speed Multifingered Hand and Slider (2010-)
• Dynamic Manipulation of a Linear Flexible Object with a High-speed Robot Arm (2009-)
• Catching a small object in high-speed motion (2009-)
• Knotting manipulation based on skill synthesis (2008-)
• Tool Manipulation by a Multifingered Hand Using a High-speed Vision (2007-)
• One Handed Knotting of flexible rope using a High-speed Multifingered Hand (2006-)
• High-speed Throwing Motion Based on Wave Propagation (2006-)
• Ball Control in High-speed Batting Motion (2005-)
• Dynamic Regrasping Using a High-speed Multifingered Hand and a High-speed Vision System (2005-)
• Dynamic Pen Spinning Using a High-speed Multifingered Hand with High-speed Tactile Sensor (2005-)
• Dynamic Holding Using a High-speed Multifingered Hand (2004-)
• High-Speed Batting Using a Multi-Jointed Manipulator (2003-)
• Soft Catching with a soft finger (2003-)
• Dynamic Active Catching Using High-speed Multifingered Hand (2002-)
• Dynamic Grasping Using High-speed Visual Feedback (2001-)

Robot Vision

• Pixel-parallel collision detection for safe human-robot-coexistence
• Visual Feedback System Using Multi-High-Speed Vision for High-Speed Manipulation (2003-)
• Real time 3D Shape Recognition Using Image Moment-Based Features (2003-)

Sensor Fusion/Sensory-Motor Fusion Theory

• Adjustment of Discount Rate Using Index for Progress of Learning (2003)
• Acquisition of Dynamics Matching in Sensory-Motor Fusion System (2001-2002)

Sensory-Motor Fusion System

• Emergency stop for safe human-robot-coexistence (2002-2004)
• A system for tactile sense through human sensory nerve fiber (2001-2002)
• 1ms Sensory-Motor Fusion System (1995-2000)
• Visual Haptization System (1997-1998)
• 1ms Visual Feedback System (1996-1999)

Grasping/Manipulation

• Grasping Using High-Speed Visual Feedback (1998-2001)
• Visual Impedance for Robot Control (1998-2000)
• Optimal Grasping Using Visual and Tactile Feedback (1996-2000)

Sensor Fusion/Sensory-Motor Fusion Theory

• Sensor Selection Method Considering Communication Delays (2003)
• Integration of Active Exploration and Task Oriented Motion (1997)
• Learning of Force Control Parameter using Vision (1994-1996)
• A Model of Acquiring a Skilled Movement by Searching the Optimal Trajectory and Learning the Inverse Model (1994-1996)
• An Active Sensing Method Using Estimated Errors for Multisensor Fusion Systems (1992-1996)
• Haptic Motion of Distributed Tactile Sensor for Obtaining Tactile Pattern (1993-1995)
• Auditory-Visual Fusion Using Multi-Input Hidden Markov Model (1990-1992)

Human Interface

• Portable Assist Tool with Visual and Force Feedback (2000)
• Robotics Aided Drawing (RAD) system (1998)
• Touching an Object by Visual Information (1997-1998)
• Effects of Active Perception for Visuo-Motor Sensory Integration (1995-1997)

Systems

• Stationary Observation System for High-speed Flying Objects (2010)
• High-Speed Focusing Vision (2009-)
• High-Speed Variable-Focus Optical System for Extended Depth of Field (2009)
• Real-World-Oriented Interaction between Humans and Microorganisms (2008-)
• High-Speed Scanning Microscope by Depth From Diffraction (DFDi) Method (2007-)
• High-Speed Tracking of Ascidian Spermatozoa (2007-)
• Mobile Microscope System (2006-)
• Three-dimensional tracking of a motile microorganism (2004-)
• Single-Cell Level Continuous Observation System for Microorganism Galvanotaxis (2003-)
• Microorganism Tracking System (1999-)
• Microscopic Visual Feedback (MVF) System (1996-)

Devices

• Saccade Mirror: High-speed Gaze Control Device Using Rotational Mirrors (2009-)
• Dynamorph Lens (DML): A High-Speed Liquid Lens with High Resolution (2005-)
• Variable-Focus Lens with 1-kHz bandwidth (2001-205)
• Vision Chip (Vision Architecture Project)
• CPV: Column Parallel Vision System

Algorithms

• Quasi Stationary Observation of Dynamic Microorganism (2008)
• High-Speed DFDi Algorithm for Multiple Cells (2006-)
• High-Speed Auto-Focusing of A Cell - Depth From Diffraction (DFDi) (2003-)
• High-Speed Snake Algorithm For Tracking A Microorganism (2003)
• High-Speed Target Tracking using Self Windowing

Organized Bio-Modules (OBM)

• Motion Control of Microorganism in 3-D Space using High-Speed Tracking (2006-)
• Visualization and Decoding of External Stimuli Perceived by Living Microorganisms (2006-)
• Nonholonomic Properties in Paramecium Galvanotaxis and Path Planning of Paramecium Cells (2005-)
• Dynamics Model of Paramecium Galvanotaxis for Microrobotic Application (2004-)
• A Current-Based Electrostimulation Device for the Motion Control of Paramecium Cells (2003-)
• Microrobotic Visual Control of Motile Cells using High-Speed Tracking System (2003-)
• Organized Bio-Modules (OBM) using Microorganisms (2002-)

High-speed Vision Systems

• Image-moment Sensor (2004-)
  • 320x240 Pixel Chip using Dynamic Logic Circuits (2008-)
  • 128x128 Pixel Chip and Small Sensor Board (2007-)
• High-speed Vision with Massively Parallel Coprocessors (2006-)
• Processor for High-speed Moment-based Analysis of Numerous Objects (2006-)

Realtime Vision and Applications

• Wide Range Image Sensing Using a Thrown-up Camera (2009-)
• Synchronized Video: An Interface for Harmonizing Video with Body Movements (2009-)
• Book Flipping Scanning (2009-)
• In-air Typing Interface for Mobile Devices (2009-)
• Surface Image Synthesis of Spinning Cans (2009-)
• Human Gait Estimation using a Wearable Camera (2009-)
• High-S/N Imaging of a Moving Object using a High-frame-rate Camera (2008-)
• Zooming Touch Panel (2007-)
• Real-time Shape Measurement of a Moving/Deforming Object (2006-)
• Real-time Particle Measurement/Fluid Measurement (2006-)

Computer Vision Based on New Principles

• High-resolution Shape Reconstruction from Multiple Range Images (2009-)
• Stereo Vision using Prior Knowledge for Artificial Objects (2009-)
• 3D Object Pose Estimation using an Analysis-by-Synthesis Method (2009-)
• Estimation of Non-rigid Surface Deformation using Developable Surface Model (2009-)
• Multi-frame Simultaneous Alignment for Reconstruction of a High-resolution 3D Shape (2007-)

Systems

• VCS-IV: Real-time Visual Processing System using a Vision Chip (2003-2005)
• A Programmable Vision Chip with 64x64 pixels (2001-2004)
• Vision Chip Controller Integrated with RISC Microprocessor (2001-2005)
• A Bit-level Compiler for Massively Parallel Vision Chips (2005-2007)
• High Speed Target Tracking Vision Chip (2000-2007)
• CPV: Column Parallel Vision System (1999-2002)

Architectures and Circuits

• Interleaved Pixel Lookup (2008)
• Shared-Memory Multi-SIMD Architecture (2006-2007)
• Parallel Extraction Architecture for Numerous Particles (2004-2005)
• Dynamically Reconfigurable SIMD Architecture (2001-2004)
• Massively Parallel Vision Chip Architecture (1997-2001)

Algorithms and Applications

• Video Mosaicing using a High-frame-rate Camera (2009)
• PTZ Control of a Remote Camera with Head Tracking (2008-2009)
• Fast Finger Tracking System for In-air Typing Interface (2006-2009)
• Real-time Visual Measurement: Target Counting / Rotation Measurement (2002-2005)
• Multi-Target Tracking Algorithm (2002-2005)
• A Software-Controlled Pixel-Level A-D Conversion Method (2002-2003)
• High Speed Target Tracking using Self Windowing (1993-1999)

Meta-Displays & Meta-Spaces

• Invoked Computing: spatial audio and video AR invoked through miming (2011-)
• Synchronized Video: An Interface for Harmonizing Video with Body Movements (2009-)
• Virtual Haptic Radar: touching ghosts (2008-)
• boxedEgo: an experimental stereoscopic & autoscopic display (2008-)
• Parallax Augmented Desktop (PAD) (2007-)
• The Deformable Workspace: a Membrane between Real and Virtual Space (2008-)
• The Volume Slicing Display (VSD) (2006-)
• Tele-ping pong: proof-of-principle of an IT-engineered wormhole (2005-)
• The Khronos Projector (2005-)

Tracking & expression interfaces

• Laserinne (2009-)
• Light Arrays (2010-)
• A "sensing display" based on a cameraless Smart Laser Projector (2010-)
• scoreLight: laser-based artificial synesthesia instrument (2009-)
• Sticky Light: interacting with a beam of pure light (2008-)
• 3D Retractable Mouse with Haptic Feedback (2006-)
• Gesture tracking with the Smart Laser Scanner (2003-)

Augmented Sensing

• Earlids: voluntary control of auditory gain by contraction of mastication muscles (2010)
• HaptiKar (2008-)
• The Haptic Radar / Extended Skin Project (2006-)
• ChAff (2006)

Meta-Ethics

• Roboethics (2005-)
• Boo-Hooray (2005-)
• Dimensional Metaethics (2005-)

Optical Networking

• Load Balanced Optical Packet Switch using Fiber Delay Line Buffers (2004-)
• Buffered Multistage Interconnection Newtwork (MIN) for packet switching (2003-)
• Unbuffered MIN for circuit-switching on supercomputers (2003-)

Optics in Computing

• Real-time image processing with OCULAR-II: Quad-tree compression (2001-2002)
• Parallel Confocal Laser Microscope System using Integrated Parallel Optical Devices (2000-2002)
• Algorithms for an Optical Parallel Interconnected Architecture (1989-2002)
• Optical Associatron: An Optical Neural Network (1989-1991)

Integration and Alignment of Optical Interconnection Systems

• Folded wave-guide based permutation modules for multistage interconnection networks (2002-2003)
• Real-Time Alignment Using Mechanical Dynamics of Optical Interconnection Systems (2002)
• Simple integration technique to realize alignment-free, plugable parallel optical interconnects (2001-2003)
• Analysis and Characterization of Alignment for Free-Space Optical Interconnects Based on Singular-Value Decomposition (1997-2000)
• Compact chip-to-chip parallel interconnections using GRIN rod lenses (1997)

Reconfigurable Interconnections & Optical Switches

• Guide-wave based, integrated semiconductor (SOA/EA) elementary 2x2 switches (2002-)
• Electromechanical / electro-optically reconfigurable interconnects using wave-guided permutation modules (2002-2003)
• Free-space reconfigurable parallel interconnects using LCD technology (1996-2001)

Faculty

• Masatoshi Ishikawa, Professor
• Hiromasa Oku, Assistant Professor / Lecturer

• Alvaro Cassinelli, Assistant Professor (Research Associate)
• Yoshihiro Watanabe, Assistant Professor (Research Associate)

• Carson Reynolds, Project Assistant Professor / Lecturer (Research Associate)

• Taku Senoo, Project Assistant Professor (Research Associate)
• Yuji Yamakawa, Project Assistant Professor (Research Associate)

• Reiko Sakamoto, Research Support Staff

• Noriko Miyazawa, Secretary
• Emi Oguro, Secretary
• Yufu Saito, Secretary

• Alexis Zerroug, Technical Assistant
• Tomoko Hayashi, Technical Assistant
• Eric Siu, Technical Assistant

Research Fellows

• Seigo Watanabe
• Masahiro Yamada
• Theodorus Tjhang

Research Students

• Chye Connsynn, Research Student
• Hyuno Kim, Research Student
• Miho Tamei, Research Student
• Niklas Bergström, Special Research Student

Graduate Students

• Koutaro Furukawa
• Kohei Okumura
• Tomohiko Hayakawa
• Yushi Moko
• Huang Shouren
• Wang Lihui
• Takehiro Nikura
• Kenichi Murakami

• Koutaro Itoyama
• Yoshiyuki Ohiwa
• Hiroaki Ohno
• Shintaro Kubo
• Hiroki Shibayama
• Hideki Takeoka
• Atushi Matsutani
• Yohei Miura
• Kazuma Murao

• Yusuke Arai
• Wataru Ikarashi
• Hiroshi Otsuka
• Michitaka Kondo
• Yoshiyuki Tabata
• Hiroki Deguchi
• Shisei Nakanou
• Shota Matsuzaki
• Keiko Yokoyama

Former Members

Papers

• Sensor Fusion
• Dynamic Image Control / Micro Visual Feedback
• Vision Architecture
• Meta Perception

Optics in Computing

Movies

• Sensor Fusion
• Dynamic Image Control / Micro Visual Feedback
• Vision Architecture
• Meta Perception

Optics in Computing

YouTube

• Ishikawa Lab Channel
• Lab Video
  

  •  Ishikawa Lab Video (2010.3)

• Throwing Batting Robot
  

  •  Throwing & Batting Robot (full ver.) (2010.1)	•  Directional Hitting (2009.11)
  •  Throwing & Batting Robot (2009.11)	•  Throwing Motion (2009.11)
  •  Batting Motion (2009.11)

• High Speed Robot Hand
  

  •  Dynamic Cloth Folding (2011.5)	•  3D Catching with Tweezers (2010.1)
  •  High-Speed Hand (2009.11)	•  Active Catching (2009.11)
  •  Grasping with Tweezers (2009.11)	•  High-Speed Catching System (2009.11)
  •  High-speed Dribbling (2009.11)	•  Egg Catching (2009.11)
  •  Knotting of a Rope (2009.11)	•  Dynamic Regrasping (2009.11)
  •  Pen Spinning (2009.11)

• Dynamic Image Control
  

  •  A high-speed liquid lens (2010.9)	•  Dynamorph Lens (2010.4)
  •  3D Tracking of a Paramecium (2010.4)	•  Focus Stacked Movie (2010.4)
  •  Visual Tracking of a Ascidian Spermatozoa (2010.4)

• 3D Input Interface
  

  •  3D Input Interface for Mobile Devices (2009.11)

  •  Deformable Workspace (2009.11)

• Book Flipping Scanning
  

  •  Book Flipping Scanning (2010.3)

  •  Real-Time Shape Measurement (2009.11)

• Meta Perception
  

  •  scoreLight (2010.9)	•  The Smart Laser Projector (2010.9)
  •  3d tracking with the markerless Smart Laser Scanner (2010.9)	•  Map browsing with the Smart Laser Scanner (2010.9)
  •  Video browsing with the Smart Laser Scanner (2010.9)	•  Markerless Smart Laser Tracking for HCI (2010.9)
  •  Haptic Radar (2010.9)	•  Volume Slicing Display (2010.9)
  •  The Khronos Projector (2010.9)

Association

• Vision Chip Association(Japanese)

Affiliation

• University of Tokyo
• Graduate School of Information Science and Technology
• Department of Information Physics and Computing
• Department of Creative Informatics
• Faculty of Engineering
• Department of Mathematical Engineering and Information Physics(Japanese)

Utilization of Research Result

• Intelligent Vision System (Hamamatsu Photonics K.K.)