The initiative design to combine real bats and balls with online baseball contents

It is very challenging issue to utilize human-being's behaviors or reactions as a way of interacting to virtual world. Indoor baseball simulation system is one of good candidates to combine real equipment and actions with virtual contents. As one of experimental approach to break a barrier between virtual game space and human-being's real behavior, we mapped out an experiment on seamless gaming between 3D virtual game space and human-being's real behavioral space, where real balls and bats are augmented with online baseball contents through computer vision and sensor technologies. The Simulation Engine, the key part of our proposal, consists of 6 components: Pitch Recognizer, Toss Controller, Swing Detector, Vehicle Recognizer, Vehicle Tracker and Trajectory Calculator. This approach, utilizing human-being's behaviors as input event, will open the new field of digital interfaces.