Real-time micro-environmental observation with virtual reality

In this paper, the observation technique on the micro environments with a real-time virtual reality camera system, which is constructed with a dynamic focusing lens and a smart vision sensor using the "depth from focus" criteria, is discussed. However, one drawback opt the all-in-focus image is that there is no information about the depth of objects. Then, it is also important to reconstruct a micro 3D environment in real-time to actuate objects in the micro virtual environments. Important factors to realize real-time system with the "depth from focus" criteria, which can obtain the all in-focus image and micro 3D reconstruction, simultaneously, are discussed. Finally, the real-time system is constructed by a dynamic focusing lens, which can change the focus in high frequency, and a smart vision system which is capable in capturing and processing the image data in high speed with SIMD architecture.