High-speed image processing system for tele-micro-operation

An observational system for tele-micro-operation has been proposed with a dynamic focusing system and a high-speed image processing system using the "depth from focus" criteria. In our past work (2000), we proposed the system which has the "all-in-focus image" and the "depth" of an object, simultaneously. Actually, in micro operation, such as for micro-surgery, DNA operation and etc., the small depth of a focus on the microscope gives bad observability. In this sense, the "all-in-focus image", which holds the in-focused texture all over the image, is useful for observing micro environments with a microscope. It is also important to obtain the depth map, and to show the 3D micro virtual environments in real-time to actuate the micro objects, intuitively. The past system with dynamic focusing lens and smart sensor could obtain the "all-in-focus image" and the "depth" in 2 sec. To realize real-time micro operation, at least, a 30 frame/sec system should be required. The paper briefly reviews the criteria of "depth from focus" to achieve the all-in-focus image and the 3D micro environments' reconstruction, simultaneously. After discussing the problem in our past system, a new frame-rate system is constructed with high-speed video camera and FPGA hardware. To apply this system in a real microscope, new criteria to reconstruct the all-in-focus image is proposed. Finally, micro observation shows the validity of the system.