Real time sensor fusion for autonomous underwater imaging in 3D

In this paper a method that enables real-time visual and acoustical processing for 3D imaging is presented. This can be used for 3D-mapping of objects and environments, inspection and/or tracking or a "lock and hold" function for an autonomous underwater vehicle (AUV). The described method gives a framework for real-time 3D information processing and modelling. It makes monitoring of 3D features easy and speeds up higher level algorithms. In underwater vision there is no single sensor that can give solutions to all perceptual problems that may arise. There is a need for data from several sensors to f.x. obtain the desired accuracy and range. The sonar has good range properties but may often have poor angular resolution. On the other hand the camera has poor depth-measurements capabilities and a rather limited sensor-range, but it has good resolution and is able to detect non-structural properties of the observed object such at colour, paint etc. An important property of this method is the fact that the raw-data from the sensors are processed on the fly. The relevant information extracted from the raw-data are organised in a 3D structure. This gives a better signal to noise ratio input to subsequent algorithms. The idea has been investigated with success for the 3D sonar case. In this method there is a close integration between the sensors which is applied before the modelling, matching or identification of objects, making real-time 3D processing feasible at a low hardware cost.