Visual tracking based on cooperation of multiple attention regions

This paper describes a method for tracking moving objects with multiple cooperative visual attention regions. Each attention region is tracked using a sum of absolute difference (SAD) correlation technique. The method is based on an implementation of a transputer-based multi-processor vision system with a correlation processor. The vision system provides a large number of attention regions, each of which can be tracked using fast SAD correlation performed in an LSI MEP. We call these regions windows since the region resembles a clipped section of a whole view. On the top of the system, we built a software manager which facilitates program image processing, motion control of a window, and cooperation control of windows. The cooperation is achieved using constraints, which are tree-structured, between windows. Cooperation of multiple attention regions enables one to track route predictable objects, deformable objects, and structured objects in a natural scene. As examples, passing car tracking, human arm tracking, and finger action recognition are shown.