GPU Acceleration of Real-time Feature Based Algorithms

Feature tracking is one of the most fundamental tasks in computer vision, being used as a preliminary step to many high-level algorithms. In general, however, the number of features tracked (leading to more accurate high-level algorithms) must be balanced against the computational requirements of the feature tracking algorithm. To enable a large number of features to be tracked in real time without degrading the computational performance of high-level computer vision algorithms, we offload the feature tracking algorithm to the the video card (GPU) found in modern personal computers. Using the GPU allows for tracking an order of magnitude more features than a pure software-based algorithm, with minimal increase in CPU usage. We have demonstrated the computational benefits of GPU-based feature tracking within a real-time video stabilization application.