Feature Matching With an Adaptive Optical Sensor in a Ground Target Tracking System

We consider methods to address the optical feature-aided remote sensing tracking problem for vehicles in a challenging environment. Our approach is to apply the dynamic data driven application systems computing paradigm to implement control of an adaptive sensor. This adaptive sensor acquires a panchromatic image while simultaneously allowing the collection of visible-near infrared spectral data at specified pixels. This sensor holds the promise of delivering the increased accuracy of targeted spectral sensing without the enormous data volume of full spectral images. The target of interest is optimally imaged by the sensor based on the target's forecasted location and motion relative to the extracted content of the background. Background context is both extracted from the image and created from the OpenStreetMap road network. We describe the implementation of the tracking framework and testing of some of the components using simulated imagery created with the digital imaging and remote sensing image generation model. The Gaussian sum filter is employed to solve the data assimilation problem by forming a multimodel forecasting set that is used to increase the robustness and flexibility of tracking. For feature matching, we create an efficient sampling strategy that is informed by the viewing conditions to adaptively determine which pixels to measure spectrally in order to distinguish between different targets using a spectral distance measure.