On ratio-based color indexing

The color ratio approach to indexing has been found to be robust and effective in indexing image and video databases, in different color spaces, and when using transformed color features, such as those from the Karhunen-Loeve transform (KLT) or the discrete cosine transform (DCT). However, the reason for the superior performance of the color ratio model, especially on different color spaces or with transformed color features has, at best, been speculative. This paper develops a generalized form for the color ratio model, based on which we characterize the general distribution of the color ratios. From the distribution, we present a theory that explains and supports the performance of the color ratio approach in image and video indexing. It is shown that the same theory accounts for its effectiveness in different color spaces and in the transform domain. Some general problems encountered in using the original retinex lightness algorithm, and some other issues specific to ratio-based color indexing are discussed in the light of the theory. Results are presented which show that the proposed theory is supported by empirical evidence.