Integration of color, shape, and texture for image annotation and retrieval

We present algorithms for automatic image annotation and retrieval based on pixel- or region-based color; region-based shape; and block- or region-based texture features and several schemes for integrating them. Automatic region selection is accomplished by integrating color and spatial edge features. Color, shape, and texture indexing may be knowledge-based (using appropriate training sets) or by example. The multi-feature integration algorithms are designed to: (1) offer the user a wide range of options and flexibilities to enhance the outcome of the search and retrieval operations, and (2) provide a compromise between accuracy and computational complexity. One of the novel features of this system is its ability to automatically segment images into meaningful regions, and provide the option of region (object)-based image indexing without user interaction.