SOM based image data structuring in an augmented reality scenario

Our research focuses on the development of a mobile augmented reality system which is capable of acquiring image data in an unrestricted environment and which provides a comfortable facility to label this data. To structure the image data modified MPEG-7 features are computed and by means of self organizing maps (SOM), the imagery can be labeled stepwise. First, the complete data set is projected onto the SOM using a combination of color and edge features. In a second step, selected parts of the imagery are retrained weighting the feature blocks depending on characteristics of the acquired image data. Within few steps, the partitioning leads to SOM nodes on which the projected imagery can be labeled as objects or rejected.