Proposal of Home Context Recognition Method Using Feature Values of Cognitive API

The emerging deep learning technology is a promising means for context recognition with multimedia data. We are interested in using the deep learning with images for context recognition in smart homes. In the home context recognition, the room layout, the environment, and the contexts to be recognized are different from one household to another. Therefore, a unique recognition model is required for every different household. For this, if we take a naive approach that uses the deep learning directly, a huge amount of labeled images are required, which is practically impossible for general households. The goal of this research is to develop an image-based context recognition method that is affordable at home. In the proposed method, we exploit a cognitive API which performs general image recognition, and retrieve the information within the image as text. By using the text as features, we classify the context with ordinal supervised machine learning. Compared with the expensive approach with deep learning, the proposed method uses generic image recognition of the cognitive API, and light-weight machine learning. As a result, the context recognition customized for every household can be achieved with much less effort.