Cooking procedure recognition and support system by intelligent environments

In this paper, we propose cooking support system by using ubiquitous sensors. We developed machine learning algorithm that recognizes cooking procedures by taking account of various and numerous sensor information and past human behaviors. In order to provide appropriate instructions to a user, we also developed Markov-model based human behavior prediction algorithm. By employing these algorithms, we developed cooking support system that automatically displays cooking instruction movies according to users progresses. We conducted experiments with subjects and the experimental results confirmed the feasibility of the proposed cooking support system.