A meal menu recognition system using RGB-D sensor

To realize automated checker system of cafeteria, we have developed a meal menu recognition system. This system employs a RGB-D sensor to get both color image and depth image. From these images, first we extract and distinguish each dishes. By knowing what type of dish is used for the meal, we can reduce candidates for meal menus, it leads up to improvement of menu recognition accuracy. Some experimental result show that we can recognize dish type over 99% accuracy except for black dishes. Further, we can recognize a dish menu about 97% accuracy.