Multi-state Ingredient Recognition via Adaptive Multi-centric Network

Ingredient recognition has received significant attention due to its numerous industrial applications, such as intelligent retail terminals and intelligent cooking devices. However, ingredient recognition has the following challenges: 1) dynamic changes in the number of categories; 2) greater diversity and regionality of ingredients; and 3) large visual differences among different states of ingredients. In this article, we propose an adaptive multi-centric network (AdMNet) to solve the problem of ingredient recognition. AdMNet is based on the idea of retrieval, which consists of two main parts, the adaptive multi-centric nearest-neighbor central mean (AdM-NCM) classifier, and the context-aware attentional pooling (CAP) module. The AdM-NCM classifier adaptively establishes category-centric vector groups to recognize ingredients via optimizing the minimum clustering variance, where each state of the ingredient has its corresponding centric vector. The CAP module combines contextual information and multiple attention mechanisms. It captures more focused and discriminative features with higher weights assigned to fine-grained features, which results in better feature representation. In addition, we collect a large-scale ingredient dataset, ISIA Ingredient-201 with 201 classes and 100 442 images. To prove the greater robustness and generalization of our method, we compare the metrics in basic scenarios and realistic scenarios with those of other methods. Specifically, the base scenario is the regular setup, and the real scenario is similar to the class incremental learning setup. The experimental results show that our method reaches the state of the art on both basic scenarios and realistic scenarios with small samples.