Study on the Plate Detection Method Based on the Data Generated by Significance Detection

In the smart restaurant environment, vision-based plate detection technology is the core of automated dish management. This study focuses on the identification of the existence of dishes on the plate, and constructs a data set of dishes on the plate by collecting data from the actual restaurant scene. In order to complete the detection of dinner plates, a plate detection model based on Yolov5 is designed. Due to the limitation of the available restaurant dishes, the data set has a single dish variety on the plate, which leads to the low performance of the trained plate detection model. In order to solve this problem, this paper proposes a plate data generation method based on salient object detection, which uses its category-independent characteristics to extract a variety of dish data from various scenarios, and completes the annotation of the generated data by designing prompts and combining with Grounding DINO, which effectively solves the problem of the scarcity of plate data and dish types. Experimental results show that the proposed plate detection model can effectively detect the presence of dishes on plates in a variety of restaurant environments, and the data generation method based on salient object detection significantly improves the quality of the data set and the performance of the plate detection model.