Cross-Modal Ingredient Recognition and Recipe Suggestion using Computer Vision and Predictive Modeling

This paper is focused on the development of a novel system known as “IngredEye.” It involves various approaches that can be grouped into categories, such as computer vision, including YOLOv8, a KNN prediction model, and a Flutter framework that hosts all of them in a mobile application environment. Previous studies have analyzed the application of computer vision and OpenCV recognition in cooking and proved that such approaches could enhance the level of convenience in the culinary field. This paper addresses issues like changes in lighting, occlusions, and other factors that have to be solved by the algorithms envisaged for real applications. The objective of this paper solely relies on integrating the OpenCV object detection method with comprehensive machine learning techniques specialized for the culinary field. Presenting the end-user with recipe recommendations based on the visual input they have given.