Abstract:Ingredient prediction has received more and more attention with the help of image processing for its diverse real-world applications, such as nutrition intake management and cafeteria self-checkout system. Existing approaches mainly focus on multi-task food category-ingredient joint learning to improve final recognition by introducing task relevance, while seldom pay attention to making good use of inherent characteristics of ingredients independently. Actually, there are two issues for ingredient prediction. First, compared with fine-grained food recognition, ingredient prediction needs to extract more comprehensive features of the same ingredient and more detailed features of various ingredients from different regions of the food image. Because it can help understand various food compositions and distinguish the differences within ingredient features. Second, the ingredient distributions are extremely unbalanced. Existing loss functions can not simultaneously solve the imbalance between positive-negative samples belonging to each ingredient and significant differences among all classes. To solve these problems, we propose a novel framework named Class-Adaptive Context Learning Network (CACLNet) for ingredient prediction. In order to extract more comprehensive and detailed features, we introduce Ingredient Context Learning (ICL) to reduce the negative impact of complex background in food images and construct internal spatial connections among ingredient regions of food objects in a self-supervised manner, which can strengthen the contacts of the same ingredients through region interactions. In order to solve the imbalance of different classes among ingredients, we propose one novel Class-Adaptive Asymmetric Loss (CAAL) to focus on various ingredient classes adaptively. Besides, considering that the over-suppression of negative samples will over-fit positive samples of those rare ingredients, CAAL alleviates this continuous suppression according to the imbalanced ratios based on gradients while maintaining the contribution of positive samples by lesser suppression. Extensive evaluation on two popular benchmark datasets (Vireo Food-172, UEC Food-100) demonstrates our proposed method achieves the state-of-the-art performance. Further qualitative analysis and visualization show the effectiveness of our method. Code and models are available at https://123.57.42.89/codes/CACLNet/index.html.

Nondestructive prediction of physicochemical properties of kimchi sauce with artificial and convolutional neural networks

Enhancing model robustness through different optimization methods and 1-D CNN to eliminate the variations in size and detection position for apple SSC determination

Predicting physicochemical properties of papayas (Carica papaya L.) using a convolutional neural networks model approach

Evaluation of vegetable sauerkraut quality during storage based on convolution neural network

Non-Destructive Detection Pilot Study of Vegetable Organic Residues Using VNIR Hyperspectral Imaging and Deep Learning Techniques

KitcheNette: Predicting and Recommending Food Ingredient Pairings using Siamese Neural Networks

Food Image Classification and Calorie Prediction for Dietary Analysis

Fusion of visible and fluorescence imaging through deep neural network for color value prediction of pelletized red peppers

Predictive Modeling of Garlic Quality in Hybrid Infrared-Convective Drying Using Artificial Neural Networks

Portable Food‐Freshness Prediction Platform Based on Colorimetric Barcode Combinatorics and Deep Convolutional Neural Networks

Ingredient Prediction via Context Learning Network With Class-Adaptive Asymmetric Loss

APPLICATION OF ARTIFICIAL NEURAL NETWORK TO PREDICTION OF CANTONESE SOY SAUCE BREWING AND CHANGING PATTERN CONCERNING TOTAL NITROGEN AND Α‐amino ACID NITROGEN

Detection of Black Spot Disease on Kimchi Cabbage Using Hyperspectral Imaging and Machine Learning Techniques

Prediction of soluble solids content using near-infrared spectra and optical properties of intact apple and pulp applying PLSR and CNN

Using Knowledge-Guided Temperature Correction for Online Non-Destructive Detection of Soluble Solids Content in Pear Via Vis/NIR Spectroscopy

Dynamic Soft Sensor Development Based on Convolutional Neural Networks

Quality prediction of whole-grain rice noodles using backpropagation artificial neural network

Stochastic Decision Fusion of Convolutional Neural Networks for Tomato Ripeness Detection in Agricultural Sorting Systems

Review: The evolution of chemometrics coupled with near infrared spectroscopy for fruit quality evaluation. II. The rise of convolutional neural networks

Predicting and evaluating separation quality of micellar electrokinetic capillary chromatography by artificial neural networks.

Deep learning and feature reconstruction assisted vis-NIR calibration method for on-line monitoring of key growth indicators during kombucha production