Abstract:The bionic-based electronic nose (e-nose) and electronic tongue (e-tongue) show satisfactory performance in flavor analysis. Traditional flavor analysis of the e-nose and e-tongue systems focuses on data fusion, and the effects of the bionic characteristics on the flavor analysis performance are rarely studied. Motivated by this, a method, including an olfactory-taste synesthesia model (OTSM) and a convolutional neural network-random forest (CNN-RF), is proposed for the effective identification of flavor substances. The OTSM is developed for human nerve conduction mechanisms to enhance the bionic characteristics of the e-nose and e-tongue systems and is combined with a CNN-RF model for flavor identification. The results show that, first, when stimulated by e-nose and e-tongue data, physiological 1/f characteristics and synchronization are shown using the OTSM. The enhancement effects on the bionic characteristics of the fusion system are validated using the 1/f characteristics and synchronization. Second, the fully connected layer for the CNN is replaced by RF to improve the identification performance of flavor substances. Finally, CNN-RF is evaluated in comparison with other flavor recognition models and ablation studies to confirm its effectiveness. By comparison, the best recognition performance, including the accuracies of 96.67%, 96.67%, and 95.00%, the F 1 -scores of 96.65%, 96.66%, and 94.95%, and the kappa coefficients of 96.03%, 96.10%, and 93.44%, for five beers, five apples, and four mixed solutions, respectively, is obtained by CNN-RF. In conclusion, excellent flavor identification for the fusion system is achieved using the OTSM and CNN-RF models.

FoodFlavorNet: A Multimodal Deep Learning Model for Food Flavor Recognition

Bimodal Fusion Network for Basic Taste Sensation Recognition from Electroencephalography and Electromyography

Basic Taste Sensation Recognition from EEG Based on Multiscale Convolutional Neural Network with Residual Learning.

Flavor Identification Based on Olfactory-Taste Synesthesia Model and Hybrid Convolutional Neural Network-Random Forest

Foodnet: Multi-Scale and Label Dependency Learning-Based Multi-Task Network for Food and Ingredient Recognition

GC-MS Fingerprints Profiling Using Machine Learning Models for Food Flavor Prediction

Food and Ingredient Joint Learning for Fine-Grained Recognition

Food Recognition Model Based on Deep Learning and Attention Mechanism.

Image Augmentation-Based Food Recognition with Convolutional Neural Networks

MVANet: Multi-Task Guided Multi-View Attention Network for Chinese Food Recognition

CuisineNet: Food Attributes Classification using Multi-scale Convolution Network

Food Ingredients Recognition through Multi-label Learning

Hybrid Fusion with Intra- and Cross-Modality Attention for Image-Recipe Retrieval

Deep Learning in Food Category Recognition

DeepFood: Automatic Multi-Class Classification of Food Ingredients Using Deep Learning

Learning Using Privileged Information for Food Recognition

Smartphone-based food recognition system using multiple deep CNN models

Fine-grained recognition of Chinese food image based on DenseNet with attention mechanism

Region-Level Attention Network for Food and Ingredient Joint Recognition

Ingredient-Guided Cascaded Multi-Attention Network for Food Recognition

Multi-Task Learning for Food Identification and Analysis with Deep Convolutional Neural Networks