Decoding Taste Information in Human Brain: A Temporal and Spatial Reconstruction Data Augmentation Method Coupled with Taste EEG

Xiuxin Xia,Yuchao Yang,Yan Shi,Wenbo Zheng,Hong Men

2023-07-01

Abstract:For humans, taste is essential for perceiving food's nutrient content or harmful components. The current sensory evaluation of taste mainly relies on artificial sensory evaluation and electronic tongue, but the former has strong subjectivity and poor repeatability, and the latter is not flexible enough. This work proposed a strategy for acquiring and recognizing taste electroencephalogram (EEG), aiming to decode people's objective perception of taste through taste EEG. Firstly, according to the proposed experimental paradigm, the taste EEG of subjects under different taste stimulation was collected. Secondly, to avoid insufficient training of the model due to the small number of taste EEG samples, a Temporal and Spatial Reconstruction Data Augmentation (TSRDA) method was proposed, which effectively augmented the taste EEG by reconstructing the taste EEG's important features in temporal and spatial dimensions. Thirdly, a multi-view channel attention module was introduced into a designed convolutional neural network to extract the important features of the augmented taste EEG. The proposed method has accuracy of 99.56%, F1-score of 99.48%, and kappa of 99.38%, proving the method's ability to distinguish the taste EEG evoked by different taste stimuli successfully. In summary, combining TSRDA with taste EEG technology provides an objective and effective method for sensory evaluation of food taste.

Signal Processing,Human-Computer Interaction

What problem does this paper attempt to address?

### Problems Addressed by the Paper

This paper aims to address the issues of subjectivity and poor repeatability in sensory evaluation of food taste. Currently, taste sensory evaluation mainly relies on manual sensory evaluation and electronic tongue technology. However, the former has strong subjectivity and poor repeatability, while the latter is not flexible enough. Therefore, the paper proposes a new strategy to decode people's objective perception of different taste stimuli through taste EEG (electroencephalography).

Specifically, the paper addresses the following issues:

1. **Data Insufficiency**:
- The number of taste EEG samples is relatively small, leading to insufficient model training. To solve this problem, the paper proposes a Temporal and Spatial Reconstruction Data Augmentation (TSRDA) method, which effectively increases the amount of taste EEG data.

2. **Separation of Feature Extraction and Classification**:
- In traditional machine learning methods, the processes of feature extraction and classification are separate, making it difficult to handle classification tasks. The paper introduces a multi-view channel attention mechanism, combined with Convolutional Neural Networks (CNN), for efficient feature extraction.

3. **Model Performance Improvement**:
- The proposed method achieved 99.56% accuracy, 99.48% F1 score, and 99.38% Kappa value, demonstrating that the method can successfully distinguish taste EEGs induced by different taste stimuli.

### Conclusion
In summary, the combination of TSRDA and taste EEG technology provides an objective and effective method for sensory evaluation of food taste.