Abstract:Recent research emphasizes more on analyzing multiple features to improve face recognition (FR) performance. One popular scheme is to extend the sparse representation based classification framework with various sparse constraints. Although these methods jointly study multiple features through the constraints, they just process each feature individually such that they overlook the possible high-level relationship among different features. It is reasonable to assume that the low-level features of facial images, such as edge information and smoothed/low-frequency image, can be fused into a more compact and more discriminative representation based on the latent high-level relationship. FR on the fused features is anticipated to produce better performance than that on the original features, since they provide more favorable properties. Focusing on this, we propose two different strategies which start from fusing multiple features and then exploit the dictionary learning (DL) framework for better FR performance. The first strategy is a simple and efficient two-step model, which learns a fusion matrix from training face images to fuse multiple features and then learns class-specific dictionaries based on the fused features. The second one is a more effective model requiring more computational time that learns the fusion matrix and the class-specific dictionaries simultaneously within an iterative optimization procedure. Besides, the second model considers to separate the shared common components from class-specified dictionaries to enhance the discrimination power of the dictionaries. The proposed strategies, which integrate multi-feature fusion process and dictionary learning framework for FR, realize the following goals: (1) exploiting multiple features of face images for better FR performances; (2) learning a fusion matrix to merge the features into a more compact and more discriminative representation; (3) learning class-specific dictionaries with consideration of the common patterns for better classification performance. We perform a series of experiments on public available databases to evaluate our methods, and the experimental results demonstrate the effectiveness of the proposed models.

Multi-source Data Fusion Using Deep Learning for Smart Refrigerators

Integration of multi-feature fusion and dictionary learning for face recognition

Interleaved Attention Convolutional Compression Network: an Effective Data Mining Method for the Fusion System of Gas Sensor and Hyperspectral

Automatic Chinese Food recognition based on a stacking fusion model

Deep Learning in Food Category Recognition

Deepfusion: A Deep Learning Framework For The Fusion Of Heterogeneous Sensory Data

DeepFood: Deep Learning-Based Food Image Recognition for Computer-Aided Dietary Assessment

Recognition of multi-modal fusion images with irregular interference

Research on Food Recognition of Smart Refrigerator Based on SSD Target Detection Algorithm

Integrating deep learning and data fusion for enhanced oranges soluble solids content prediction using machine vision and Vis/NIR spectroscopy

A Study of Multi-Task and Region-Wise Deep Learning for Food Ingredient Recognition.

YOLO Models for Fresh Fruit Classification from Digital Videos

A Multi-Source Heterogeneous Data Fusion Method Based on Deep Learning

Smartphone-based food recognition system using multiple deep CNN models

Recognize after early fusion: the Chinese food recognition based on the alignment of image and ingredients

Food Image Recognition and Food Safety Detection Method Based on Deep Learning

Application of Deep Learning in Food: A Review

Food Ingredients Recognition through Multi-label Learning

Multi-Task Learning for Food Identification and Analysis with Deep Convolutional Neural Networks

Study for Food Recognition System Using Deep Learning

DeepFruits: A Fruit Detection System Using Deep Neural Networks