Abstract:If fusion rules cannot adapt to the changes of environment and individual users, multimodal systems may perform worse than unimodal systems when one or more modalities encounter data degeneration. This paper develops a robust face and ear based multimodal biometric system using Sparse Representation (SR), which integrates the face and ear at feature level, and can effectively adjust the fusion rule based on reliability difference between the modalities. We first propose a novel index called Sparse Coding Error Ratio (SCER) to measure the reliability difference between face and ear query samples. Then, SCER is utilized to develop an adaptive feature weighting scheme for dynamically reducing the negative effect of the less reliable modality. In multimodal classification phase, SR-based classification techniques are employed, i.e., Sparse Representation based Classification (SRC) and Robust Sparse Coding (RSC). Finally, we derive a category of SR-based multimodal recognition methods, including Multimodal SRC with feature Weighting (MSRCW) and Multimodal RSC with feature Weighting (MRSCW). Experimental results demonstrate that: (a) MSRCW and MRSCW perform significantly better than the unimodal recognition using either face or ear alone, as well as the known multimodal methods; (b) The effectiveness of adaptive feature weighting is verified. MSRCW and MRSCW are very robust to the image degeneration occurring to one of the modalities. Even when face (ear) query sample suffers from 100% random pixel corruption, they can still get the performance close to the ear (face) unimodal recognition; (c) By integrating the advantages of adaptive feature weighting and sparsity-constrained regression, MRSCW seems excellent in tackling the face and ear based multimodal recognition problem.

A Robust Algorithm for Ear Recognition under Partial Occlusion

Ear recognition under partial occlusion based on sparse representation

Robust classification for occluded ear via Gabor scale feature-based non-negative sparse representation

3D Ear Identification Based on Sparse Representation.

Ear recognition under partial occlusion based on sub-classifier fusion

Ear Recognition under Partial Occlusion Based on Neighborhood Preserving Embedding

An Automatic Ear Recognition Approach

Non-negative dictionary based sparse representation classification for ear recognition with occlusion

A Novel 3D Ear Identification Approach Based on Sparse Representation

Robust Ear Recognition Using Sparse Representation of Local Features

Local and Holistic Feature Fusion for Occlusion-Robust 3D Ear Recognition.

Ear Recognition With Occlusion Via Discrimination Dictionary And Occlusion Dictionary Based Sparse Representation

3D Ear Identification Using Block-Wise Statistics-Based Features and LC-KSVD.

Ear Recognition from One Sample Per Person

Human Ear Fusion Recognition Algorithm Based on Sparse Representation

Robust Ear Recognition Via Nonnegative Sparse Representation of Gabor Orientation Information

An Efficient Approach of 3D Ear Recognition

A Robust Face and Ear Based Multimodal Biometric System Using Sparse Representation

Pointnet Plus Plus And Three Layers Of Features Fusion For Occlusion Three-Dimensional Ear Recognition Based On One Sample Per Person

Ear Recognition Based on Local Information Fusion.

Local feature fusion and SRC-based decision fusion for ear recognition