Abstract:If fusion rules cannot adapt to the changes of environment and individual users, multimodal systems may perform worse than unimodal systems when one or more modalities encounter data degeneration. This paper develops a robust face and ear based multimodal biometric system using Sparse Representation (SR), which integrates the face and ear at feature level, and can effectively adjust the fusion rule based on reliability difference between the modalities. We first propose a novel index called Sparse Coding Error Ratio (SCER) to measure the reliability difference between face and ear query samples. Then, SCER is utilized to develop an adaptive feature weighting scheme for dynamically reducing the negative effect of the less reliable modality. In multimodal classification phase, SR-based classification techniques are employed, i.e., Sparse Representation based Classification (SRC) and Robust Sparse Coding (RSC). Finally, we derive a category of SR-based multimodal recognition methods, including Multimodal SRC with feature Weighting (MSRCW) and Multimodal RSC with feature Weighting (MRSCW). Experimental results demonstrate that: (a) MSRCW and MRSCW perform significantly better than the unimodal recognition using either face or ear alone, as well as the known multimodal methods; (b) The effectiveness of adaptive feature weighting is verified. MSRCW and MRSCW are very robust to the image degeneration occurring to one of the modalities. Even when face (ear) query sample suffers from 100% random pixel corruption, they can still get the performance close to the ear (face) unimodal recognition; (c) By integrating the advantages of adaptive feature weighting and sparsity-constrained regression, MRSCW seems excellent in tackling the face and ear based multimodal recognition problem.

3D Ear Modeling Based on SFS

A synthesis method for personalized 3D face reconstruction

3D Ear Recognition Using Local Salience and Principal Manifold

An Efficient Approach of 3D Ear Recognition

3D Ear Matching Using Local Salient Shape Feature

A 3D ear acquisition system design by using triangulation imaging principle

3D Ear Extraction Based on Contourlet Transform

AudioEar: Single-View Ear Reconstruction for Personalized Spatial Audio

An approach for precise three-dimensional modeling of the human inner ear.

A Fast 3D Ear Recognition Method Based on Local Surface Patch

A Robust Face and Ear Based Multimodal Biometric System Using Sparse Representation

SIFT-based Ear Recognition by Fusion of Detected Keypoints from Color Similarity Slice Regions

BIOMETRICS BASED ON EAR FEATURE

WSC-Trans: A 3D network model for automatic multi-structural segmentation of temporal bone CT

Pericentric inversion of chromosome 14 and the risk of partial duplication of 14q (14q31 leads to 14qter).

Binding of the globular domain of linker histones H5/H1 to the nucleosome: a hypothesis.

Physiological Curves Extraction of Human Ear Based on Improved YOLACT

Panoramic face and ear image stitching in multi-modal recognition

The Study of Using 3D Scan Technique to Evaluate the Expanding Method of Ear Reconstruction Before Operation

Fused deposition modelling of an auricle framework for microtia reconstruction based on CT images

Adopting level set theory based algorithms to segment human ear