Abstract:Kinship verification is a long-standing research challenge in computer vision. The visual differences presented to the face have a significant effect on the recognition capabilities of the kinship systems. We argue that aggregating multiple visual knowledge can better describe the characteristics of the subject for precise kinship identification. Typically, the age-invariant features can represent more natural facial details. Such age-related transformations are essential for face recognition due to the biological effects of aging. However, the existing methods mainly focus on employing the single-view image features for kinship identification, while more meaningful visual properties such as race and age are directly ignored in the feature learning step. To this end, we propose a novel deep collaborative multi-modal learning (DCML) to integrate the underlying information presented in facial properties in an adaptive manner to strengthen the facial details for effective unsupervised kinship verification. Specifically, we construct a well-designed adaptive feature fusion mechanism, which can jointly leverage the complementary properties from different visual perspectives to produce composite features and draw greater attention to the most informative components of spatial feature maps. Particularly, an adaptive weighting strategy is developed based on a novel attention mechanism, which can enhance the dependencies between different properties by decreasing the information redundancy in channels in a self-adaptive manner. Moreover, we propose to use self-supervised learning to further explore the intrinsic semantics embedded in raw data and enrich the diversity of samples. As such, we could further improve the representation capabilities of kinship feature learning and mitigate the multiple variations from original visual images. To validate the effectiveness of the proposed method, extensive experimental evaluations conducted on four widely-used datasets show that ou- DCML method is always superior to some state-of-the-art kinship verification methods.

Survey on the Analysis and Modeling of Visual Kinship: A Decade in the Making

A review on kinship verification from facial information

Kinship verification and recognition based on handcrafted and deep learning feature-based techniques

Tri-Subject Kinship Verification: Understanding the Core of A Family

Kinship Measurement on Salient Facial Features

Unveiling facial kinship: The BioKinVis dataset for facial kinship verification and genetic association studies

Facial Kinship Verification: A Comprehensive Review and Outlook

Kinship verification from facial images under uncontrolled conditions.

Enhancing Kinship Verification through Multiscale Retinex and Combined Deep-Shallow features

The Fg 2015 Kinship Verification in the Wild Evaluation

Deep Collaborative Multi-Modal Learning for Unsupervised Kinship Estimation

Kinship Verification in the Wild: the First Kinship Verification Competition.

Video-Based Facial Kinship Verification

Audio-Visual Kinship Verification: A New Dataset and a Unified Adaptive Adversarial Multimodal Learning Approach

Modeling of Facial Aging and Kinship: A Survey

Families In Wild Multimedia: A Multimodal Database for Recognizing Kinship

From Face Recognition to Kinship Verification: an Adaptation Approach.

Recognizing Families In the Wild: White Paper for the 4th Edition Data Challenge

Facial Kinship Verification - A Machine Learning Approach

Multi-attribute balanced dataset generation framework AutoSyn and KinFace Channel-Spatial Feature Extractor for kinship recognition

SelfKin: Self Adjusted Deep Model For Kinship Verification