Abstract:Here, a novel approach called feature map similarity‐based knowledge transfer for low‐resolution gaze estimation (FSKT‐GE) is proposed. The motivation behind this work is to address the challenge of accurately estimating gaze direction for low‐resolution facial images encountered in unconstrained outdoor environments. The limited of texture details information in low‐resolution facial or eye images presents a challenge for gaze estimation. To address this, FSKT‐GE (feature maps similarity knowledge transfer for low‐resolution gaze estimation) is proposed, a gaze estimation framework consisting of both a high resolution (HR) network and low resolution (LR) network with the identical structure. Rather than mere feature imitation, this issue is addressed by assessing the cosine similarity of feature layers, emphasizing the distribution similarity between the HR and LR networks. This enables the LR network to acquire richer knowledge. This framework utilizes a combination loss function, incorporating cosine similarity measurement, soft loss based on probability distribution difference and gaze direction output, along with a hard loss from the LR network output layer. This approach on low‐resolution datasets derived from Gaze360 and RT‐Gene datasets is validated, demonstrating excellent performance in low‐resolution gaze estimation. Evaluations on low‐resolution images obtained through 2×, 4×, and 8× down‐sampling are conducted on two datasets. On the Gaze360 dataset, the lowest mean angular errors of 10.97°, 11.22°, and 13.61° were achieved, while on the RT‐Gene dataset, the lowest mean angular errors of 6.73°, 6.83°, and 7.75° were obtained.

Knowledge-embedded symmetry transform for accurate eyeball location

Accurate Iris Center Localization Method Using Facial Landmark, Snakuscule, Circle Fitting and Binary Connected Component

Accurate Gaze Estimation Based on Average‐binary‐connected‐component‐centroid

Regularization Based Iterative Point Match Weighting for Accurate Rigid Transformation Estimation

An Improved Spherical Coordinate System Applied in Oculomotor System-the Possibility for Rapid Strabismus Diagnosis

Locatization of Human Eyes Based on a Series of Binary Images

CephalFormer: Incorporating Global Structure Constraint into Visual Features for General Cephalometric Landmark Detection

Enhanced Pictorial Structures for Precise Eye Localization under Incontrolled Conditions

Keypoint Description by Symmetry Assessment -- Applications in Biometrics

Periocular embedding learning with consistent knowledge distillation from face

FSKT‐GE: Feature maps similarity knowledge transfer for low‐resolution gaze estimation

3D Rotation and Translation for Hyperbolic Knowledge Graph Embedding

Large-Baseline Matching And Reconstruction From Symmetry Cells

Map-Free Visual Relocalization Enhanced by Instance Knowledge and Depth Knowledge

Symmetry-based 3-D Reconstruction from Perspective Images

Leveraging Systematic Knowledge of 2D Transformations

Resolving Symmetry Ambiguity in Correspondence-based Methods for Instance-level Object Pose Estimation

Incorporating eyebrow and eye state information for facial expression recognition in mask-obscured scenes

Structure and Pose from Single Images of Symmetric Objects with Applications to Robot Navigation

Pose Estimation for Cross-Domain Non-Cooperative Spacecraft Based on Spatial-Aware Keypoints Regression

Real-Time 3D Eye Performance Reconstruction for RGBD Cameras