Abstract:In this work, we propose a Semi-supervised Triply Robust Inductive transFer LEarning (STRIFLE) approach, which integrates heterogeneous data from a label-rich source population and a label-scarce target population and uses a large amount of unlabeled data simultaneously to improve the learning accuracy in the target population. Specifically, we consider a high dimensional covariate shift setting and employ two nuisance models, a density ratio model and an imputation model, to combine transfer learning and surrogate-assisted semi-supervised learning strategies effectively and achieve triple robustness. While the STRIFLE approach assumes the target and source populations to share the same conditional distribution of outcome Y given both the surrogate features S and predictors X , it allows the true underlying model of Y⏧X to differ between the two populations due to the potential covariate shift in S and X . Different from double robustness, even if both nuisance models are misspecified or the distribution of Y⏧S,X is not the same between the two populations when the shifted source population and the target population share enough similarities, the triply robust STRIFLE estimator can still partially use the source population when the shifted source population and the target population share enough similarities. Moreover, it is guaranteed to be no worse than the target-only surrogate-assisted semi-supervised estimator with an additional error term from transferability detection. These desirable properties of our estimator are established theoretically and verified in finite samples via extensive simulation studies. We use the STRIFLE estimator to train a Type II diabetes polygenic risk prediction model for the African American target population by transferring knowledge from electronic health records linked genomic data observed in a larger European source population. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.

Doubly Flexible Estimation under Label Shift

Label Shift Estimators for Non-Ignorable Missing Data

Estimating calibration error under label shift without labels

Efficient and Multiply Robust Risk Estimation under General Forms of Dataset Shift

Theory-inspired Label Shift Adaptation via Aligned Distribution Mixture

Relaxed Doubly Robust Estimation in Causal Inference

Handling New Class in Online Label Shift

Doubly robust calibration of prediction sets under covariate shift

Estimation of prediction error with known covariate shift

Not all distributional shifts are equal: Fine-grained robust conformal inference

Distribution-Free Prediction Intervals Under Covariate Shift, With an Application to Causal Inference

Distributional Shift-Aware Off-Policy Interval Estimation: A Unified Error Quantification Framework

Estimating Model Performance Under Covariate Shift Without Labels

Double Debiased Covariate Shift Adaptation Robust to Density-Ratio Estimation

Doubly robust estimation of partially linear models for longitudinal data with dropouts and measurement error in covariates

ELSA: Efficient Label Shift Adaptation through the Lens of Semiparametric Models

Efficient data integration under prior probability shift

Multi-Source Conformal Inference Under Distribution Shift

Semi-Supervised Triply Robust Inductive Transfer Learning

Coping with Label Shift via Distributionally Robust Optimisation

Doubly Robust Augmented Model Accuracy Transfer Inference with High Dimensional Features