Towards Enabling Learnware to Handle Heterogeneous Feature Spaces

Peng Tan,Zhi-Hao Tan,Yuan Jiang,Zhi-Hua Zhou
DOI: https://doi.org/10.1007/s10994-022-06245-1
IF: 5.414
2022-01-01
Machine Learning
Abstract:The learnware paradigm was recently proposed by Zhou ( 2016 ) with the wish of developing the learnware market to help users build models more efficiently by reusing existing well-performed models rather than starting from scratch. Specifically, a learnware in the learnware market is a well-performed pre-trained model with a specification describing its specialty and utility, and the market identifies helpful learnware(s) for the user’s task based on the specification. Recent studies have attempted to realize a homogeneous prototype learnware market initially through Reduced Kernel Mean Embedding (RKME) specification, which requires all models in the market to share the same feature space. However, this limits the application scope of the learnware paradigm because various pre-trained models are often obtained from different feature spaces in real-world scenarios. In this paper, we make the first attempt to enable the learnware to handle heterogeneous feature spaces. We propose a more powerful specification to manage heterogeneous learnwares by integrating subspace learning in the specification design, along with a practical approach for identifying and reusing helpful learnwares for the user’s task. Empirical studies on both synthetic data and real-world tasks validate the efficacy of our approach.
What problem does this paper attempt to address?