Research and Application of Multi-Task Regularized Extreme Learning Machine

Lulu SUI,Dongsheng HAN,Fei YAN,Gaowei YAN
DOI: https://doi.org/10.3778/j.issn.1002-8331.1710-0172
2019-01-01
Abstract:MT-ELM enables multi-task learning using hidden layers to share data characteristics among different tasks. However, MT-ELM ignores correlation differences between tasks and over-fitting problem. Therefore, MT-RELM is proposed. Firstly, RELM is used to solve the over-fitting problem. Secondly, considering correlation differences between tasks, the constraints are added to output weights based on the assumptions that similar task having similar weight, so this paper uses this constraint to indicate relevance level between tasks. Finally, ADMM algorithm are used to solve MT-RELM model parameters. The results based on the synthetic dataset and wet ball mill dataset show that this algorithm can effectively improve the prediction accuracy and generalization ability.
What problem does this paper attempt to address?