KATE ? CHARLIE ? KATE ? CHARLIE ? KATE ? CHARLIE ? ( a ) ( b ) ( c ) Annotator 1 : Cow Annotator 2 : Deer Annotator 3 : Elk Cow ? Deer ?
Chen Gong,Tongliang Liu,Yuanyan Tang,Jian Yang,Jie Yang,Dacheng Tao
2019-01-01
Abstract:Different from the traditional supervised learning in which each training example has only one explicit label, Superset Label Learning (SLL) refers to the problem that a training example can be associated with a set of candidate labels, and only one of them is correct. Existing SLL methods are either regularization-based or instance-based, and the latter of which has achieved state-of-the-art performance. This is because the latest instance-based methods contain an explicit disambiguation operation that accurately picks up the groundtruth label of each training example from its ambiguous candidate labels. However, such disambiguation operation does not fully consider the mutually exclusive relationship among different candidate labels, so the disambiguated labels are usually generated in a nondiscriminative way, which is unfavorable for the instance-based methods to obtain satisfactory performance. To address this defect, we develop a novel Regularization approach for Instancebased Superset Label (RegISL) learning so that our instancebased method also inherits the good discriminative ability possessed by the regularization scheme. Specifically, we employ a graph to represent the training set, and require the examples that are adjacent on the graph to obtain similar labels. More importantly, a discrimination term is proposed to enlarge the gap of values between possible labels and unlikely labels for every training example. As a result, the intrinsic constraints among different candidate labels are deployed, and the disambiguated labels generated by RegISL are more discriminative and accurate than those output by existing instance-based algorithms. The experimental results on various tasks convincingly demonstrate This research is supported by NSFC of China (No. 61602246, 61572315, 91420201, 61472187, 61502235, 61233011 and 61373063), 973 Plan of China (No. 2014CB349303 and 2015CB856004), Program for Changjiang Scholars, and Australian Research Council Projects (No. DP-140102164, FT-130101457 and LP-150100671). Chen Gong is with the School of Computer Science and Engineering, Nanjing University of Science and Technology, and also with the Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University. (e-mail: chen.gong@njust.edu.cn). Tongliang Liu is with the School of Software, Faculty of Engineering and Information Technology, University of Technology Sydney, Ultimo, NSW 2007, Australia (e-mail: tliang.liu@gmail.com). Yuanyan Tang is with the Faculty of Science and Technology, University of Macau, Macau 999078, China, and also with the College of Computer Science, Chongqing University, Chongqing 400000, China (e-mail: yytang@umac.mo; yytang@cqu.edu.cn). Jian Yang is with School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, China, 210094 (e-mail: csjyang@njust.edu.cn). Jie Yang is with the Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, Shanghai, China, 200240 (e-mail: jieyang@sjtu.edu.cn). Dacheng Tao is with the School of Information Technologies and the Faculty of Engineering and Information Technologies, University of Sydney, J12/318 Cleveland St, Darlington NSW 2008, Australia (e-mail: dacheng.tao@sydney.edu.au). c ©20XX IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. the superiority of our RegISL to other typical SLL methods in terms of both training accuracy and test accuracy.