Structured Visual Feature Learning for Classification Via Supervised Probabilistic Tensor Factorization

Xu Tan,Fei Wu,Xi Li,Siliang Tang,Weiming Lu,Yueting Zhuang
DOI: https://doi.org/10.1109/tmm.2015.2410135
IF: 7.3
2015-01-01
IEEE Transactions on Multimedia
Abstract:In this paper, structured visual feature learning aims at exploiting the intrinsic structural properties of mutually correlated multimedia collections (e.g., video frames or facial images) to learn a more effective feature representation for multimedia data classification. We pose structured visual feature learning as a problem of supervised tensor factorization (STF), which is capable of effectively learning multi-view visual features from structural tensorial multimedia data. In mathematics, STF is formulated as a joint optimization framework of probabilistic inference and ε-insensitive support vector regression. As a result, the feature representation obtained by STF not only preserves the intrinsic multi-view structural information on tensorial multimedia data, but also includes the discriminative information derived from the max-margin learning process. Using the learned discriminative visual features, we conduct a set of multimedia classification experiments on several challenging datasets, including images and videos, which demonstrate the effectiveness of our method.
What problem does this paper attempt to address?