Method and device for learning cross-platform multi-mode media data common feature representation

Xu Changsheng,Yang Xiaoshan,Zhang Tianzhu
2014-01-01
Abstract:The invention discloses a method and device for learning cross-platform multi-mode media data common feature representation by using a denoising auto-encoder. The method comprises the steps that S1, an optimal object equation is established, wherein in the object equation, media data features of different platforms and different modes are reestablished by adopting the single-layer denoising auto-encoder, mode correlation constraint and cross-platform constraint are considered during reestablishing, and the media data features of the different platforms and the different modes comprise image features and textual features; S2, an analytical solution to the optimal object equation is obtained, and the globally optimal solution is obtained by searching for the point of which a partial derivative is zero in the analytical solution obtaining process; S3, the analytical solution is solved through a marginalization method, wherein solving is conducted by marginalizing random noise of feature vectors through the weak law of large numbers in the solving process. According to the method and device for learning cross-platform multi-mode media data common feature representation, the random noise of the feature vectors is marginalized by means of the weak law of large numbers.
What problem does this paper attempt to address?