Abstract:Significant progress has been witnessed in learning-based Multi-view Stereo (MVS) under supervised and unsupervised settings. To combine their respective merits in accuracy and completeness, meantime reducing the demand for expensive labeled data, this paper explores the problem of learning-based MVS in a semi-supervised setting that only a tiny part of the MVS data is attached with dense depth ground truth. However, due to huge variation of scenarios and flexible settings in views, it may break the basic assumption in classic semi-supervised learning, that unlabeled data and labeled data share the same label space and data distribution, named as semi-supervised distribution-gap ambiguity in the MVS problem. To handle these issues, we propose a novel semi-supervised distribution-augmented MVS framework, namely SDA-MVS. For the simple case that the basic assumption works in MVS data, consistency regularization encourages the model predictions to be consistent between original sample and randomly augmented sample. For further troublesome case that the basic assumption is conflicted in MVS data, we propose a novel style consistency loss to alleviate the negative effect caused by the distribution gap. The visual style of unlabeled sample is transferred to labeled sample to shrink the gap, and the model prediction of generated sample is further supervised with the label in original labeled sample. The experimental results in semi-supervised settings of multiple MVS datasets show the superior performance of the proposed method. With the same settings in backbone network, our proposed SDA-MVS outperforms its fully-supervised and unsupervised baselines.

Supervised Semi-Definite Embedding For Image Manifolds

Geodesic Based Semi-supervised Multi-manifold Feature Extraction

A Regularized Approach for Geodesic-Based Semisupervised Multimanifold Learning

Signed Laplacian Embedding for Supervised Dimension Reduction.

Unsupervised Learning of Image Manifolds by Semidefinite Programming

Submanifold Decomposition

Semisupervised Feature Selection via Structured Manifold Learning

Semi-supervised Local Multi-Manifold Isomap by Linear Embedding for Feature Extraction.

Semi-supervised Discriminant Isomap with Application to Visualization, Image Retrieval and Classification

Semi-supervised manifold learning and its application to remote sensing image classification

Learning Semi-Riemannian Metrics for Semisupervised Feature Extraction

Semi-Supervised Graph Based Embedding with Non-Convex Sparse Coding Techniques

Semisupervised Feature Selection Via Generalized Uncorrelated Constraint and Manifold Embedding.

Image/Video Semantic Analysis by Semi-Supervised Learning

Deep Feature Learning with Manifold Embedding for Robust Image Retrieval

A Semi-Definite Programming Embedding Framework for Local Preserving Manifold Learning

Semi-supervised Deep Multi-view Stereo

Semi-definite Manifold Alignment

Semi-supervised Projection Twin Support Vector Machine Via Manifold Regularization

Semi-supervised Discriminant Analysis Based on Dependence Estimation

Face Recognition Based on Semi-Supervised Manifold Learning