Abstract:The wide-angle lens shows appealing applications in VR technologies, but it introduces severe radial distortion into its captured image. To recover the realistic scene, previous works devote to rectifying the content of the wide-angle image. However, such a rectification solution inevitably distorts the image boundary, which changes related geometric distributions and misleads the current vision perception models. In this work, we explore constructing a win-win representation on both content and boundary by contributing a new learning model, i.e., Rectangling Rectification Network (RecRecNet). In particular, we propose a thin-plate spline (TPS) module to formulate the non-linear and non-rigid transformation for rectangling images. By learning the control points on the rectified image, our model can flexibly warp the source structure to the target domain and achieves an end-to-end unsupervised deformation. To relieve the complexity of structure approximation, we then inspire our RecRecNet to learn the gradual deformation rules with a DoF (Degree of Freedom)-based curriculum learning. By increasing the DoF in each curriculum stage, namely, from similarity transformation (4-DoF) to homography transformation (8-DoF), the network is capable of investigating more detailed deformations, offering fast convergence on the final rectangling task. Experiments show the superiority of our solution over the compared methods on both quantitative and qualitative evaluations. The code and dataset are available at <a class="link-external link-https" href="https://github.com/KangLiao929/RecRecNet" rel="external noopener nofollow">this https URL</a>.

Assembling Convolution Neural Networks for Automatic Viewing Transformation.

An Adaptive Viewpoint Transformation Network for 3D Human Pose Estimation

Three Orthogonal Vanishing Points Estimation In Structured Scenes Using Convolutional Neural Networks

DualBEV: CNN is All You Need in View Transformation

3D Orientation Estimation and Vanishing Point Extraction from Single Panoramas Using Convolutional Neural Network

Binocular Vision Calibration and 3D Re-Construction with an Orthogonal Learning Neural Network.

Equivariant Multi-View Networks

Hierarchical Spatial Transformer Network

High-Quality 3D Face Reconstruction with Affine Convolutional Networks

Hybrid bundle-adjusting 3D Gaussians for view consistent rendering with pose optimization

Deep Cross-View Reconstruction GAN Based on Correlated Subspace for Multi-View Transformation

Transform-Invariant Convolutional Neural Networks for Image Classification and Search

2L3: Lifting Imperfect Generated 2D Images into Accurate 3D

Deformable convolutional networks for multi‐view 3D shape classification

Training Deep Convolutional Neural Networks to Acquire the Best View of a 3D Shape.

Perception-Oriented U-Shaped Transformer Network for 360-Degree No-Reference Image Quality Assessment

A Pseudoinverse Siamese Convolutional Neural Network of Transformation Invariance Feature Detection and Description for a SLAM System

3D Interpreter Networks for Viewer-Centered Wireframe Modeling

SurfaceNet: An End-to-End 3D Neural Network for Multiview Stereopsis

RecRecNet: Rectangling Rectified Wide-Angle Images by Thin-Plate Spline Model and DoF-based Curriculum Learning

Equivariant Light Field Convolution and Transformer