Abstract:Data acquired in space operational conditions is scarce due to the costs and complexity of space operations. This poses a challenge to learning-based visual-based navigation algorithms employed in autonomous spacecraft navigation. Existing datasets, which largely depend on computer-simulated data, have partially filled this gap. However, the image generation tools they use are proprietary, which limits the evaluation of methods to unseen scenarios. Furthermore, these datasets provide limited ground-truth data, primarily focusing on the spacecraft's translation and rotation relative to the camera. To address these limitations, we present SPIN (SPacecraft Imagery for Navigation), an open-source realistic spacecraft image generation tool for relative navigation between two spacecrafts. SPIN provides a wide variety of ground-truth data and allows researchers to employ custom 3D models of satellites, define specific camera-relative poses, and adjust various settings such as camera parameters and environmental illumination conditions. For the task of spacecraft pose estimation, we compare the results of training with a SPIN-generated dataset against existing synthetic datasets. We show a %50 average error reduction in common testbed data (that simulates realistic space conditions). Both the SPIN tool (and source code) and our enhanced version of the synthetic datasets will be publicly released upon paper acceptance on GitHub <a class="link-external link-https" href="https://github.com/vpulab/SPIN" rel="external noopener nofollow">this https URL</a>.

Spin Image Based on Local Shape Similarity and Its Application

Region-based Saliency Estimation for 3D Shape Analysis and Understanding

Shape Representation and Recognition in High Dimensional Feature Space

Intrinsic spin images: a subspace decomposition approach to understanding 3D deformable shapes

Using spin images for efficient object recognition in cluttered 3D scenes

SpinNet: Learning a General Surface Descriptor for 3D Point Cloud Registration

An image representation method based on the similarity of feature points

A new 3D shape descriptor based on rotation

Sphere-Spin-Image: A Viewpoint-Invariant Surface Representation For 3d Face Recognition

A similarity computing algorithm for volumetric data sets

3d Image Interpolation Based On Directional Coherence

Detection of Image Region Duplication Using Spin Image

Learning similarity for image retrieval with locally spatial information feedback

Vertex saliency computation from 3D facial meshes

SPIN: Spacecraft Imagery for Navigation

Generalized Spatial Differentiation From The Spin Hall Effect Of Light And Its Application In Image Processing Of Edge Detection

Three-dimensional object reconstruction based on spin–orbit interaction of light

Colorization Using the Rotation-Invariant Feature Space

Local Cardinal Spline Interpolation and Its Application to Image-Processing