Abstract:The rapid increase of space assets represented by small satellites in low Earth orbit can enable ubiquitous digital services for everyone. However, due to the dynamic space environment, numerous space objects, complex atmospheric conditions, and unexpected events can easily introduce adverse conditions affecting space safety, operations, and sustainability of the outer space environment. This challenge calls for responsive, effective satellite object detection (SOD) solutions that allow a small satellite to assess and respond to collision risks, with the consideration of constrained resources on a small satellite platform. This paper discusses the SOD tasks and onboard deep learning (DL) approach to the tasks. Two new DL models are proposed, called GELAN-ViT and GELAN-RepViT, which incorporate vision transformer (ViT) into the Generalized Efficient Layer Aggregation Network (GELAN) architecture and address limitations by separating the convolutional neural network and ViT paths. These models outperform the state-of-the-art YOLOv9-t in terms of mean average precision (mAP) and computational costs. On the SOD dataset, our proposed models can achieve around 95% mAP50 with giga-floating point operations (GFLOPs) reduced by over 5.0. On the VOC 2012 dataset, they can achieve $\geq$ 60.7% mAP50 with GFLOPs reduced by over 5.2.

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is to conduct efficient and accurate Satellite Object Detection (SOD) for Low - Earth - Orbit (LEO) satellites in the complex space environment, in order to assess and avoid collision risks and ensure space safety and sustainability. Specifically: 1. **Challenges in the space environment**: With the increase in the number of small satellites, the dynamic space environment, numerous space objects, complex atmospheric conditions and unexpected events may all introduce adverse conditions, affecting space safety, operations and the sustainability of the outer space environment. 2. **Resource - constrained small - satellite platforms**: Due to the limited hardware capacity and energy of small - satellite platforms, the existing ground - based radar or laser telescope facilities cannot meet the requirements of real - time and low - latency, and LiDAR sensors are also limited by the detection range and atmospheric conditions. 3. **Effective Satellite Object Detection (SOD) solutions**: A solution that can quickly and accurately detect other satellite objects and operate under resource - constrained conditions is required. The existing models based on Convolutional Neural Networks (CNN) have limitations in handling such tasks, especially when combining local and global features, which may lead to information interference and loss. To solve the above problems, the paper proposes two new deep - learning models - GELAN - ViT and GELAN - RepViT. These models improve performance and reduce computational costs by integrating the Vision Transformer (ViT) into the Generalized Efficient Layer Aggregation Network (GELAN) architecture and separating the Convolutional Neural Network (CNN) path and the ViT path. ### Main contributions - The **GELAN - ViT** and **GELAN - RepViT** models perform excellently in satellite object detection tasks, especially in the application of Low - Earth - Orbit satellites. - Compared with the state - of - the - art YOLOv9 - t, these two models achieve an mAP50 of about 95% on the SOD dataset, while reducing GFLOPs by more than 5.0. - On the VOC 2012 dataset, GELAN - ViT and GELAN - RepViT also perform well, achieving an mAP50 of ≥60.7% respectively, and reducing GFLOPs by more than 5.2. Through these improvements, the paper provides a more efficient solution that can achieve high - precision satellite object detection on resource - constrained small - satellite platforms, thereby improving space safety and sustainability.

Sensing for Space Safety and Sustainability: A Deep Learning Approach with Vision Transformers

Spacecraft Components Detection Based on a Lightweight YOLOv3 Model

A Simple yet Effective Network based on Vision Transformer for Camouflaged Object and Salient Object Detection

Small Visual Object Detection in Smart Waste Classification Using Transformers with Deep Learning.

Automated classification of remote sensing satellite images using deep learning based vision transformer

A Deep Learning Approach for Satellite and Debris Detection: YOLO in Action

SegMarsViT: Lightweight Mars Terrain Segmentation Network for Autonomous Driving in Planetary Exploration

Innovative Research on Small Object Detection and Recognition in Remote Sensing Images Using YOLOv5

OD-YOLO: Robust Small Object Detection Model in Remote Sensing Image with a Novel Multi-Scale Feature Fusion

Improving Small and Cluttered Object Detection by Incorporating Instance Level Denoising Into Single-Shot Alignment Network for Remote Sensing Imagery

Salient Object Detection in Optical Remote Sensing Images Driven by Transformer

Towards a High-Performance Object Detector: Insights from Drone Detection Using ViT and CNN-based Deep Learning Models

SRDD: a lightweight end-to-end object detection with transformer

Vision-Based Detection of Uncooperative Targets and Components on Small Satellites

Few-shot Semantic Learning for Robust Multi-Biome 3D Semantic Mapping in Off-Road Environments

SOD‐YOLO: Small Object Detection Network for UAV Aerial Images

TransVOD: End-to-End Video Object Detection With Spatial-Temporal Transformers

Image-Based Lunar Hazard Detection in Low Illumination Simulated Conditions via Vision Transformers

VisionTwinNet: Gated Clarity Enhancement Paired With Light-Robust CD Transformers

Swin-Transformer-Enabled YOLOv5 with Attention Mechanism for Small Object Detection on Satellite Images

A Bio-Inspired Visual Perception Transformer for Cross-Domain Semantic Segmentation of High-Resolution Remote Sensing Images