Abstract:Accurate classification of celestial objects is essential for advancing our understanding of the universe. MargNet is a recently developed deep learning-based classifier applied to the Sloan Digital Sky Survey (SDSS) Data Release 16 (DR16) dataset to segregate stars, quasars, and compact galaxies using photometric data. MargNet utilizes a stacked architecture, combining a Convolutional Neural Network (CNN) for image modelling and an Artificial Neural Network (ANN) for modelling photometric parameters. Notably, MargNet focuses exclusively on compact galaxies and outperforms other methods in classifying compact galaxies from stars and quasars, even at fainter magnitudes. In this study, we propose enhancing MargNet's performance by incorporating attention mechanisms and Vision Transformer (ViT)-based models for processing image data. The attention mechanism allows the model to focus on relevant features and capture intricate patterns within images, effectively distinguishing between different classes of celestial objects. Additionally, we leverage ViTs, a transformer-based deep learning architecture renowned for exceptional performance in image classification tasks. We enhance the model's understanding of complex astronomical images by utilizing ViT's ability to capture global dependencies and contextual information. Our approach uses a curated dataset comprising 240,000 compact and 150,000 faint objects. The models learn classification directly from the data, minimizing human intervention. Furthermore, we explore ViT as a hybrid architecture that uses photometric features and images together as input to predict astronomical objects. Our results demonstrate that the proposed attention mechanism augmented CNN in MargNet marginally outperforms the traditional MargNet and the proposed ViT-based MargNet models. Additionally, the ViT-based hybrid model emerges as the most lightweight and easy-to-train model with classification accuracy similar to that of the best-performing attention-enhanced MargNet. This advancement in deep learning will contribute to greater success in identifying objects in upcoming surveys like the Vera C. Rubin Large Synoptic Survey Telescope.

Automatic classification algorithm of astronomical objects based on improved resnet

An Improved Res-UNet Model for Tree Species Classification Using Airborne High-Resolution Images

Preparation for CSST: Star-galaxy Classification using a Rotationally Invariant Supervised Machine Learning Method

Superpixel-Based Long-Range Dependent Network for High-Resolution Remote-Sensing Image Classification

Scientific Preparation for CSST: Classification of Galaxy and Nebula/Star Cluster Based on Deep Learning

Classifying High Resolution Remote Sensing Images by Fine-Tuned VGG Deep Networks

Research on sports image classification method based on SE-RES-CNN model

Galaxy detection and identification using deep learning and data augmentation

[Galaxy/quasar classification based on nearest neighbor method]

DSRL: A low-resolution stellar spectral of LAMOST automatic classification method based on discrete wavelet transform and deep learning methods

Galaxy morphology classification with densenet

Remote sensing image classification method based on improved ShuffleNet convolutional neural network

AutoSourceID-Classifier. Star-Galaxy Classification using a Convolutional Neural Network with Spatial Information

Predicting galaxy morphology using attention-enhanced ResNets

Detection, instance segmentation, and classification for astronomical surveys with deep learning ( deepdisc ): detectron2 implementation and demonstration with Hyper Suprime-Cam data

GReFC-Net: an automated method for measuring structural features of spiral galaxies

Automatic Morphological Classification of Galaxies: Convolutional Autoencoder and Bagging-based Multiclustering Model

Classification of Radio Galaxy Images with Semi-supervised Learning.

Object-oriented remote sensing image information extraction method based on multi-classifier combination and deep learning algorithm

Enhanced astronomical source classification with integration of attention mechanisms and vision transformers

Machine Learning-Based Photometric Classification of Galaxies, Quasars, Emission-Line Galaxies, and Stars