In vitro susceptibility of pathogenic staphylococci to seven antibiotics.

M. Finland,P. Frank,C. Wilcox

DOI: https://doi.org/10.1093/AJCP/20.4.325

1950-04-01

American Journal of Clinical Pathology

Abstract:

What problem does this paper attempt to address?

Machine learning based stellar classification with highly sparse photometry data

Sean Enis Cody,Sebastian Scher,Iain McDonald,Albert Zijlstra,Emma Alexander,Nick L.J. Cox

DOI: https://doi.org/10.12688/openreseurope.17023.2

2024-10-30

Abstract:Identifying stars belonging to different classes is vital in order to build up statistical samples of different phases and pathways of stellar evolution. In the era of surveys covering billions of stars, an automated method of identifying these classes becomes necessary. Many classes of stars are identified based on their emitted spectra. In this paper, we use a combination of the multi-class multi-label Machine Learning (ML) method XGBoost and the PySSED spectral-energy-distribution fitting algorithm to classify stars into nine different classes, based on their photometric data. The classifier is trained on subsets of the SIMBAD database. Particular challenges are the very high sparsity (large fraction of missing values) of the underlying data as well as the high class imbalance. We discuss the different variables available, such as photometric measurements on the one hand, and indirect predictors such as Galactic position on the other hand. We show the difference in performance when excluding certain variables, and discuss in which contexts which of the variables should be used. Finally, we show that increasing the number of samples of a particular type of star significantly increases the performance of the model for that particular type, while having little to no impact on other types. The accuracy of the main classifier is ~0.7 with a macro F1 score of 0.61. While the current accuracy of the classifier is not high enough to be reliably used in stellar classification, this work is an initial proof of feasibility for using ML to classify stars based on photometry.

Instrumentation and Methods for Astrophysics,Solar and Stellar Astrophysics
A Machine-Learning Photometric Classifier for Massive Stars in Nearby Galaxies I. the Method

Grigoris Maravelias,Alceste Z. Bonanos,Frank Tramper,Stephan de Wit,Ming Yang,Paolo Bonfini

DOI: https://doi.org/10.1051/0004-6361/202141397

2022-01-01

Abstract:(abridged) Mass loss is a key parameter in the evolution of massive stars, with discrepancies between theory and observations and with unknown importance of the episodic mass loss. To address this we need increased numbers of classified sources stars spanning a range of metallicity environments. We aim to remedy the situation by applying machine learning techniques to recently available extensive photometric catalogs. We used IR/Spitzer and optical/Pan-STARRS, with Gaia astrometric information, to compile a large catalog of known massive stars in M31 and M33, which were grouped in Blue, Red, Yellow, B[e] supergiants, Luminous Blue Variables, Wolf-Rayet, and background galaxies. Due to the high imbalance, we implemented synthetic data generation to populate the underrepresented classes and improve separation by undersampling the majority class. We built an ensemble classifier using color indices. The probabilities from Support Vector Classification, Random Forests, and Multi-layer Perceptron were combined for the final classification. The overall weighted balanced accuracy is ~83%, recovering Red supergiants at ~94%, Blue/Yellow/B[e] supergiants and background galaxies at ~50-80%, Wolf-Rayets at ~45%, and Luminous Blue Variables at ~30%, mainly due to their small sample sizes. The mixing of spectral types (no strict boundaries in their color indices) complicates the classification. Independent application to IC 1613, WLM, and Sextans A galaxies resulted in an overall lower accuracy of ~70%, attributed to metallicity and extinction effects. The missing data imputation was explored using simple replacement with mean values and an iterative imputor, which proved more capable. We also found that r-i and y-[3.6] were the most important features. Our method, although limited by the sampling of the feature space, is efficient in classifying sources with missing data and at lower metallicitites.
Probabilistic Classification of Infrared-selected targets for SPHEREx mission: In search of YSOs

K. Lakshmipathaiah,S. Vig,Matthew L. N. Ashby,Joseph L. Hora,Miju Kang,Rama Krishna Sai S. Gorthi

DOI: https://doi.org/10.1093/mnras/stad2782

2023-09-22

Abstract:We apply machine learning algorithms to classify Infrared (IR)-selected targets for NASA's upcoming SPHEREx mission. In particular, we are interested in classifying Young Stellar Objects (YSOs), which are essential for understanding the star formation process. Our approach differs from previous work, which has relied heavily on broadband color criteria to classify IR-bright objects, and are typically implemented in color-color and color-magnitude diagrams. However, these methods do not state the confidence associated with the classification and the results from these methods are quite ambiguous due to the overlap of different source types in these diagrams. Here, we utilize photometric colors and magnitudes from seven near and mid-infrared bands simultaneously and employ machine and deep learning algorithms to carry out probabilistic classification of YSOs, Asymptotic Giant Branch (AGB) stars, Active Galactic Nuclei (AGN) and main-sequence (MS) stars. Our approach also sub-classifies YSOs into Class I, II, III and flat spectrum YSOs, and AGB stars into carbon-rich and oxygen-rich AGB stars. We apply our methods to infrared-selected targets compiled in preparation for SPHEREx which are likely to include YSOs and other classes of objects. Our classification indicates that out of $8,308,384$ sources, $1,966,340$ have class prediction with probability exceeding $90\%$, amongst which $\sim 1.7\%$ are YSOs, $\sim 58.2\%$ are AGB stars, $\sim 40\%$ are (reddened) MS stars, and $\sim 0.1\%$ are AGN whose red broadband colors mimic YSOs. We validate our classification using the spatial distributions of predicted YSOs towards the Cygnus-X star-forming complex, as well as AGB stars across the Galactic plane.

Solar and Stellar Astrophysics,Astrophysics of Galaxies,Instrumentation and Methods for Astrophysics
Optimized sampling of SDSS-IV MaStar spectra for stellar classification using supervised models

R. I. El-Kholy,Z. M. Hayman

2024-06-29

Abstract:Supervised machine learning models are increasingly being used for solving the problem of stellar classification of spectroscopic data. However, training such models requires a large number of labelled instances, the collection of which is usually costly in both time and expertise. Active learning algorithms minimize training dataset sizes by keeping only the most informative instances. This paper explores the application of active learning to sampling stellar spectra using data from a highly class-imbalanced dataset. We utilize the MaStar library from the SDSS DR17 along with its associated stellar parameter catalogue. A preprocessing pipeline that includes feature selection, scaling, and dimensionality reduction is applied to the data. Using different active learning algorithms, we iteratively query instances, where the model or committee of models exhibits the highest uncertainty or disagreement, respectively. We assess the effectiveness of the sampling techniques by comparing several performance metrics of supervised-learning models trained on the queried samples with randomly-sampled counterparts. Evaluation metrics include specificity, sensitivity, and the area under the curve; in addition to the Matthew's correlation coefficient, which accounts for class imbalance. We apply this procedure to effective temperature, surface gravity, and iron metallicity, separately. Our results demonstrate the effectiveness of active learning algorithms in selecting samples that produce performance metrics superior to random sampling and even stratified samples, with fewer training instances. Active learning is recommended for prioritizing instance labelling of astronomical-survey data by experts or crowdsourcing to mitigate the high time cost. Its effectiveness can be further exploited in selection of targets for follow-up observations in automated astronomical surveys.

Solar and Stellar Astrophysics,Instrumentation and Methods for Astrophysics
Analyzing Astronomical Data with Machine Learning Techniques

Mohammad H. Zhoolideh Haghighi

DOI: https://doi.org/10.48550/arXiv.2302.11573

2023-02-22

Abstract:Classification is a popular task in the field of Machine Learning (ML) and Artificial Intelligence (AI), and it happens when outputs are categorical variables. There are a wide variety of models that attempts to draw some conclusions from observed values, so classification algorithms predict categorical class labels and use them in classifying new data. Popular classification models including logistic regression, decision tree, random forest, Support Vector Machine (SVM), multilayer perceptron, Naive Bayes, and neural networks have proven to be efficient and accurate applied to many industrial and scientific problems. Particularly, the application of ML to astronomy has shown to be very useful for classification, clustering, and data cleaning. It is because after learning computers, these tasks can be done automatically by them in a more precise and more rapid way than human operators. In view of this, in this paper, we will review some of these popular classification algorithms, and then we apply some of them to the observational data of nonvariable and the RR Lyrae variable stars that come from the SDSS survey. For the sake of comparison, we calculate the accuracy and F1-score of the applied models.

Instrumentation and Methods for Astrophysics,Solar and Stellar Astrophysics,Computational Physics,Data Analysis, Statistics and Probability
Classifying Unidentified X-ray Sources in the Chandra Source Catalog Using a Multiwavelength Machine-learning Approach

Hui Yang,Jeremy Hare,Oleg Kargaltsev,Igor Volkov,Steven Chen,Blagoy Rangelov

DOI: https://doi.org/10.3847/1538-4357/ac952b

2023-07-21

Abstract:The rapid increase in serendipitous X-ray source detections requires the development of novel approaches to efficiently explore the nature of X-ray sources. If even a fraction of these sources could be reliably classified, it would enable population studies for various astrophysical source types on a much larger scale than currently possible. Classification of large numbers of sources from multiple classes characterized by multiple properties (features) must be done automatically and supervised machine learning (ML) seems to provide the only feasible approach. We perform classification of Chandra Source Catalog version 2.0 (CSCv2) sources to explore the potential of the ML approach and identify various biases, limitations, and bottlenecks that present themselves in these kinds of studies. We establish the framework and present a flexible and expandable Python pipeline, which can be used and improved by others. We also release the training data set of 2941 X-ray sources with confidently established classes. In addition to providing probabilistic classifications of 66,369 CSCv2 sources (21% of the entire CSCv2 catalog), we perform several narrower-focused case studies (high-mass X-ray binary candidates and X-ray sources within the extent of the H.E.S.S. TeV sources) to demonstrate some possible applications of our ML approach. We also discuss future possible modifications of the presented pipeline, which are expected to lead to substantial improvements in classification confidences.

High Energy Astrophysical Phenomena
Comparison of Stellar Classification Accuracies Using Automated Algorithms

Tessa Thorsen,Jiahuan Zhou,Ying Wu

2016-01-01

Abstract:Machine learning algorithms can be used to reduce the dimensionality of stellar spectra, and make automated classification using these spectra faster and more efficient. Much work has been done in applying one such algorithm, Principal Component Analysis (PCA), to spectra, but PCA assumes that the data is linear globally, which is not the case for spectral data. Other work has been done to examine the possibilities of applying nonlinear dimension reduction algorithms, such as Locally Linear Embedding (LLE) and Isometric Mapping (Isomap). These algorithms only require local linearity in the data, which is satisfied by spectral data. We apply PCA, LLE and Isomap to spectra of K-type stars from SDSS, and use a trained Support Vector Machine to determine subclasses of these stars. We then compare these subclasses to those given by SDSS to determine the accuracy of the classifications. This allows us to …
Semi-supervised classification and clustering analysis for variable stars

R Pantoja,M Catelan,K Pichara,P Protopapas

DOI: https://doi.org/10.1093/mnras/stac2715

IF: 4.8

2022-09-30

Monthly Notices of the Royal Astronomical Society

Abstract:ABSTRACT The immense amount of time series data produced by astronomical surveys has called for the use of machine learning algorithms to discover and classify several million celestial sources. In the case of variable stars, supervised learning approaches have become commonplace. However, this needs a considerable collection of expert-labelled light curves to achieve adequate performance, which is costly to construct. To solve this problem, we introduce two approaches. First, a semi-supervised hierarchical method, which requires substantially less trained data than supervised methods. Second, a clustering analysis procedure that finds groups that may correspond to classes or subclasses of variable stars. Both methods are primarily supported by dimensionality reduction of the data for visualization and to avoid the curse of dimensionality. We tested our methods with catalogues collected from the Optical Gravitational Lensing Experiment (OGLE), the Catalina Sky Survey (CSS), and the Gaia survey. The semi-supervised method reaches a performance of around 90 per cent for all of our three selected catalogues of variable stars using only $5{{\ \rm per\ cent}}$ of the data in the training. This method is suitable for classifying the main classes of variable stars when there is only a small amount of training data. Our clustering analysis confirms that most of the clusters found have a purity over 90 per cent with respect to classes and 80 per cent with respect to subclasses, suggesting that this type of analysis can be used in large-scale variability surveys as an initial step to identify which classes or subclasses of variable stars are present in the data and/or to build training sets, among many other possible applications.

astronomy & astrophysics
A Novel Approach for Variable Star Classification Based on Imbalanced Learning

Jingyi Zhang,Yanxia Zhang,Zihan Kang,Changhua Li,Yihan Tao,Yongheng Zhao,Xue-Bing Wu

DOI: https://doi.org/10.1017/pasa.2023.35

2023-01-01

Publications of the Astronomical Society of Australia

Abstract:The advent of time-domain sky surveys has generated a vast amount of light variation data, enabling astronomers to investigate variable stars with large-scale samples. However, this also poses new opportunities and challenges for the time-domain research. In this paper, we focus on the classification of variable stars from the Catalina Surveys Data Release 2 and propose an imbalanced learning classifier based on Self-paced Ensemble (SPE) method. Compared with the work of Hosenie et al. (2020), our approach significantly enhances the classification Recall of Blazhko RR Lyrae stars from 12% to 85%, mixed-mode RR Lyrae variables from 29% to 64%, detached binaries from 68% to 97%, and LPV from 87% to 99%. SPE demonstrates a rather good performance on most of the variable classes except RRab, RRc, and contact and semi-detached binary. Moreover, the results suggest that SPE tends to target the minority classes of objects, while Random Forest is more effective in finding the majority classes. To balance the overall classification accuracy, we construct a Voting Classifier that combines the strengths of SPE and Random Forest. The results show that the Voting Classifier can achieve a balanced performance across all classes with minimal loss of accuracy. In summary, the SPE algorithm and Voting Classifier are superior to traditional machine learning methods and can be well applied to classify the periodic variable stars. This paper contributes to the current research on imbalanced learning in astronomy and can also be extended to the time-domain data of other larger sky survey projects (LSST, etc.).
Photometrically-Classified Superluminous Supernovae from the Pan-STARRS1 Medium Deep Survey: A Case Study for Science with Machine Learning-Based Classification

Brian Hsu,Griffin Hosseinzadeh,V. Ashley Villar,Edo Berger

DOI: https://doi.org/10.3847/1538-4357/ac87ff

2023-07-17

Abstract:With the upcoming Vera C.~Rubin Observatory Legacy Survey of Space and Time (LSST), it is expected that only $\sim 0.1\%$ of all transients will be classified spectroscopically. To conduct studies of rare transients, such as Type I superluminous supernovae (SLSNe), we must instead rely on photometric classification. In this vein, here we carry out a pilot study of SLSNe from the Pan-STARRS1 Medium-Deep Survey (PS1-MDS) classified photometrically with our SuperRAENN and Superphot algorithms. We first construct a sub-sample of the photometric sample using a list of simple selection metrics designed to minimize contamination and ensure sufficient data quality for modeling. We then fit the multi-band light curves with a magnetar spin-down model using the Modular Open-Source Fitter for Transients (MOSFiT). Comparing the magnetar engine and ejecta parameter distributions of the photometric sample to those of the PS1-MDS spectroscopic sample and a larger literature spectroscopic sample, we find that these samples are overall consistent, but that the photometric sample extends to slower spins and lower ejecta masses, which correspond to lower luminosity events, as expected for photometric selection. While our PS1-MDS photometric sample is still smaller than the overall SLSN spectroscopic sample, our methodology paves the way to an orders-of-magnitude increase in the SLSN sample in the LSST era through photometric selection and study.

High Energy Astrophysical Phenomena
Fine-grained Photometric Classification Using Multi-model Fusion Method with Redshift Estimation

Peng Cheng,Zhihui Liu,Fatemeh Zahra Zeraatgri,Liquan Mei

DOI: https://doi.org/10.1016/j.jheap.2024.07.008

IF: 4.925

2024-07-20

Journal of High Energy Astrophysics

Abstract:The modern sky surveys accelerates astronomical data collection. We proposed a multi-model fusion method aimed at comprehensive and fine-grained astronomical source classification. This method incorporates a redshift estimation model using the mixture density network into a source classification model. Based on 1.2 million sources from the SDSS and the ALLWISE, we performed three-class experiments for stars, quasars, and galaxies, four-class experiments to further classify galaxies into normal and emission-line galaxies (NGs; ELGs), and seven-class experiments where ELG were refined into active galactic nuclei (AGNs), broad-line galaxies (BLs), star-forming galaxies (SFs), and starburst galaxies (SBs). In all experiments, our proposed method is superior to direct classification. In three- and four-class, we obtains 0.77% and 1.14% improvement in accuracy, demonstrating the effectiveness of adding redshift estimation. Meanwhile, three machine learning algorithms were stacked into one by us to finish fine-grained classification, which achieved an accuracy of 78.5%, with F1 scores of 99.2% for stars, 97% for quasars, 64.3% for NGs, 60.8% for AGNs, 68.3% for BLs, 87.2% for SBs, and 71.3% for SFs. The NMAD and R2 for the redshift estimation part of our method are 0.18 and 0.916, while it has only 2.65% outliers. The method we proposed further mines the information contained in the photometry to achieve comprehensive and fine-grained classification, which will be beneficial for immediate analysis in large-scale surveys. Besides, this method can leverage feature importance to stimulate new insights for astronomers.

astronomy & astrophysics
Towards Precision Photometric Type Ia Supernova Cosmology with Machine Learning

Helen Qu

2024-06-07

Abstract:The revolutionary discovery of dark energy and accelerating cosmic expansion was made with just 42 type Ia supernovae (SNe Ia) in 1999. Since then, large synoptic surveys, e.g., Dark Energy Survey (DES), have observed thousands more SNe Ia and the upcoming Rubin Legacy Survey of Space and Time (LSST) and Roman Space Telescope promise to deliver millions in the next decade. This unprecedented data volume can be used to test concordance cosmology. However, extracting a pure SN Ia sample with accurate redshifts for such a large dataset will be a challenge. Spectroscopic classification will not be possible for the vast majority of discovered objects, and only 25% will have spectroscopic redshifts. This thesis presents a series of observational and methodological studies designed to address the questions associated with this new era of photometric SN Ia cosmology. First, we present a machine learning (ML) method for SN photometric classification, SCONE. Photometric classification enables SNe with no spectroscopic information to be categorized, a critical step for cosmological analysis. SCONE achieves 99+% accuracy distinguishing simulated SNe Ia from non-Ia SNe, and is a part of DES, LSST, and Roman analysis pipelines. We also show that SCONE can classify 6 SN types with 75% accuracy on the night of initial discovery, comparable to results in the literature for full-phase SNe. Next, we study current methods for estimating SN Ia redshifts and propose an ML alternative that uses SN photometry alone to extract redshift information. Photo-zSNthesis is a host galaxy-independent redshift estimator accurate to within 2% across the redshift range of LSST, a first in the literature. Finally, we focus on ML robustness and demonstrate a general method for improving robustness that achieves new state-of-the-art results on astronomical object classification, wildlife identification, and tumor detection.

Cosmology and Nongalactic Astrophysics
Photometric redshift-aided classification using ensemble learning

P. A. C. Cunha,A. Humphrey

DOI: https://doi.org/10.1051/0004-6361/202243135

2022-05-19

Abstract:We present SHEEP, a new machine learning approach to the classic problem of astronomical source classification, which combines the outputs from the XGBoost, LightGBM, and CatBoost learning algorithms to create stronger classifiers. A novel step in our pipeline is that prior to performing the classification, SHEEP first estimates photometric redshifts, which are then placed into the data set as an additional feature for classification model training; this results in significant improvements in the subsequent classification performance. SHEEP contains two distinct classification methodologies: (i) Multi-class and (ii) one versus all with correction by a meta-learner. We demonstrate the performance of SHEEP for the classification of stars, galaxies, and quasars using a data set composed of SDSS and WISE photometry of 3.5 million astronomical sources. The resulting F1-scores are as follows: 0.992 for galaxies; 0.967 for quasars; and 0.985 for stars. In terms of the F1-scores for the three classes, SHEEP is found to outperform a recent RandomForest-based classification approach using an essentially identical data set. Our methodology also facilitates model and data set explainability via feature importances; it also allows the selection of sources whose uncertain classifications may make them interesting sources for follow-up observations.

Instrumentation and Methods for Astrophysics
Using machine learning to investigate the populations of dusty evolved stars in various metallicities

Grigoris Maravelias,Alceste Z. Bonanos,Frank Tramper,Stephan de Wit,Ming Yang,Paolo Bonfini,Emmanuel Zapartas,Konstantinos Antoniadis,Evangelia Christodoulou,Gonzalo Muñoz-Sanchez

DOI: https://doi.org/10.1017/s1743921322003337

2024-09-02

Proceedings of the International Astronomical Union

Abstract:Mass loss is a key property to understand stellar evolution and in particular for low-metallicity environments. Our knowledge has improved dramatically over the last decades both for single and binary evolutionary models. However, episodic mass loss although definitely present observationally, is not included in the models, while its role is currently undetermined. A major hindrance is the lack of large enough samples of classified stars. We attempted to address this by applying an ensemble machine-learning approach using color indices (from IR/Spitzer and optical/Pan-STARRS photometry) as features and combining the probabilities from three different algorithms. We trained on M31 and M33 sources with known spectral classification, which we grouped into Blue/Yellow/Red/B[e] Supergiants, Luminous Blue Variables, classical Wolf-Rayet and background galaxies/AGNs. We then applied the classifier to about one million Spitzer point sources from 25 nearby galaxies, spanning a range of metallicites (). Equipped with spectral classifications we investigated the occurrence of these populations with metallicity.
Exploring galactic properties with machine learning Predicting star formation, stellar mass, and metallicity from photometric data

F. Z. Zeraatgari,F. Hafezianzadeh,Y.-X. Zhang,A. Mosallanezhad,J.-Y. Zhang

2024-05-24

Abstract:ims. We explore machine learning techniques to forecast star formation rate, stellar mass, and metallicity across galaxies with redshifts ranging from 0.01 to 0.3. Methods. Leveraging CatBoost and deep learning architectures, we utilize multiband optical and infrared photometric data from SDSS and AllWISE, trained on the SDSS MPA-JHU DR8 catalogue. Results. Our study demonstrates the potential of machine learning in accurately predicting galaxy properties solely from photometric data. We achieve minimised root mean square errors, specifically employing the CatBoost model. For star formation rate prediction, we attain a value of RMSESFR = 0.336 dex, while for stellar mass prediction, the error is reduced to RMSESM = 0.206 dex. Additionally, our model yields a metallicity prediction of RMSEmetallicity = 0.097 dex. Conclusions. These findings underscore the significance of automated methodologies in efficiently estimating critical galaxy properties, amid the exponential growth of multi-wavelength astronomy data. Future research may focus on refining machine learning models and expanding datasets for even more accurate predictions.

Astrophysics of Galaxies
Unsupervised machine learning for the classification of astrophysical X-ray sources

Víctor Samuel Pérez-Díaz,Juan Rafael Martínez-Galarza,Alexander Caicedo,Raffaele D’Abrusco

DOI: https://doi.org/10.1093/mnras/stae260

IF: 4.8

2024-01-24

Monthly Notices of the Royal Astronomical Society

Abstract:ABSTRACT The automatic classification of X-ray detections is a necessary step in extracting astrophysical information from compiled catalogues of astrophysical sources. Classification is useful for the study of individual objects, statistics for population studies, as well as for anomaly detection, that is, the identification of new unexplored phenomena, including transients and spectrally extreme sources. Despite the importance of this task, classification remains challenging in X-ray astronomy due to the lack of optical counterparts and representative training sets. We develop an alternative methodology that employs an unsupervised machine learning approach to provide probabilistic classes to Chandra Source Catalog sources with a limited number of labelled sources, and without ancillary information from optical and infrared catalogues. We provide a catalogue of probabilistic classes for 8756 sources, comprising a total of 14 507 detections, and demonstrate the success of the method at identifying emission from young stellar objects, as well as distinguishing between small- and large-scale compact accretors with a significant level of confidence. We investigate the consistency between the distribution of features among classified objects and well-established astrophysical hypotheses such as the unified active galactic nucleus model. This provides interpretability to the probabilistic classifier. Code and tables are available publicly through GitHub. We provide a web playground for readers to explore our final classification at https://umlcaxs-playground.streamlit.app.

astronomy & astrophysics
Machine-learning classification of astronomical sources: estimating F1-score in the absence of ground truth

A Humphrey,W Kuberski,J Bialek,N Perrakis,W Cools,N Nuyttens,H Elakhrass,P A C Cunha

DOI: https://doi.org/10.1093/mnrasl/slac120

2022-10-16

Monthly Notices of the Royal Astronomical Society: Letters

Abstract:ABSTRACT Machine-learning based classifiers have become indispensable in the field of astrophysics, allowing separation of astronomical sources into various classes, with computational efficiency suitable for application to the enormous data volumes that wide-area surveys now typically produce. In the standard supervised classification paradigm, a model is typically trained and validated using data from relatively small areas of sky, before being used to classify sources in other areas of the sky. However, population shifts between the training examples and the sources to be classified can lead to ‘silent’ degradation in model performance, which can be challenging to identify when the ground-truth is not available. In this letter, we present a novel methodology using the nannyml Confidence-Based Performance Estimation (CBPE) method to predict classifier F1-score in the presence of population shifts, but without ground-truth labels. We apply CBPE to the selection of quasars with decision-tree ensemble models, using broad-band photometry, and show that the F1-scores are predicted remarkably well (${\rm MAPE} \sim 10{{\ \rm per\ cent}}$; R2 = 0.74–0.92). We discuss potential use-cases in the domain of astronomy, including machine-learning model and/or hyperparameter selection, and evaluation of the suitability of training data sets for a particular classification problem.

English Else
Star Cluster Classification using Deep Transfer Learning with PHANGS-HST

Stephen Hannon,Bradley C. Whitmore,Janice C. Lee,David A. Thilker,Sinan Deger,E. A. Huerta,Wei Wei,Bahram Mobasher,Ralf Klessen,Mederic Boquien,Daniel A. Dale,Melanie Chevance,Kathryn Grasha,Patricia Sanchez-Blazquez,Thomas Williams,Fabian Scheuermann,Brent Groves,Hwihyun Kim,J. M. Diederick Kruijssen,PHANGS-HST Team

DOI: https://doi.org/10.1093/mnras/stad2238

2023-07-28

Abstract:Currently available star cluster catalogues from HST imaging of nearby galaxies heavily rely on visual inspection and classification of candidate clusters. The time-consuming nature of this process has limited the production of reliable catalogues and thus also post-observation analysis. To address this problem, deep transfer learning has recently been used to create neural network models which accurately classify star cluster morphologies at production scale for nearby spiral galaxies (D < 20 Mpc). Here, we use HST UV-optical imaging of over 20,000 sources in 23 galaxies from the Physics at High Angular Resolution in Nearby GalaxieS (PHANGS) survey to train and evaluate two new sets of models: i) distance-dependent models, based on cluster candidates binned by galaxy distance (9-12 Mpc, 14-18 Mpc, 18-24 Mpc), and ii) distance-independent models, based on the combined sample of candidates from all galaxies. We find that the overall accuracy of both sets of models is comparable to previous automated star cluster classification studies (~60-80 per cent) and show improvement by a factor of two in classifying asymmetric and multi-peaked clusters from PHANGS-HST. Somewhat surprisingly, while we observe a weak negative correlation between model accuracy and galactic distance, we find that training separate models for the three distance bins does not significantly improve classification accuracy. We also evaluate model accuracy as a function of cluster properties such as brightness, colour, and SED-fit age. Based on the success of these experiments, our models will provide classifications for the full set of PHANGS-HST candidate clusters (N ~ 200,000) for public release.

Astrophysics of Galaxies,Solar and Stellar Astrophysics
Using Machine Learning to Identify Extragalactic Globular Cluster Candidates from Ground-Based Photometric Surveys of M87

Emilia Barbisan,Jeff Huang,Kristen C. Dage,Daryl Haggard,Robin Arnason,Arash Bahramian,William I. Clarkson,Arunav Kundu,Stephen E. Zepf

DOI: https://doi.org/10.1093/mnras/stac1396

2022-05-19

Abstract:Globular clusters (GCs) have been at the heart of many longstanding questions in many sub-fields of astronomy and, as such, systematic identification of GCs in external galaxies has immense impacts. In this study, we take advantage of M87's well-studied GC system to implement supervised machine learning (ML) classification algorithms - specifically random forest and neural networks - to identify GCs from foreground stars and background galaxies using ground-based photometry from the Canada-France-Hawai'i Telescope (CFHT). We compare these two ML classification methods to studies of "human-selected" GCs and find that the best performing random forest model can reselect 61.2% $\pm$ 8.0% of GCs selected from HST data (ACSVCS) and the best performing neural network model reselects 95.0% $\pm$ 3.4%. When compared to human-classified GCs and contaminants selected from CFHT data - independent of our training data - the best performing random forest model can correctly classify 91.0% $\pm$ 1.2% and the best performing neural network model can correctly classify 57.3% $\pm$ 1.1%. ML methods in astronomy have been receiving much interest as Vera C. Rubin Observatory prepares for first light. The observables in this study are selected to be directly comparable to early Rubin Observatory data and the prospects for running ML algorithms on the upcoming dataset yields promising results.

Astrophysics of Galaxies

In vitro susceptibility of pathogenic staphylococci to seven antibiotics.

Machine learning based stellar classification with highly sparse photometry data

A Machine-Learning Photometric Classifier for Massive Stars in Nearby Galaxies I. the Method

Probabilistic Classification of Infrared-selected targets for SPHEREx mission: In search of YSOs

Optimized sampling of SDSS-IV MaStar spectra for stellar classification using supervised models

Analyzing Astronomical Data with Machine Learning Techniques

Classifying Unidentified X-ray Sources in the Chandra Source Catalog Using a Multiwavelength Machine-learning Approach

Comparison of Stellar Classification Accuracies Using Automated Algorithms

Semi-supervised classification and clustering analysis for variable stars

A Novel Approach for Variable Star Classification Based on Imbalanced Learning

Photometrically-Classified Superluminous Supernovae from the Pan-STARRS1 Medium Deep Survey: A Case Study for Science with Machine Learning-Based Classification

Fine-grained Photometric Classification Using Multi-model Fusion Method with Redshift Estimation

Towards Precision Photometric Type Ia Supernova Cosmology with Machine Learning

Photometric redshift-aided classification using ensemble learning

Using machine learning to investigate the populations of dusty evolved stars in various metallicities

Exploring galactic properties with machine learning Predicting star formation, stellar mass, and metallicity from photometric data

Unsupervised machine learning for the classification of astrophysical X-ray sources

Machine-learning classification of astronomical sources: estimating F1-score in the absence of ground truth

Star Cluster Classification using Deep Transfer Learning with PHANGS-HST

Using Machine Learning to Identify Extragalactic Globular Cluster Candidates from Ground-Based Photometric Surveys of M87