Identifying Telescope Usage in Astrophysics Publications: A Machine Learning Framework for Institutional Research Management at Observatories

Vicente Amado Olivo,Wolfgang Kerzendorf,Brian Cherinka,Joshua V. Shields,Annie Didier,Katharina von der Wense

2024-11-02

Abstract:Large scientific institutions, such as the Space Telescope Science Institute, track the usage of their facilities to understand the needs of the research community. Astrophysicists incorporate facility usage data into their scientific publications, embedding this information in plain-text. Traditional automatic search queries prove unreliable for accurate tracking due to the misidentification of facility names in plain-text. As automatic search queries fail, researchers are required to manually classify publications for facility usage, which consumes valuable research time. In this work, we introduce a machine learning classification framework for the automatic identification of facility usage of observation sections in astrophysics publications. Our framework identifies sentences containing telescope mission keywords (e.g., Kepler and TESS) in each publication. Subsequently, the identified sentences are transformed using Term Frequency-Inverse Document Frequency and classified with a Support Vector Machine. The classification framework leverages the context surrounding the identified telescope mission keywords to provide relevant information to the classifier. The framework successfully classifies usage of MAST hosted missions with a 92.9% accuracy. Furthermore, our framework demonstrates robustness when compared to other approaches, considering common metrics and computational complexity. The framework's interpretability makes it adaptable for use across observatories and other scientific facilities worldwide.

Instrumentation and Methods for Astrophysics,Digital Libraries

What problem does this paper attempt to address?

### What problem does this paper attempt to solve?

This paper aims to solve the problem of automatic identification of the use of telescope facilities in astrophysics publications. Specifically, large - scale scientific research institutions (such as the Space Telescope Science Institute) need to track the use of their facilities in order to understand the needs of the research community, effectively allocate resources, and plan current and future facility management. However, traditional automatic search query methods are error - prone when identifying facility names, resulting in an inability to accurately track the use of telescope facilities.

#### Main problems:

1. **Time - consuming manual classification**: Since the information describing the use of telescopes is embedded in unstructured text, researchers have to manually classify publications, which consumes a great deal of precious research time.
2. **Unreliable automatic search**: Simple automatic search query methods cannot accurately distinguish the names of telescope facilities in the text, leading to misidentification.
3. **Rapid growth of literature**: With the exponential growth of astronomy literature, the amount of manual classification tasks has also increased dramatically, further increasing the workload of researchers.

To solve these problems, the author introduced a machine - learning - based classification framework for automatically identifying the use of telescope facilities in astrophysics publications. The framework is implemented through the following steps:

- **Keyword identification**: Identify sentences containing telescope mission keywords (such as Kepler and TESS) from each publication.
- **Feature extraction**: Use term frequency - inverse document frequency (TF - IDF) to convert the identified sentences into numerical representations.
- **Classification model**: Use classifiers such as support vector machines (SVM) to classify the converted sentences and identify whether a specific telescope facility has been used.

Finally, the framework successfully increased the classification accuracy of MAST - hosted task usage to 92.9% and demonstrated robustness and interpretability compared to other methods.

### Formula explanation

The formulas involved in the paper are as follows:

- **TF - IDF calculation formula**:
\[
\text{TF - IDF}(t, d)=\text{TF}(t, d)\times\text{IDF}(t)
\]
where,
\[
\text{TF}(t, d)=\frac{\text{count}(t, d)}{\text{maxCount}(d)}
\]
\[
\text{IDF}(t)=\log\left(1 + \frac{n}{\text{DF}(t)+ 1}\right)+1
\]
- \(t\) represents a term (word) in document \(d\);
- \(n\) represents the total number of documents;
- \(\text{count}(t, d)\) represents the number of times term \(t\) appears in document \(d\);
- \(\text{maxCount}(d)\) represents the number of all terms in document \(d\);
- \(\text{DF}(t)\) represents the number of documents containing term \(t\).

Through these methods, the framework can identify and classify the use of telescope facilities in astrophysics publications more efficiently and accurately.