Abstract:The mining of Virtual Observatories (VOs) is becoming a powerful new method for discovery in astronomy. Here we report on the development of SkyDOT (Sky Database for Objects in the Time domain), a new Virtual Observatory, which is dedicated to the study of sky variability. The site will confederate a number of massive variability surveys and enable exploration of the time domain in astronomy. We discuss the architecture of the database and the functionality of the user interface. An important aspect of SkyDOT is that it is continuously updated in near real time so that users can access new observations in a timely manner. The site will also utilize high level machine learning tools that will allow sophisticated mining of the archive. Another key feature is the real time data stream provided by RAPTOR (RAPid Telescopes for Optical Response), a new sky monitoring experiment under construction at Los Alamos National Laboratory (LANL).

What problem does this paper attempt to address?

The paper attempts to address the issue of efficiently managing and analyzing large-scale datasets of sky transients in astronomy. Specifically, the paper introduces the development of SkyDOT (Sky Database for Objects in the Time Domain), a virtual observatory aimed at studying transient phenomena in the sky. The main issues addressed in the paper are as follows: 1. **Large-scale Data Management**: With the rapid increase in data volume from astronomical projects, effectively storing, managing, and accessing this data has become a challenge. SkyDOT provides a unified database system by integrating multiple large-scale transient survey data. 2. **Real-time Data Stream Processing**: Many astronomical events need to be identified and studied within a short time frame, making real-time data processing capabilities crucial. SkyDOT utilizes data streams from real-time monitoring experiments like RAPTOR to achieve near real-time data updates and access. 3. **Advanced Data Analysis Tools**: To extract useful information from massive datasets, SkyDOT integrates advanced data mining and machine learning tools, supporting complex database queries and analysis. 4. **Joint Analysis Across Datasets**: Different astronomical observation projects use different technologies and standards, making it challenging to combine these datasets for comprehensive analysis. SkyDOT achieves integration and interoperability of different datasets through standardized interfaces and federated database technology. 5. **User-friendly Interface**: To facilitate the use of this data by astronomers, SkyDOT is designed with an easy-to-use user interface, providing graphical data query and visualization tools. By addressing the above issues, SkyDOT is expected to significantly enhance the understanding and discovery capabilities of transient phenomena in astronomical research.

SkyDOT (Sky Database for Objects in the Time Domain): A Virtual Observatory for Variability Studies at LANL

A data science platform to enable time-domain astronomy

Northern Sky Variability Survey: Public Data Release

Connecting the time domain community with the Virtual Astronomical Observatory

Real-Time Data Mining of Massive Data Streams from Synoptic Sky Surveys

Astronomical Archives of the Future: A Virtual Observatory

The Virtual Astronomical Observatory: Re-engineering Access to Astronomical Data

Automated Real-Time Classification and Decision Making in Massive Data Streams from Synoptic Sky Surveys

Automating Discovery and Classification of Transients and Variable Stars in the Synoptic Survey Era

VAST - a real-time pipeline for detecting radio transients and variables on the Australian SKA Pathfinder (ASKAP) telescope

The Sky is for Everyone - Outreach and Educaction with the Virtual Observatory

Drowning in Data : VO to the rescue

VSOP: The Variable Star One-shot Project I. Project presentation and first data release

An Automated tool to detect variable sources in the Vista Variables in the V\'ıa Láctea Survey. The VVV Variables (V$^{4}$) catalog of tiles d001 and d002

A 22-year Southern Sky Survey for Transient and Variable Radio Sources using the Molonglo Observatory Synthesis Telescope

VOStat: A Statistical Web Service for Astronomers

Big Science with a nUV-MidIR Rapid-Response 1.3m telescope at L2

A case study in adaptable and reusable infrastructure at the Keck Observatory Archive: VO interfaces, moving targets, and more

SPRITEly: Time-domain Millimeter Interferometry at the Owens Valley Radio Observatory

Advancements in Streamlining Time-Domain and Multi-Messenger Astronomy Follow-Up Infrastructure at Keck Observatory

Observers' Data Access Portal: Realtime Streaming for Astronomical Data