Abstract:The rate of image acquisition in modern synoptic imaging surveys has already begun to outpace the feasibility of keeping astronomers in the real-time discovery and classification loop. Here we present the inner workings of a framework, based on machine-learning algorithms, that captures expert training and ground-truth knowledge about the variable and transient sky to automate 1) the process of discovery on image differences and, 2) the generation of preliminary science-type classifications of discovered sources. Since follow-up resources for extracting novel science from fast-changing transients are precious, self-calibrating classification probabilities must be couched in terms of efficiencies for discovery and purity of the samples generated. We estimate the purity and efficiency in identifying real sources with a two-epoch image-difference discovery algorithm for the Palomar Transient Factory (PTF) survey. Once given a source discovery, using machine-learned classification trained on PTF data, we distinguish between transients and variable stars with a 3.8% overall error rate (with 1.7% errors for imaging within the Sloan Digital Sky Survey footprint). At >96% classification efficiency, the samples achieve 90% purity. Initial classifications are shown to rely primarily on context-based features, determined from the data itself and external archival databases. In the ~one year since autonomous operations, this discovery and classification framework has led to several significant science results, from outbursting young stars to subluminous Type IIP supernovae to candidate tidal disruption events. We discuss future directions of this approach, including the possible roles of crowdsourcing and the scalability of machine learning to future surveys such a the Large Synoptical Survey Telescope (LSST).

The Incidence of Dwarf Novae in Large Area Transient Searches

The Zwicky Transient Facility Bright Transient Survey. II. A Public Statistical Sample for Exploring Supernova Demographics

An unusually brilliant transient in the galaxy Messier 85

The JCMT Transient Survey: Single-epoch Transients and Variability of Faint Sources

Unveiling the nature of two dwarf novae: CRTS J080846.2+313106 and V416 Dra

The JADES Transient Survey: Discovery and Classification of Supernovae in the JADES Deep Field

A Snapshot Survey of Nearby Supernovae with the Hubble Space Telescope

Automating Discovery and Classification of Transients and Variable Stars in the Synoptic Survey Era

AT2022aedm and a new class of luminous, fast-cooling transients in elliptical galaxies

Rapidly Evolving Transients in the Dark Energy Survey

A bright triple transient that vanished within 50 minutes

A transient search using combined human and machine classifications

SPIRITS 15c and SPIRITS 14buu: Two Obscured Supernovae in the Nearby Star-forming Galaxy IC 2163

Anomaly Detection and Approximate Similarity Searches of Transients in Real-time Data Streams

Needle in a Haystack: Finding Supermassive Black Hole-Related Flares in the Zwicky Transient Facility Public Survey

Astrometric Jitter as a Detection Diagnostic for Recoiling and Slingshot Supermassive Black Hole Candidates

A Phenomenon Resembling Early Superhumps in a New SU UMa-Type Dwarf Nova with a 2-Hour Orbital Period

WTP 19aalnxx: Discovery of a Bright Mid-infrared Transient in the Emerging Class of Low-luminosity Supernovae Revealed by Delayed Circumstellar Interaction

How Many Kilonovae Can Be Found in Past, Present, and Future Survey Datasets?