Frank J. Masci,Russ R. Laher,Ben Rusholme,David L. Shupe,Steven Groom,Jason Surace,Edward Jackson,Serge Monkewitz,Ron Beck,David Flynn,Scott Terek,Walter Landry,Eugean Hacopians,Vandana Desai,Justin Howell,Tim Brooke,David Imel,Stefanie Wachter,Quan-Zhi Ye,Hsing-Wen Lin,S. Bradley Cenko,Virginia Cunningham,Umaa Rebbapragada,Brian Bue,Adam A. Miller,Ashish Mahabal,Eric C. Bellm,Maria T. Patterson,Mario Jurić,V. Zach Golkhou,Eran O. Ofek,Richard Walters,Matthew Graham,Mansi M. Kasliwal,Richard G. Dekany,Thomas Kupfer,Kevin Burdge,Christopher B. Cannella,Tom Barlow,Angela Van Sistine,Matteo Giomi,Christoffer Fremling,Nadejda Blagorodnova,David Levitan,Reed Riddle,Roger M. Smith,George Helou,Thomas A. Prince,Shrinivas R. Kulkarni

Abstract:The Zwicky Transient Facility (ZTF) is a new robotic time-domain survey currently in progress using the Palomar 48-inch Schmidt Telescope. ZTF uses a 47 square degree field with a 600 megapixel camera to scan the entire northern visible sky at rates of ∼3760 square degrees/hour to median depths of g ∼ 20.8 and r ∼ 20.6 mag (AB, 5σ in 30 sec). We describe the Science Data System that is housed at IPAC, Caltech. This comprises the data-processing pipelines, alert production system, data archive, and user interfaces for accessing and analyzing the products. The real-time pipeline employs a novel image-differencing algorithm, optimized for the detection of point-source transient events. These events are vetted for reliability using a machine-learned classifier and combined with contextual information to generate data-rich alert packets. The packets become available for distribution typically within 13 minutes (95th percentile) of observation. Detected events are also linked to generate candidate moving-object tracks using a novel algorithm. Objects that move fast enough to streak in the individual exposures are also extracted and vetted. We present some preliminary results of the calibration performance delivered by the real-time pipeline. The reconstructed astrometric accuracy per science image with respect to Gaia DR1 is typically 45 to 85 milliarcsec. This is the RMS per-axis on the sky for sources extracted with photometric S/N ≥ 10 and hence corresponds to the typical astrometric uncertainty down to this limit. The derived photometric precision (repeatability) at bright unsaturated fluxes varies between 8 and 25 millimag. The high end of these ranges corresponds to an airmass approaching ∼2—the limit of the public survey. Photometric calibration accuracy with respect to Pan-STARRS1 is generally better than 2%. The products support a broad range of scientific applications: fast and young supernovae; rare flux transients; variable stars; eclipsing binaries; variability from active galactic nuclei; counterparts to gravitational wave sources; a more complete census of Type Ia supernovae; and solar-system objects.

YSE-PZ: A Transient Survey Management Platform that Empowers the Human-in-the-Loop

Automating Discovery and Classification of Transients and Variable Stars in the Synoptic Survey Era

The S-PLUS Transient Extension Program: Imaging Pipeline, Transient Identification, and Survey Optimization for Multi-Messenger Astronomy

The Zwicky Transient Facility: Data Processing, Products, and Archive

A data science platform to enable time-domain astronomy

Design and operation of the ATLAS Transient Science Server

Transient processing and analysis using $\texttt{AMPEL}$: Alert Management, Photometry and Evaluation of Lightcurves

Automated Real-Time Classification and Decision Making in Massive Data Streams from Synoptic Sky Surveys

Blast: a Web Application for Characterizing the Host Galaxies of Astrophysical Transients

The SED Machine: a robotic spectrograph for fast transient classification

Real-Time Data Mining of Massive Data Streams from Synoptic Sky Surveys

The Zwicky Transient Facility Bright Transient Survey. II. A Public Statistical Sample for Exploring Supernova Demographics

Bursts from Space: MeerKAT - The first citizen science project dedicated to commensal radio transients

Towards an Automated Classification of Transient Events in Synoptic Sky Surveys

Keck Infrared Transient Survey. I. Survey Description and Data Release 1

The Atacama Cosmology Telescope: Systematic Transient Search of Single Observation Maps

$\texttt{simsurvey}$: Estimating Transient Discovery Rates for the Zwicky Transient Facility

AUTOMATED TRANSIENT IDENTIFICATION IN THE DARK ENERGY SURVEY

The simulated catalogue of optical transients and correlated hosts (SCOTCH)

Anomaly Detection and Approximate Similarity Searches of Transients in Real-time Data Streams