Abstract:Astronomy has a long history of acquiring, systematizing, and interpreting large quantities of data. Starting from the earliest sky atlases through the first major photographic sky surveys of the 20th century, this tradition is continuing today, and at an ever increasing rate. Like many other fields, astronomy has become a very data-rich science, driven by the advances in telescope, detector, and computer technology. Numerous large digital sky surveys and archives already exist, with information content measured in multiple Terabytes, and even larger, multi-Petabyte data sets are on the horizon. Systematic observations of the sky, over a range of wavelengths, are becoming the primary source of astronomical data. Numerical simulations are also producing comparable volumes of information. Data mining promises to both make the scientific utilization of these data sets more effective and more complete, and to open completely new avenues of astronomical research. Technological problems range from the issues of database design and federation, to data mining and advanced visualization, leading to a new toolkit for astronomical research. This is similar to challenges encountered in other data-intensive fields today. These advances are now being organized through a concept of the Virtual Observatories, federations of data archives and services representing a new information infrastructure for astronomy of the 21st century. In this article, we provide an overview of some of the major datasets in astronomy, discuss different techniques used for archiving data, and conclude with a discussion of the future of massive datasets in astronomy.

Big Data analytics and Cognitive Computing: future opportunities for Astronomical research

Astroinformatics, data mining and the future of astronomical research

SETI reloaded, Next Generation Radio Telescopes, Transients and Cognitive Computing

Data-rich astronomy: mining synoptic sky surveys

Astronomy research in big-data era

Big Universe, Big Data: Machine Learning and Image Analysis for Astronomy

Astronomical Archives of the Future: A Virtual Observatory

From Dark Energy to Exolife: Improving the Digital Information Infrastructure for Astrophysics

Massive Datasets in Astronomy

Applications of AI in Astronomy

The Data Big Bang and the Expanding Digital Universe: High-Dimensional, Complex and Massive Data Sets in an Inflationary Epoch

Machine Learning for Observational Cosmology

Computational Intelligence in Astronomy

Virtual Astronomy, Information Technology, and the New Scientific Methodology

Multi-Messenger Astrophysics: Harnessing the Data Revolution

From Stars to Patients: Lessons from Space Science and Astrophysics for Health Care Informatics

Astronomia ex machina: a history, primer, and outlook on neural networks in astronomy

Astroinformatics: A 21st Century Approach to Astronomy

Scientific Data Mining in Astronomy

Advances in Machine and Deep Learning for Modeling and Real-time Detection of Multi-Messenger Sources

Application of Big Data and Machine Learning for Astrological Predictions