Abstract:Modern data science research can involve massive computational experimentation; an ambitious PhD in computational fields may do experiments consuming several million CPU hours. Traditional computing practices, in which researchers use laptops or shared campus-resident resources, are inadequate for experiments at the massive scale and varied scope that we now see in data science. On the other hand, modern cloud computing promises seemingly unlimited computational resources that can be custom configured, and seems to offer a powerful new venue for ambitious data-driven science. Exploiting the cloud fully, the amount of work that could be completed in a fixed amount of time can expand by several orders of magnitude. As potentially powerful as cloud-based experimentation may be in the abstract, it has not yet become a standard option for researchers in many academic disciplines. The prospect of actually conducting massive computational experiments in today's cloud systems confronts the potential user with daunting challenges. Leading considerations include: (i) the seeming complexity of today's cloud computing interface, (ii) the difficulty of executing an overwhelmingly large number of jobs, and (iii) the difficulty of monitoring and combining a massive collection of separate results. Starting a massive experiment `bare-handed' seems therefore highly problematic and prone to rapid `researcher burn out'. New software stacks are emerging that render massive cloud experiments relatively painless. Such stacks simplify experimentation by systematizing experiment definition, automating distribution and management of tasks, and allowing easy harvesting of results and documentation. In this article, we discuss several painless computing stacks that abstract away the difficulties of massive experimentation, thereby allowing a proliferation of ambitious experiments for scientific discovery.

Edge, Fog, and Cloud Against Disease: The Potential of High-Performance Cloud Computing for Pharma Drug Discovery

SCAN: A Smart Application Platform for Empowering Parallelizations of Big Genomic Data Analysis in Clouds

High-Performance Cloud Computing: A View of Scientific Applications

Molecular Dynamics Simulations on Cloud Computing and Machine Learning Platforms

Reinventing High Performance Computing: Challenges and Opportunities

Scalable Systems and Software Architectures for High-Performance Computing on cloud platforms

Future of Drug Discovery: The Synergy of Edge Computing, Internet of Medical Things, and Deep Learning

Electronic structure simulations in the cloud computing environment

An Intelligent Health Care System in Fog Platform with Optimized Performance

HPC Cloud for Scientific and Business Applications: Taxonomy, Vision, and Research Challenges

Enabling Workload Engineering in Edge, Fog, and Cloud Computing through OpenStack-based Middleware

Cloud Services Enable Efficient AI-Guided Simulation Workflows across Heterogeneous Resources

Molecular Dynamics and Other HPC Simulations for Drug Discovery

Performance on HPC Platforms Is Possible Without C++

Edge Computing Empowered Smart Healthcare: Monitoring and Diagnosis with Deep Learning Methods

Pandemic Drugs at Pandemic Speed: Infrastructure for Accelerating COVID-19 Drug Discovery with Hybrid Machine Learning- and Physics-based Simulations on High Performance Computers

Infrastructure for Artificial Intelligence, Quantum and High Performance Computing

Perspective of drug design with high-performance computing

Medical Cloud Computing Data Processing to Optimize the Effect of Drugs

Ambitious Data Science Can Be Painless

Convergence of Artificial Intelligence and High Performance Computing on NSF-supported Cyberinfrastructure