Abstract:The field of Big Data is particularly challenging in practical aspects of data collection, data analysis and data storage and has massive consequential implications for the future. The scope and scale of Big Data frequently necessitate the processing power attributed to High Performance Computing (HPC) and the scalability of Cloud Computing for processing and storage. Source topics for Big Data are continually expanding and include diverse topic areas of finance, medical, particle physics and social interaction and everything in between. Effective Big Data analysis encompasses the need to minimise data sets by identifying, analysing and storing only significant data; recognising and separating the relevant and irrelevant data provide many research opportunities in itself. The outcomes of Big Data analysis may explain past events and trends, suggest controls that are necessary for the present or predict a future world in terms of preparation, planning or positioning. This special issue will further publicise and promote this immensely import field of research with goals of creating a public record of achievements so far and providing inspiration for even greater developments in the coming years. Computational costs associated with Cloud Computing can be significant. In the paper ‘Online optimization scheduling for scientific workflows with deadline constraint on hybrid clouds’ [1], Bing Lin, Wenzhong Guo and Xiuyan Lin examine scheduling strategies and propose ‘hierarchical iterative application partition’ (HIAP) as an algorithm to increase the number of workflows completed within a given timeframe, thereby reducing overall costs. Ensuring the integrity of transmitted data is of paramount importance for data analysis, the paper ‘A MapReduce based Parallel K-Means Clustering for Large Scale CIM Data Verification’ [2] discusses the topic and presents a parallel K-means clustering algorithm for large scale Common Information Model (CIM) data verification. The paper concludes that time saving is achievable using parallel K-means while generating a high level of precision in data verification. ‘Bursty Event Detection from Microblog: A Distributed and Incremental Approach’ [3] is a practical example of the use of Big Data analysis. The researchers propose a method of bursty event detection, BEE+, as a means of tracking ‘topic drift’ from a microblog dataset of over 6 million posts. The amount of data collected and necessary storage rate are frequent considered to be problems for Big Data systems. ‘Performance Evaluation of a Distributed Storage Service in Community Network Clouds’ [4] compares the write and read capability of Tahoe-LAFS storage system is when deployed on community clouds and commercial systems. The paper concludes that write speeds are comparable, while read speeds were better in the commercial system. The information content of Big Data can have a significant commercial value. The cost to analyse data can be very high while the act of data collection can be both expensive and time consuming; loss of data to a competitor or invalidation because of falsification could result in commercial collapse of a business. ‘Secure Cryptographic Functions via Virtualization-based Outsourced Computing’ [5] considers the use of cryptography to protect data and, more fundamentally, suggests a method for the protection of the cryptographic system and process. In ‘Towards an Autonomous Decentralised Orchestration System’ [6], the authors propose distributed execution engines which exploit the benefits of parallel computation in the workflow to improve overall execution time. The paper provides an evaluation of the system and demonstrates the scalability benefit of the decentralised system. The limitations of Cloud related simulation tools are the subject of ‘Multi-layered simulations at the heart of workflow enactment on Clouds’ [7]. The authors suggest that a multistage approach is

SCAN: A Smart Application Platform for Empowering Parallelizations of Big Genomic Data Analysis in Clouds

A cost-effective approach to improving performance of big genomic data analyses in clouds

Cloud-based bioinformatics workflow platform for large-scale next-generation sequencing analyses

Cloud Based Short Read Mapping Service

Exploring Cloud Computing for Large-Scale Scientific Applications

CloudGT: A High Performance Genome Analysis Toolkit Leveraging Pipeline Optimization on Spark.

Distributed Gene Clinical Decision Support System Based on Cloud Computing

Recent Developments in Parallel and Distributed Computing for Remotely Sensed Big Data Processing

Science in the Cloud: Allocation and Execution of Data-Intensive Scientific Workflows

Big Data and Smart Computing: Methodology and Practice

Scalability and cost-effectiveness analysis of whole genome-wide association studies on Google Cloud Platform and Amazon Web Services

Creating a Cloud-based Life Science Gateway

Simple Parallel Genetic Algorithm Using Cloud Computing

Heterogeneous Cloud Framework for Big Data Genome Sequencing.

Sae: Toward Efficient Cloud Data Analysis Service for Large-Scale Social Networks

SNC: A Cloud Service Platform for Symbolic-Numeric Computation Using Just-In-Time Compilation

High-Performance Cloud Computing: A View of Scientific Applications

Cloud Computing Service Framework for Bioinformatics Tools

Building biomedical pipelines for large-scale sequencing analysis based on Galaxy and Cloud

CloudProteoAnalyzer: scalable processing of big data from proteomics using cloud computing

Critical assessment of on-premise approaches to scalable genome analysis