Abstract:The field of Big Data is particularly challenging in practical aspects of data collection, data analysis and data storage and has massive consequential implications for the future. The scope and scale of Big Data frequently necessitate the processing power attributed to High Performance Computing (HPC) and the scalability of Cloud Computing for processing and storage. Source topics for Big Data are continually expanding and include diverse topic areas of finance, medical, particle physics and social interaction and everything in between. Effective Big Data analysis encompasses the need to minimise data sets by identifying, analysing and storing only significant data; recognising and separating the relevant and irrelevant data provide many research opportunities in itself. The outcomes of Big Data analysis may explain past events and trends, suggest controls that are necessary for the present or predict a future world in terms of preparation, planning or positioning. This special issue will further publicise and promote this immensely import field of research with goals of creating a public record of achievements so far and providing inspiration for even greater developments in the coming years. Computational costs associated with Cloud Computing can be significant. In the paper ‘Online optimization scheduling for scientific workflows with deadline constraint on hybrid clouds’ [1], Bing Lin, Wenzhong Guo and Xiuyan Lin examine scheduling strategies and propose ‘hierarchical iterative application partition’ (HIAP) as an algorithm to increase the number of workflows completed within a given timeframe, thereby reducing overall costs. Ensuring the integrity of transmitted data is of paramount importance for data analysis, the paper ‘A MapReduce based Parallel K-Means Clustering for Large Scale CIM Data Verification’ [2] discusses the topic and presents a parallel K-means clustering algorithm for large scale Common Information Model (CIM) data verification. The paper concludes that time saving is achievable using parallel K-means while generating a high level of precision in data verification. ‘Bursty Event Detection from Microblog: A Distributed and Incremental Approach’ [3] is a practical example of the use of Big Data analysis. The researchers propose a method of bursty event detection, BEE+, as a means of tracking ‘topic drift’ from a microblog dataset of over 6 million posts. The amount of data collected and necessary storage rate are frequent considered to be problems for Big Data systems. ‘Performance Evaluation of a Distributed Storage Service in Community Network Clouds’ [4] compares the write and read capability of Tahoe-LAFS storage system is when deployed on community clouds and commercial systems. The paper concludes that write speeds are comparable, while read speeds were better in the commercial system. The information content of Big Data can have a significant commercial value. The cost to analyse data can be very high while the act of data collection can be both expensive and time consuming; loss of data to a competitor or invalidation because of falsification could result in commercial collapse of a business. ‘Secure Cryptographic Functions via Virtualization-based Outsourced Computing’ [5] considers the use of cryptography to protect data and, more fundamentally, suggests a method for the protection of the cryptographic system and process. In ‘Towards an Autonomous Decentralised Orchestration System’ [6], the authors propose distributed execution engines which exploit the benefits of parallel computation in the workflow to improve overall execution time. The paper provides an evaluation of the system and demonstrates the scalability benefit of the decentralised system. The limitations of Cloud related simulation tools are the subject of ‘Multi-layered simulations at the heart of workflow enactment on Clouds’ [7]. The authors suggest that a multistage approach is

Recent Advances in Autonomic Provisioning of Big Data Applications on Clouds

Advances in Methods and Techniques for Processing Streaming Big Data in Datacentre Clouds

Big Data and Smart Computing: Methodology and Practice

Exploring Cloud Computing for Large-Scale Scientific Applications

Managing Big Data in Cloud Computing Environments

Big Data Analytics-Enhanced Cloud Computing: Challenges, Architectural Elements, and Future Directions

Big Data Processing in Cloud Computing Environments

Provisioning big data applications as services on containerised cloud: a microservices-based approach

Big Data Processing: Big Challenges and Opportunities

Big Data Cloud and the Frontier of Computer Science and Technology

High-Performance Cloud Computing: A View of Scientific Applications

Collaboration- and Fairness-Aware Big Data Management in Distributed Clouds.

Big Data computing and clouds: Trends and future directions

Cloud Computing and Big Data: A Review of Current Service Models and Hardware Perspectives

A Survey of Big Data Machine Learning Applications Optimization in Cloud Data Centers and Networks

The anatomy of big data computing

Cloud-assisted Industrial Systems and Applications

Recent Developments in Parallel and Distributed Computing for Remotely Sensed Big Data Processing

Data Processing Model to Perform Big Data Analytics in Hybrid Infrastructures

Scalable Data Partitioning Techniques for Distributed Data Processing in Cloud Environments: A Review

A novel approach for large‐scale environmental data partitioning on cloud and on‐premises storage for compute continuum applications