Abstract:The field of Big Data is particularly challenging in practical aspects of data collection, data analysis and data storage and has massive consequential implications for the future. The scope and scale of Big Data frequently necessitate the processing power attributed to High Performance Computing (HPC) and the scalability of Cloud Computing for processing and storage. Source topics for Big Data are continually expanding and include diverse topic areas of finance, medical, particle physics and social interaction and everything in between. Effective Big Data analysis encompasses the need to minimise data sets by identifying, analysing and storing only significant data; recognising and separating the relevant and irrelevant data provide many research opportunities in itself. The outcomes of Big Data analysis may explain past events and trends, suggest controls that are necessary for the present or predict a future world in terms of preparation, planning or positioning. This special issue will further publicise and promote this immensely import field of research with goals of creating a public record of achievements so far and providing inspiration for even greater developments in the coming years. Computational costs associated with Cloud Computing can be significant. In the paper ‘Online optimization scheduling for scientific workflows with deadline constraint on hybrid clouds’ [1], Bing Lin, Wenzhong Guo and Xiuyan Lin examine scheduling strategies and propose ‘hierarchical iterative application partition’ (HIAP) as an algorithm to increase the number of workflows completed within a given timeframe, thereby reducing overall costs. Ensuring the integrity of transmitted data is of paramount importance for data analysis, the paper ‘A MapReduce based Parallel K-Means Clustering for Large Scale CIM Data Verification’ [2] discusses the topic and presents a parallel K-means clustering algorithm for large scale Common Information Model (CIM) data verification. The paper concludes that time saving is achievable using parallel K-means while generating a high level of precision in data verification. ‘Bursty Event Detection from Microblog: A Distributed and Incremental Approach’ [3] is a practical example of the use of Big Data analysis. The researchers propose a method of bursty event detection, BEE+, as a means of tracking ‘topic drift’ from a microblog dataset of over 6 million posts. The amount of data collected and necessary storage rate are frequent considered to be problems for Big Data systems. ‘Performance Evaluation of a Distributed Storage Service in Community Network Clouds’ [4] compares the write and read capability of Tahoe-LAFS storage system is when deployed on community clouds and commercial systems. The paper concludes that write speeds are comparable, while read speeds were better in the commercial system. The information content of Big Data can have a significant commercial value. The cost to analyse data can be very high while the act of data collection can be both expensive and time consuming; loss of data to a competitor or invalidation because of falsification could result in commercial collapse of a business. ‘Secure Cryptographic Functions via Virtualization-based Outsourced Computing’ [5] considers the use of cryptography to protect data and, more fundamentally, suggests a method for the protection of the cryptographic system and process. In ‘Towards an Autonomous Decentralised Orchestration System’ [6], the authors propose distributed execution engines which exploit the benefits of parallel computation in the workflow to improve overall execution time. The paper provides an evaluation of the system and demonstrates the scalability benefit of the decentralised system. The limitations of Cloud related simulation tools are the subject of ‘Multi-layered simulations at the heart of workflow enactment on Clouds’ [7]. The authors suggest that a multistage approach is

Big Data computing and clouds: Trends and future directions

Big Data Analytics-Enhanced Cloud Computing: Challenges, Architectural Elements, and Future Directions

Big Data Analytics in Medicine and Healthcare

The anatomy of big data computing

Emerging Trends on Big Data & Cloud Computing

Big Data Computing Using Cloud-Based Technologies, Challenges and Future Perspectives

Big data analytics in Cloud computing: an overview

Big Data and cloud computing: innovation opportunities and challenges

Data science and Machine learning in the Clouds: A Perspective for the Future

Big Data Processing in Cloud Computing Environments

Big Data Systems Meet Machine Learning Challenges: Towards Big Data Science as a Service

Cloud Computing and Big Data: A Review of Current Service Models and Hardware Perspectives

Big Data and Smart Computing: Methodology and Practice

A Survey of Big Data Machine Learning Applications Optimization in Cloud Data Centers and Networks

Data Processing Model to Perform Big Data Analytics in Hybrid Infrastructures

Big Data in Cloud Computing Review and Opportunities

Big data and cloud computing: roles and relationships, techniques and tools

HPC Cloud for Scientific and Business Applications: Taxonomy, Vision, and Research Challenges

Video Big Data Analytics in the Cloud: A Reference Architecture, Survey, Opportunities, and Open Research Issues

Big Data Processing: Big Challenges and Opportunities

Orchestrating Big Data Analysis Workflows in the Cloud: Research Challenges, Survey, and Future Directions