Abstract:Big data cognition has become a dominant problem in interactive visual analytics for event detection and response, metereology, cosmology, and large smart city applications including traffic monitoring and management, search and rescue operations, crowd management and logistics. The main problems are mainly due to big data volume and velocity and, in some cases, variety in both dimension and type. A practical approach to understanding and viewing big data features is through streaming operations. Streaming allows for both volume and velocity characteristics of big data, and often, for variety as well. However, performing analytics at interactive rates is currently an open challenge in most big data applications. Cloud computing platforms provide practical support and leverage to solving some of the big data and visual analytics problems, especially when dealing with the volume and velocity characteristics of current data generation. In order to interact with streaming data patterns in an elastic cloud environment, we present a new elastic framework for big data visual analytics in the cloud, the Cloudet. The Cloudet is a self-adaptive cloud-based platform that treats both data and compute nodes as elastic objects. The main objective is to readily achieve the scalability and elasticity of cloud computing platforms in order to process large streaming data and adapt to potential interactions between data stream features. Our main contributions include a robust cloud-based framework, the Cloudet, which can flexibly process the streaming data and applications to illustrate the setup and operations of this framework. The framework includes a cloud profile manager that attempts to optimize the cloudet parameters in order to achieve expressivity, scalability, reliability, and the proper aggregation of the data streams into several density maps for the purpose of dynamic visualization of data features.

Elastic Data Analytics for the Cloud-to-Things Continuum

A cost-effective approach to improving performance of big genomic data analyses in clouds

Big Data Analytics-Enhanced Cloud Computing: Challenges, Architectural Elements, and Future Directions

Elastic stream processing in the Cloud

Cloudets: Cloud-based Cognition for Large Streaming Data

Edge-Cloud Solutions for Big Data Analysis and Distributed Machine Learning - 1

Controlling Data Gravity and Data Friction: from Metrics to Multidimensional Elasticity Strategies.

Cloudet: A Cloud-Driven Visual Cognition of Large Streaming Data.

Big Data Systems Meet Machine Learning Challenges: Towards Big Data Science as a Service

Big Data computing and clouds: Trends and future directions

Principles of Software-Defined Elastic Systems for Big Data Analytics

Elastic Stream Processing for Distributed Environments.

Continuous Elasticity: Design and Operation of Elastic Systems

Elastic Stream Processing for the Internet of Things

Analytics-as-a-Service in a Multi-Cloud Environment through Semantically enabled Hierarchical Data Processing

Big data analytics in Cloud computing: an overview

Towards a computing continuum: Enabling edge-to-cloud integration for data-driven workflows

A novel approach for large‐scale environmental data partitioning on cloud and on‐premises storage for compute continuum applications

Cloud services, storage and communications at large scale for reliable enterprise systems

On Analyzing Elasticity Relationships of Cloud Services

On Developing And Operating Of Data Elasticity Management Process