Abstract:Big data solutions are designed to cope with data of huge Volume and wide Variety, that need to be ingested at high Velocity and have potential Veracity issues, challenging characteristics that are usually referred to as the "4Vs of Big Data". In order to evaluate possibly complex big data solutions, stress tests require to assess a large number of combinations of sub-components jointly with the possible big data variations. A formalization of the Design of Experiments (DoE) on big data solutions is aimed at ensuring the reproducibility of the experiments, facilitating their partitioning in sub-experiments and guaranteeing the consistency of their outcomes in a global assessment. In this paper, an ontology-based approach is proposed to support the evaluation of a big data system in two ways. Firstly, the approach formalizes a decomposition and recombination of the big data solution, allowing for the aggregation of component evaluation results at inter-component level. Secondly, existing work on DoE is translated into an ontology for supporting the selection of experiments. The proposed ontology-based approach offers the possibility to combine knowledge from the evaluation domain and the application domain. It exploits domain and inter-domain specific restrictions on the factor combinations in order to reduce the number of experiments. Contrary to existing approaches, the proposed use of ontologies is not limited to the assertional description and exploitation of past experiments but offers richer terminological descriptions for the development of a DoE from scratch. As an application example, a maritime big data solution to the problem of detecting and predicting vessel suspicious behaviour through mobility analysis is selected. The article is concluded with a sketch of future works.

A discrete dynamics approach to sparse calculation and applied in ontology science

Fast Uncertainty Quantification by Sparse Data Learning from Multiphysics Systems

Ontology Design with a Granular Approach

Approximation Analysis of Ontology Learning Algorithm in Linear Combination Setting

An Overview of Computational Sparse Models and Their Applications in Artificial Intelligence

Pareto-based Optimization of Sparse Dynamical Systems

Ontology Geometry Distance Computation Using Deep Learning Technology.

Ontology-based Design of Experiments on Big Data Solutions

Dynamical Modeling for Non-Gaussian Data with High-Dimensional Sparse Ordinary Differential Equations

Semantic-based Big Data integration framework using scalable distributed ontology matching strategy

Exploiting Term Sparsity in Moment-SOS Hierarchy for Dynamical Systems

Dynamic Multivariate Functional Data Modeling Via Sparse Subspace Learning

Data-Induced Interactions of Sparse Sensors

Data driven approach to sparsification of reaction diffusion complex network systems

Learning Individual Interactions from Population Dynamics with Discrete-Event Simulation Model

Dynamics and Synchrony from Oscillatory Data via Dimension Reduction

Big data dimensional analysis

Unraveling Low-Dimensional Network Dynamics: A Fusion of Sparse Identification and Proper Orthogonal Decomposition

Dimensionality Reduction in Discrete-Time Dynamical Systems

Recovering missing CFD data for high-order discretizations using deep neural networks and dynamics learning