Abstract:As fusion experiment goes to steady state and high-performance data acquisition system been developed, traditional storage solutions cannot cope with the needs of fusion experiment data storage. Distributed file systems such as Lustre are being adopted by more and more facilities. The scaling-out of performance and capacity features addressed the main issue of traditional SAN (Storage Area Network) based storage. However, traditional file system based software solutions are still being used with the distributed file system. They lack modern data manage functions and limiting the performance of parallel storage. J-TEXT Cloud Database (JCDB) is a software stack that uses distributed database to provide fusion experiment data storage and management services. It ships with a storage engine powered by Cassandra database. This storage engine is designed for fusion experiment data and provides great performance. Data is divided into chunks when written and stored in a specially designed distributed database across the cluster. It has a MongoDB powered metadata management system which works seamlessly with the storage engine. JCDB is fully modular, handling different data type and metadata management functions are integrated as plugins. Even the storage engine can be changed. Though J-TEXT not supports long pulse experiments, the design of JCDB is aiming to meet long pulse discharge requirements, bring distributed database technology for future fusion devices such as China fusion engineering test reactor (CFETR). JCDB has the benefit of distributed file systems, provides complex metadata manage functions and comes with great performance.

Design and Implementation of Numerical Simulation Mesh Data Model

Research on General Data Format and I/O Interface for High Power Microwave Numerical Simulations

JADLib-A High Level I/O Library for Scientific Computing Data

Scientific data organization and management in numerical simulations

Mesh Data Management in Large-Scale Scientific Computing

MASSIVE: A Multidisciplinary Applications-Oriented Simulation and Visualization Environment

An Enabling Environment for Distributed Simulation and Visualization

Research and Implementation of Scientific Computing Metadata

Intermediate model based efficient and integrated multidisciplinary simulation data visualization for simulation information reuse

Design and Implementation of Metadata Management System

Development of an Integrative Electromagnetic Simulation Software

SIMDMS: Data Management and Analysis to Support Decision Making Through Large Simulation Ensembles.

Aerospace Numerical Simulation and Digital Prototyping Technologies

Design and Implementation of a XML-based Simulation Software of Flight Control&Guide System

CAD-Centered Integration and Efficient Visualization of Multidisciplinary Simulation Data

An Improved CIP-based Numerical Model for Simulating Free-Surface Flow with Adaptive Mesh

J-TEXT Distributed Data Storage and Management System

A Post-Processing Module Scheme of Finite Element Software.

A Uniform Intermediate Model for High-Fidelity and Efficient Visualisation of Multidisciplinary Heterogeneous Simulation Data.

A data management system for machine learning research of tokamak

Development of the Design and Analysis System for the Solar Array Drive Mechanism