Abstract:Scientific computing augmentation paving the way for the advent of next‐generation synchrotron imaging research is discussed.To date, computed tomography experiments, carried‐out at synchrotron radiation facilities worldwide, pose a tremendous challenge in terms of the breadth and complexity of the experimental datasets produced. Furthermore, near real‐time three‐dimensional reconstruction capabilities are becoming a crucial requirement in order to perform high‐quality and result‐informed synchrotron imaging experiments, where a large amount of data is collected and processed within a short time window. To address these challenges, we have developed and deployed a synchrotron computed tomography framework designed to automatically process online the experimental data from the synchrotron imaging beamlines, while leveraging the high‐performance computing cluster capabilities to accelerate the real‐time feedback to the users on their experimental results. We have, further, integrated it within a modern unified national authentication and data management framework, which we have developed and deployed, spanning the entire data lifecycle of a large‐scale scientific facility. In this study, the overall architecture, functional modules and workflow design of our synchrotron computed tomography framework are presented in detail. Moreover, the successful integration of the imaging beamlines at the Shanghai Synchrotron Radiation Facility into our scientific computing framework is also detailed, which, ultimately, resulted in accelerating and fully automating their entire data processing pipelines. In fact, when compared with the original three‐dimensional tomography reconstruction approaches, the implementation of our synchrotron computed tomography framework led to an acceleration in the experimental data processing capabilities, while maintaining a high level of integration with all the beamline processing software and systems.

Supporting High-Performance and High-Throughput Computing for Experimental Science

High-Throughput Computing on High-Performance Platforms: A Case Study

Linking Scientific Instruments and HPC: Patterns, Technologies, Experiences

US ATLAS and US CMS HPC and Cloud Blueprint

Managed Network Services for Exascale Data Movement Across Large Global Scientific Collaborations

HEP computing collaborations for the challenges of the next decade

Combining HPC and Big Data Infrastructures in Large-Scale Post-Processing of Simulation Data: A Case Study.

Exploring Cloud Computing for Large-Scale Scientific Applications

Modeling Performance of Data Collection Systems for High-Energy Physics

Convergence of Artificial Intelligence and High Performance Computing on NSF-supported Cyberinfrastructure

Building Science Gateways for Humanities.

Modeling Distributed Computing Infrastructures for HEP Applications

Defining a Cyberinfrastructure for Plasma Science and Space Weather Simulations.

Accelerating imaging research at large‐scale scientific facilities through scientific computing

High-Performance Ptychographic Reconstruction with Federated Facilities

Enabling Data Streaming-based Science Gateways through Federated Cyberinfrastructure

Accelerating Time-to-Science by Streaming Detector Data Directly into Perlmutter Compute Nodes

MeDiCi-Cloud: A Workflow Infrastructure for Large-scale Scientific Applications

A hybrid architecture for astronomical computing

Accelerating scientific discovery through computation and visualization

Future Computing Platforms for Science in a Power Constrained Era