Abstract:Scientists generate petabytes of data daily to help uncover environmental trends or behaviors that are hard to predict. For example, understanding climate simulations based on the long-term average of temperature, precipitation, and other environmental variables is essential to predicting and establishing root causes of future undesirable scenarios and assessing possible mitigation strategies. While supercomputer centers provide a powerful infrastructure for generating petabytes of simulation output, accessing and analyzing these datasets interactively remains challenging on multiple fronts. This paper presents an approach to managing, visualizing, and analyzing petabytes of data within a browser on equipment ranging from the top NASA supercomputer to commodity hardware like a laptop. Our novel data fabric abstraction layer allows user-friendly querying of scientific information while hiding the complexities of dealing with file systems or cloud services. We also optimize network utilization while streaming from petascale repositories through state-of-the-art progressive compression algorithms. Based on this abstraction, we provide customizable dashboards that can be accessed from any device with any internet connection, enabling interactive visual analysis of vast amounts of data to a wide range of users - from top scientists with access to leadership-class computing environments to undergraduate students of disadvantaged backgrounds from minority-serving institutions. We focus on NASA's use of petascale climate datasets as an example of particular societal impact and, therefore, a case where achieving equity in science participation is critical. We further validate our approach by deploying the dashboards and simplified training materials in the classroom at a minority-serving institution.

From Big Data to Big Displays: High-Performance Visualization at Blue Brain

Hybrid-Dimensional Visualization and Interaction - Integrating 2D and 3D Visualization with Semi-Immersive Navigation Techniques

VisAnywhere: Developing Multi-platform Scientific Visualization Applications

Visualization of Large Non-Trivially Partitioned Unstructured Data with Native Distribution on High-Performance Computing Systems

Parallel Visualization for Large-Scale Datasets

Immersive and Collaborative Data Visualization Using Virtual Reality Platforms

State of In Situ Visualization in Simulations: We are fast. But are we inspiring?

Introducing HiBoP: a Unity-based visualization software for large iEEG datasets

Parallel Rendering and Large Data Visualization

Visualization Multi-Pipeline for Communicating Biology

Distributed Interactive Visualization Using GPU-Optimized Spark

A Real-Time Magnetoencephalography Brain-Computer Interface Using Interactive 3D Visualization and the Hadoop Ecosystem

Dynamic Sharing of Large-Scale Visualization

A Visualization Cluster Platform For Bridge Health Monitoring

A real-time display methods for large-scale human body data

The Hiperwall Visualization Platform for Big Data Research

A Scalable Cyberinfrastructure for Interactive Visualization of Terascale Microscopy Data

Scientific 3D visualization of high performance computing in internet environment

Web-based Visualization and Analytics of Petascale data: Equity as a Tide that Lifts All Boats

How Big Data and High-performance Computing Drive Brain Science

Real-time Interactive Heart Illustration Platform Via Hardware Accelerated Rendering