Abstract:With the advent of advances in imaging and computing technologies, large-scale data acquisition and processing have become commonplace in many science and engineering disciplines. Conventional workflows for large-scale data processing usually rely on in-house or commercial software that are designed for domain-specific computing tasks. Recent advances in MapReduce, which was originally developed for batch processing textual data via a simplified programming model of the map and reduce functions, have expanded its applications to more general tasks in big-data processing, such as scientific computing, and biomedical image processing. However, as shown in previous work, volume rendering and visualization using MapReduce is still considered challenging and impractical owing to the disk-based, batch-processing nature of its computing model. In this article, contrary to this common belief, we show that the MapReduce computing model can be effectively used for interactive visualization. Our proposed system is a novel extension of Spark, one of the most popular open-source MapReduce frameworks, which offers GPU-accelerated MapReduce computing. To minimize CPU-GPU communication and overcome slow, disk-based shuffle performance, the proposed system supports GPU in-memory caching and MPI-based direct communication between compute nodes. To allow for GPU-accelerated in-situ visualization using raster graphics in Spark, we leveraged the CUDA-OpenGL interoperability, resulting in faster processing speeds by several orders of magnitude compared to conventional MapReduce systems. We demonstrate the performance of our system via several volume processing and visualization tasks, such as direct volume rendering, iso-surface extraction, and numerical simulations with in-situ visualization.

A cloud-enabled remote visualization tool for time-varying climate data analytics

SPATIOTEMPORAL VISUALIZATION OF TIME-SERIES SATELLITE-DERIVED CO2 FLUX DATA USING VOLUME RENDERING AND GPU-BASED INTERPOLATION ON A CLOUD-DRIVEN DIGITAL EARTH

A Web-Based Geovisual Analytical System for Climate Studies

Remote visualization for large terrain surfaces based on parallel streaming pipeline architecture

High-Performance Time-Series Quantitative Retrieval from Satellite Images on a GPU Cluster

Spatial and Temporal Processes Visualization for Marine Environmental Data Using Particle System.

A Rendering Cloud Frame Based on 3D-Graphics-Accelerating Technique for Virtualization

Visualizing 3D/4D environmental data using many-core graphics processing units (GPUs) and multi-core central processing units (CPUs)

Spatio-Temporal Visualization of Air-Sea Co2 Flux and Carbon Budget Using Volume Rendering

Distributed Interactive Visualization Using GPU-Optimized Spark

High-speed Visualization of Time-Varying Data in Large-Scale Structural Dynamic Analyses with a GPU

A high performance web-based system for analyzing and visualizing spatiotemporal data for climate studies

Cloud3dview: An Interactive Tool For Cloud Data Center Operations

Petascale Cloud Supercomputing for Terapixel Visualization of a Digital Twin

Large-Scale Datasets Visualization on Networks Using Dynamic Pipeline Decomposition and Mapping

Cloudet: A Cloud-Driven Visual Cognition of Large Streaming Data.

Interactive visualization technology of multidimensional marine remote sensing data in time series

GPU-accelerated Viewshed Analysis in the Fire Fighting High Altitude Lookout Technology

Simulation of Earth Atmosphere and 3D Volumetric Clouds Based on Graphics Processing Unit

Cloud Rendering Learning Platform Technology Research for Visual Analysis of Large Scale 3D Multimedia Data

Accelerating Geospatial Analysis on GPUs Using CUDA