Abstract:The ability to use data stored in the current Earth Observing System (EOS) archives for studying regional or global phenomena is highly dependent on having a detailed understanding of the data's internal structure and physical implementation. Gaining this understanding and applying it to data reduction is a time- consuming task that must be undertaken before the core investigation can begin. This is an especially difficult challenge when science objectives require users to deal with large multi-sensor data sets that are usually of different formats, structures, and resolutions, for example, when preparing data for input into modeling systems. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) has taken a major step towards meeting this challenge by developing an infrastructure with a Web interface that allows users to perform interactive analysis online without downloading any data, the GES-DISC Interactive Online Visualization and Analysis Infrastructure or Giovanni. Giovanni provides interactive, online, analysis tools for data users to facilitate their research. There have been several instances of this interface created to serve TRMM users, Aerosol scientists, Ocean Color and Agriculture applications users. The first generation of these tools support gridded data only. The user selects geophysical parameters, area of interest, time period; and the system generates an output on screen in a matter of seconds. The currently available output options are: Area plot averaged or accumulated over any available data period for any rectangular area; Time plot time series averaged over any rectangular area; Time plots image view of any longitude-time and latitude-time cross sections; ASCII output for all plot types; Image animation for area plot. In the future, we will add correlation plots, GIS-compatible outputs, etc. This allow user to focus on data content (i.e. science parameters) and eliminate the need for expensive learning, development and processing tasks that are redundantly incurred by an archive's user community. The current implementation utilizes the GrADS-DODS Server (GDS), a stable, secure data server that provides subsetting and analysis services across the Internet for any GrADS-readable dataset. The subsetting capability allows users to retrieve a specified temporal and/or spatial subdomain from a large dataset, eliminating the need to download everything simply to access a small relevant portion of a dataset. The analysis capability allows users to retrieve the results of an operation applied to one or more datasets on the server. In our case, we use this approach to read pre-processed binary files and/or to read and extract the needed parts from HDF or HDF-EOS files. These subsets then serve as inputs into GrADS processing and analysis scripts. It can be used in a wide variety of Earth science applications: climate and weather events study and monitoring; modeling. It can be easily configured for new applications.

The ESGF Virtual Aggregation (CMIP6 v20240125)

The Earth System Grid: Supporting the Next Generation of Climate Modeling Research

An Assessment of Data Transfer Performance for Large-Scale Climate Data Analysis and Recommendations for the Data Infrastructure for CMIP6

ESSG-Based Global Big Data Spatially Correlate and Its Share Service

Coordinating an operational data distribution network for CMIP6 data

A Tile Service-Driven Architecture for Online Climate Analysis with an Application to Estimation of Ocean Carbon Flux

Earth Virtualization Engines -- A Technical Perspective

The evolution of shared infrastructure for climate analytics

Automated, Reliable, and Efficient Continental-Scale Replication of 7.3 Petabytes of Climate Simulation Data: A Case Study

Earth System Data Cubes: Avenues for advancing Earth system research

Distributed Resources for the Earth System Grid Advanced Management (DREAM)

EASE-DGGS: a hybrid discrete global grid system for Earth sciences

Snowmass Energy Frontier Simulations using the Open Science Grid (A Snowmass 2013 whitepaper)

The EGI Federated Cloud e-Infrastructure

SPATIOTEMPORAL VISUALIZATION OF TIME-SERIES SATELLITE-DERIVED CO2 FLUX DATA USING VOLUME RENDERING AND GPU-BASED INTERPOLATION ON A CLOUD-DRIVEN DIGITAL EARTH

Distributive On-line Processing, Visualization and Analysis System for Gridded Remote Sensing Data

Lifting the Information Barriers to Address Sustainability Challenges with Data from Physical Geography and Earth Observation

Grid-enabled Standard-compliant Open Computing Environment for Earth Science Exploration and Applications

Astronomical data organization, management and access in Scientific Data Lakes

A Large Ensemble Global Dataset for Climate Impact Assessments

SCISPACE: A Scientific Collaboration Workspace for File Systems in Geo-Distributed HPC Data Centers