Abstract:High performance computing (HPC) and cloud have traditionally been separate, and presented in an adversarial light. The conflict arises from disparate beginnings that led to two drastically different cultures, incentive structures, and communities that are now in direct competition with one another for resources, talent, and speed of innovation. With the emergence of converged computing, a new paradigm of computing has entered the space that advocates for bringing together the best of both worlds from a technological and cultural standpoint. This movement has emerged due to economic and practical needs. Emerging heterogeneous, complex scientific workloads that require an orchestration of services, simulation, and reaction to state can no longer be served by traditional HPC paradigms. However, while cloud offers automation, portability, and orchestration, as it stands now it cannot deliver the network performance, fine-grained resource mapping, or scalability that these same simulations require. These novel requirements call for change not just in workflow software or design, but also in the underlying infrastructure to support them. This is one of the goals of converged computing. While the future of traditional HPC and commercial cloud cannot be entirely known, a reasonable approach to take is one that focuses on new models of convergence, and a collaborative mindset. In this paper, we introduce a new paradigm for compute -- a traditional HPC workload manager, Flux Framework, running seamlessly with a user-space Kubernetes "Usernetes" to bring a service-oriented, modular, and portable architecture directly to on-premises HPC clusters. We present experiments that assess HPC application performance and networking between the environments, and provide a reproducible setup for the larger community to do exactly that.

The data center of tomorrow is made up of heterogeneous accelerators

Engaging Heterogeneous FPGAs in the Cloud.

High-performance computing: Transitioning from Instruction-Level Parallelism to heterogeneous hybrid architectures

HPC Alongside User-space Kubernetes

Predicting Heterogeneity and Serverless Principles of Converged High-Performance Computing, Artificial Intelligence, and Workflows

Exploiting Heterogeneity For Energy Efficiency In Chip Multiprocessors

Affinity and Conflict-Aware Placement of Virtual Machines in Heterogeneous Data Centers.

Understanding Data Movement in Tightly Coupled Heterogeneous Systems: A Case Study with the Grace Hopper Superchip

Heterogeneous architectures for computational intensive applications: A cost-effectiveness analysis

DDC: A Vision for a Disaggregated Datacenter

Orchestrating Complex Application Architectures in Heterogeneous Clouds

Research Challenges for Heterogeneous CPS Design

Challenges Towards Deploying Data Intensive Scientific Applications on Extreme Heterogeneity Supercomputers

Accelerator-as-a-Service in Public Clouds: An Intra-Host Traffic Management View for Performance Isolation in the Wild

At the Edge of a Seamless Cloud Experience

Accelerator Virtualization in Fog Computing: Moving From the Cloud to the Edge

Infrastructure for Artificial Intelligence, Quantum and High Performance Computing

Fork is All You Need in Heterogeneous Systems

Hyper Converged Infrastructures: Beyond virtualization

Building Mega Data Center from Heterogeneous Containers

Shall I Use Heterogeneous Data Centers? - A Case Study On Video On Demand Systems