Regularization of Ill-Posed Problems with Unbounded Operators

A.G. Ramm

DOI: https://doi.org/10.48550/arXiv.math-ph/0111014

2001-11-09

Abstract:Variational regularization and the quasisolutions method are justified for unbounded closed, possibly nonlinear, operators. The argument is quite simple and yields general results.

Mathematical Physics,Numerical Analysis

What problem does this paper attempt to address?

Portal Access to Scientific Computation and Customized Collaborative Visualization on Campus Grid

Yingjie Xia,Guanghua Song,Yao Zheng

DOI: https://doi.org/10.1109/apscc.2006.77

2006-01-01

Abstract:In order to integrate the distributed computing resources in Zhejiang University (ZJU), a campus grid is constructed by using the hierarchical combination of middleware, Globus Toolkit and Sun Grid Engine. As one realization of the computational grid, the foundation of the campus grid provides a large amount of scientific computation cycles. Furthermore, our grid system adopts two different approaches, Java 3D and Para View, to manipulate a collaborative visualization of the computed data respectively. Therefore the users can choose the most appropriate method according to their requirements. Three cases are tested on the campus grid via portal access. The results demonstrate that the ZJU Campus Grid provides powerful computation cycles and an efficient collaborative visualization service.
Tools and Techniques for Managing Clusters for SciDAC Lattice QCD at Fermilab

A. Singh,D. Holmgren,R. Rechenmacher,S. Epsteyn

DOI: https://doi.org/10.48550/arXiv.cs/0307021

2003-07-09

Abstract:Fermilab operates several clusters for lattice gauge computing. Minimal manpower is available to manage these clusters. We have written a number of tools and developed techniques to cope with this task. We describe our tools which use the IPMI facilities of our systems for hardware management tasks such as remote power control, remote system resets, and health monitoring. We discuss our techniques involving network booting for installation and upgrades of the operating system on these computers, and for reloading BIOS and other firmware. Finally, we discuss our tools for parallel command processing and their use in monitoring and administrating the PBS batch queue system used on our clusters.

Distributed, Parallel, and Cluster Computing
Lattice QCD Application Development within the US DOE Exascale Computing Project

Richard Brower,Norman Christ,Carleton DeTar,Robert Edwards,Paul Mackenzie

DOI: https://doi.org/10.1051/epjconf/201817509010

2018-01-01

EPJ Web of Conferences

Abstract:In October, 2016, the US Department of Energy launched the Exascale Computing Project, which aims to deploy exascale computing resources for science and engineering in the early 2020’s. The project brings together application teams, software developers, and hardware vendors in order to realize this goal. Lattice QCD is one of the applications. Members of the US lattice gauge theory community with significant collaborators abroad are developing algorithms and software for exascale lattice QCD calculations. We give a short description of the project, our activities, and our plans.
Analysis and MPI Implementation of LQCD Dslash on Sunway TaihuLight*

Miao ZHANG,Yu ZHOU,Jianhai CHEN,Qinming HE,Shun XU,Ming GONG

2019-01-01

Abstract:Sunway TaihuLight is the supercomputer whose cores are more than ten million developed by China in its own independent way. Many large scale applications have been transplanted and optimized on it. However, the lattice quantum chromodynamics (LQCD) application of high energy physics has not been ported and optimized on the Sunway platform, which has attracted the attention of researchers. In this paper, the transplantation and optimization of LQCD on Sunway platform is studied. Firstly, the development at home and abroad of parallel optimization of LQCD in different hardware architectures is discussed. Secondly, through the reconstruction of its hot module—Dslash, it realizes the successful transplantation on Sunway platform. Thirdly, according to the architecture and parallel mode of the heterogeneous many-core SW26010 processor, the heterogeneous parallelism of the computing processing element (CPE) cluster, the direct memory access (DMA) communication between the CPE local device memory (LDM) and the main memory, the message passing interface (MPI) communication between the management processing elements (MPE), and the global reduction are realized. Finally, through the experiment, the optimized program of single core group (CG) version and the optimized program of 16 CGs version achieve 165 and 25 times speedups accordingly compared with single MPE version, and some important performance bottlenecks are found, which lays an important foundation for further optimization to improve the overall performance. At the same time, the work of this paper has positive significance for the popularization of the domestic supercom-puting platform.
Multi-discipline computations and collaborative visualization on the campus grid

Yingjie Xia,Guanghua Song,Yao Zheng

DOI: https://doi.org/10.3321/j.issn:1671-4512.2007.z2.029

2007-01-01

Abstract:A campus grid is developed and deployed to integrate high performance computing resources in Zhejiang University.The architecture is based on a hierarchical combination of two grid middleware products,Globus Toolkit and Sun Grid Engine,in order to make use of their advantages.The campus grid is applied for scientific computation,bioinformatics,computational fluid dynamics,etc.Some test cases using Message Passing Interface(MPI) show that the campus grid can provide powerful and stable computing cycles.The campus grid also provides two collaborative visualization services,the local rendering and the server rendering,which can be customized by the user.Finally,the collaborative visualization service facilitates users to research and analyze cooperatively.
Recent development and perspectives of machines for lattice QCD

Th Lippert

DOI: https://doi.org/10.1016/s0920-5632(03)02510-6

2004-03-01

Abstract:I am going to highlight recent progress in cluster computer technology and to assess status and prospects of cluster computers for lattice QCD with respect to the development of QCDOC and apeNEXT. Taking the LatFor test case, I specify a 512-processor QCD-cluster better than 1$/Mflops.

English Else
A Framework for Lattice QCD Calculations on GPUs

F. T. Winter,M. A. Clark,R. G. Edwards,B. Joó

DOI: https://doi.org/10.1109/IPDPS.2014.112

2014-08-26

Abstract:Computing platforms equipped with accelerators like GPUs have proven to provide great computational power. However, exploiting such platforms for existing scientific applications is not a trivial task. Current GPU programming frameworks such as CUDA C/C++ require low-level programming from the developer in order to achieve high performance code. As a result porting of applications to GPUs is typically limited to time-dominant algorithms and routines, leaving the remainder not accelerated which can open a serious Amdahl's law issue. The lattice QCD application Chroma allows to explore a different porting strategy. The layered structure of the software architecture logically separates the data-parallel from the application layer. The QCD Data-Parallel software layer provides data types and expressions with stencil-like operations suitable for lattice field theory and Chroma implements algorithms in terms of this high-level interface. Thus by porting the low-level layer one can effectively move the whole application in one swing to a different platform. The QDP-JIT/PTX library, the reimplementation of the low-level layer, provides a framework for lattice QCD calculations for the CUDA architecture. The complete software interface is supported and thus applications can be run unaltered on GPU-based parallel computers. This reimplementation was possible due to the availability of a JIT compiler (part of the NVIDIA Linux kernel driver) which translates an assembly-like language (PTX) to GPU code. The expression template technique is used to build PTX code generators and a software cache manages the GPU memory. This reimplementation allows us to deploy an efficient implementation of the full gauge-generation program with dynamical fermions on large-scale GPU-based machines such as Titan and Blue Waters which accelerates the algorithm by more than an order of magnitude.

High Energy Physics - Lattice,Mathematical Software,Computational Physics
SIMULATeQCD: A simple multi-GPU lattice code for QCD calculations

Lukas Mazur,Dennis Bollweg,David A. Clarke,Luis Altenkort,Olaf Kaczmarek,Rasmus Larsen,Hai-Tao Shu,Jishnu Goswami,Philipp Scior,Hauke Sandmeyer,Marius Neumann,Henrik Dick,Sajid Ali,Jangho Kim,Christian Schmidt,Peter Petreczky,Swagato Mukherjee

DOI: https://doi.org/10.1016/j.cpc.2024.109164

2024-04-04

Abstract:The rise of exascale supercomputers has fueled competition among GPU vendors, driving lattice QCD developers to write code that supports multiple APIs. Moreover, new developments in algorithms and physics research require frequent updates to existing software. These challenges have to be balanced against constantly changing personnel. At the same time, there is a wide range of applications for HISQ fermions in QCD studies. This situation encourages the development of software featuring a HISQ action that is flexible, high-performing, open source, easy to use, and easy to adapt. In this technical paper, we explain the design strategy, provide implementation details, list available algorithms and modules, and show key performance indicators for SIMULATeQCD, a simple multi-GPU lattice code for large-scale QCD calculations, mainly developed and used by the HotQCD collaboration. The code is publicly available on GitHub.

High Energy Physics - Lattice
Let's HPC: A web-based interactive platform to aid High Performance Computing education

Akshar Varma,Yashwant Keswani,Yashodhan Bhatnagar,Bhaskar Chaudhury

DOI: https://doi.org/10.48550/arXiv.1701.06356

2017-01-23

Computers and Society

Abstract:Let's HPC (www.letshpc.org) is an open-access online platform to supplement conventional classroom oriented High Performance Computing (HPC) and Parallel & Distributed Computing (PDC) education. The web based platform provides online plotting and analysis tools which allow users to learn, evaluate, teach and see the performance of parallel algorithms from a system's viewpoint. The user can quantitatively compare and understand the importance of numerous deterministic as well as non-deterministic factors of both the software and the hardware that impact the performance of parallel programs. At the heart of this platform is a database archiving the performance and execution environment related data of standard parallel algorithms executed on different computing architectures using different programming environments, this data is contributed by various stakeholders in the HPC community. The plotting and analysis tools of our platform can be combined seamlessly with the database to aid self-learning, teaching, evaluation and discussion of different HPC related topics. Instructors of HPC/PDC related courses can use the platform's tools to illustrate the importance of proper analysis in understanding factors impacting performance, to encourage peer learning among students, as well as to allow students to prepare a standard lab/project report aiding the instructor in uniform evaluation. The platform's modular design enables easy inclusion of performance related data from contributors as well as addition of new features in the future.
HEPCloud, a New Paradigm for HEP Facilities: CMS Amazon Web Services Investigation

Burt Holzman,Lothar A. T. Bauerdick,Brian Bockelman,Dave Dykstra,Ian Fisk,Stuart Fuess,Gabriele Garzoglio,Maria Girone,Oliver Gutsche,Dirk Hufnagel,Hyunwoo Kim,Robert Kennedy,Nicolo Magini,David Mason,Panagiotis Spentzouris,Anthony Tiradani,Steve Timm,Eric W. Vaandering

DOI: https://doi.org/10.1007/s41781-017-0001-9

2017-09-30

Abstract:Historically, high energy physics computing has been performed on large purpose-built computing systems. These began as single-site compute facilities, but have evolved into the distributed computing grids used today. Recently, there has been an exponential increase in the capacity and capability of commercial clouds. Cloud resources are highly virtualized and intended to be able to be flexibly deployed for a variety of computing tasks. There is a growing nterest among the cloud providers to demonstrate the capability to perform large-scale scientific computing. In this paper, we discuss results from the CMS experiment using the Fermilab HEPCloud facility, which utilized both local Fermilab resources and virtual machines in the Amazon Web Services Elastic Compute Cloud. We discuss the planning, technical challenges, and lessons learned involved in performing physics workflows on a large-scale set of virtualized resources. In addition, we will discuss the economics and operational efficiencies when executing workflows both in the cloud and on dedicated resources.

Distributed, Parallel, and Cluster Computing,Computational Physics
A Web-Based Development Environment for Collaborative Data Analysis

M Erdmann,R Fischer,C Glaser,D Klingebiel,M Komm,G Müller,M Rieger,J Steggemann,M Urban,T Winchen

DOI: https://doi.org/10.1088/1742-6596/523/1/012021

2014-06-06

Journal of Physics: Conference Series

Abstract:Visual Physics Analysis (VISPA) is a web-based development environment addressing high energy and astroparticle physics. It covers the entire analysis spectrum from the design and validation phase to the execution of analyses and the visualization of results. VISPA provides a graphical steering of the analysis flow, which consists of self-written, re-usable Python and C++ modules for more demanding tasks. All common operating systems are supported since a standard internet browser is the only software requirement for users. Even access via mobile and touch-compatible devices is possible. In this contribution, we present the most recent developments of our web application concerning technical, state-of-the-art approaches as well as practical experiences. One of the key features is the use of workspaces, i.e. user-configurable connections to remote machines supplying resources and local file access. Thereby, workspaces enable the management of data, computing resources (e.g. remote clusters or computing grids), and additional software either centralized or individually. We further report on the results of an application with more than 100 third-year students using VISPA for their regular particle physics exercises during the winter term 2012/13. Besides the ambition to support and simplify the development cycle of physics analyses, new use cases such as fast, location-independent status queries, the validation of results, and the ability to share analyses within worldwide collaborations with a single click become conceivable.
Design and Implementation of Distributed Data Acquisition Architecture in High Energy Physics

Jin LI,Minhao GU,Fei LI,Kejun ZHU

DOI: https://doi.org/10.3778/j.issn.1002-8331.1806-0032

2019-01-01

Abstract:The amount of experimental data generated in the large-scaled contemporary high energy physics experiments have increased dramatically, that places more stringent, complex and high-performance requirements on the data acquisition online processing software system. With the high-speed Internet and powerful process units, the data collection and processing capabilities of distributed online processing software have been significantly improved, making data acquisition targets of particle physics experiments have been achieved more efficiently. The framework of distributed online processing takes the charge of the control and management of multiple processes that running on the cluster, hardware and software configuration, status monitoring, information sharing and interaction in functional. Compared to distributed coordination services based on message delivery, the shared memory technology such as Redis simplifies the coordination among multiple processes in the system, achieves the final balance of lightweight CAP, and stores data acquisition information as a central database, which is a convenient, lightweight and practical solution for realizing the online processing framework. In some medium-scale high energy physics experimental computing cluster, it is reliable and stable for development, implementa-tion, and deployment.
A graphical user interface software for lattice QCD based on Python acceleration technology

Lin Gao

2024-10-30

Abstract:A graphical user interface (GUI) software is provided for lattice QCD simulations, aimed at streamlining the process. The current version of the software employs the Metropolis algorithm with the Wilson gauge action. It is implemented in Python, utilizing Just-In-Time (JIT) compilation to enhance computational speed while preserving Python's simplicity and extensibility. Additionally, the program supports parallel computations to evaluate physical quantities at different inverse coupling $\beta$ values, allowing users to specify the number of CPU cores. The software also enables the use of various initial conditions, as well as the specification of the save directory, file names, and background settings. Through this software, users can observe the configurations and behaviors of the plaquette under different $\beta$ values.

High Energy Physics - Lattice
Performance of lattice QCD programs on CP-PACS

S. Aoki,R. Burkhalter,K. Kanaya,T. Yoshié,T. Boku,H. Nakamura,Y. Yamashita

DOI: https://doi.org/10.48550/arXiv.hep-lat/9903001

1999-05-21

Abstract:The CP-PACS is a massively parallel MIMD computer with the theoretical peak speed of 614 GFLOPS which has been developed for computational physics applications at the University of Tsukuba, Japan. We report on the performance of the CP-PACS computer measured during recent production runs using our Quantum Chromodynamics code for the simulation of quarks and gluons in particle physics. With the full 2048 processing nodes, our code shows a sustained speed of 237.5 GFLOPS for the heat-bath update of gluon variables, 264.6 GFLOPS for the over-relaxation update, and 325.3 GFLOPS for quark matrix inversion with an even-odd preconditioned minimal residual algorithm.

High Energy Physics - Lattice
Optimization of Lattice Boltzmann Simulations on Heterogeneous Computers

E. Calore,A. Gabbana,S. F. Schifano,R. Tripiccione

DOI: https://doi.org/10.1177/1094342017703771

2017-03-15

Abstract:High-performance computing systems are more and more often based on accelerators. Computing applications targeting those systems often follow a host-driven approach in which hosts offload almost all compute-intensive sections of the code onto accelerators; this approach only marginally exploits the computational resources available on the host CPUs, limiting performance and energy efficiency. The obvious step forward is to run compute-intensive kernels in a concurrent and balanced way on both hosts and accelerators. In this paper we consider exactly this problem for a class of applications based on Lattice Boltzmann Methods, widely used in computational fluid-dynamics. Our goal is to develop just one program, portable and able to run efficiently on several different combinations of hosts and accelerators. To reach this goal, we define common data layouts enabling the code to exploit efficiently the different parallel and vector options of the various accelerators, and matching the possibly different requirements of the compute-bound and memory-bound kernels of the application. We also define models and metrics that predict the best partitioning of workloads among host and accelerator, and the optimally achievable overall performance level. We test the performance of our codes and their scaling properties using as testbeds HPC clusters incorporating different accelerators: Intel Xeon-Phi many-core processors, NVIDIA GPUs and AMD GPUs.

Distributed, Parallel, and Cluster Computing
Parallel Supercomputing PC Cluster and Some Physical Results in Lattice QCD

Luo Xiang-Qian,Mei Zhong-Hao,Eric B. Gregory,Yang Jie-Chao,Wang Yu-Li,Lin Yin

DOI: https://doi.org/10.1088/0253-6102/40/3/319

2003-09-15

Communications in Theoretical Physics

Abstract:We describe the construction of a high performance parallel computer composed of PC components, present some physical results for light hadron and hybrid meson masses from lattice QCD. We also show that the smearing technique is very useful for improving the spectrum calculations.

physics, multidisciplinary
Portable Programming Model Exploration for LArTPC Simulation in a Heterogeneous Computing Environment: OpenMP vs. SYCL

Meifeng Lin,Zhihua Dong,Tianle Wang,Mohammad Atif,Meghna Battacharya,Kyle Knoepfel,Charles Leggett,Brett Viren,Haiwang Yu

2023-04-04

Abstract:The evolution of the computing landscape has resulted in the proliferation of diverse hardware architectures, with different flavors of GPUs and other compute accelerators becoming more widely available. To facilitate the efficient use of these architectures in a heterogeneous computing environment, several programming models are available to enable portability and performance across different computing systems, such as Kokkos, SYCL, OpenMP and others. As part of the High Energy Physics Center for Computational Excellence (HEP-CCE) project, we investigate if and how these different programming models may be suitable for experimental HEP workflows through a few representative use cases. One of such use cases is the Liquid Argon Time Projection Chamber (LArTPC) simulation which is essential for LArTPC detector design, validation and data analysis. Following up on our previous investigations of using Kokkos to port LArTPC simulation in the Wire-Cell Toolkit (WCT) to GPUs, we have explored OpenMP and SYCL as potential portable programming models for WCT, with the goal to make diverse computing resources accessible to the LArTPC simulations. In this work, we describe how we utilize relevant features of OpenMP and SYCL for the LArTPC simulation module in WCT. We also show performance benchmark results on multi-core CPUs, NVIDIA and AMD GPUs for both the OpenMP and the SYCL implementations. Comparisons with different compilers will also be given where appropriate.

High Energy Physics - Experiment,Distributed, Parallel, and Cluster Computing,Computational Physics
Parallelizing the QUDA Library for Multi-GPU Calculations in Lattice Quantum Chromodynamics

Ronald Babich,Michael A. Clark,Bálint Joó

DOI: https://doi.org/10.1109/SC.2010.40

2010-10-30

Abstract:Graphics Processing Units (GPUs) are having a transformational effect on numerical lattice quantum chromodynamics (LQCD) calculations of importance in nuclear and particle physics. The QUDA library provides a package of mixed precision sparse matrix linear solvers for LQCD applications, supporting single GPUs based on NVIDIA's Compute Unified Device Architecture (CUDA). This library, interfaced to the QDP++/Chroma framework for LQCD calculations, is currently in production use on the "9g" cluster at the Jefferson Laboratory, enabling unprecedented price/performance for a range of problems in LQCD. Nevertheless, memory constraints on current GPU devices limit the problem sizes that can be tackled. In this contribution we describe the parallelization of the QUDA library onto multiple GPUs using MPI, including strategies for the overlapping of communication and computation. We report on both weak and strong scaling for up to 32 GPUs interconnected by InfiniBand, on which we sustain in excess of 4 Tflops.

High Energy Physics - Lattice,Computational Physics
Simulation of the Lattice QCD and Technological Trends in Computation

K. Ibrahim,J. Jaeger,Z. Liu,L.N. Pouchet,P. Lesnicki,L. Djoudi,D.Barthou,F. Bodin,C. Eisenbeis,G. Grosdidier,O. Pene,P. Roudeau

DOI: https://doi.org/10.48550/arXiv.0808.0391

2008-08-13

Abstract:Simulation of Lattice QCD is a challenging computational problem. Currently, technological trends in computation show multiple divergent models of computation. We are witnessing homogeneous multi-core architectures, the use of accelerator on-chip or off-chip, in addition to the traditional architectural models. On the verge of this technological abundance, assessing the performance trade-offs of computing nodes based on these technologies is of crucial importance to many scientific computing applications. In this study, we focus on assessing the efficiency and the performance expected for the Lattice QCD problem on representative architectures and we project the expected improvement on these architectures and their impact on performance for Lattice QCD. We additionally try to pinpoint the limiting factors for performance on these architectures.

High Energy Physics - Lattice
Modeling Distributed Computing Infrastructures for HEP Applications

Maximilian Horzela,Henri Casanova,Manuel Giffels,Artur Gottmann,Robin Hofsaess,Günter Quast,Simone Rossi Tisbeni,Achim Streit,Frédéric Suter

DOI: https://doi.org/10.1051/epjconf/202429504032

2024-05-13

Abstract:Predicting the performance of various infrastructure design options in complex federated infrastructures with computing sites distributed over a wide area network that support a plethora of users and workflows, such as the Worldwide LHC Computing Grid (WLCG), is not trivial. Due to the complexity and size of these infrastructures, it is not feasible to deploy experimental test-beds at large scales merely for the purpose of comparing and evaluating alternate designs. An alternative is to study the behaviours of these systems using simulation. This approach has been used successfully in the past to identify efficient and practical infrastructure designs for High Energy Physics (HEP). A prominent example is the Monarc simulation framework, which was used to study the initial structure of the WLCG. New simulation capabilities are needed to simulate large-scale heterogeneous computing systems with complex networks, data access and caching patterns. A modern tool to simulate HEP workloads that execute on distributed computing infrastructures based on the SimGrid and WRENCH simulation frameworks is outlined. Studies of its accuracy and scalability are presented using HEP as a case-study. Hypothetical adjustments to prevailing computing architectures in HEP are studied providing insights into the dynamics of a part of the WLCG and candidates for improvements.

Distributed, Parallel, and Cluster Computing,High Energy Physics - Experiment

Regularization of Ill-Posed Problems with Unbounded Operators

Portal Access to Scientific Computation and Customized Collaborative Visualization on Campus Grid

Tools and Techniques for Managing Clusters for SciDAC Lattice QCD at Fermilab

Lattice QCD Application Development within the US DOE Exascale Computing Project

Analysis and MPI Implementation of LQCD Dslash on Sunway TaihuLight*

Multi-discipline computations and collaborative visualization on the campus grid

Recent development and perspectives of machines for lattice QCD

A Framework for Lattice QCD Calculations on GPUs

SIMULATeQCD: A simple multi-GPU lattice code for QCD calculations

Let's HPC: A web-based interactive platform to aid High Performance Computing education

HEPCloud, a New Paradigm for HEP Facilities: CMS Amazon Web Services Investigation

A Web-Based Development Environment for Collaborative Data Analysis

Design and Implementation of Distributed Data Acquisition Architecture in High Energy Physics

A graphical user interface software for lattice QCD based on Python acceleration technology

Performance of lattice QCD programs on CP-PACS

Optimization of Lattice Boltzmann Simulations on Heterogeneous Computers

Parallel Supercomputing PC Cluster and Some Physical Results in Lattice QCD

Portable Programming Model Exploration for LArTPC Simulation in a Heterogeneous Computing Environment: OpenMP vs. SYCL

Parallelizing the QUDA Library for Multi-GPU Calculations in Lattice Quantum Chromodynamics

Simulation of the Lattice QCD and Technological Trends in Computation

Modeling Distributed Computing Infrastructures for HEP Applications