Introduction to transverse lattice gauge theory

S. Dalley

DOI: https://doi.org/10.1063/1.1301660

1999-12-07

Abstract:I review a new treatment of an old idea for light-front quantization of lattice gauge theories and give new results from some illustrative calculations: [I] transverse lattice gauge theory; [II] pure glue; [III] heavy sources and winding modes; [IV] an example -- large-N QCD in 2+1 dimensions.

High Energy Physics - Lattice

What problem does this paper attempt to address?

A Scalable Semantic Grid Framework -- VDHA_Grid.

H Lican,Z Yin,XZ Ye

DOI: https://doi.org/10.1109/icsmc.2004.1401168

2004-01-01

Abstract:This paper presents a scalable semantic Grid framework based on Vimal and Dynamic Hierarchical Architecture (VDHA) VDHA-Grid. This framework includes a scalable Grid information service, in which the information such as services and resources are published and registered into its owner node by the node itself: Service discovery is scalable. autonomous, efJicient, and reliable. VDHA-Grid also includes a Scalable Grid Security Iilfrastructure, which solves the problem of mapping global entity iianie into local entity name and rnanaging large number af users and resources.
An Adaptive Model For Building Service-Partition System

jian wang,jianling sun,xinyu wang,hang chen,juefeng li,k sanjeev

DOI: https://doi.org/10.1109/INDIN.2008.4618304

2008-01-01

Abstract:Many software clustering approaches have been proposed for developing enterprise systems in the distributed environment to gain improved performance, good scalability and high availability. The mostly adopted approaches - symmetrical and unsymmetrical clustering, have some negative impact on system performance. Service-partition is a new clustering approach which solves these disadvantages. It divides the core business service into partitions based on data and distributes them on each node hence it enables the "aggressive cache" and reduces the remote invocations and database contention.This paper presents a practical model named Adaptive Partition Model (APM) for building enterprise systems using the service-partition approach. APM consists of the business level and the meta-level which provides an adaptive characteristic that can balance the workload dynamically. A case study is also reported in reengineering a standalone financial trading system using APM. The test results show the reengineered trading system has improved performance, scalability and workload distribution than before.
Scalable Fine-Grained Reconfigurable Replica Coordination

Arun Venkataramni,Zhaoyu Gao,Tianbo Gu,Karthik Anantharamu

2018-01-01

Abstract:Many large distributed systems today use sophisticated combinations of replication and partitioning of data and compute, but traditional distributed system designs steer developers towards a monolithic design, wherein the distributed principal–a slice of the state or the state machine–is heavyweight and replication and partitioning decisions are infrequently reconfigured if at all. We present GigaPaxos, a novel system for scalable, fine-grained, reconfigurable replica coordination. A key capability in GigaPaxos is maximal object-group configurability, i.e., the ability to easily manage and quickly reconfigure a very large number of replica groups, one for each lightweight fault-tolerant principal as small as a single record in a key-value store or an ephemeral service replica created on the fly for each user. GigaPaxos achieves this goal by driving down the marginal memory overhead of a replicated state machine to a few hundred bytes while keeping the messaging overhead, throughput, and latency of each group independent of the total number of groups and comparable to or vastly better than state-of-the-art consensus systems. We study the benefits of object-group configurability using several case studies including myCloud, a hypothetical application that creates a custom, reconfigurable replica group for each user’s personal cloud data, and show that agile reconfigurability can significantly enhance user-perceived performance.
MultiScaler: A Multi-Loop Auto-Scaling Approach for Cloud-Based Applications

Auday Al-Dulaimy,Javid Taheri,Andreas Kassler,M. Reza HoseinyFarahabady,Shuiguang Deng,Albert Zomaya

DOI: https://doi.org/10.1109/tcc.2020.3031676

IF: 5.697

2020-01-01

IEEE Transactions on Cloud Computing

Abstract:Cloud computing offers a wide range of services through a pool of heterogeneous Physical Machines (PMs) hosted on cloud data centers, where each PM can host several Virtual Machines (VMs). Resource sharing among VMs comes with major benefits, but it can create technical challenges that have a detrimental effect on the performance. To ensure a specific service level requested by the cloud-based applications, there is a need for an approach to assign adequate resources to each VM. To this end, we present our novel Multi-Loop Control approach, called MultiScaler, to allocate resources to VMs based on the Service Level Agreement (SLA) requirements and the run-time conditions. MultiScaler is mainly composed of three different levels working closely with each other to achieve an optimal resource allocation. We propose a set of tailor-made controllers to monitor VMs and take actions accordingly to regulate contention among collocated VMs, to reallocate resources if required, and to migrate VMs from one PM to another. The evaluation in a VMware cluster have shown that the MultiScaler approach can meet applications performance goals and guarantee the SLA by assigning the exact resources that the applications require. Compared with sophisticated baselines, MultiScaler produces significantly better reaction to changes in workloads even under the presence of noisy neighbors.
Characterizing the Scalability of Decision-Support Workloads on Clusters and SMP Systems.

Yanyong Zhang,Anand Sivasubramaniam,Jianyong Zhang,Shailabh Nagar,Hubertus Franke

DOI: https://doi.org/10.1007/3-540-45706-2_47

2002-01-01

Abstract:Using a public domain version of a commercial clustered database server and TPC-H like decision support queries, this paper studies the performance and scalability issues of a Pentium/Linux cluster and an 8-way Linux SMP. The execution profile demonstrates the dominance of the I/O subsystem in the execution, and the importance of the communication subsystem for cluster scalability. In addition to quantifying their importance, this paper provides further details on how these subsystems are exercised by the database engine.
Scalable RDF store based on HBase and MapReduce

Jianling Sun,Qiang Jin

DOI: https://doi.org/10.1109/ICACTE.2010.5578937

2010-01-01

Abstract:The growing size of Resource Description Framework (RDF) dataset requires RDF repository to be excellent scalable and highly efficient. Distributed and parallel processing model meets the urgent needs naturally. In this paper, we propose a scalable RDF store based on HBase, which is a distributed, column-oriented database modeled after Google's Bigtable. Our approach adopts the idea of Hexastore and considers both RDF data model and HBase capability. We store RDF triples into six HBase tables (S_PO, P_SO, O_SP, PS_O, SO_P and PO_S) which covers all combinations of RDF triple patterns. And we index them with HBase provided index structure on row key. Besides presenting the storage schema, we also propose a MapReduce strategy for SPARQL Basic Graph Pattern (BGP) processing, which is suitable for our storage schema. It uses multiple MapReduce jobs to process a typical BGP. In each job, it uses a greedy method to select join key and eliminates multiple triple patterns. The evaluation result indicates that our approach works well against large RDF dataset.
Scalability in modeling and simulation systems for multi-agent, AI, and machine learning applications

Charles Newton,John Singleton,Cameron Copland,Sarah Kitchen,Jeffrey Hudack

DOI: https://doi.org/10.1117/12.2585723

2021-04-12

Abstract:Today’s battlefield increasingly incorporates emerging technologies using artificial intelligence. These systems not only provide unparalleled speed and accuracy, but also allow for digital models to be developed and tested in simulation prior to deployment, reducing the time and cost of acquisition. This holds additional promise for wargaming modeling and simulation for understanding the impact of complex, multi-domain operations on future force efficacy and structure. However, current modeling and simulation environments are not designed for simulating decentralized, intelligent systems at scale. Cloud computing has revolutionized how we scale computational capability, but was not designed for complex, low latency interactions between independently reasoning entities. This motivates new methods for characterizing and mitigating complexity to meet operational and mission requirements. We outline the challenges and opportunities for modeling and simulating large-scale multi-agent systems and identify future research areas that should address these challenges. We recommend that investment be placed in holistically understanding scalability from a cost-benefit perspective, measuring the impact on requirements, developing improved tools for understanding the dimensions of scalability, and formalizing specifications of the scalability requirements met (or not met) by available systems. We propose that a framework for reasoning over and adjusting the fidelity of various models within a system of systems is needed to meet development and testing requirements. Formal methods can be used to understand the limits on scalability as a function of objectives (e.g. speed, convergence, performance) and constraints (e.g. cost, compute, and time), optimizing resources to develop and test interacting artificial intelligence systems at scale.
A scalable distributed information management system

Praveen Yalagandula,Mike Dahlin

DOI: https://doi.org/10.1145/1030194.1015509

IF: 1.937

2004-08-30

ACM SIGCOMM Computer Communication Review

Abstract:We present a Scalable Distributed Information Management System (SDIMS) that aggregates information about large-scale networked systems and that can serve as a basic building block for a broad range of large-scale distributed applications by providing detailed views of nearby information and summary views of global information. To serve as a basic building block, a SDIMS should have four properties: scalability to many nodes and attributes, flexibility to accommodate a broad range of applications, administrative isolation for security and availability, and robustness to node and network failures. We design, implement and evaluate a SDIMS that (1) leverages Distributed Hash Tables (DHT) to create scalable aggregation trees, (2) provides flexibility through a simple API that lets applications control propagation of reads and writes, (3) provides administrative isolation through simple extensions to current DHT algorithms, and (4) achieves robustness to node and network reconfigurations through lazy reaggregation, on-demand reaggregation, and tunable spatial replication. Through extensive simulations and micro-benchmark experiments, we observe that our system is an order of magnitude more scalable than existing approaches, achieves isolation properties at the cost of modestly increased read latency in comparison to flat DHTs, and gracefully handles failures.

computer science, information systems
Rack-Scaling: An efficient rack-based redistribution method to accelerate the scaling of cloud disk arrays

Zhehan Lin,Hanchen Guo,Chentao Wu,Jie Li,Guangtao Xue,Minyi Guo

DOI: https://doi.org/10.1109/IPDPS49936.2021.00098

2021-01-01

Abstract:In cloud storage systems, disk arrays are widely used because of their high reliability and low monetary cost. Due to the burst of I/O in sprinting computing scenarios (i.e. online retailer services on Black Friday or Cyber Monday), large scale cloud storage systems such as AWS S3 and GFS need to afford 10X I/O workloads. Therefore, rack level scaling for cloud disk arrays becomes urgent for sprinting services. Although several existing methods, such as Round-Robin(RR) and Scale-RS, are proposed to accelerate the scaling processes, the efficiencies of these approaches are limited. It is because that the crass-rack data migrations are ill-considered in their designs. To address the above problem, in this paper, we propose Rack-Scaling, a novel data redistribution method to accelerate rack level scaling process in cloud storage systems. The basic idea of Rack-Scaling is migrating appropriate data blocks within and among racks to achieve a uniform data distribution while minimizing the cross-rack migration. which costs more than intra-rack migration. We conduct simulations via Disksim and we also implement Rack-Scaling on Hadoop to demonstrate the effectiveness of Rack-Scaling. The results show that, compared to typical methods such as Round-Robin (RR), Semi-RR, Scale-KS and BDR, Rack-Scaling reduces the number of I/O operations and the data amount of cross-rack transmission by up to 90.4% and 99.9%, respectively, and speeds up the scaling by up to 8.77X.
Affordable Scalability Using Multi-Cubes

Håkon Bugge,Knut Omang

DOI: https://doi.org/10.1007/10704208_11

1999-01-01

Abstract:This chapter presents an analysis of the scalability of Scali systems. A Scali high-performance server consists of compute nodes, interconnected by a high-speed, low-latency SCI interconnect. The topology addressed in this paper will be direct networks based on r-ary f-cubes, or multi-dimensional tori, also called multi-cubes. The focus is on the scalability of a specific implementation of the SCI architecture, namely the PCI to SCI adapter boards from Dolphin Interconnect Solutions [5]. The adapter boards are enhanced with more than one SCI link controller (LC) in order to increase the number of supported dimensions (or fan-outs).We show how the SCI ringlets and the internal bus in each adapter limit scalability of the interconnect, and how the two relate to each other. The internal bus (the B-Link) is used to take packets between different dimensions and between each dimension and the PCI interface towards the local node.The resulting analysis can serve as a guide to select the right topology for a given system size.We discuss how the interconnect scales with respect to the amount of traffic each node can generate, which is limited to the bandwidth of a single PCI bus, and argue that these topologies scale to 512 nodes using state-of-the-art technology.
Scaling Replicated State Machines with Compartmentalization [Technical Report]

Michael Whittaker,Ailidani Ailijiang,Aleksey Charapko,Murat Demirbas,Neil Giridharan,Joseph M. Hellerstein,Heidi Howard,Ion Stoica,Adriana Szekeres

DOI: https://doi.org/10.48550/arXiv.2012.15762

2021-05-17

Abstract:State machine replication protocols, like MultiPaxos and Raft, are a critical component of many distributed systems and databases. However, these protocols offer relatively low throughput due to several bottlenecked components. Numerous existing protocols fix different bottlenecks in isolation but fall short of a complete solution. When you fix one bottleneck, another arises. In this paper, we introduce compartmentalization, the first comprehensive technique to eliminate state machine replication bottlenecks. Compartmentalization involves decoupling individual bottlenecks into distinct components and scaling these components independently. Compartmentalization has two key strengths. First, compartmentalization leads to strong performance. In this paper, we demonstrate how to compartmentalize MultiPaxos to increase its throughput by 6x on a write-only workload and 16x on a mixed read-write workload. Unlike other approaches, we achieve this performance without the need for specialized hardware. Second, compartmentalization is a technique, not a protocol. Industry practitioners can apply compartmentalization to their protocols incrementally without having to adopt a completely new protocol.

Distributed, Parallel, and Cluster Computing
How to Measure Scalability of SMP Cluster

何家华,陈国良,单久龙

2004-01-01

Ruan Jian Xue Bao/Journal of Software

Abstract:Scalability is an important performance criterion of parallel computing. However the conventional scalability metrics are not suitable for SMP(symmetric multiprocessor) cluster. How to measure scalability of SMP cluster? This paper proposes a solution to the problem. It first finds out and verifies the reason, nonequivalence of the processor sets and then it adopts the viewpoint of processor set to observe the behaviors of the system correctly and comprehensively instead of using only the number of processors to describe the parallel system. By introducing the concept of performance reference factor, it extends the conventional metrics to fit the SMP cluster architecture.As the experiments indicate, the extended metrics are applicable to the SMP cluster and have high precision.
The Anatomy of the Grid - Enabling Scalable Virtual Organizations

Ian Foster,Carl Kesselman,Steven Tuecke

DOI: https://doi.org/10.48550/arXiv.cs/0103025

2001-03-29

Abstract:"Grid" computing has emerged as an important new field, distinguished from conventional distributed computing by its focus on large-scale resource sharing, innovative applications, and, in some cases, high-performance orientation. In this article, we define this new field. First, we review the "Grid problem," which we define as flexible, secure, coordinated resource sharing among dynamic collections of individuals, institutions, and resources-what we refer to as virtual organizations. In such settings, we encounter unique authentication, authorization, resource access, resource discovery, and other challenges. It is this class of problem that is addressed by Grid technologies. Next, we present an extensible and open Grid architecture, in which protocols, services, application programming interfaces, and software development kits are categorized according to their roles in enabling resource sharing. We describe requirements that we believe any such mechanisms must satisfy, and we discuss the central role played by the intergrid protocols that enable interoperability among different Grid systems. Finally, we discuss how Grid technologies relate to other contemporary technologies, including enterprise integration, application service provider, storage service provider, and peer-to-peer computing. We maintain that Grid concepts and technologies complement and have much to contribute to these other approaches.

Hardware Architecture,Distributed, Parallel, and Cluster Computing
Scalability in Visualization

Gaëlle Richer,Alexis Pister,Moataz Abdelaal,Jean-Daniel Fekete,Michael Sedlmair,Daniel Weiskopf

DOI: https://doi.org/10.1109/TVCG.2022.3231230

2022-12-14

Abstract:We introduce a conceptual model for scalability designed for visualization research. With this model, we systematically analyze over 120 visualization publications from 1990-2020 to characterize the different notions of scalability in these works. While many papers have addressed scalability issues, our survey identifies a lack of consistency in the use of the term in the visualization research community. We address this issue by introducing a consistent terminology meant to help visualization researchers better characterize the scalability aspects in their research. It also helps in providing multiple methods for supporting the claim that a work is "scalable". Our model is centered around an effort function with inputs and outputs. The inputs are the problem size and resources, whereas the outputs are the actual efforts, for instance, in terms of computational run time or visual clutter. We select representative examples to illustrate different approaches and facets of what scalability can mean in visualization literature. Finally, targeting the diverse crowd of visualization researchers without a scalability tradition, we provide a set of recommendations for how scalability can be presented in a clear and consistent way to improve fair comparison between visualization techniques and systems and foster reproducibility.

Human-Computer Interaction
The Design and Architecture of the Microsoft Cluster Service -- A Practical Approach to High-Availability and Scalability

Werner Vogels,Dan Dumitriu,Ken Birman,Rod Gamache,Mike Massa,Rob Short,John Vert,Joe Barrera

DOI: https://doi.org/10.48550/arXiv.cs/9809006

1998-09-03

Abstract:Microsoft Cluster Service (MSCS) extends the Win-dows NT operating system to support high-availability services. The goal is to offer an execution environment where off-the-shelf server applications can continue to operate, even in the presence of node failures. Later ver-sions of MSCS will provide scalability via a node and application management system that allows applications to scale to hundreds of nodes. This paper provides a de-tailed description of the MSCS architecture and the de-sign decisions that have driven the implementation of the service. The paper also describes how some major appli-cations use the MSCS features, and describes features added to make it easier to implement and manage fault-tolerant applications on MSCS.

Operating Systems,Distributed, Parallel, and Cluster Computing
Survey on Software Scalability of Distributed Systems

CHEN Bin,BAI Xiao-ying,MA Bo,HUANG Jun-fei

DOI: https://doi.org/10.3969/j.issn.1002-137x.2011.08.003

2011-01-01

Computer Science

Abstract:Scalability represents the ability that a system continually satisfies the performance requirements with the changing system requirements and resources.Based on different scenarios,the basic definition and metrics of scalability can be understood and introduced from different perspectives.The main approach that systems implement scalability is to dynamically change the amount of available resources and the manner of task scheduling according to the system requirements and running status,resulting dynamic adjustment of system performance.The key technique of distributed resource management system can be analyzed from parallel task scheduling and distributed system framework.Scalability is the key issue for evaluating and measuring system performance,this paper stressed on parallel code testing and the main approaches in scalability testing system design.With the development in software diagram,the deployment and supply of software are gradually transferring to the approach of open and shared virtual resource management online service platform,scalability becomes an important guideline for software under Cloud Computing,this paper further discussed the challenging problems under new software diagram for further research purpose.
Comprehensive Analysis of Performance, Fault-Tolerance and Scalability in Grid Resource Management System

Xiangzhen Kong,Jiwei Huang,Chuang Lin

DOI: https://doi.org/10.1109/GCC.2009.30

2009-01-01

Abstract:The management of the large scale heterogeneous resources is a critical issue in grid computing. The resource management system (RMS) is an essential component of grids. To ensure the QoS of the upper layer service, it raises high requirement for the performance, fault-tolerance and scalability of RMS. In this paper, we study three typical structures of RMS, including centralized, hierarchical and peer-to-peer structures, and make a comprehensive analysis of performance, fault tolerance and scalability. We put forward the performance, fault tolerance and scalability evaluation metrics of the RMS, and give the mathematical expressions and detailed calculation processes. Besides, we make further discussions on the interactions of the performance, fault-tolerance and scalability, and make a comparison of the RMSs with the three typical structures. We believe that the results of this work will help system architects make informed choices for building the RMS.
SCALL: Software Component Allocator for Heterogeneous Embedded Systems

Ivan Svogor,Jan Carlson

DOI: https://doi.org/10.1145/2797433.2797501

2016-12-31

Abstract:Allocation of software components on a heterogeneous computing platform involves hard decisions; handling different types of computing units with specific processing paradigms and a number of software components which require specific resources. An allocation method which explores the design space to provide a system architect with deployment alternatives in an early design phase can have a significant impact on the utilization of underlying platform. In this paper we present SCALL, an early prototype tool which uses heuristics and AHP for weighted multi-objective design space exploration to support systems architects in complex allocation decisions in early design phases.

Software Engineering
A Fast Approach to Scale Up Disk Arrays with Parity Declustered Data Layout by Minimizing Data Migration

Zhipeng Li,Yinlong Xu,Yongkun Li,Chengjin Tian,John C. S. Lui

DOI: https://doi.org/10.1109/access.2019.2896263

IF: 3.9

2019-01-01

IEEE Access

Abstract:Parity declustering is widely deployed in erasure-coded storage systems so as to provide fast recovery and high data availability. However, to perform scaling on such redundant array of inexpensive disks (RAIDs), it is necessary to preserve parity declustered data layout so as to preserve the properties after scaling. Unfortunately, existing scaling algorithms fail to achieve this goal so they cannot be applied for scaling RAIDs with parity declustering. To address this challenge, we develop an efficient online scaling scheme called parity declustering scaling (PDS), which employs an auxiliary balanced incomplete block design to define the data migration so as to preserve parity declustered data layout. Furthermore, PDS can also be applied to scale RAIDs for improving reliability and/or storage efficiency as options by allocating more parity blocks and/or data blocks in stripes. We provide theoretical proofs to formally show that PDS preserves parity declustered data layout, and achieves uniform distributions of data and parity blocks after scaling while requiring only the minimal data migration. We implement PDS in Linux kernel 3.14.72 and evaluate its performance with real-world traces. The results show that PDS can reduce 82.37 percent of scaling time and 18.25 percent of user response time during scaling on average, compared with “moving-everything” round-robin approach adapted to achieve parity declustered data layout after scaling.
Efficient Parity Update For Scaling Raid-Like Storage Systems

Dongdong Sun,Yinlong Xu,Yongkun Li,Si Wu,Chengjin Tian

DOI: https://doi.org/10.1109/NAS.2016.7549400

2016-01-01

Abstract:It is inevitable to scale RAID systems with the increasing demand of storage capacity and I/O throughput. When scaling RAID systems, we will always need to update parity to maintain the reliability of the storage systems. There are two schemes, read-modify-write (RMW) and read-reconstruct-write (RCW), to update parity. However most existing scaling approaches simply use RMW to update parity. While in many scenarios for existing scaling approaches, RCW performs better in terms of the number of scaling I/Os.In this paper, we propose an algorithm, called EPU, to analyze which of RCW and RMW is better for a scaling scenario and select the more efficient one to save the scaling I/Os. We apply EPU to online scaling scenarios and further use two optimizations, I/O overlap and access aggregation, to enhance the online scaling performance. Using Scale-CRS, one of the existing scaling approaches, as an example, we show via numerical studies that Scale-CRS+EPU reduces the amount of scaling I/Os over the traditional Scale-CRS in many scaling cases. To justify the online efficiency of EPU, we implement both Scale-CRS+EPU and Scale-CRS in a simulator with Disksim as a working module. Through extensive experiments, we show that Scale-CRS+EPU reduces the scaling time and the online response time of user requests over Scale-CRS.

Introduction to transverse lattice gauge theory

A Scalable Semantic Grid Framework -- VDHA_Grid.

An Adaptive Model For Building Service-Partition System

Scalable Fine-Grained Reconfigurable Replica Coordination

MultiScaler: A Multi-Loop Auto-Scaling Approach for Cloud-Based Applications

Characterizing the Scalability of Decision-Support Workloads on Clusters and SMP Systems.

Scalable RDF store based on HBase and MapReduce

Scalability in modeling and simulation systems for multi-agent, AI, and machine learning applications

A scalable distributed information management system

Rack-Scaling: An efficient rack-based redistribution method to accelerate the scaling of cloud disk arrays

Affordable Scalability Using Multi-Cubes

Scaling Replicated State Machines with Compartmentalization [Technical Report]

How to Measure Scalability of SMP Cluster

The Anatomy of the Grid - Enabling Scalable Virtual Organizations

Scalability in Visualization

The Design and Architecture of the Microsoft Cluster Service -- A Practical Approach to High-Availability and Scalability

Survey on Software Scalability of Distributed Systems

Comprehensive Analysis of Performance, Fault-Tolerance and Scalability in Grid Resource Management System

SCALL: Software Component Allocator for Heterogeneous Embedded Systems

A Fast Approach to Scale Up Disk Arrays with Parity Declustered Data Layout by Minimizing Data Migration

Efficient Parity Update For Scaling Raid-Like Storage Systems