A Heavy Traffic Theory of Two-Sided Queues

Sushil Mahavir Varma,Siva Theja Maguluri

DOI: https://doi.org/10.1145/3529113.3529127

2022-03-22

ACM SIGMETRICS Performance Evaluation Review

Abstract:Motivated by emerging applications in online matching platforms and marketplaces, we study a two-sided queue. Customers and servers that arrive into a two-sided queue depart as soon as they are matched.

What problem does this paper attempt to address?

A Heavy Traffic Theory of Matching Queues

Sushil Mahavir Varma,Siva Theja Maguluri

2024-12-02

Abstract:Motivated by emerging applications in online matching platforms and marketplaces, we study a matching queue. Customers and servers that arrive in a matching queue depart as soon as they are matched. While state-dependent control is an effective lever to regulate the throughput and delay, it often comes at a cost in practice for matching platforms. Optimizing this fundamental trade-off motivates the use of small amounts of control, so we study a matching queue in an asymptotic regime where the state-dependent control decreases to zero. Unlike the heavy traffic regime in classical queues, there are two different ways the control can be sent to zero, via a magnitude scaling parameter $\epsilon$ that goes to zero and a time scaling parameter $\tau$ that goes to infinity. Depending on the cost of control, we show that the rates of $\epsilon$ and $\tau$ that optimize the trade-off between delay and cost of control could correspond to three different regimes. As we traverse these regimes, we observe a phase transition in the limiting distribution of the matching queue. We show that a low cost of control corresponds to the regime $\epsilon \tau \rightarrow 0$ and we call it the delay-driven regime. The limiting behavior in this regime is an asymmetrical Laplace distribution. On the other hand, $\epsilon \tau \rightarrow \infty$ is the cost-driven regime corresponding to a high cost of control where the limiting behavior is either a uniform or a truncated exponential distribution. We christen the in-between regime of $\epsilon\tau \rightarrow (0, \infty)$ the hybrid regime where the limiting behavior is a Gibbs distribution. These results are obtained by novel generalizations of the transform method, where each regime requires new ideas. The hybrid regime employs inverse Fourier transforms while the other two regimes engineer multiple complex exponential test functions.

Probability
Dynamic Pricing and Matching for Two-Sided Queues

Sushil Mahavir Varma,Pornpawee Bumpensanti,Siva Theja Maguluri,He Wang

DOI: https://doi.org/10.1145/3410048.3410109

2020-07-08

ACM SIGMETRICS Performance Evaluation Review

Abstract:Motivated by diverse applications in sharing economy and online marketplaces, we consider optimal pricing and matching control in a two-sided queueing system. We assume that heterogeneous customers and servers arrive to the system with price-dependent arrival rates. The compatibility between servers and customers is specified by a bipartite graph. Once a pair of customer and server are matched, they depart from the system instantaneously. The objective is to maximize the long-run average profits of the system while minimizing average waiting time. We first propose a static pricing and max-weight matching policy, which achieves O(√ n) optimality rate when all of the arrival rates are scaled by n. We further show that a dynamic pricing and modified max-weight matching policy achieves an improved O(n1/3) optimality rate. In addition, we propose a constraint generation algorithm that solves value function approximation of the MDP and demonstrate strong numerical performance of this algorithm.
Conflicts and Delay of Two-Way Traffic Sharing a Single-Way Path

Yibing Wang,Jingqiu Guo,Leigh Furness

2013-01-01

Abstract:Serving two-way traffic in a single-way path is needed in some circumstances. When traffic demands are low, vehicles in two opposing directions may share a single-way path without much problem. With the demands increasing, however, the possibility of conflict is getting larger and eventually conflict becomes unavoidable. In case of no signalization, the following scenario is considered in this paper that opposing traffic arriving at both ends of a single-way path negotiates, based on the first-come-first-serve rule, to avoid unsolvable conflict within the path. In particular, a latecomer has to wait at her entry of the path until an early bird from the other entry and possibly some of its followers to first go across the path. Consequently, a queue may build up behind the latecomer. When traffic demands get even bigger, alternating queues are expected at either entry of the path. This paper examines the probability that typical conflict occurs in this scenario as well as average queueing delay resulting. Mathematical analysis is conducted also to reveal basic features of alternating queues. The obtained theoretical results are crucial for decision-making concerning the usage of a single-way path to serve two-way traffic in case of needs. Further theoretical work and simulation studies are outlined.
On the Primal and Dual Formulations of Traffic Assignment Problems with Perception Stochasticity and Demand Elasticity

Chi Xie,Yanjie Wan,Min Xu,Xiqun Chen,Travis Waller

DOI: https://doi.org/10.1080/19427867.2022.2071534

2022-01-01

Transportation Letters

Abstract:This article reinvestigates the mathematical formulations of traffic assignment problems with perception stochasticity and demand elasticity in both the system optimum and user equilibrium principles. Our focus is given to a pair of new general formulations that pose a duality relationship to each other. In this primal-dual modeling framework, we found that the equilibrium or optimality conditions of a traffic assignment problem with perception stochasticity and demand elasticity can be redefined as a combination of three sets of equations and an arbitrary feasible solution of either the primal or dual formulation satisfies only two of them. We further rigorously proved the solution equivalency and uniqueness of both the primal and dual formulations, by using derivative-based techniques. While the two formulations pose their respective modeling advantages and drawbacks, our preliminary algorithmic analysis and numerical test results indicate that the dual formulation-based algorithm, i.e., the Cauchy algorithm, can be more readily implemented for large-scale problems and converge evidently faster than the primal formulation-based one, i.e. the Frank-Wolfe algorithm.
Vertical and Horizontal Queue Models for Oversaturated Signal Intersections with Quasi-Real-Time Reconstruction of Deterministic and Shockwave Queueing Profiles Using Limited Mobile Sensing Data

Yongyang Liu,Jingqiu Guo,Yibing Wang

DOI: https://doi.org/10.1155/2018/6986198

IF: 2.249

2018-01-01

Journal of Advanced Transportation

Abstract:Deterministic/point/vertical and shockwave/physical/horizontal queueing models are widely used in traffic operation to estimate vehicular queue length and delays at bottlenecks such as signalized intersections. The consistency between the two types of queueing model in terms of their estimation performance has been a subject of debate for decades. This paper reexamines the issue, typically with respect to oversaturated signal intersections, and demonstrates the consistency based on analytical studies and microscopic simulations. While fixed-location sensor data was dominating, it was hardly possible to construct the deterministic or shockwave queueing profile using real data. For this reason, either profile had significance only at a conceptual level and could not be put into practical usage. With the quick spread of mobile sensing data, however, the situation has drastically changed. In this context, this paper also intends to develop an efficient approach to the reconstruction of the deterministic and shockwave queueing profiles in a quasi-real-time manner using very limited mobile sensing data. Microscopic simulations with AIMSUN have demonstrated the efficiency of the approach as well as the analytical results obtained in this paper.
Two Basic Queueing Models of Service Platforms in Digital Sharing Economy

Heng-Li Liu,Quan-Lin Li,Xiaole Wu,Chi Zhang

DOI: https://doi.org/10.48550/arXiv.2108.02852

2021-07-27

Performance

Abstract:This paper describes two basic queueing models of service platforms in digital sharing economy by means of two different policies of platform matching information. We show that the two queueing models of service platforms can be expressed as the level-independent quasi birth-and-death (QBD) processes. Using the proposed QBD processes, we provide a detailed analysis for the two queueing models of service platforms, including the system stability, the average stationary numbers of seekers and of idle owners, the expected sojourn time of an arriving seeker, and the expected profits for both the service platform and each owner. Finally, numerical examples are employed to verify our theoretical results, and demonstrate how the performance measures of service platforms are influenced by some key system parameters. We believe that the methodology and results developed in this paper not only can be applied to develop a broad class of queuing models of service platforms, but also will open a series of promising innovative research on performance evaluation, optimal control and queueing-game of service platforms and digital sharing economy.
Multi-component Matching Queues in Heavy Traffic

Bowen Xie

2022-07-24

Abstract:We consider multi-component matching systems in heavy traffic consisting of $K\geq 2$ distinct perishable components which arrive randomly over time at high speed at the assemble-to-order station, and they wait in their respective queues according to their categories until matched or their ``patience" runs out. An instantaneous match occurs if all categories are available, and the matched components leave immediately thereafter. For a sequence of such systems parameterized by $n$, we establish an explicit definition for the matching completion process, and when all the arrival rates tend to infinity in concert as $n\to\infty$, we obtain a heavy traffic limit of the appropriately scaled queue lengths under mild assumptions, which is characterized by a coupled stochastic integral equation with a scalar-valued non-linear term. We demonstrate some crucial properties for certain coupled equations and exhibit numerical case studies. Moreover, we establish an asymptotic Little's law, which reveals the asymptotic relationship between the queue length and its virtual waiting time. Motivated by the cost structure of blood bank drives, we formulate an infinite-horizon discounted cost functional and show that the expected value of this cost functional for the nth system converges to that of the heavy traffic limiting process as n tends to infinity.

Probability
Learning-Based Pricing and Matching for Two-Sided Queues

Zixian Yang,Lei Ying

2024-03-17

Abstract:We consider a dynamic system with multiple types of customers and servers. Each type of waiting customer or server joins a separate queue, forming a bipartite graph with customer-side queues and server-side queues. The platform can match the servers and customers if their types are compatible. The matched pairs then leave the system. The platform will charge a customer a price according to their type when they arrive and will pay a server a price according to their type. The arrival rate of each queue is determined by the price according to some unknown demand or supply functions. Our goal is to design pricing and matching algorithms to maximize the profit of the platform with unknown demand and supply functions, while keeping queue lengths of both customers and servers below a predetermined threshold. This system can be used to model two-sided markets such as ride-sharing markets with passengers and drivers. The difficulties of the problem include simultaneous learning and decision making, and the tradeoff between maximizing profit and minimizing queue length. We use a longest-queue-first matching algorithm and propose a learning-based pricing algorithm, which combines gradient-free stochastic projected gradient ascent with bisection search. We prove that our proposed algorithm yields a sublinear regret $\tilde{O}(T^{5/6})$ and queue-length bound $\tilde{O}(T^{2/3})$, where $T$ is the time horizon. We further establish a tradeoff between the regret bound and the queue-length bound: $\tilde{O}(T^{1-\gamma/4})$ versus $\tilde{O}(T^{\gamma})$ for $\gamma \in (0, 2/3].$

Optimization and Control,Machine Learning,Probability
Two Unordered Queues

Samantha Molinaro,Myron Hlynka,Shan Xu

DOI: https://doi.org/10.48550/arXiv.1108.1179

2011-08-05

Abstract:A special customer must complete service from two servers in series, in either order, each with an M/M/1 queueing system. It is assumed that the two queueing system lengths are independent with initial numbers of customers a and b at the instant when the special customer arrives. We find the expected total time (ETT) for the special customer to complete service. We show that even if the interarrival and service time parameters of two queues are identical, there exist examples (specific values of the parameters and initial lengths) for which the special customer surprisingly has a lower expected total time to completion by joining the longer queue first rather than the shorter one.

Probability,Statistics Theory
Applications of the $M^X/\text{semi-Markov}/1$ queue to road traffic

Abhishek,Marko Boon,Rudesindo Núñez-Queija

DOI: https://doi.org/10.48550/arXiv.1812.02406

2018-12-06

Abstract:The single server queue with multiple customer types and semi-Markovian service times, sometimes referred to as the $M/SM/1$ queue, has been well-studied since its introduction by Neuts in 1966. In this paper, we apply an extension of this model, with batch arrivals and exceptional first service, to road traffic situations involving multiple streams of conflicting traffic. In particular, we use it in the context of gap acceptance models where low-priority traffic needs to cross (or, depending on the application, merge with) another traffic flow of higher priority. Traditionally, gap acceptance models are based on the $M/G/1$ queue with exceptional first service, in this application area commonly referred to as the $M/G2/1$ queue. In an earlier study, we showed how the $M^X/SM/1$ queue with exceptional first service can be applied in this context to extend the model with driver impatience and more realistic merging behaviour. In this paper, we show how this same queueing system can be used to model a Markov modulated Poisson arrival process of the high-priority traffic stream. Due to its flexibility, this arrival process is very relevant in this application, particularly because it allows the modelling of platoon forming of vehicles. The correlated inter-arrival times of these high priority vehicles cause the merging times of two subsequent low priority vehicles to become dependent as well (as they correspond with the service times in the underlying queueing model). We derive the waiting time and sojourn time distributions of an arbitrary customer, showing that these depend on the position of the customer inside the batch, as well as on the type of the first customer in the batch.

Probability
Managing Congestion in Two-Sided Platforms: The Case of Online Rentals

Caterina Calsamiglia,Laura Doval,Alejandro Robinson-Cortés,Matthew Shum

2023-08-29

Abstract:Thick two-sided matching platforms, such as the room-rental market, face the challenge of showing relevant objects to users to reduce search costs. Many platforms use ranking algorithms to determine the order in which alternatives are shown to users. Ranking algorithms may depend on simple criteria, such as how long a listing has been on the platform, or incorporate more sophisticated aspects, such as personalized inferences about users' preferences. Using rich data on a room rental platform, we show how ranking algorithms can be a source of unnecessary congestion, especially when the ranking is invariant across users. Invariant rankings induce users to view, click, and request the same rooms in the platform we study, greatly limiting the number of matches it creates. We estimate preferences and simulate counterfactuals under different ranking algorithms varying the degree of user personalization and variation across users. In our case, increased personalization raises both user match utility and congestion, which leads to a trade-off. We find that the current outcome is inefficient as it lies below the possibility frontier, and propose alternatives that improve upon it.

General Economics
Equivalent Queue Length Change Rate Models for Congested Traffic Flow

Ronghan Yao,Dianhai Wang

DOI: https://doi.org/10.1061/40995(322)36

2008-01-01

Abstract:To describe the evolution principle of vehicular queue in the congested traffic flow, the equivalent queue length model for a single-lane link and the average equivalent queue length model for a multi-lane link are built based on the two-fluid theory. By applying the calculous, the average equivalent queue length change rate models are deduced for single-lane and multi-lane links respectively. It is found that the change rate of equivalent queue length is relative to the traffic wave speed and they are identical at the special circumstance. Finally, the equivalent queue length change rate models are validated by using the simulation data from VISSIM. The results show that the equivalent and actual queue length change rates approach during the sampling interval and they more approach when the sampling interval is longer. When the traffic flow is in the congested state, the evolution speed of vehicular queue can be described quantitatively and simply by the equivalent queue length change rate model. The model provides the theoretical basis for adjusting the strategy of urban traffic control.
Many-Server Queueing Systems with Heterogeneous Strategic Servers in Heavy Traffic

Burak Büke,Goncalo dos Reis,Vadim Platonov

DOI: https://doi.org/10.48550/arXiv.2211.04158

2022-11-08

Abstract:In most service systems, the servers are humans who desire to experience a certain level of idleness. In call centers, this manifests itself as the call avoidance behavior, where servers strategically adjust their service rate to strike a balance between the idleness they receive and effort to work harder. Moreover, being humans, each server values this trade-off differently and has different capabilities. Drawing ideas on mean-field games we develop a novel framework relying on measure-valued processes to simultaneously address strategic server behavior and inherent server heterogeneity in service systems. This framework enables us to extend the recent literature on strategic servers in four new directions by: (i) incorporating individual choices of servers, (ii) incorporating individual abilities of servers, (iii) modeling the discomfort experienced by servers due to low levels of idleness, and (iv) considering more general routing policies. Using our framework, we are able to asymptotically characterize asymmetric Nash equilibria for many-server systems with strategic servers. In simpler cases, it has been shown that the purely quality-driven regime is asymptotically optimal. However, we show that if the discomfort increases fast enough as the idleness approaches zero, the quality-and-efficiency-driven regime and other quality driven regimes can be optimal. This is the first time this conclusion appears in the literature.

Probability
Equivalent queue length model for congested traffic stream based on two-fluid theory

Yao Ronghan,Wang Dianhai,Qu Zhaowei

DOI: https://doi.org/10.3321/j.issn:1001-0505.2007.03.034

2007-01-01

Abstract:To describe the queue phenomena in congested traffic flow, based on two-fluid theory a thinking which converts actual traffic-flow operation state into two-fluid operation state is put forward.The equivalent queue length model is built for a single-lane segment according to conservation equation.On this basis,the average equivalent queue length model is educed for a multi-lane segment.To validate the effectiveness of the models,the simulation schemes are designed for the congested traffic flow by applying the VISSIM software.By comparing the equivalent queue lengths computed by the models with the actual queue lengths obtained by the software,it is found that the equivalent queue lengths are all longer than the actual ones;the equivalent queue lengths are stable,but the actual values fluctuate.The results show that the equivalent queue length models can quantitatively and better describe the congested degree of traffic-flow on congested segment.The models are simple and easy to be applied in engineering practice.Their results can provide a theoretical basis for urban traffic control system optimization etc.
Heavy-Traffic Analysis Through Uniform Acceleration of Queues with Diminishing Populations

Gianmarco Bet,Remco van der Hofstad,Johan S. H. van Leeuwaarden

DOI: https://doi.org/10.1287/moor.2018.0947

IF: 2.215

2019-08-01

Mathematics of Operations Research

Abstract:We consider a single-server queue that serves a finite population of <math>n</math> customers that will enter the queue (require service) only once, also known as the <math>Δ(i)/G/1</math> queue. This paper presents a method for analyzing heavy-traffic behavior by using uniform acceleration, which simultaneously lets <math>n</math> and the service rate grow large, while the initial resource utilization approaches one. A key feature of the model is that, as time progresses, more customers have joined the queue, and fewer customers can potentially join. This diminishing population gives rise to a class of reflected stochastic processes that vanish over time and hence do not have a stationary distribution. We establish that, when the arrival times are exponentially distributed, by suitably rescaling space and time, the queue-length process converges to a Brownian motion with a negative quadratic drift, a stochastic-process limit that captures the effect of the diminishing population. When the arrival times are generally distributed, our techniques provide information on the typical queue length and the first busy period.

mathematics, applied,operations research & management science
An $ε$-Nash equilibrium with high probability for strategic customers in heavy traffic

Rami Atar,Subhamay Saha

DOI: https://doi.org/10.48550/arXiv.1505.01328

2015-05-06

Abstract:A multiclass queue with many servers is considered, where customers make a join-or-leave decision upon arrival based on queue length information, without knowing the scheduling policy or the state of other queues. A game theoretic formulation is proposed and analyzed, that takes advantage of a phenomenon unique to heavy traffic regimes, namely Reiman's snaphshot principle, by which waiting times are predicted with high precision by the information available upon arrival. The payoff considered is given as a random variable, which depends on the customer's decision, accounting for waiting time in the queue and penalty for leaving. The notion of an equilibrium is only meaningful in an asymptotic framework, which is taken here to be the Halfin-Whitt heavy traffic regime. The main result is the identification of an $\epsilon$-Nash equilibrium with probability approaching 1. On way to proving this result, new diffusion limit results for systems with finite buffers are obtained.

Optimization and Control
Queueing Theory and Network Applications

Quan-Lin Li,Shunfu Jin

DOI: https://doi.org/10.1007/978-3-319-68520-5

2017-01-01

Abstract:Chen et al. (2015) studied the equilibrium threshold balking strategies for the fully observable and fully unobservable single-server queues with threshold policy and setup times. The server shuts down whenever the system becomes empty, and is only resumed when the number of customers reaches to a given threshold. Customers decide whether to join or to balk the system based on their observations of the queue length and status of the server at arrival instants. This paper aims to study the partially observable case and the unobservable case. The stationary probability distribution, the mean queue length and the social welfare are derived. The equilibrium strategies for the customers and the system performance under these strategies are analyzed.
Double-End Queues with Non-Poisson Inputs and Their Effective Algorithms

Heng-Li Liu,Quan-Lin Li,Yan-Xia Chang,Chi Zhang

DOI: https://doi.org/10.48550/arXiv.2001.00946

2022-04-28

Abstract:It is interesting and challenging to study double-ended queues with First-Come-First-Match discipline under customers' impatient behavior and non-Poisson inputs. The system stability can be guaranteed by the customers' impatient behavior, while the existence of impatient customers makes analysis of such double-ended queues more difficult or even impossible to find an explicitly analytic solution, thus it becomes more and more important to develop effective numerical methods in a variety of practical matching problems. This paper studies a block-structured double-ended queue, whose block structure comes from two independent Markovian arrival processes (MAPs), which are non-Poisson inputs. We show that such a queue can be expressed as a new bilateral quasi birth-and-death (QBD) process which has its own interest. Based on this, we provide a detailed analysis for both the bilateral QBD process and the double-ended queue, including the system stability, the queue size distributions, the average stationary queue lengths, and the sojourn time of any arriving customers. Furthermore, we develop three effective algorithms for computing the performance measures (i.e., the probabilities of stationary queue lengths, the average stationary queue lengths, and the average sojourn times) of the double-ended queue with non-Poisson inputs. Finally, we use some numerical examples in tabular and graphical to illustrate how the performance measures are influenced by some key system parameters. We believe that the methodology and results described in this paper can be applicable to deal with more general double-ended queues in practice, and develop some effective algorithms for the purpose of many actual uses.

Probability,Performance
Equilibrium and Socially optimal of a double-sided queueing system with two-mass point matching time

Zhen Wang,Cheryl Yang,Liwei Liu,Yiqiang Q. Zhao

DOI: https://doi.org/10.48550/arXiv.2101.12043

2021-01-28

Probability

Abstract:We study a passenger-taxi double-ended queue with impatient passengers and two-point matching time in this paper. The system considered in this paper is different from those considered in the existing literature, which fully considers the matching time between passengers and taxis, and the taxi capacity of the system. The objective is to get the equilibrium joining strategy and the socially optimal strategy under two information levels. For the practical consideration of the airport terminal scenario, two different information levels are considered. The theoretical results show that the passenger utility function in the partially observable case is monotonic. For the complex form of social welfare function of the partially observable case, we use a split derivation. The equilibrium strategy and socially optimal strategy of the observable case are threshold-type. Furthermore, some representative numerical scenarios are used to visualize the theoretical results. The numerical scenarios illustrate the influence of parameters on the equilibrium strategy and socially optimal strategy under two information levels. Finally, the optimal social welfare for the two information levels with the same parameters are compared.

A Heavy Traffic Theory of Two-Sided Queues

A Heavy Traffic Theory of Matching Queues

Dynamic Pricing and Matching for Two-Sided Queues

Conflicts and Delay of Two-Way Traffic Sharing a Single-Way Path

On the Primal and Dual Formulations of Traffic Assignment Problems with Perception Stochasticity and Demand Elasticity

Vertical and Horizontal Queue Models for Oversaturated Signal Intersections with Quasi-Real-Time Reconstruction of Deterministic and Shockwave Queueing Profiles Using Limited Mobile Sensing Data

Two Basic Queueing Models of Service Platforms in Digital Sharing Economy

Multi-component Matching Queues in Heavy Traffic

Learning-Based Pricing and Matching for Two-Sided Queues

Two Unordered Queues

Applications of the $M^X/\text{semi-Markov}/1$ queue to road traffic

Managing Congestion in Two-Sided Platforms: The Case of Online Rentals

Equivalent Queue Length Change Rate Models for Congested Traffic Flow

Many-Server Queueing Systems with Heterogeneous Strategic Servers in Heavy Traffic

Equivalent queue length model for congested traffic stream based on two-fluid theory

Heavy-Traffic Analysis Through Uniform Acceleration of Queues with Diminishing Populations

An $ε$-Nash equilibrium with high probability for strategic customers in heavy traffic

Queueing Theory and Network Applications

Double-End Queues with Non-Poisson Inputs and Their Effective Algorithms

Equilibrium and Socially optimal of a double-sided queueing system with two-mass point matching time