The Largest Table in Chinese Restaurant Processes

XinXing Chen,JianGang Ying

DOI: https://doi.org/10.1007/s11425-009-0101-z

2009-01-01

Science in China Series A Mathematics

Abstract:In this paper, we investigate the expectation of the size of the largest table in an (α, θ)-Chinese restaurant process by using and developing an idea originated in the work by Shepp, which discusses random permutation.

What problem does this paper attempt to address?

Online Uniform Machine Covering with the Known Largest Size

Cao Shunjuan,Tan Zhiyi

2007-01-01

Abstract:This paper investigates the semi-online scheduling problem with the known largest size on two uniform machines. The objective is to maximize the minimum machine completion time. Both lower bounds and algorithms are given. Algorithms are optimal for the majority values of s >= 1, where s is the speed ratio of the two machines. The largest gap between the competitive ratio and the lower bound is about 0.064. Moreover, the overall competitive ratio 2 matches the overall lower bound.
A two-table theorem for a disordered Chinese restaurant process

Jakob E. Björnberg,Cécile Mailler,Peter Mörters,Daniel Ueltschi

DOI: https://doi.org/10.48550/arXiv.2303.12623

2024-05-04

Abstract:We investigate a disordered variant of Pitman's Chinese restaurant process where tables carry i.i.d. weights. Incoming customers choose to sit at an occupied table with a probability proportional to the product of its occupancy and its weight, or they sit at an unoccupied table with a probability proportional to a parameter $\theta>0$. This is a system out of equilibrium where the proportion of customers at any given table converges to zero almost surely. We show that for weight distributions in any of the three extreme value classes, Weibull, Gumbel or Fréchet, the proportion of customers sitting at the largest table converges to one in probability, but not almost surely, and the proportion of customers sitting at either of the largest two tables converges to one almost surely.

Probability
Limit theorems for random permutations induced by Chinese restaurant processes

Jaime Garza,Yizao Wang

2024-12-03

Abstract:We investigate the random permutation matrices induced by the Chinese restaurant processes with $(\alpha,\theta)$-seating. When $\alpha=0,\theta>0$, the permutations are those following Ewens measures on symmetric groups, and have been extensively studied in the literature. Here, we consider $\alpha\in(0,1)$ and $\theta>-\alpha$. In an accompanying paper, a functional central limit theorem is established for partial sum of weighted cycle counts in the form of $\sum_{j=1}^n a_jC_{n,j}$, where $C_{n,j}$ is the number of $j$-cycles of the permutation matrix of size $n$. Two applications are presented. One is on linear statistics of the spectrum, and the other is on the characteristic polynomials outside the unit circle.

Probability
Large Scale App Recommendation in Ant Financial

Chaochao Chen,Xinxing Yang,Li Wang,Jun Zhou,Xiaolong Li

DOI: https://doi.org/10.1109/bigdata.2017.8258524

2017-01-01

Abstract:Nowadays, the number of mobile applications (Apps) is rapidly increasing due to different kinds of user needs. Existing App recommendation models can not scale to practical large data scenarios. In this paper, we present a large scale App recommendation framework, which has been applied into real application in Ant Financial for recommending Apps for hundreds of millions of users. We first present feature engineering, including a novel way to high-level features, and then use a linear ranking model to make recommendation. We also report the encouraging results through the experiments in real large scale dataset.
Concentration in the Generalized Chinese Restaurant Process

Alan Pereira,Roberto I. Oliveira,Rodrigo Ribeiro

DOI: https://doi.org/10.48550/arXiv.1806.09656

2018-06-26

Abstract:The Generalized Chinese Restaurant Process (GCRP) describes a sequence of exchangeable random partitions of the numbers $\{1,\dots,n\}$. This process is related to the Ewens sampling model in Genetics and to Bayesian nonparametric methods such as topic models. In this paper, we study the GCRP in a regime where the number of parts grows like $n^\alpha$ with $\alpha>0$. We prove a non-asymptotic concentration result for the number of parts of size $k=o(n^{\alpha/(2\alpha+4)}/(\log n)^{1/(2+\alpha)})$. In particular, we show that these random variables concentrate around $c_{k}\,V_*\,n^\alpha$ where $V_*\,n^\alpha$ is the asymptotic number of parts and $c_k\approx k^{-(1+\alpha)}$ is a positive value depending on $k$. We also obtain finite-$n$ bounds for the total number of parts. Our theorems complement asymptotic statements by Pitman and more recent results on large and moderate deviations by Favaro, Feng and Gao.

Probability
Random unfriendly seating arrangement in a dining table

Hua-Huai Chern,Hsien-Kuei Hwang,Tsung-Hsi Tsai

DOI: https://doi.org/10.48550/arXiv.1406.0614

2015-01-23

Abstract:A detailed study is made of the number of occupied seats in an unfriendly seating scheme with two rows of seats. An unusual identity is derived for the probability generating function, which is itself an asymptotic expansion. The identity implies particularly a local limit theorem with optimal convergence rate. Our approach relies on the resolution of Riccati equations.

Probability
Statistical Mechanics of the Chinese Restaurant Process: lack of self-averaging, anomalous finite-size effects and condensation

Bruno Bassetti,Mina Zarei,Marco Cosentino Lagomarsino,Ginestra Bianconi

DOI: https://doi.org/10.1103/PhysRevE.80.066118

2009-12-12

Abstract:The Pitman-Yor, or Chinese Restaurant Process, is a stochastic process that generates distributions following a power-law with exponents lower than two, as found in a numerous physical, biological, technological and social systems. We discuss its rich behavior with the tools and viewpoint of statistical mechanics. We show that this process invariably gives rise to a condensation, i.e. a distribution dominated by a finite number of classes. We also evaluate thoroughly the finite-size effects, finding that the lack of stationary state and self-averaging of the process creates realization-dependent cutoffs and behavior of the distributions with no equivalent in other statistical mechanical models.

Disordered Systems and Neural Networks,Statistical Mechanics
Sequential Chinese Restaurant Game

Chih-Yu Wang,Yan Chen,K. J. Ray Liu

DOI: https://doi.org/10.1109/TSP.2012.2225053

IF: 4.875

2013-01-01

IEEE Transactions on Signal Processing

Abstract:In a social network, agents are intelligent and have the capability to make decisions to maximize their utilities. They can either make wise decisions by taking advantages of other agents' experiences through learning, or make decisions earlier to avoid competitions from huge crowds. Both these two effects, social learning and negative network externality, play important roles in the decision process of an agent. While there are existing works on either social learning or negative network externality, a general study on considering both effects is still limited. We find that Chinese restaurant process, a popular random process, provides a well-defined structure to model the decision process of an agent under these two effects. By introducing the strategic behavior into the non-strategic Chinese restaurant process, we propose a new game, called the Chinese restaurant game, to formulate the social learning problem with negative network externality. Through analyzing the proposed Chinese restaurant game, we derive the optimal strategy of each agent and provide a recursive method to achieve the optimal strategy. How social learning and negative network externality influence each other under various settings is studied through simulations. We also illustrate the spectrum access problem in cognitive radio networks as one of the application of Chinese restaurant game. We find that the proposed Chinese restaurant game theoretic approach indeed helps users make better decisions and improves the overall system performance.
Big Data Applications in Guangzhou Restaurants Analysis

Victor Chang,Ziyang Ji,Qianwen Ariel Xu

DOI: https://doi.org/10.1089/big.2020.0222

IF: 4.426

Big Data

Abstract:With the development of modern information and communication technologies, such as the internet of things and big data analytics, businesses and users have become more adaptable to rapid changes. Both consumers and merchants have obtained great convenience. Meanwhile, a huge amount of data is generated. However, many businesses lack the ability to process these data, which contain critical business values. Therefore, this article uses data from the Dianping website to show how to use big data analytics techniques to exploit the valuable information from these raw data. First, descriptive analysis is conducted by using kernel density estimation. Then, multilinear regression analysis, Naive Bayes, and J48 are used to predict the level of restaurants. We found that flavor, environment, and service score are essential factors to the restaurant level. Moreover, J48 performs best among the three models with an accuracy of 88.89%.
Up-down ordered Chinese restaurant processes with two-sided immigration, emigration and diffusion limits

Quan Shi,Matthias Winkel

DOI: https://doi.org/10.48550/arXiv.2012.15758

2021-01-01

Abstract:We introduce a three-parameter family of up-down ordered Chinese restaurant processes ${\rm PCRP}^{(\alpha)}(\theta_1,\theta_2)$, $\alpha\in(0,1)$, $\theta_1,\theta_2\ge 0$, generalising the two-parameter family of Rogers and Winkel. Our main result establishes self-similar diffusion limits, ${\rm SSIP}^{(\alpha)}(\theta_1,\theta_2)$-evolutions generalising existing families of interval partition evolutions. We use the scaling limit approach to extend stationarity results to the full three-parameter family, identifying an extended family of Poisson--Dirichlet interval partitions. Their ranked sequence of interval lengths has Poisson--Dirichlet distribution with parameters $\alpha\in(0,1)$ and $\theta:=\theta_1+\theta_2-\alpha\ge-\alpha$, including for the first time the usual range of $\theta>-\alpha$ rather than being restricted to $\theta\ge 0$. This has applications to Fleming--Viot processes, nested interval partition evolutions and tree-valued Markov processes, notably relying on the extended parameter range.

Probability
Generalized Chinese restaurant construction of exchangeable Gibbs partitions and related results

Annalisa Cerquetti

DOI: https://doi.org/10.48550/arXiv.0805.3853

2008-05-26

Abstract:By resorting to sequential constructions of exchangeable random partitions (Pitman, 2006), and exploiting some known facts about generalized Stirling numbers, we derive a generalized Chinese restaurant process construction of exchangeable Gibbs partitions of type $\alpha$ (Gnedin and Pitman, 2006). Our construction represents the natural theoretical probabilistic framework in which to embed some recent results about a Bayesian nonparametric treatment of estimation problems arising in genetic experiment under Gibbs, species sampling, models priors.

Probability
A hydrodynamic limit and fluctuations for a Chinese restaurant-like process

Mathias Rafler

DOI: https://doi.org/10.48550/arXiv.1306.4582

2013-06-19

Abstract:We study a Markov process constructed from the Pólya sum process, which yields a kind of spatial version of the Chinese restaurant process, where each 'table' is assigned a 'location'. This construction firstly allows a definition of summation of independent processes, and secondly a monotone coupling for different parameters. Moreover, the process is related to a multi-particle random walk on the positive integers and its hydrodynamic limit and fluctuations are discussed.

Probability
A simple proof of Pitman-Yor's Chinese restaurant process from its stick-breaking representation

Caroline Lawless,Julyan Arbel

DOI: https://doi.org/10.1515/demo-2019-0003

2018-10-24

Abstract:For a long time, the Dirichlet process has been the gold standard discrete random measure in Bayesian nonparametrics. The Pitman--Yor process provides a simple and mathematically tractable generalization, allowing for a very flexible control of the clustering behaviour. Two commonly used representations of the Pitman--Yor process are the stick-breaking process and the Chinese restaurant process. The former is a constructive representation of the process which turns out very handy for practical implementation, while the latter describes the partition distribution induced. However, the usual proof of the connection between them is indirect and involves measure theory. We provide here an elementary proof of Pitman--Yor's Chinese Restaurant process from its stick-breaking representation.

Statistics Theory
Estimating the Number of Clusters Via Proportional Chinese Restaurant Process

Yingying Wen,Hangjin Jiang,Jianwei Yin

DOI: https://doi.org/10.1145/3426826.3426840

2020-01-01

Abstract:Dirichlet Process Mixture (DPM) models tend to produce some major clusters along with many small clusters. These small confusing clusters are highly overlapped with major clusters. As the size of samples increasing without the change of sample distribution, the small unnecessary clusters would be introduced more and more in the cluster results. Recently, powered Chinese Restaurant Process (pCRP) is purposed to eliminate the counterfactual small clusters. However, it violates the usual and indispensable exchangeability assumption of DPM. In this paper, we propose a new method called proportional Chinese Restaurant Process (pro-CRP) that keeps the property of exchangeability while reduces the number of unnecessary small clusters. We show the experiment results on comparing pro-CRP with CRP and pCRP models and prove the number of clusters reduced by pro-CRP.
Restaurant Survival Analysis with Heterogeneous Information

Jianxun Lian,Fuzheng Zhang,Xing Xie,Guangzhong Sun

DOI: https://doi.org/10.1145/3041021.3055130

2017-01-01

Abstract:For shopkeepers, one of their biggest common concerns is whether their business will thrive or fail in the future. With the development of new ways to collect business data, it is possible to leverage multiple domains' knowledge to build an intelligent model for business assessment. In this paper, we discuss what the potential indicators are for the long-term survival of a physical store. To this end, we study factors from four pillars: geography, user mobility, user rating, and review text. We start by exploring the impact of geographic features, which describe the location environment of the retailer store. The location and nearby places play an important role in the popularity of the shop, and usually less competitiveness and more heterogeneity is better. Then we study user mobility. It can be viewed as supplementary to the geographical placement, showing how the location can attract users from anywhere. Another important factor is how the shop can serve and satisfy users. We find that restaurant survival prediction is a hard task that can not be solved simply using consumers' ratings or sentiment metrics. Compared with conclusive and well-formatted ratings, the various review words provide more insight of the shop and deserve in-depth mining. We adopt several language models to fully explore the textual message. Comprehensive experiments demonstrate that review text indeed have the strongest predictive power. We further compare different cities' models and find the conclusions are highly consistent. Although we focus on the class of restaurant in this paper, the method can be easily extended to other shop categories.
A Ray-Knight representation of up-down Chinese restaurants

Dane Rogers,Matthias Winkel

DOI: https://doi.org/10.48550/arXiv.2006.06334

2020-06-11

Abstract:We study composition-valued continuous-time Markov chains that appear naturally in the framework of Chinese Restaurant Processes (CRPs). As time evolves, new customers arrive (up-step) and existing customers leave (down-step) at suitable rates derived from the ordered CRP of Pitman and Winkel (2009). We relate such up-down CRPs to the splitting trees of Lambert (2010) inducing spectrally positive Lévy processes. Conversely, we develop theorems of Ray-Knight type to recover more general up-down CRPs from the heights of Lévy processes with jumps marked by integer-valued paths. We further establish limit theorems for the Lévy process and the integer-valued paths to connect to work by Forman et al. (2018+) on interval partition diffusions and hence to some long-standing conjectures.

Probability
Tracking Retail and Institutional Investors Activity in China

Siyang Li,Xiaoyan Zhang,Xinran Zhang

DOI: https://doi.org/10.2139/ssrn.4630162

2023-01-01

SSRN Electronic Journal

Abstract:Using recent comprehensive account-level proprietary data, we validate and improve the order size algorithm that track retail and institutional purchases and sales in the Chinese stock market. We find the order size algorithm that classify small orders as small retail investors, medium orders as large retail investors, and large orders as institutions, gradually loses its power in recent years, especially after 2018. Observing patterns that small retail investors are more likely to submit orders with shares at a higher level of roundness than institutional investors, we propose tentative improvements for the order size algorithm by moving orders that are not multiples of 500 shares from retail orders to institutional orders. We find that our modified algorithm can better measure the order imbalances from retail and institutional investors, and our measurement of institutional investors' order imbalances have stronger return predictive power.
An elementary derivation of the Chinese restaurant process from Sethuraman's stick-breaking process

Jeffrey W. Miller

DOI: https://doi.org/10.48550/arXiv.1801.00513

2018-10-15

Abstract:The Chinese restaurant process (CRP) and the stick-breaking process are the two most commonly used representations of the Dirichlet process. However, the usual proof of the connection between them is indirect, relying on abstract properties of the Dirichlet process that are difficult for nonexperts to verify. This short note provides a direct proof that the stick-breaking process leads to the CRP, without using any measure theory. We also discuss how the stick-breaking representation arises naturally from the CRP.

Statistics Theory,Machine Learning
Large Language Model for Table Processing: A Survey

Weizheng Lu,Jing Zhang,Ju Fan,Zihao Fu,Yueguo Chen,Xiaoyong Du

2024-10-24

Abstract:Tables, typically two-dimensional and structured to store large amounts of data, are essential in daily activities like database queries, spreadsheet manipulations, web table question answering, and image table information extraction. Automating these table-centric tasks with Large Language Models (LLMs) or Visual Language Models (VLMs) offers significant public benefits, garnering interest from academia and industry. This survey provides a comprehensive overview of table-related tasks, examining both user scenarios and technical aspects. It covers traditional tasks like table question answering as well as emerging fields such as spreadsheet manipulation and table data analysis. We summarize the training techniques for LLMs and VLMs tailored for table processing. Additionally, we discuss prompt engineering, particularly the use of LLM-powered agents, for various table-related tasks. Finally, we highlight several challenges, including diverse user input when serving and slow thinking using chain-of-thought.

Artificial Intelligence,Computation and Language
Tree-of-Table: Unleashing the Power of LLMs for Enhanced Large-Scale Table Understanding

Deyi Ji,Lanyun Zhu,Siqi Gao,Peng Xu,Hongtao Lu,Jieping Ye,Feng Zhao

2024-11-13

Abstract:The ubiquity and value of tables as semi-structured data across various domains necessitate advanced methods for understanding their complexity and vast amounts of information. Despite the impressive capabilities of large language models (LLMs) in advancing the natural language understanding frontier, their application to large-scale tabular data presents significant challenges, specifically regarding table size and complex intricate relationships. Existing works have shown promise with small-scale tables but often flounder when tasked with the complex reasoning required by larger, interconnected tables found in real-world scenarios. To address this gap, we introduce "Tree-of-Table", a novel approach designed to enhance LLMs' reasoning capabilities over large and complex tables. Our method employs Table Condensation and Decomposition to distill and reorganize relevant data into a manageable format, followed by the construction of a hierarchical Table-Tree that facilitates tree-structured reasoning. Through a meticulous Table-Tree Execution process, we systematically unravel the tree-structured reasoning chain to derive the solutions. Experiments across diverse datasets, including WikiTQ, TableFact, FeTaQA, and BIRD, demonstrate that Tree-of-Table sets a new benchmark with superior performance, showcasing remarkable efficiency and generalization capabilities in large-scale table reasoning.

Computation and Language

The Largest Table in Chinese Restaurant Processes

Online Uniform Machine Covering with the Known Largest Size

A two-table theorem for a disordered Chinese restaurant process

Limit theorems for random permutations induced by Chinese restaurant processes

Large Scale App Recommendation in Ant Financial

Concentration in the Generalized Chinese Restaurant Process

Random unfriendly seating arrangement in a dining table

Statistical Mechanics of the Chinese Restaurant Process: lack of self-averaging, anomalous finite-size effects and condensation

Sequential Chinese Restaurant Game

Big Data Applications in Guangzhou Restaurants Analysis

Up-down ordered Chinese restaurant processes with two-sided immigration, emigration and diffusion limits

Generalized Chinese restaurant construction of exchangeable Gibbs partitions and related results

A hydrodynamic limit and fluctuations for a Chinese restaurant-like process

A simple proof of Pitman-Yor's Chinese restaurant process from its stick-breaking representation

Estimating the Number of Clusters Via Proportional Chinese Restaurant Process

Restaurant Survival Analysis with Heterogeneous Information

A Ray-Knight representation of up-down Chinese restaurants

Tracking Retail and Institutional Investors Activity in China

An elementary derivation of the Chinese restaurant process from Sethuraman's stick-breaking process

Large Language Model for Table Processing: A Survey

Tree-of-Table: Unleashing the Power of LLMs for Enhanced Large-Scale Table Understanding