Textbook examples of recursion

Donald E. Knuth

DOI: https://doi.org/10.48550/arXiv.cs/9301113

1991-08-01

Abstract:We discuss properties of recursive schemas related to McCarthy's ``91 function'' and to Takeuchi's triple recursion. Several theorems are proposed as interesting candidates for machine verification, and some intriguing open questions are raised.

Computational Complexity

What problem does this paper attempt to address?

Recursion Theory - Computational Aspects of Definability.

Chi Tat Chong,Liang Yu

2015-01-01

Abstract:This monograph presents recursion theory from a generalized and largely global point of view. A major theme is the study of the structures of degrees arising from two key notions of reducibility, the Turing degrees and the hyperdegrees, using ideas and techniques beyond those of classical recursion theory. These include structure theory, hyperarithmetic determinacy and rigidity, basis theorems, independence results on Turing degrees, as well as applications to higher randomness.
Chapter 2. To acquire a recursive grammar, children start with a recursive procedure (MERGE)

Iain Giblin,Peng Zhou,Cory Bill,Jiawei Shi,Stephen Crain

DOI: https://doi.org/10.1075/sibil.66.02gib

2024-01-01

Abstract:Recursion is a central topic in language acquisition because it helps to inform an explanatorily adequate theory of the human language faculty. Some researchers (e.g., Roeper, 2011) have proposed that it is possible for children’s early grammars to include a transitory acquisition stage that is based on conjunction rather than the truly recursive operation of merge which characterizes mature grammars. A truth-value judgement task with an elicitation component was designed to elicit recursive genitive structures in both Mandarin and English. Our results indicate that child participants in both Mandarin and English understood recursive genitive structures and a substantial majority could also produce the target recursive genitive structures. These results provide compelling evidence that recursion emerges early in child language acquisition and that there is no need to propose a transitory stage that lacks a recursive procedure.
When Are Tree Structures Necessary for Deep Learning of Representations?

Jiwei Li,Minh-Thang Luong,Dan Jurafsky,Eudard Hovy

DOI: https://doi.org/10.18653/v1/d15-1278

2015-01-01

Abstract:Recursive neural models, which use syntactic parse trees to recursively generate representations bottom-up, are a popular architecture. However there have not been rigorous evaluations showing for exactly which tasks this syntax-based method is appropriate. In this paper, we benchmark recursive neural models against sequential recurrent neural models, enforcing applesto-apples comparison as much as possible. We investigate 4 tasks: (1) sentiment classification at the sentence level and phrase level; (2) matching questions to answerphrases; (3) discourse parsing; (4) semantic relation extraction. Our goal is to understand better when, and why, recursive models can outperform simpler models. We find that recursive models help mainly on tasks (like semantic relation extraction) that require longdistance connection modeling, particularly on very long sequences. We then introduce a method for allowing recurrent models to achieve similar performance: breaking long sentences into clause-like units at punctuation and processing them separately before combining. Our results thus help understand the limitations of both classes of models, and suggest directions for improving recurrent models.
Elementary recursive algorithms

Yiannis N. Moschovakis

DOI: https://doi.org/10.48550/arXiv.2108.03574

2021-08-08

Abstract:They run our lives, if you believe the hype in the news, but there is no precise definition of "algorithms" which is generally accepted by the mathematicians, logicians and computer scientists who create and study them. My main aims here are (first) to discuss briefly and point to the few publications that try to deal with this foundational question and (primarily) to outline in Sections 4 and 5 simple proofs of two basic mathematical results about the "elementary recursive algorithms" from specified primitives expressed by recursive (McCarthy) programs.

Logic
Mathematics, Recursion, and Universals in Human Languages

P. Gilkey,S. Lopez Ornat,A. Karousou

DOI: https://doi.org/10.48550/arXiv.0909.3591

2009-09-19

Abstract:There are many scientific problems generated by the multiple and conflicting alternative definitions of linguistic recursion and human recursive processing that exist in the literature. The purpose of this article is to make available to the linguistic community the standard mathematical definition of recursion and to apply it to discuss linguistic recursion. As a byproduct, we obtain an insight into certain "soft universals" of human languages, which are related to cognitive constructs necessary to implement mathematical reasoning, i.e. mathematical model theory.

Computation and Language
Applications of Recursively Defined Data Structures

Lloyd Allison

DOI: https://doi.org/10.48550/arXiv.2206.12795

2022-06-26

Abstract:A circular program contains a data structure whose definition is self-referential or recursive. The use of such a definition allows efficient functional programs to be written and can avoid repeated evaluations and the creation of intermediate data structures that would have to be garbage collected. This paper uses circular programs in various ways, to implement memo-structures and explicit search-trees to hold solutions to constraint-satisfaction problems.

Data Structures and Algorithms,Programming Languages
Geometric recursion

Jørgen Ellegaard Andersen,Gaëtan Borot,Nicolas Orantin

2023-11-19

Abstract:We propose a general theory for constructing functorial assignments $\Sigma \longmapsto \Omega_{\Sigma} \in E(\Sigma)$ for a large class of functors $E$ from a certain category of bordered surfaces to a suitable target category of topological vector spaces. The construction proceeds by successive excisions of homotopy classes of embedded pairs of pants, and thus by induction on the Euler characteristic. We provide sufficient conditions to guarantee the infinite sums appearing in this construction converge. In particular, we can generate mapping class group invariant vectors $\Omega_{\Sigma} \in E(\Sigma)$. The initial data for the recursion encode the cases when $\Sigma$ is a pair of pants or a torus with one boundary, as well as the "recursion kernels" used for glueing. We give this construction the name of Geometric Recursion. As a first application, we demonstrate that our formalism produce a large class of measurable functions on the moduli space of bordered Riemann surfaces. Under certain conditions, the functions produced by the geometric recursion can be integrated with respect to the Weil--Petersson measure on moduli spaces with fixed boundary lengths, and we show that the integrals satisfy a topological recursion generalizing the one of Eynard and Orantin. We establish a generalization of Mirzakhani--McShane identities, namely that multiplicative statistics of hyperbolic lengths of multicurves can be computed by the geometric recursion. As a corollary, we show that the systole function can be obtained from the geometric recursion. The theory has however a wider scope than functions on Teichmüller space, which will be explored in subsequent papers; one expects that many functorial objects in low-dimensional geometry could be constructed by variants of this geometric recursion.

Geometric Topology,Mathematical Physics
"Like a Nesting Doll": Analyzing Recursion Analogies Generated by CS Students using Large Language Models

Seth Bernstein,Paul Denny,Juho Leinonen,Lauren Kan,Arto Hellas,Matt Littlefield,Sami Sarsa,Stephen MacNeil

2024-03-14

Abstract:Grasping complex computing concepts often poses a challenge for students who struggle to anchor these new ideas to familiar experiences and understandings. To help with this, a good analogy can bridge the gap between unfamiliar concepts and familiar ones, providing an engaging way to aid understanding. However, creating effective educational analogies is difficult even for experienced instructors. We investigate to what extent large language models (LLMs), specifically ChatGPT, can provide access to personally relevant analogies on demand. Focusing on recursion, a challenging threshold concept, we conducted an investigation analyzing the analogies generated by more than 350 first-year computing students. They were provided with a code snippet and tasked to generate their own recursion-based analogies using ChatGPT, optionally including personally relevant topics in their prompts. We observed a great deal of diversity in the analogies produced with student-prescribed topics, in contrast to the otherwise generic analogies, highlighting the value of student creativity when working with LLMs. Not only did students enjoy the activity and report an improved understanding of recursion, but they described more easily remembering analogies that were personally and culturally relevant.

Human-Computer Interaction,Artificial Intelligence,Computation and Language
Is recursion language-specific? Evidence of recursive mechanisms in the structure of intentional action

Giuseppe Vicari,Mauro Adenzato

DOI: https://doi.org/10.1016/j.concog.2014.03.010

Abstract:In their 2002 seminal paper Hauser, Chomsky and Fitch hypothesize that recursion is the only human-specific and language-specific mechanism of the faculty of language. While debate focused primarily on the meaning of recursion in the hypothesis and on the human-specific and syntax-specific character of recursion, the present work focuses on the claim that recursion is language-specific. We argue that there are recursive structures in the domain of motor intentionality by way of extending John R. Searle's analysis of intentional action. We then discuss evidence from cognitive science and neuroscience supporting the claim that motor-intentional recursion is language-independent and suggest some explanatory hypotheses: (1) linguistic recursion is embodied in sensory-motor processing; (2) linguistic and motor-intentional recursions are distinct and mutually independent mechanisms. Finally, we propose some reflections about the epistemic status of HCF as presenting an empirically falsifiable hypothesis, and on the possibility of testing recursion in different cognitive domains.
On nested simple recursion

Ján Komara

DOI: https://doi.org/10.1007/s00153-011-0236-9

2011-04-30

Archive for Mathematical Logic

Abstract:We give a novel proof that primitive recursive functions are closed under nested simple recursion. This new presentation is supplied with a detailed proof which can be easily formalized in small fragments of Peano Arithmetic.

mathematics,logic
Classical (Co)Recursion: Programming

Paul Downen,Zena M. Ariola

DOI: https://doi.org/10.48550/arXiv.2103.06913

2021-03-12

Abstract:Our aim here is to illustrate how the benefits of structural corecursion can be found in a broader swath of the programming landscape than previously thought. Beginning from a tutorial on structural corecursion in the total, pure functional language Agda, we show how these same ideas are mapped to familiar concepts in a variety of different languages. We show how corecursion can be done in strict functional languages like Scheme, and even escapes the functional paradigm entirely, showing up in the natural expression of common object-oriented features found in languages like Python and Java. Opening up structural corecursion to a much wider selection of languages and paradigms -- and therefore, also to a much larger audience of programmers -- lets us also ask how corecursion interacts with computational effects. Of note, we demonstrate that combining structural corecursion with effects can increase its expressive power. We show a classical version of corecursion -- using first-class control made possible by Scheme's classical call/cc -- that enables us to write some new stream-processing algorithms that aren't possible in effect-free languages.

Programming Languages
Making Neural Programming Architectures Generalize via Recursion

Jonathon Cai,Richard Shin,Dawn Song

DOI: https://doi.org/10.48550/arXiv.1704.06611

2017-04-22

Abstract:Empirically, neural networks that attempt to learn programs from data have exhibited poor generalizability. Moreover, it has traditionally been difficult to reason about the behavior of these models beyond a certain level of input complexity. In order to address these issues, we propose augmenting neural architectures with a key abstraction: recursion. As an application, we implement recursion in the Neural Programmer-Interpreter framework on four tasks: grade-school addition, bubble sort, topological sort, and quicksort. We demonstrate superior generalizability and interpretability with small amounts of training data. Recursion divides the problem into smaller pieces and drastically reduces the domain of each neural network component, making it tractable to prove guarantees about the overall system's behavior. Our experience suggests that in order for neural architectures to robustly learn program semantics, it is necessary to incorporate a concept like recursion.

Machine Learning,Neural and Evolutionary Computing,Programming Languages
An alternative recursive approach to functions of simple triangular matrices

Ellen Baake,Michael Baake

2024-05-13

Abstract:The computation of matrix functions is a well-studied problem. Of special importance are the exponential and the logarithm of a matrix, where the latter also raises existence and uniqueness questions. This is particularly relevant in the context of matrix semigroups and their generators. Here, we look at matrix functions of triangular matrices, where a recursive approach is possible when the matrix has simple spectrum. The special feature is that no knowledge of eigenvectors is required, and that the same recursion applies to the computation of multiple functions or semigroups simultaneously.

Rings and Algebras
A Linear Division-Based Recursion with Number Theoretic Applications

Jonathan L. Merzel

DOI: https://doi.org/10.48550/arXiv.2101.10428

2021-01-26

Abstract:A simple remark on infinite series is presented. This applies to a particular recursion scenario, which in turn has applications related to a classical theorem on Euler's phi-function and to recent work by Ron Brown on natural density of square-free numbers.

Number Theory
Simple recursions displaying interesting evolutions

Francesco Calogero

2024-05-01

Abstract:Some simple nonlinear recursions which can be completely managed are identified and the behaviour of all their solutions is ascertained.

Exactly Solvable and Integrable Systems
Transformer-Based Models Are Not Yet Perfect At Learning to Emulate Structural Recursion

Dylan Zhang,Curt Tigges,Zory Zhang,Stella Biderman,Maxim Raginsky,Talia Ringer

2024-01-24

Abstract:This paper investigates the ability of transformer-based models to learn structural recursion from examples. Recursion is a universal concept in both natural and formal languages. Structural recursion is central to the programming language and formal mathematics tasks where symbolic tools currently excel beyond neural models, such as inferring semantic relations between datatypes and emulating program behavior. We introduce a general framework that nicely connects the abstract concepts of structural recursion in the programming language domain to concrete sequence modeling problems and learned models' behavior. The framework includes a representation that captures the general \textit{syntax} of structural recursion, coupled with two different frameworks for understanding their \textit{semantics} -- one that is more natural from a programming languages perspective and one that helps bridge that perspective with a mechanistic understanding of the underlying transformer architecture.

Computation and Language,Artificial Intelligence,Formal Languages and Automata Theory,Logic in Computer Science,Programming Languages
What is a recursive module?

Karl Crary,Robert Harper,Sidd Puri

DOI: https://doi.org/10.1145/301631.301641

1999-05-01

ACM SIGPLAN Notices

Abstract:A hierarchical module system is an effective tool for structuring large programs. Strictly hierarchical module systems impose an acyclic ordering on import dependencies among program units. This can impede modular programming by forcing mutually-dependent components to be consolidated into a single module. Recently there have been several proposals for module systems that admit cyclic dependencies, but it is not clear how these proposals relate to one another, nor how one might integrate them into an expressive module system such as that of ML.To address this question we provide a type-theoretic analysis of the notion of a recursive module in the context of a "phase-distinction" formalism for higher-order module systems. We extend this calculus with a recursive module mechanism and a new form of signature, called a recursively dependent signature , to support the definition of recursive modules. These extensions are justified by an interpretation in terms of more primitive language constructs. This interpretation may also serve as a guide for implementation.

English Else
Improving Programs which Recurse over Multiple Inductive Structures

Leonidas Fegaras,Tim Sheard,Tong Zhou

1994-01-01

Abstract:This paper considers generic recursion schemes for programs which recurse over multiple inductive structures simultaneously, such as equality, zip and the nth element of a list function. Such schemes have been notably absent from pervious work. This paper defines a uniform mechanism for defining such programs and shows that these programs satisfy generic theorems. These theorems are the basis for an automatic improvement algorithm. This algorithm is an improvement over the algorithm presented earlier [15] because, in addition to inducting over multiple structures, it can be incorporated into any algebraic language and is no longer restricted to a "safe" subset.
Runtime Repeated Recursion Unfolding in CHR: A Just-In-Time Online Program Optimization Strategy That Can Achieve Super-Linear Speedup

Thom Fruehwirth

2024-04-25

Abstract:We introduce a just-in-time runtime program transformation strategy based on repeated recursion unfolding. Our online program optimization generates several versions of a recursion differentiated by the minimal number of recursive steps covered. The base case of the recursion is ignored in our technique. Our method is introduced here on the basis of single linear direct recursive rules. When a recursive call is encountered at runtime, first an unfolder creates specializations of the associated recursive rule on-the-fly and then an interpreter applies these rules to the call. Our approach reduces the number of recursive rule applications to its logarithm at the expense of introducing a logarithmic number of generic unfolded rules. We prove correctness of our online optimization technique and determine its time complexity. For recursions which have enough simplifyable unfoldings, a super-linear is possible, i.e. speedup by more than a constant factor.The necessary simplification is problem-specific and has to be provided at compile-time. In our speedup analysis, we prove a sufficient condition as well as a sufficient and necessary condition for super-linear speedup relating the complexity of the recursive steps of the original rule and the unfolded rules. We have implemented an unfolder and meta-interpreter for runtime repeated recursion unfolding with just five rules in Constraint Handling Rules (CHR) embedded in Prolog. We illustrate the feasibility of our approach with simplifications, time complexity results and benchmarks for some basic tractable algorithms. The simplifications require some insight and were derived manually. The runtime improvement quickly reaches several orders of magnitude, consistent with the super-linear speedup predicted by our theorems.

Programming Languages,Computational Complexity,Performance,Symbolic Computation
Large language models and (non-)linguistic recursion

Maksymilian Dąbkowski,Gašper Beguš

DOI: https://doi.org/10.48550/arXiv.2306.07195

2023-06-12

Computation and Language

Abstract:Recursion is one of the hallmarks of human language. While many design features of language have been shown to exist in animal communication systems, recursion has not. Previous research shows that GPT-4 is the first large language model (LLM) to exhibit metalinguistic abilities (Begu\v{s}, D\k{a}bkowski, and Rhodes 2023). Here, we propose several prompt designs aimed at eliciting and analyzing recursive behavior in LLMs, both linguistic and non-linguistic. We demonstrate that when explicitly prompted, GPT-4 can both produce and analyze recursive structures. Thus, we present one of the first studies investigating whether meta-linguistic awareness of recursion -- a uniquely human cognitive property -- can emerge in transformers with a high number of parameters such as GPT-4.

Textbook examples of recursion

Recursion Theory - Computational Aspects of Definability.

Chapter 2. To acquire a recursive grammar, children start with a recursive procedure (MERGE)

When Are Tree Structures Necessary for Deep Learning of Representations?

Elementary recursive algorithms

Mathematics, Recursion, and Universals in Human Languages

Applications of Recursively Defined Data Structures

Geometric recursion

"Like a Nesting Doll": Analyzing Recursion Analogies Generated by CS Students using Large Language Models

Is recursion language-specific? Evidence of recursive mechanisms in the structure of intentional action

On nested simple recursion

Classical (Co)Recursion: Programming

Making Neural Programming Architectures Generalize via Recursion

An alternative recursive approach to functions of simple triangular matrices

A Linear Division-Based Recursion with Number Theoretic Applications

Simple recursions displaying interesting evolutions

Transformer-Based Models Are Not Yet Perfect At Learning to Emulate Structural Recursion

What is a recursive module?

Improving Programs which Recurse over Multiple Inductive Structures

Runtime Repeated Recursion Unfolding in CHR: A Just-In-Time Online Program Optimization Strategy That Can Achieve Super-Linear Speedup

Large language models and (non-)linguistic recursion