Seamless, Correct, and Generic Programming over Serialised Data

Guillaume Allais

2024-04-27

Abstract:In typed functional languages, one can typically only manipulate data in a type-safe manner if it first has been deserialised into an in-memory tree represented as a graph of nodes-as-structs and subterms-as-pointers.

Programming Languages

What problem does this paper attempt to address?

Generic Programming with Combinators and Objects

Dmitrii Kosarev,Dmitry Boulytchev

DOI: https://doi.org/10.48550/arXiv.2106.01250

2021-06-03

Abstract:We present a generic programming framework for OCAML which makes it possible to implement extensible transformations for a large scale of type definitions. Our framework makes use of objectoriented features of OCAML, utilising late binding to override the default behaviour of generated transformations. The support for polymorphic variant types complements the ability to describe composable data types with the ability to implement composable transformations.

Programming Languages
Type checking data structures more complex than trees

Jin Sano,Naoki Yamamoto,Kazunori Ueda

DOI: https://doi.org/10.48550/arXiv.2209.05149

2022-09-12

Abstract:Graphs are a generalized concept that encompasses more complex data structures than trees, such as difference lists, doubly-linked lists, skip lists, and leaf-linked trees. Normally, these structures are handled with destructive assignments to heaps, which is opposed to a purely functional programming style and makes verification difficult. We propose a new purely functional language, $\lambda_{GT}$, that handles graphs as immutable, first-class data structures with a pattern matching mechanism based on Graph Transformation and developed a new type system, $F_{GT}$, for the language. Our approach is in contrast with the analysis of pointer manipulation programs using separation logic, shape analysis, etc. in that (i) we do not consider destructive operations but pattern matchings over graphs provided by the new higher-level language that abstract pointers and heaps away and that (ii) we pursue what properties can be established automatically using a rather simple typing framework.

Programming Languages
Extended abstract: Type oriented programming for task based parallelism

Nick Brown,Ludovic Capelli,J. Mark Bull

DOI: https://doi.org/10.48550/arXiv.2010.14133

2020-10-27

Abstract:Writing parallel codes is difficult and exhibits a fundamental trade-off between abstraction and performance. The high level language abstractions designed to simplify the complexities of parallelism make certain assumptions that impacts performance and scalability. On the other hand lower level languages, providing many opportunities for optimisation, require in-depth knowledge and the programmer to consider tricky details of parallelism. An approach is required which can bridge the gap and provide both the ease of programming and opportunities for control and optimisation. By optionally decorating their codes with additional type information, programmers can either direct the compiler to make certain decisions or rely on sensible default choices.

Programming Languages
Towards Polytypic Parallel Programming

Zhenjiang Hu,Masato Takeichi,Hideya Iwasaki

1998-01-01

Abstract:main parallel data structures that most data parallel languages cur-rently support are restricted to simple collection data types like lists, arrays or similar structures. But other useful data structures like trees have not been well addressed. Second, parallel programming relies on a set of parallel primitives that capture parallel skeletons of interest. However, these primitives are not well structured, and e cient parallel programming with these primitives is di cult. In this paper, we propose a polytypic framework for developing e-cient parallel programs on most data structures. We show how a set of polytypic parallel primitives can be formally de ned for manipulating most data structures, how these primitives can be successfully struc-tured into a uniform recursive de nition, and how an e cient combi-nation of primitives can be derived from a naive speci cation program. Our framework should be signi cant not only in development of new parallel algorithms, but also in construction of parallelizing compilers.
Object Orientation,Generic Programming and Type Constraint Checking

Bing Swen

DOI: https://doi.org/10.3321/j.issn:0254-4164.2004.11.008

2004-01-01

Jisuanji Xuebao/Chinese Journal of Computers

Abstract:A thorough and in-depth analysis of the underlying ideas and methodology of object-orientation and generic programming is presented, elaborating the aims, technological characteristics, advantages and disadvantages of both, with the emphasis on the significant innovation introduced by generic programming to compensate object-orientation for its insufficiency. The paper also details the author's work on further enhancing generic programming by providing direct language support and compiler checking for static type requirements, which leads to a new programming mechanism called named type constraint. As the first example of generic programming languages in the literatures, a generic programming extension of C++ is also discussed.
The tree machine

Arnaud Spiwack

DOI: https://doi.org/10.48550/arXiv.1507.04589

2015-07-16

Abstract:A variant of Turing machines is introduced where the tape is replaced by a single tree which can be manipulated in a style akin to purely functional programming. This yields two benefits: first, the extra structure on the tape can be leveraged to write explicit constructions of machines much more easily than with Turing machines. Second, this new kind of machines models finely the asymptotic complexity of functional programming languages, and may allow to answer questions such as "is this problem inherently slower in functional languages".

Logic in Computer Science
Extensional equality preservation and verified generic programming

Nicola Botta,Nuria Brede,Patrik Jansson,Tim Richter

DOI: https://doi.org/10.1017/S0956796821000204

2021-09-10

Abstract:In verified generic programming, one cannot exploit the structure of concrete data types but has to rely on well chosen sets of specifications or abstract data types (ADTs). Functors and monads are at the core of many applications of functional programming. This raises the question of what useful ADTs for verified functors and monads could look like. The functorial map of many important monads preserves extensional equality. For instance, if $f, g : A \rightarrow B$ are extensionally equal, that is, $\forall x \in A, \ f \ x = g \ x$, then $map \ f : List \ A \rightarrow List \ B$ and $map \ g$ are also extensionally equal. This suggests that preservation of extensional equality could be a useful principle in verified generic programming. We explore this possibility with a minimalist approach: we deal with (the lack of) extensional equality in Martin-Löf's intensional type theories without extending the theories or using full-fledged setoids. Perhaps surprisingly, this minimal approach turns out to be extremely useful. It allows one to derive simple generic proofs of monadic laws but also verified, generic results in dynamical systems and control theory. In turn, these results avoid tedious code duplication and ad-hoc proofs. Thus, our work is a contribution towards pragmatic, verified generic programming.

Logic in Computer Science
Fungi: Typed incremental computation with names

Matthew A. Hammer,Jana Dunfield,Kyle Headley,Monal Narasimhamurthy,Dimitrios J. Economou

DOI: https://doi.org/10.48550/arXiv.1808.07826

2018-08-20

Programming Languages

Abstract:Incremental computations attempt to exploit input similarities over time, reusing work that is unaffected by input changes. To maximize this reuse in a general-purpose programming setting, programmers need a mechanism to identify dynamic allocations (of data and subcomputations) that correspond over time. We present Fungi, a typed functional language for incremental computation with names. Unlike prior general-purpose languages for incremental computing, Fungi's notion of names is formal, general, and statically verifiable. Fungi's type-and-effect system permits the programmer to encode (program-specific) local invariants about names, and to use these invariants to establish global uniqueness for their composed programs, the property of using names correctly. We prove that well-typed Fungi programs respect global uniqueness. We derive a bidirectional version of the type and effect system, and we have implemented a prototype of Fungi in Rust. We apply Fungi to a library of incremental collections, showing that it is expressive in practice.
Native Implementation of Mutable Value Semantics

Dimitri Racordon,Denys Shabalin,Daniel Zheng,Dave Abrahams,Brennan Saeta

DOI: https://doi.org/10.48550/arXiv.2106.12678

2021-06-24

Abstract:Unrestricted mutation of shared state is a source of many well-known problems. The predominant safe solutions are pure functional programming, which bans mutation outright, and flow sensitive type systems, which depend on sophisticated typing rules. Mutable value semantics is a third approach that bans sharing instead of mutation, thereby supporting part-wise in-place mutation and local reasoning, while maintaining a simple type system. In the purest form of mutable value semantics, references are second-class: they are only created implicitly, at function boundaries, and cannot be stored in variables or object fields. Hence, variables can never share mutable state. Because references are often regarded as an indispensable tool to write efficient programs, it is legitimate to wonder whether such a discipline can compete other approaches. As a basis for answering that question, we demonstrate how a language featuring mutable value semantics can be compiled to efficient native code. This approach relies on stack allocation for static garbage collection and leverages runtime knowledge to sidestep unnecessary copies.

Programming Languages
Repr Types: One Abstraction to Rule Them All

Viktor Palmkvist,Anders Ågren Thuné,Elias Castegren,David Broman

2024-09-12

Abstract:The choice of how to represent an abstract type can have a major impact on the performance of a program, yet mainstream compilers cannot perform optimizations at such a high level. When dealing with optimizations of data type representations, an important feature is having extensible representation-flexible data types; the ability for a programmer to add new abstract types and operations, as well as concrete implementations of these, without modifying the compiler or a previously defined library. Many research projects support high-level optimizations through static analysis, instrumentation, or benchmarking, but they are all restricted in at least one aspect of extensibility. This paper presents a new approach to representation-flexible data types without such restrictions and which still finds efficient optimizations. Our approach centers around a single built-in type $\texttt{repr}$ and function overloading with cost annotations for operation implementations. We evaluate our approach (i) by defining a universal collection type as a library, a single type for all conventional collections, and (ii) by designing and implementing a representation-flexible graph library. Programs using $\texttt{repr}$ types are typically faster than programs with idiomatic representation choices -- sometimes dramatically so -- as long as the compiler finds good implementations for all operations. Our compiler performs the analysis efficiently by finding optimized solutions quickly and by reusing previous results to avoid recomputations.

Programming Languages,Performance
Types and Semantics for Extensible Data Types (Extended Version)

Cas van der Rest,Casper Bach Poulsen

DOI: https://doi.org/10.48550/arXiv.2309.14985

2023-09-26

Abstract:Developing and maintaining software commonly requires (1) adding new data type constructors to existing applications, but also (2) adding new functions that work on existing data. Most programming languages have native support for defining data types and functions in a way that supports either (1) or (2), but not both. This lack of native support makes it difficult to use and extend libraries. A theoretically well-studied solution is to define data types and functions using initial algebra semantics. While it is possible to encode this solution in existing programming languages, such encodings add syntactic and interpretive overhead, and commonly fail to take advantage of the map and fold fusion laws of initial algebras which compilers could exploit to generate more efficient code. A solution to these is to provide native support for initial algebra semantics. In this paper, we develop such a solution and present a type discipline and core calculus for a language with native support for initial algebra semantics.

Programming Languages
Strategy Preserving Compilation for Parallel Functional Code

Robert Atkey,Michel Steuwer,Sam Lindley,Christophe Dubach

DOI: https://doi.org/10.48550/arXiv.1710.08332

2017-10-23

Abstract:Graphics Processing Units (GPUs) and other parallel devices are widely available and have the potential for accelerating a wide class of algorithms. However, expert programming skills are required to achieving maximum performance. hese devices expose low-level hardware details through imperative programming interfaces where programmers explicity encode device-specific optimisation strategies. This inevitably results in non-performance-portable programs delivering suboptimal performance on other devices. Functional programming models have recently seen a renaissance in the systems community as they offer possible solutions for tackling the performance portability challenge. Recent work has shown how to automatically choose high-performance parallelisation strategies for a wide range of hardware architectures encoded in a functional representation. However, the translation of such functional representations to the imperative program expected by the hardware interface is typically performed ad hoc with no correctness guarantees and no guarantees to preserve the intended parallelisation strategy. In this paper, we present a formalised strategy-preserving translation from high-level functional code to low-level data race free parallel imperative code. This translation is formulated and proved correct within a language we call Data Parallel Idealised Algol (DPIA), a dialect of Reynolds' Idealised Algol. Performance results on GPUs and a multicore CPU show that the formalised translation process generates low-level code with performance on a par with code generated from ad hoc approaches.

Distributed, Parallel, and Cluster Computing,Programming Languages
A Frame Stack Semantics for Sequential Core Erlang

Péter Bereczky,Dániel Horpácsi,Simon Thompson

2023-08-24

Abstract:We present a small-step, frame stack style, semantics for sequential Core Erlang, a dynamically typed, impure functional programming language. The semantics and the properties that we prove are machine-checked with the Coq proof assistant. We improve on previous work by including exceptions and exception handling, as well as built-in data types and functions. Based on the semantics, we define multiple concepts of program equivalence (contextual, CIU equivalence, and equivalence based on logical relations) and prove that the definitions are all equivalent. Using this we are able to give a correctness criterion for refactorings by means of contextually equivalent symbolic expression pairs, which is one of the main motivations of this work.

Programming Languages
Programming with union, intersection, and negation types

Giuseppe Castagna

2024-03-27

Abstract:In this essay, I present the advantages and, I dare say, the beauty of programming in a language with set-theoretic types, that is, types that include union, intersection, and negation type connectives. I show by several examples how set-theoretic types are necessary to type some common programming patterns, but also how they play a key role in typing several language constructs-from branching and pattern matching to function overloading and type-cases-very precisely. I start by presenting the theory of types known as semantic subtyping and extend it to include polymorphic types. Next, I discuss the design of languages that use these types. I start by defining a theoretical framework that covers all the examples given in the first part of the presentation. Since the system of the framework cannot be effectively implemented, I then describe three effective restrictions of this system: (i) a polymorphic language with explicitly-typed functions, (ii) an implicitly-typed polymorphic language à la Hindley-Milner, and (iii) a monomorphic language that, by implementing classic union-elimination, precisely reconstructs intersection types for functions and implements a very general form of occurrence typing. I conclude the presentation with a short overview of other aspects of these languages, such as pattern matching, gradual typing, and denotational semantics.

Programming Languages
Fibred Computational Effects

Danel Ahman

DOI: https://doi.org/10.48550/arXiv.1710.02594

2017-10-07

Abstract:Dependent types provide a lightweight and modular means to integrate programming and formal program verification. In particular, the types of programs written in dependently typed programming languages (Agda, Idris, F*, etc.) can be used to express specifications of program correctness. These specifications can vary from being as simple as requiring the divisor in the division function to be non-zero, to as complex as specifying the correctness of compilers of industrial-strength languages. Successful compilation of a program then guarantees that it satisfies its type-based specification. While dependent types allow many runtime errors to be eliminated by rejecting erroneous programs at compile-time, dependently typed languages are yet to gain popularity in the wider programming community. One reason for this is their limited support for computational effects, an integral part of all widely used programming languages, ranging from imperative languages, such as C, to functional languages, such as ML and Haskell. For example, in addition to simply turning their inputs to outputs, programs written in these programming languages can raise exceptions, access computer's memory, communicate over a network, render images on a screen, etc. Therefore, if dependently typed programming languages are to truly live up to their promise of seamlessly integrating programming and formal program verification, we must first understand how to properly account for computational effects in such languages. While there already exists work on this topic, ingredients needed for a comprehensive theory are generally missing. For example, foundations are often not settled; available effects may be limited; or effects may not be treated systematically. In this thesis we address these shortcomings by providing a comprehensive treatment of the combination of dependent types and general computational effects.

Logic in Computer Science
A Language for Generic Programming in the Large

Jeremy G. Siek,Andrew Lumsdaine

DOI: https://doi.org/10.48550/arXiv.0708.2255

2007-08-17

Abstract:Generic programming is an effective methodology for developing reusable software libraries. Many programming languages provide generics and have features for describing interfaces, but none completely support the idioms used in generic programming. To address this need we developed the language G. The central feature of G is the concept, a mechanism for organizing constraints on generics that is inspired by the needs of modern C++ libraries. G provides modular type checking and separate compilation (even of generics). These characteristics support modular software development, especially the smooth integration of independently developed components. In this article we present the rationale for the design of G and demonstrate the expressiveness of G with two case studies: porting the Standard Template Library and the Boost Graph Library from C++ to G. The design of G shares much in common with the concept extension proposed for the next C++ Standard (the authors participated in its design) but there are important differences described in this article.

Programming Languages,Software Engineering
Latent Effects for Reusable Language Components: Extended Version

Birthe van den Berg,Tom Schrijvers,Casper Bach-Poulsen,Nicolas Wu

DOI: https://doi.org/10.48550/arXiv.2108.11155

2021-08-25

Programming Languages

Abstract:The development of programming languages can be quite complicated and costly. Hence, much effort has been devoted to the modular definition of language features that can be reused in various combinations to define new languages and experiment with their semantics. A notable outcome of these efforts is the algebra-based "datatypes a la carte" (DTC) approach. When combined with algebraic effects, DTC can model a wide range of common language features. Unfortunately, the current state of the art does not cover modular definitions of advanced control-flow mechanisms that defer execution to an appropriate point, such as call-by-name and call-by-need evaluation, as well as (multi-)staging. This paper defines latent effects, a generic class of such control-flow mechanisms. We demonstrate how function abstractions, lazy computations and a MetaML-like staging can all be expressed in a modular fashion using latent effects, and how they can be combined in various ways to obtain complex semantics. We provide a full Haskell implementation of our effects and handlers with a range of examples.
A Specification for Typed Template Haskell

Matthew Pickering,Andres Löh,Nicolas Wu

DOI: https://doi.org/10.48550/arXiv.2112.03653

2021-12-07

Abstract:Multi-stage programming is a proven technique that provides predictable performance characteristics by controlling code generation. We propose a core semantics for Typed Template Haskell, an extension of Haskell that supports multi staged programming that interacts well with polymorphism and qualified types. Our semantics relates a declarative source language with qualified types to a core language based on the the polymorphic lambda calculus augmented with multi-stage constructs.

Programming Languages
A Typed Slicing Compilation of the Polymorphic RPC Calculus

Kwanghoon Choi,James Cheney,Sam Lindley,Bob Reynders

DOI: https://doi.org/10.48550/arXiv.2107.10793

2021-07-27

Abstract:The polymorphic RPC calculus allows programmers to write succinct multitier programs using polymorphic location constructs. However, until now it lacked an implementation. We develop an experimental programming language based on the polymorphic RPC calculus. We introduce a polymorphic Client-Server (CS) calculus with the client and server parts separated. In contrast to existing untyped CS calculi, our calculus is not only able to resolve polymorphic locations statically, but it is also able to do so dynamically. We design a type-based slicing compilation of the polymorphic RPC calculus into this CS calculus, proving type and semantic correctness. We propose a method to erase types unnecessary for execution but retaining locations at runtime by translating the polymorphic CS calculus into an untyped CS calculus, proving semantic correctness.

Programming Languages
Algebraic program semantics for supercomputing

Yifeng Chen

DOI: https://doi.org/10.1007/978-3-642-39698-4_8

2013-01-01

Abstract:The competition for higher performance/price ratio is pushing processor chip design into the manycore age. Existing multicore technologies such as caching no longer scale up to dozens of processor cores. Even moderate level of performance optimisation requires direct handling of data locality and distribution. Such architectural complexity inevitably introduces challenges to programming. A better approach for abstraction than completely relying on compiler optimization is to expose some performance-critical features of the system and expect the programmer to handle them explicitly. This paper studies an algebra-semantic programming theory for a performance-transparent level of parallel programming of array-based data layout, distribution, transfer and their affinity with threads. The programming model contributes to the simplification of system-level complexities and the answering of crucial engineering questions through rigorous reasoning.

Seamless, Correct, and Generic Programming over Serialised Data

Generic Programming with Combinators and Objects

Type checking data structures more complex than trees

Extended abstract: Type oriented programming for task based parallelism

Towards Polytypic Parallel Programming

Object Orientation,Generic Programming and Type Constraint Checking

The tree machine

Extensional equality preservation and verified generic programming

Fungi: Typed incremental computation with names

Native Implementation of Mutable Value Semantics

Repr Types: One Abstraction to Rule Them All

Types and Semantics for Extensible Data Types (Extended Version)

Strategy Preserving Compilation for Parallel Functional Code

A Frame Stack Semantics for Sequential Core Erlang

Programming with union, intersection, and negation types

Fibred Computational Effects

A Language for Generic Programming in the Large

Latent Effects for Reusable Language Components: Extended Version

A Specification for Typed Template Haskell

A Typed Slicing Compilation of the Polymorphic RPC Calculus

Algebraic program semantics for supercomputing