Shaping the foundations of programming languages

Leah Hoffmann

DOI: https://doi.org/10.1145/3460442

IF: 22.7

2021-06-01

Communications of the ACM

Abstract:ACM A.M. Turing Award recipients Alfred Aho and Jeffrey Ullman discuss their early work, the 'Dragon Book,' and the future of 'live' computer science education.

computer science, theory & methods, software engineering, hardware & architecture

What problem does this paper attempt to address?

How Are Programs Found? Speculating About Language Ergonomics With Curry-Howard

Johannes Emerich

DOI: https://doi.org/10.1145/2986012.2986030

2016-12-02

Abstract:Functional languages with strong static type systems have beneficial properties to help ensure program correctness and reliability. Surprisingly, their practical significance in applications is low relative to other languages lacking in those dimensions. In this paper, the programs-as-proofs analogy is taken seriously to gain speculative insights by analysis of creation habits in the proof-centric discipline of mathematics. Viewed in light of this analogy, a sampling of mathematicians' attitudes towards formal proof suggests that the crucial role of intuition and experimentation in programming tasks may be under appreciated, hinting at a possible explanation of the challenges rigorously disciplined languages face in practical applications.

Programming Languages
Thoughts on Learning Human and Programming Languages

Daniel S. Katz,Jeffrey C. Carver

DOI: https://doi.org/10.1109/MCSE.2024.3398949

2024-07-23

Abstract:This is a virtual dialog between Jeffrey C. Carver and Daniel S. Katz on how people learn programming languages. It's based on a talk Jeff gave at the first US-RSE Conference (US-RSE'23), which led Dan to think about human languages versus computer languages. Dan discussed this with Jeff at the conference, and this discussion continued asynchronous, with this column being a record of the discussion.

Software Engineering,Computers and Society
Towards the Ultimate Programming Language: Trust and Benevolence in the Age of Artificial Intelligence

Bartosz Sawicki,Michał Śmiałek,Bartłomiej Skowron

2024-11-30

Abstract:This article explores the evolving role of programming languages in the context of artificial intelligence. It highlights the need for programming languages to ensure human understanding while eliminating unnecessary implementation details and suggests that future programs should be designed to recognize and actively support user interests. The vision includes a three-level process: using natural language for requirements, translating it into a precise system definition language, and finally optimizing the code for performance. The concept of an "Ultimate Programming Language" is introduced, emphasizing its role in maintaining human control over machines. Trust, reliability, and benevolence are identified as key elements that will enhance cooperation between humans and AI systems.

Artificial Intelligence,Computers and Society,Human-Computer Interaction,Programming Languages,Software Engineering
Alan Turing and the development of Artificial Intelligence

Stephen Muggleton

DOI: https://doi.org/10.3233/aic-130579

IF: 1.029

2014-01-01

AI Communications

Abstract:During the centennial year of his birth Alan Turing (1912–1954) has been widely celebrated as having laid the foundations for Computer Science, Automated Decryption, Systems Biology and the Turing Test. In this paper we investigate Turing's motivations and expectations for the development of Machine Intelligence, as expressed in his 1950 article in Mind. We show that many of the trends and developments within AI over the last 50 years were foreseen in this foundational paper. In particular, Turing not only describes the use of Computational Logic but also the necessity for the development of Machine Learning in order to achieve human-level AI within a 50 year time-frame. His description of the Child Machine (a machine which learns like an infant) dominates the closing section of the paper, in which he provides suggestions for how AI might be achieved. Turing discusses three alternative suggestions which can be characterised as: (1) AI by programming, (2) AI by ab initio machine learning and (3) AI using logic, probabilities, learning and background knowledge. He argues that there are inevitable limitations in the first two approaches and recommends the third as the most promising. We compare Turing's three alternatives to developments within AI, and conclude with a discussion of some of the unresolved challenges he posed within the paper.

computer science, artificial intelligence
Toward Programming Languages for Reasoning: Humans, Symbolic Systems, and AI Agents

Mark Marron

DOI: https://doi.org/10.1145/3622758.3622895

2024-07-09

Abstract:Integration, composition, mechanization, and AI assisted development are the driving themes in the future of software development. At their core these concepts are rooted in the increasingly important role of computing in our world, the desire to deliver functionality faster, with higher quality, and to empower more people to benefit from programmatic automation. These themes, and how they impact the human developers driving them, are the foundations for the next generation of programming languages. At first glance the needs of mechanization tools, AI agents, and human developers along with the various goals around development velocity, software quality, and software democratization are a broad and seemingly diverse set of needs. However, at their core is a single challenge that, once resolved, enables us to make radical progress in all of these areas. Our hypothesis is that, fundamentally, software development is a problem of reasoning about code and semantics. This is true for human developers implementing a feature, symbolic tools building models of application behavior, and even for language based AI agents as they perform tasks. While the particular aspects of reasoning that each agent struggles with varies to some degree, they share many common themes and, surprisingly, most mainstream languages extensively employ (anti)features that make this task harder or infeasible! This paper proposes a novel approach to this challenge -- instead of new language features or logical constructs, that add more complexity to what is already a problem of complexity, we propose radical simplification in the form of the Bosque platform and language.

Programming Languages,Software Engineering
Programming Is Hard -- Or at Least It Used to Be: Educational Opportunities And Challenges of AI Code Generation

Brett A. Becker,Paul Denny,James Finnie-Ansley,Andrew Luxton-Reilly,James Prather,Eddie Antonio Santos

2022-12-02

Abstract:The introductory programming sequence has been the focus of much research in computing education. The recent advent of several viable and freely-available AI-driven code generation tools present several immediate opportunities and challenges in this domain. In this position paper we argue that the community needs to act quickly in deciding what possible opportunities can and should be leveraged and how, while also working on how to overcome or otherwise mitigate the possible challenges. Assuming that the effectiveness and proliferation of these tools will continue to progress rapidly, without quick, deliberate, and concerted efforts, educators will lose advantage in helping shape what opportunities come to be, and what challenges will endure. With this paper we aim to seed this discussion within the computing education community.

Human-Computer Interaction,Artificial Intelligence,Computers and Society,Machine Learning,Software Engineering
A Symbolic Computing Perspective on Software Systems

Arthur C. Norman,Stephen M. Watt

2024-06-13

Abstract:Symbolic mathematical computing systems have served as a canary in the coal mine of software systems for more than sixty years. They have introduced or have been early adopters of programming language ideas such ideas as dynamic memory management, arbitrary precision arithmetic and dependent types. These systems have the feature of being highly complex while at the same time operating in a domain where results are well-defined and clearly verifiable. These software systems span multiple layers of abstraction with concerns ranging from instruction scheduling and cache pressure up to algorithmic complexity of constructions in algebraic geometry. All of the major symbolic mathematical computing systems include low-level code for arithmetic, memory management and other primitives, a compiler or interpreter for a bespoke programming language, a library of high level mathematical algorithms, and some form of user interface. Each of these parts invokes multiple deep issues. We present some lessons learned from this environment and free flowing opinions on topics including: * Portability of software across architectures and decades; * Infrastructure to embrace and infrastructure to avoid; * Choosing base abstractions upon which to build; * How to get the most out of a small code base; * How developments in compilers both to optimise and to validate code have always been and remain of critical importance, with plenty of remaining challenges; * The way in which individuals including in particular Alan Mycroft who has been able to span from hand-crafting Z80 machine code up to the most abstruse high level code analysis techniques are needed, and * Why it is important to teach full-stack thinking to the next generation.

Symbolic Computation,Mathematical Software,Software Engineering
From Today's Code to Tomorrow's Symphony: The AI Transformation of Developer's Routine by 2030

Ketai Qiu,Niccolò Puccinelli,Matteo Ciniselli,Luca Di Grazia

2024-09-27

Abstract:In the rapidly evolving landscape of software engineering, the integration of Artificial Intelligence (AI) into the Software Development Life-Cycle (SDLC) heralds a transformative era for developers. Recently, we have assisted to a pivotal shift towards AI-assisted programming, exemplified by tools like GitHub Copilot and OpenAI's ChatGPT, which have become a crucial element for coding, debugging, and software design. In this paper we provide a comparative analysis between the current state of AI-assisted programming in 2024 and our projections for 2030, by exploring how AI advancements are set to enhance the implementation phase, fundamentally altering developers' roles from manual coders to orchestrators of AI-driven development ecosystems. We envision HyperAssistant, an augmented AI tool that offers comprehensive support to 2030 developers, addressing current limitations in mental health support, fault detection, code optimization, team interaction, and skill development. We emphasize AI as a complementary force, augmenting developers' capabilities rather than replacing them, leading to the creation of sophisticated, reliable, and secure software solutions. Our vision seeks to anticipate the evolution of programming practices, challenges, and future directions, shaping a new paradigm where developers and AI collaborate more closely, promising a significant leap in SE efficiency, security and creativity.

Software Engineering
From Theory to Systems: A Grounded Approach to Programming Language Education

Will Crichton

DOI: https://doi.org/10.48550/arXiv.1904.06750

2019-04-14

Programming Languages

Abstract:I present a new approach to teaching a graduate-level programming languages course focused on using systems programming ideas and languages like WebAssembly and Rust to motivate PL theory. Drawing on students' prior experience with low-level languages, the course shows how type systems and PL theory are used to avoid tricky real-world errors that students encounter in practice. I reflect on the curricular design and lessons learned from two years of teaching at Stanford, showing that integrating systems ideas can provide students a more grounded and enjoyable education in programming languages. The curriculum, course notes, and assignments are freely available: http://cs242.stanford.edu/f18/
The centaur programmer -- How Kasparov's Advanced Chess spans over to the software development of the future

Pedro Alves,Bruno Pereira Cipriano

2023-04-21

Abstract:We introduce the idea of Centaur Programmer, based on the premise that a collaborative approach between humans and AI will be more effective than AI alone, as demonstrated in centaur chess tournaments where mixed teams of humans and AI beat sole computers. The paper introduces several collaboration models for programming alongside an AI, including the guidance model, the sketch model, and the inverted control model, and suggests that universities should prepare future programmers for a more efficient and productive programming environment augmented with AI. We hope to contribute to the important discussion about the diverse ways whereby humans and AI can work together in programming in the next decade, how universities should handle these changes and some legal implications surrounding this topic.

Human-Computer Interaction,Computers and Society
Programming Paradigms, Turing Completeness and Computational Thinking

Greg Michaelson

DOI: https://doi.org/10.22152/programming-journal.org/2020/4/4

2020-02-15

Abstract:The notion of programming paradigms, with associated programming languages and methodologies, is a well established tenet of Computer Science pedagogy, enshrined in international curricula. However, this notion sits ill with Kuhn's classic conceptualisation of a scientific paradigm as a dominant world view, which supersedes its predecessors through superior explanatory power. Furthermore, it is not at all clear how programming paradigms are to be characterised and differentiated. Indeed, on closer inspection, apparently disparate programming paradigms are very strongly connected. Rather, they should be viewed as different traditions of a unitary Computer Science paradigm of Turing complete computation complemented by Computational Thinking.

Programming Languages
From the String Landscape to the Mathematical Landscape: a Machine-Learning Outlook

Yang-Hui He

DOI: https://doi.org/10.48550/arXiv.2202.06086

2022-02-12

Abstract:We review the recent programme of using machine-learning to explore the landscape of mathematical problems. With this paradigm as a model for human intuition - complementary to and in contrast with the more formalistic approach of automated theorem proving - we highlight some experiments on how AI helps with conjecture formulation, pattern recognition and computation.

High Energy Physics - Theory,Machine Learning,History and Overview
Alan Turing and the Other Theory of Computation

Lenore Blum

DOI: https://doi.org/10.1145/2325296.2325299

2012-01-01

Abstract:The two major traditions of the Theory of Computation, each asking claim to similar motivations and aspirations, have for the most part run a parallel non-intersecting course. On one hand, we have the tradition arising from logic and computer science addressing problems with more recent origins, using tools of combinatorics and discrete mathematics. On the other hand, we have numerical analysis and scientific computation emanating from the classical tradition of equation solving and the continuous mathematics of calculus. Both traditions are motivated by a desire to understand the essence of computation, of algorithm; both aspire to discover useful, even profound, consequences. While the logic and computer science communities are keenly aware of Alan Turing's seminal role in the former (discrete) tradition of the theory of computation, most remain unaware of Alan Turing's role in the latter (continuous) tradition, this notwithstanding the many references to Turing in the modern numerical analysis/computational mathematics literature. In this talk I recognize Turing's work in the foundations of numerical computation. I also indicate its role in complexity theory today, and how it provides a unifying concept for the two major traditions in the Theory of Computation.
Tapping into the Natural Language System with Artificial Languages when Learning Programming

Elisa Madeleine Hartmann,Annabelle Bergum,Dominik Gorgosch,Norman Peitek,Sven Apel,Janet Siegmund

2024-01-12

Abstract:Background: In times when the ability to program is becoming increasingly important, it is still difficult to teach students to become successful programmers. One remarkable aspect are recent findings from neuro-imaging studies, which suggest a consistent role of language competency of novice programmers when they learn programming. Thus, for effectively teaching programming, it might be beneficial to draw from linguistic research, especially from foreign language acquisition.

Computers and Society,Human-Computer Interaction
On the Evolution of Programming Languages

K. R. Chowdhary

DOI: https://doi.org/10.48550/arXiv.2007.02699

2020-06-27

Abstract:This paper attempts to connects the evolution of computer languages with the evolution of life, where the later has been dictated by \emph{theory of evolution of species}, and tries to give supportive evidence that the new languages are more robust than the previous, carry-over the mixed features of older languages, such that strong features gets added into them and weak features of older languages gets removed. In addition, an analysis of most prominent programming languages is presented, emphasizing on how the features of existing languages have influenced the development of new programming languages. At the end, it suggests a set of experimental languages, which may rule the world of programming languages in the time of new multi-core architectures. Index terms- Programming languages' evolution, classifications of languages, future languages, scripting-languages.

Programming Languages,Computation and Language
Programming education and learner motivation in the age of generative AI: student and educator perspectives

Samuel Boguslawski,Rowan Deer,Mark G. Dawson

DOI: https://doi.org/10.1108/ils-10-2023-0163

2024-07-09

Information and Learning Science

Abstract:Programming education is being rapidly transformed by generative AI tools and educators must determine how best to support students in this context. This study aims to explore the experiences of programming educators and students to inform future education provision. Twelve students and six members of faculty in a small technology-focused university were interviewed. Thematic analysis of the interview data was combined with data collected from a survey of 44 students at the same university. Self-determination theory was applied as an analytical framework. Three themes were identified – bespoke learning, affect and support – that significantly impact motivation and learning outcomes in programming education. It was also found that students are already making extensive use of large language models (LLMs). LLMs can significantly improve learner autonomy and sense of competence by improving the options for bespoke learning; fostering emotions that are conducive to engendering and maintaining motivation; and inhibiting the negative affective states that discourage learning. However, current LLMs cannot adequately provide or replace social support, which is still a key factor in learner motivation. Integrating the use of LLMs into curricula can improve learning motivation and outcomes. It can also free educators from certain tasks, leaving them with more time and capacity to focus their attention on developing social learning opportunities to further enhance learner motivation. To the best of the authors' knowledge, this is the first attempt to explore the relationship between motivation and LLM use in programming education.
Teaching Programming for Mathematical Scientists

Jack Betteridge,Eunice Y. S. Chan,Robert M. Corless,James H. Davenport,James Grant

DOI: https://doi.org/10.1007/978-3-030-86909-0_12

2022-01-01

Abstract:Over the past 30 years or so, the authors have been teachingTeaching various programming for mathematics courses at our respective universities, as well as incorporating computer algebraAlgebra and numerical computation into traditional mathematics courses. These activities are, in some important ways, natural precursors to the use of Artificial IntelligenceArtificial Intelligence (AI) in Mathematics Education. This chapter reflects on some of our course designs and experiences and is therefore a mix of theory and practice. Underlying both is a clear recognition of the value of computer programming for mathematics education. We use this theory and practice to suggest good techniques for and raise questions about the use of AI in Mathematics Education.
Programming in Alma-0, or Imperative and Declarative Programming Reconciled

Krzysztof R. Apt,Andrea Schaerf

DOI: https://doi.org/10.48550/arXiv.cs/0004002

2000-04-05

Logic in Computer Science

Abstract:In (Apt et al, TOPLAS 1998) we introduced the imperative programming language Alma-0 that supports declarative programming. In this paper we illustrate the hybrid programming style of Alma-0 by means of various examples that complement those presented in (Apt et al, TOPLAS 1998). The presented Alma-0 programs illustrate the versatility of the language and show that ``don't know'' nondeterminism can be naturally combined with assignment.
Redefining Computer Science Education: Code-Centric to Natural Language Programming with AI-Based No-Code Platforms

David Y.J. Kim

2023-08-19

Abstract:This paper delves into the evolving relationship between humans and computers in the realm of programming. Historically, programming has been a dialogue where humans meticulously crafted communication to suit machine understanding, shaping the trajectory of computer science education. However, the advent of AI-based no-code platforms is revolutionizing this dynamic. Now, humans can converse in their natural language, expecting machines to interpret and act. This shift has profound implications for computer science education. As educators, it's imperative to integrate this new dynamic into curricula. In this paper, we've explored several pertinent research questions in this transformation, which demand continued inquiry and adaptation in our educational strategies.

Human-Computer Interaction,Computers and Society

Shaping the foundations of programming languages

How Are Programs Found? Speculating About Language Ergonomics With Curry-Howard

Thoughts on Learning Human and Programming Languages

Towards the Ultimate Programming Language: Trust and Benevolence in the Age of Artificial Intelligence

Alan Turing and the development of Artificial Intelligence

Toward Programming Languages for Reasoning: Humans, Symbolic Systems, and AI Agents

Programming Is Hard -- Or at Least It Used to Be: Educational Opportunities And Challenges of AI Code Generation

A Symbolic Computing Perspective on Software Systems

From Today's Code to Tomorrow's Symphony: The AI Transformation of Developer's Routine by 2030

From Theory to Systems: A Grounded Approach to Programming Language Education

The centaur programmer -- How Kasparov's Advanced Chess spans over to the software development of the future

Programming Paradigms, Turing Completeness and Computational Thinking

From the String Landscape to the Mathematical Landscape: a Machine-Learning Outlook

Alan Turing and the Other Theory of Computation

Tapping into the Natural Language System with Artificial Languages when Learning Programming

On the Evolution of Programming Languages

Programming education and learner motivation in the age of generative AI: student and educator perspectives

Teaching Programming for Mathematical Scientists

Programming in Alma-0, or Imperative and Declarative Programming Reconciled

Redefining Computer Science Education: Code-Centric to Natural Language Programming with AI-Based No-Code Platforms