Declarative machine learning systems

Piero Molino,Christopher Ré

DOI: https://doi.org/10.1145/3475167

IF: 22.7

2022-01-01

Communications of the ACM

Abstract:The future of machine learning will depend on it being in the hands of the rest of us.

computer science, theory & methods, software engineering, hardware & architecture

What problem does this paper attempt to address?

Declarative Machine Learning - A Classification of Basic Properties and Types

Matthias Boehm,Alexandre V. Evfimievski,Niketan Pansare,Berthold Reinwald

DOI: https://doi.org/10.48550/arXiv.1605.05826

2016-05-19

Databases

Abstract:Declarative machine learning (ML) aims at the high-level specification of ML tasks or algorithms, and automatic generation of optimized execution plans from these specifications. The fundamental goal is to simplify the usage and/or development of ML algorithms, which is especially important in the context of large-scale computations. However, ML systems at different abstraction levels have emerged over time and accordingly there has been a controversy about the meaning of this general definition of declarative ML. Specification alternatives range from ML algorithms expressed in domain-specific languages (DSLs) with optimization for performance, to ML task (learning problem) specifications with optimization for performance and accuracy. We argue that these different types of declarative ML complement each other as they address different users (data scientists and end users). This paper makes an attempt to create a taxonomy for declarative ML, including a definition of essential basic properties and types of declarative ML. Along the way, we provide insights into implications of these properties. We also use this taxonomy to classify existing systems. Finally, we draw conclusions on defining appropriate benchmarks and specification languages for declarative ML.
A Declarative Query Language for Scientific Machine Learning

Hasan M Jamil

DOI: https://doi.org/10.48550/arXiv.2405.16159

2024-05-25

Abstract:The popularity of data science as a discipline and its importance in the emerging economy and industrial progress dictate that machine learning be democratized for the masses. This also means that the current practice of workforce training using machine learning tools, which requires low-level statistical and algorithmic details, is a barrier that needs to be addressed. Similar to data management languages such as SQL, machine learning needs to be practiced at a conceptual level to help make it a staple tool for general users. In particular, the technical sophistication demanded by existing machine learning frameworks is prohibitive for many scientists who are not computationally savvy or well versed in machine learning techniques. The learning curve to use the needed machine learning tools is also too high for them to take advantage of these powerful platforms to rapidly advance science. In this paper, we introduce a new declarative machine learning query language, called {\em MQL}, for naive users. We discuss its merit and possible ways of implementing it over a traditional relational database system. We discuss two materials science experiments implemented using MQL on a materials science workflow system called MatFlow.

Machine Learning,Databases
Machine Learning and the Future of Realism

Giles Hooker,Cliff Hooker

DOI: https://doi.org/10.48550/arXiv.1704.04688

2017-04-16

Abstract:The preceding three decades have seen the emergence, rise, and proliferation of machine learning (ML). From half-recognised beginnings in perceptrons, neural nets, and decision trees, algorithms that extract correlations (that is, patterns) from a set of data points have broken free from their origin in computational cognition to embrace all forms of problem solving, from voice recognition to medical diagnosis to automated scientific research and driverless cars, and it is now widely opined that the real industrial revolution lies less in mobile phone and similar than in the maturation and universal application of ML. Among the consequences just might be the triumph of anti-realism over realism.

Machine Learning
SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle

Matthias Boehm,Iulian Antonov,Sebastian Baunsgaard,Mark Dokter,Robert Ginthoer,Kevin Innerebner,Florijan Klezin,Stefanie Lindstaedt,Arnab Phani,Benjamin Rath,Berthold Reinwald,Shafaq Siddiqi,Sebastian Benjamin Wrede

DOI: https://doi.org/10.48550/arXiv.1909.02976

2020-01-08

Abstract:Machine learning (ML) applications become increasingly common in many domains. ML systems to execute these workloads include numerical computing frameworks and libraries, ML algorithm libraries, and specialized systems for deep neural networks and distributed ML. These systems focus primarily on efficient model training and scoring. However, the data science process is exploratory, and deals with underspecified objectives and a wide variety of heterogeneous data sources. Therefore, additional tools are employed for data engineering and debugging, which requires boundary crossing, unnecessary manual effort, and lacks optimization across the lifecycle. In this paper, we introduce SystemDS, an open source ML system for the end-to-end data science lifecycle from data integration, cleaning, and preparation, over local, distributed, and federated ML model training, to debugging and serving. To this end, we aim to provide a stack of declarative language abstractions for the different lifecycle tasks, and users with different expertise. We describe the overall system architecture, explain major design decisions (motivated by lessons learned from Apache SystemML), and discuss key features and research directions. Finally, we provide preliminary results that show the potential of end-to-end lifecycle optimization.

Databases
Declarative Integration and Management of Large Language Models through Finite Automata: Application to Automation, Communication, and Ethics

Thierry Petit,Arnault Pachot,Claire Conan-Vrinat,Alexandre Dubarry

2024-09-02

Abstract:This article introduces an innovative architecture designed to declaratively combine Large Language Models (LLMs) with shared histories, and triggers to identify the most appropriate LLM for a given task. Our approach is general and declarative, relying on the construction of finite automata coupled with an event management system. The developed tool is crafted to facilitate the efficient and complex integration of LLMs with minimal programming effort, especially, but not only, for integrating methods of positive psychology to AI. The flexibility of our technique is demonstrated through applied examples in automation, communication, and ethics.

Formal Languages and Automata Theory,Artificial Intelligence,Computation and Language,Emerging Technologies,Human-Computer Interaction
Computer Systems Have 99 Problems, Let's Not Make Machine Learning Another One

David Mohaisen,Songqing Chen

DOI: https://doi.org/10.1109/tps-isa48467.2019.00040

2019-12-01

Abstract:Machine learning techniques are finding many applications in computer systems, including many tasks that require decision making: network optimization, quality of service assurance, and security. We believe machine learning systems are here to stay, and to materialize on their potential we advocate a fresh look at various key issues that need further attention, including security as a requirement and system complexity, and how machine learning systems affect them. We also discuss reproducibility as a key requirement for sustainable machine learning systems, and leads to pursuing it.
(Machine) Learning to Be Like Thee? For Algorithm Education, Not Training

Susana Perez Blazquez,Inas Hipolito

2023-05-20

Abstract:This paper argues that Machine Learning (ML) algorithms must be educated. ML-trained algorithms moral decisions are ubiquitous in human society. Sometimes reverting the societal advances governments, NGOs and civil society have achieved with great effort in the last decades or are yet on the path to be achieved. While their decisions have an incommensurable impact on human societies, these algorithms are within the least educated agents known (data incomplete, un-inclusive, or biased). ML algorithms are not something separate from our human idiosyncrasy but an enactment of our most implicit prejudices and biases. Some research is devoted to responsibility assignment as a strategy to tackle immoral AI behaviour. Yet this paper argues that the solution for AI ethical decision-making resides in algorithm education (as opposed to the training) of ML. Drawing from an analogy between ML and child education for social responsibility, the paper offers clear directions for responsible and sustainable AI design, specifically with respect to how to educate algorithms to decide ethically.

Machine Learning,Neurons and Cognition
Formal Semantics and High Performance in Declarative Machine Learning Using Datalog

Wang Jin,Wu Jiacheng,Li Mingda,Gu Jiaqi,Das Ariyam,Zaniolo Carlo

DOI: https://doi.org/10.1007/s00778-021-00665-6

2021-01-01

The VLDB Journal

Abstract:With an escalating arms race to adopt machine learning (ML) in diverse application domains, there is an urgent need to support declarative machine learning over distributed data platforms. Toward this goal, a new framework is needed where users can specify ML tasks in a manner where programming is decoupled from the underlying algorithmic and system concerns. In this paper, we argue that declarative abstractions based on Datalog are natural fits for machine learning and propose a purely declarative ML framework with a Datalog query interface. We show that using aggregates in recursive Datalog programs entails a concise expression of ML applications, while providing a strictly declarative formal semantics. This is achieved by introducing simple conditions under which the semantics of recursive programs is guaranteed to be equivalent to that of aggregate-stratified ones. We further provide specialized compilation and planning techniques for semi-naive fixpoint computation in the presence of aggregates and optimization strategies that are effective on diverse recursive programs and distributed data platforms. To test and demonstrate these research advances, we have developed a powerful and user-friendly system on top of Apache Spark. Extensive evaluations on large-scale datasets illustrate that this approach will achieve promising performance gains while improving both programming flexibility and ease of development and deployment for ML applications.
Machine Teaching: A New Paradigm for Building Machine Learning Systems

Patrice Y. Simard,Saleema Amershi,David M. Chickering,Alicia Edelman Pelton,Soroush Ghorashi,Christopher Meek,Gonzalo Ramos,Jina Suh,Johan Verwey,Mo Wang,John Wernsing

DOI: https://doi.org/10.48550/arXiv.1707.06742

2017-08-11

Abstract:The current processes for building machine learning systems require practitioners with deep knowledge of machine learning. This significantly limits the number of machine learning systems that can be created and has led to a mismatch between the demand for machine learning systems and the ability for organizations to build them. We believe that in order to meet this growing demand for machine learning systems we must significantly increase the number of individuals that can teach machines. We postulate that we can achieve this goal by making the process of teaching machines easy, fast and above all, universally accessible. While machine learning focuses on creating new algorithms and improving the accuracy of "learners", the machine teaching discipline focuses on the efficacy of the "teachers". Machine teaching as a discipline is a paradigm shift that follows and extends principles of software engineering and programming languages. We put a strong emphasis on the teacher and the teacher's interaction with data, as well as crucial components such as techniques and design principles of interaction and visualization. In this paper, we present our position regarding the discipline of machine teaching and articulate fundamental machine teaching principles. We also describe how, by decoupling knowledge about machine learning algorithms from the process of teaching, we can accelerate innovation and empower millions of new uses for machine learning models.

Machine Learning,Artificial Intelligence,Human-Computer Interaction,Software Engineering
AI, Meet Human: Learning Paradigms for Hybrid Decision Making Systems

Clara Punzi, Roberto Pellungrini, Mattia Setzu, Fosca Giannotti, Dino Pedreschi

2024-02-10

Abstract:Everyday we increasingly rely on machine learning models to automate and support high-stake tasks and decisions. This growing presence means that humans are now constantly interacting with machine learning-based systems, training and using models everyday. Several different techniques in computer science literature account for the human interaction with machine learning systems, but their classification is sparse and the goals varied. This survey proposes a taxonomy of Hybrid Decision Making Systems, providing both a conceptual and technical framework for understanding how current computer science literature models interaction between humans and machines.

Machine Learning,Human-Computer Interaction,Artificial Intelligence
Machine Teaching by Domain Experts: Towards More Humane,Inclusive, and Intelligent Machine Learning Systems

Claudio Pinhanez

DOI: https://doi.org/10.48550/arXiv.1908.08931

2019-08-20

Abstract:This paper argues that a possible way to escape from the limitations of current machine learning (ML) systems is to allow their development directly by domain experts without the mediation of ML experts. This could be accomplished by making ML systems interactively teachable using concepts, definitions, and similar high level knowledge constructs. Pointing to the recent advances in machine teaching technology, we list key technical challenges specific for such expert-centric ML systems, and suggest that they are more humane and possibly more intelligent than traditional ML systems in many domains. We then argue that ML systems could also benefit greatly from being built by a community of experts as much as open source software did, creating more inclusive systems, in terms of enabling different points-of-view about the same corpus of knowledge. Advantages of the community approach over current ways to build ML systems, as well as specific challenges this approach raises, are also discussed in the paper.

Computers and Society,Human-Computer Interaction
Machine Learning and Deep Learning: Open Issues and Future Research Directions for the Next 10 Years

Akshara Pramod,Harsh Sankar Naicker,Amit Kumar Tyagi

DOI: https://doi.org/10.1002/9781119785750.ch18

2021-07-28

Abstract:With the development in technology, many other technologies like machine learning (ML), deep learning, blockchain technology, Internet of Things, and quantum computing have taken place in this current era. These technologies are helping human being to live their life comfortably and without any hurdle. Today, technology is helping human and protecting nature with minimum waste of available/limited resources. Among these inventions, ML and deep learning are two unique inventions which have attract many researchers or computer science researchers (or many research communities) to solve complex problems through ML. Today, ML use has been moved in many sectors to increase productivity of businesses; for example, for retail/marketing purpose, churn prediction of customers, for e‐healthcare, and detecting disease in early stages. These are the few examples where ML is used in this current smart era. Together, this deep learning also has increased its importance over ML in many applications like bio‐informatics, health informatics, identification of images or handwritten languages, and audio recognition. Many researchers get problematic scenario when they are not sure about particular use of machine and deep learning. This work fulfil such conditions/requirements and provide a complete details about ML and deep learning, i.e., with its evolution to forefront use, to use in many applications, to benefiting to the society, and to challenges and potential limitation in the respective learning techniques.
Considerations upon the Machine Learning Technologies

Alin Munteanu,Cristina Ofelia Sofran

DOI: https://doi.org/10.48550/arXiv.0904.3667

IF: 5.414

2009-04-23

Machine Learning

Abstract:Artificial intelligence offers superior techniques and methods by which problems from diverse domains may find an optimal solution. The Machine Learning technologies refer to the domain of artificial intelligence aiming to develop the techniques allowing the computers to "learn". Some systems based on Machine Learning technologies tend to eliminate the necessity of the human intelligence while the others adopt a man-machine collaborative approach.
Machine learning's own Industrial Revolution

Yuan Luo,Song Han,Jingjing Liu

2023-11-04

Abstract:Machine learning is expected to enable the next Industrial Revolution. However, lacking standardized and automated assembly networks, ML faces significant challenges to meet ever-growing enterprise demands and empower broad industries. In the Perspective, we argue that ML needs to first complete its own Industrial Revolution, elaborate on how to best achieve its goals, and discuss new opportunities to enable rapid translation from ML's innovation frontier to mass production and utilization.

Machine Learning
Position Paper: Towards Transparent Machine Learning

Dustin Juliano

DOI: https://doi.org/10.48550/arXiv.1911.06612

IF: 5.414

2019-11-12

Machine Learning

Abstract:Transparent machine learning is introduced as an alternative form of machine learning, where both the model and the learning system are represented in source code form. The goal of this project is to enable direct human understanding of machine learning models, giving us the ability to learn, verify, and refine them as programs. If solved, this technology could represent a best-case scenario for the safety and security of AI systems going forward.
Reflections on the future of machine learning for materials research

Naohiro Fujinuma,Brian L. DeCost,Jason Hattrick-Simpers,Samuel E. Lofland

DOI: https://doi.org/10.48550/arXiv.2112.09764

2021-12-18

Abstract:Applied machine learning (ML) has rapidly spread throughout the physical sciences; in fact, ML-based data analysis and experimental decision-making has become commonplace. We suggest a shift in the conversation from proving that ML can be used to evaluating how to equitably and effectively implement ML for <a class="link-external link-http" href="http://science.We" rel="external noopener nofollow">this http URL</a> advocate a shift from a "more data, more compute" mentality to a model-oriented approach that prioritizes using machine learning to support the ecosystem of computational models and experimental <a class="link-external link-http" href="http://measurements.We" rel="external noopener nofollow">this http URL</a> also recommend an open conversation about dataset bias to stabilize productive research through careful model interrogation and deliberate exploitation of known biases. Further, we encourage the community to develop ML methods that connect experiments with theoretical models to increase scientific understanding rather than incrementally optimizing materials. Moreover we envision a future of radical materials innovations enabled by computational creativity tools combined with online visualization and analysis tools that support active outside-the-box thinking inside the scientific knowledge feedback loop. Finally, as a community we must acknowledge ethical issues that can arise from blindly following machine learning predictions and the issues of social equity that will arise if data, code, and computational resources are not readily available to all.

Materials Science
Machine Learning with Requirements: a Manifesto

Eleonora Giunchiglia,Fergus Imrie,Mihaela van der Schaar,Thomas Lukasiewicz

2024-02-03

Abstract:In the recent years, machine learning has made great advancements that have been at the root of many breakthroughs in different application domains. However, it is still an open issue how make them applicable to high-stakes or safety-critical application domains, as they can often be brittle and unreliable. In this paper, we argue that requirements definition and satisfaction can go a long way to make machine learning models even more fitting to the real world, especially in critical domains. To this end, we present two problems in which (i) requirements arise naturally, (ii) machine learning models are or can be fruitfully deployed, and (iii) neglecting the requirements can have dramatic consequences. We show how the requirements specification can be fruitfully integrated into the standard machine learning development pipeline, proposing a novel pyramid development process in which requirements definition may impact all the subsequent phases in the pipeline, and viceversa.

Machine Learning,Artificial Intelligence,Software Engineering
A category theory approach to the semiotics of machine learning

Gangle, Rocco,Caterina, Gianluca

DOI: https://doi.org/10.1007/s10472-024-09932-y

IF: 1.019

2024-02-10

Annals of Mathematics and Artificial Intelligence

Abstract:The successes of Machine Learning, and in particular of Deep Learning systems, have led to a reformulation of the Artificial Intelligence agenda. One of the pressing issues in the field is the extraction of knowledge out of the behavior of those systems. In this paper we propose a semiotic analysis of that behavior, based on the formal model of learners . We analyze the topos-theoretic properties that ensure the logical expressivity of the knowledge embodied by learners. Furthermore, we show that there exists an ideal universal learner , able to interpret the knowledge gained about any possible function as well as about itself, which can be monotonically approximated by networks of increasing size.

computer science, artificial intelligence,mathematics, applied
The Challenges of Machine Learning: A Critical Review

Enrico Barbierato,Alice Gatti

DOI: https://doi.org/10.3390/electronics13020416

IF: 2.9

2024-01-20

Electronics

Abstract:The concept of learning has multiple interpretations, ranging from acquiring knowledge or skills to constructing meaning and social development. Machine Learning (ML) is considered a branch of Artificial Intelligence (AI) and develops algorithms that can learn from data and generalize their judgment to new observations by exploiting primarily statistical methods. The new millennium has seen the proliferation of Artificial Neural Networks (ANNs), a formalism able to reach extraordinary achievements in complex problems such as computer vision and natural language recognition. In particular, designers claim that this formalism has a strong resemblance to the way the biological neurons operate. This work argues that although ML has a mathematical/statistical foundation, it cannot be strictly regarded as a science, at least from a methodological perspective. The main reason is that ML algorithms have notable prediction power although they cannot necessarily provide a causal explanation about the achieved predictions. For example, an ANN could be trained on a large dataset of consumer financial information to predict creditworthiness. The model takes into account various factors like income, credit history, debt, spending patterns, and more. It then outputs a credit score or a decision on credit approval. However, the complex and multi-layered nature of the neural network makes it almost impossible to understand which specific factors or combinations of factors the model is using to arrive at its decision. This lack of transparency can be problematic, especially if the model denies credit and the applicant wants to know the specific reasons for the denial. The model's "black box" nature means it cannot provide a clear explanation or breakdown of how it weighed the various factors in its decision-making process. Secondly, this work rejects the belief that a machine can simply learn from data, either in supervised or unsupervised mode, just by applying statistical methods. The process of learning is much more complex, as it requires the full comprehension of a learned ability or skill. In this sense, further ML advancements, such as reinforcement learning and imitation learning denote encouraging similarities to similar cognitive skills used in human learning.

engineering, electrical & electronic,computer science, information systems,physics, applied
Machine learning: Trends, perspectives, and prospects

M I Jordan,T M Mitchell,M. I. Jordan,T. M. Mitchell

DOI: https://doi.org/10.1126/science.aaa8415

IF: 56.9

2015-07-17

Science

Abstract:Machine learning addresses the question of how to build computers that improve automatically through experience. It is one of today’s most rapidly growing technical fields, lying at the intersection of computer science and statistics, and at the core of artificial intelligence and data science. Recent progress in machine learning has been driven both by the development of new learning algorithms and theory and by the ongoing explosion in the availability of online data and low-cost computation. The adoption of data-intensive machine-learning methods can be found throughout science, technology and commerce, leading to more evidence-based decision-making across many walks of life, including health care, manufacturing, education, financial modeling, policing, and marketing.

multidisciplinary sciences

Declarative machine learning systems

Declarative Machine Learning - A Classification of Basic Properties and Types

A Declarative Query Language for Scientific Machine Learning

Machine Learning and the Future of Realism

SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle

Declarative Integration and Management of Large Language Models through Finite Automata: Application to Automation, Communication, and Ethics

Computer Systems Have 99 Problems, Let's Not Make Machine Learning Another One

(Machine) Learning to Be Like Thee? For Algorithm Education, Not Training

Formal Semantics and High Performance in Declarative Machine Learning Using Datalog

Machine Teaching: A New Paradigm for Building Machine Learning Systems

AI, Meet Human: Learning Paradigms for Hybrid Decision Making Systems

Machine Teaching by Domain Experts: Towards More Humane,Inclusive, and Intelligent Machine Learning Systems

Machine Learning and Deep Learning: Open Issues and Future Research Directions for the Next 10 Years

Considerations upon the Machine Learning Technologies

Machine learning's own Industrial Revolution

Position Paper: Towards Transparent Machine Learning

Reflections on the future of machine learning for materials research

Machine Learning with Requirements: a Manifesto

A category theory approach to the semiotics of machine learning

The Challenges of Machine Learning: A Critical Review

Machine learning: Trends, perspectives, and prospects