opML: Optimistic Machine Learning on Blockchain

KD Conway,Cathie So,Xiaohang Yu,Kartin Wong

2024-02-05

Abstract:The integration of machine learning with blockchain technology has witnessed increasing interest, driven by the vision of decentralized, secure, and transparent AI services. In this context, we introduce opML (Optimistic Machine Learning on chain), an innovative approach that empowers blockchain systems to conduct AI model inference. opML lies a interactive fraud proof protocol, reminiscent of the optimistic rollup systems. This mechanism ensures decentralized and verifiable consensus for ML services, enhancing trust and transparency. Unlike zkML (Zero-Knowledge Machine Learning), opML offers cost-efficient and highly efficient ML services, with minimal participation requirements. Remarkably, opML enables the execution of extensive language models, such as 7B-LLaMA, on standard PCs without GPUs, significantly expanding accessibility. By combining the capabilities of blockchain and AI through opML, we embark on a transformative journey toward accessible, secure, and efficient on-chain machine learning.

Cryptography and Security

What problem does this paper attempt to address?

The problem addressed in this paper is how to achieve efficient, low-cost, and trustworthy machine learning services on the blockchain, while overcoming the high cost and inefficiency issues of existing methods such as zkML when dealing with large-scale models.

The paper introduces an innovative approach called opML (Optimistic Machine Learning on Blockchain) that utilizes fraud-proof protocols instead of zero-knowledge proofs to ensure the correctness of machine learning inference on the blockchain. Compared to zkML, opML can run on standard PCs without the need for GPUs when executing large language models like 7B-LLaMA, reducing hardware requirements and improving accessibility. opML reduces computational burden through interactive fraud-proof protocols, enabling fast and cost-effective machine learning services on the chain. This enhances efficiency and scalability while ensuring security and transparency.