Abstract:Blockchain is an essentially distributed database recording all transactions or digital events among participating parties. Each transaction in the records is approved and verified by consensus of the participants in the system that requires solving a hard mathematical puzzle, which is known as proof-of-work. To make the approved records immutable, the mathematical puzzle is not trivial to solve and therefore consumes substantial computing resources. However, it is energy-wasteful to have many computational nodes installed in the blockchain competing to approve the records by just solving a meaningless puzzle. Here, we pose proof-of-work as a reinforcement-learning problem by modeling the blockchain growing as a Markov decision process, in which a learning agent makes an optimal decision over the environment's state, whereas a new block is added and verified. Specifically, we design the block verification and consensus mechanism as a deep reinforcement-learning iteration process. As a result, our method utilizes the determination of state transition and the randomness of action selection of a Markov decision process, as well as the computational complexity of a deep neural network, collectively to make the blocks not easy to recompute and to preserve the order of transactions, while the blockchain nodes are exploited to train the same deep neural network with different data samples (state-action pairs) in parallel, allowing the model to experience multiple episodes across computing nodes but at one time. Our method is used to design the next generation of public blockchain networks, which has the potential not only to spare computational resources for industrial applications but also to encourage data sharing and AI model design for common problems.

Optimizing Governed Blockchains for Financial Process Authentications

On Replacing Cryptopuzzles with Useful Computation in Blockchain Proof-of-Work Protocols

A Dual-functional Blockchain Framework for Solving Distributed Optimization

Adapting Blockchain Technology for Scientific Computing

A Difficulty in Controlling Blockchain Mining Costs via Cryptopuzzle Difficulty

Incentive-based integration of useful work into blockchains

Permissionless Refereed Tournaments

A blockchain consensus mechanism that uses Proof of Solution to optimize energy dispatch and trading

Blockchain Framework for Artificial Intelligence Computation

Resilient Consensus Sustained Collaboratively

Fully Automated Selfish Mining Analysis in Efficient Proof Systems Blockchains

A Proof of Useful Work for Artificial Intelligence on the Blockchain

Blockchain using Proof-of-Interaction

Towards a low carbon proof-of-work blockchain

PRAGTHOS:Practical Game Theoretically Secure Proof-of-Work Blockchain

Game Dilemma Analysis and Optimization of PoW Consensus Algorithm

Reward Mechanism for Blockchains Using Evolutionary Game Theory

Efficient MDP Analysis for Selfish-Mining in Blockchains

Towards a model for comprehending and reasoning about PoW-based blockchain network sustainability.

DECENT-BRM: Decentralization through Block Reward Mechanisms

Committee-Based Blockchains as Games between Opportunistic Players and Adversaries