Factor Machine: Mixed-signal Architecture for Fine-Grained Graph-Based Computing

Piotr Dudek
2024-02-19
Abstract:This paper proposes the design and implementation strategy of a novel computing architecture, the Factor Machine. The work is a step towards a general-purpose parallel system operating in a non-sequential manner, exploiting processing/memory co-integration and replacing the traditional Turing/von Neumann model of a computer system with a framework based on "factorised computation". This architecture is inspired by neural information processing principles and aims to progress the development of brain-like machine intelligence systems, through providing a computing substrate designed from the ground up to enable efficient implementations of algorithms based on relational networks. The paper provides a rationale for such machine, in the context of the history of computing, and more recent developments in neuromorphic hardware, reviews its general features, and proposes a mixed-signal hardware implementation, based on using analogue circuits to carry out computation and localised and sparse communication between the compute units.
Hardware Architecture
What problem does this paper attempt to address?
The paper aims to address the limitations of traditional computer architectures (such as the von Neumann architecture) in terms of parallel processing and energy efficiency. Specifically, the paper proposes a novel computing architecture—the Factor Machine—to overcome the "von Neumann bottleneck" in existing architectures, which refers to the communication delay and energy consumption between the processor and memory. By adopting a new framework based on "factorized computing," this architecture aims to achieve a non-sequential, distributed large-scale parallel system. **The main objectives include:** 1. **Replacing traditional computing models**: Proposing a computing framework different from the Turing machine model to provide general parallel computing capabilities and be applicable to a wide range of problem types. 2. **Improving energy efficiency and performance**: By integrating processing and memory in the same physical location, reducing the delay and energy consumption of data transmission, thereby improving the overall system's energy efficiency and performance. 3. **Building brain-like intelligent systems**: Designing a computational substrate that can efficiently implement algorithms based on relational networks, further advancing the development of brain-like machine intelligence systems. 4. **Exploring new hardware implementation methods**: Proposing a mixed-signal hardware implementation scheme, utilizing analog circuits for computation, and investigating its potential advantages in speed and energy efficiency. Through these efforts, the paper hopes to provide a new design approach and development direction for future high-performance computing systems, especially those that implement artificial intelligence functions.