Abstract:Cost-volume construction, a cornerstone of stereo vision processing, has been widely utilized across diverse domains such as robotics, autonomous vehicles, 3-D reconstruction, and augmented/virtual reality applications. However, this process necessitates substantial parameter sizes and continuous memory data accesses, imposing considerable demands on memory bandwidth. Computation-in-memory (CIM) emerges as a promising technology to alleviate this memory bottleneck by its ability to execute parallel computations within structured arrays. Nevertheless, the direct deployment of cost-volume construction on CIM platforms faces several challenges, including functional limitations, reduced compute margins, and structural rigidity. To overcome these obstacles, we present a novel CIM architecture, named cost-volume CIM (CV-CIM), which incorporates the following key features. First, the xor-derived logic integrates fundamental arithmetic functions and heterogeneous CIM array (CA) function together to complete requisite cost computation. Second, the pixel-wise similarity is discovered to enlarge the bit sparsity. Then, sparse-mode CIM leverages the resulting sparsity to enlarge the xor-based computing margin. Third, dual degrees of freedom peripherals collectively contribute to latency reduction through dynamic row computation skipping (row peripheral) and the overlapping of data loading and computing (column peripheral). A test chip is fabricated in 28-nm technology and operates within a voltage range of 0.6-0.9 V and a frequency range of 50-286 MHz. Notably, CV-CIM demonstrates support for L0/L1/L2 cost computations and achieves a remarkable peak energy efficiency of 1158 TOPs/W.

7.7 CV-CIM: A 28nm XOR-Derived Similarity-Aware Computation-in-Memory for Cost-Volume Construction

CV-CIM: A Hybrid Domain Xor-Derived Similarity-Aware Computation-in-Memory Supporting Cost–Volume Construction

An Overview of Computing-in-Memory Interfaces

A Low-Power In-Memory Multiplication and Accumulation Array with Modified Radix-4 Input and Canonical Signed Digit Weights

MC-CIM

MC-CIM: a reconfigurable computation-in-memory for efficient stereo matching cost computation

A Robust 8-Bit Non-Volatile Computing-in-Memory Core for Low-Power Parallel MAC Operations.

Voxel-CIM: An Efficient Compute-in-Memory Accelerator for Voxel-based Point Cloud Neural Networks

BR-CIM: an Efficient Binary Representation Computation-In-Memory Design

A 2.75-to-75.9tops/w Computing-in-Memory NN Processor Supporting Set-Associate Block-Wise Zero Skipping and Ping-Pong CIM with Simultaneous Computation and Weight Updating.

SSM-CIM: an Efficient CIM Macro Featuring Single-Step Multi-bit MAC Computation for CNN Edge Inference

Memory-Immersed Collaborative Digitization for Area-Efficient Compute-in-Memory Deep Learning

CIMQ: A Hardware-Efficient Quantization Framework for Computing-In-Memory Based Neural Network Accelerators

A 28nm 16.9-300TOPS/W Computing-in-Memory Processor Supporting Floating-Point NN Inference/Training with Intensive-CIM Sparse-Digital Architecture

7.3 A 28nm 38-to-102-tops/w 8b Multiply-Less Approximate Digital SRAM Compute-In-Memory Macro for Neural-Network Inference

GCFP-ACIM: A 40nm 4.74TFLOPS/W General Complex Float-Point Analog Compute-in-Memory with Adaptive Power-Saving for HDR Signal Processing Applications

A Configurable Computing-in-Memory Structure Based on Convolutional Neural Network

A Systolic Computing-in-Memory Array Based Accelerator with Predictive Early Activation for Spatiotemporal Convolutions

16.4 TensorCIM: A 28nm 3.7nj/gather and 8.3TFLOPS/W FP32 Digital-CIM Tensor Processor for MCM-CIM-Based Beyond-NN Acceleration

SLAM-CIM: A Visual SLAM Backend Processor with Dynamic-Range-Driven-Skipping Linear-Solving FP-CIM Macros