Abstract:Robotics applications have hard time constraints and heavy computational burdens that can greatly benefit from domain-specific hardware accelerators. For the latency-critical problem of robot motion planning and control, there exists a performance gap of at least an order of magnitude between joint actuator response rates and state-of-the-art software solutions. Hardware acceleration can close this gap, but it is essential to define automated hardware design flows to keep the design process agile as applications and robot platforms evolve. To address this challenge, we introduce robomorphic computing: a methodology to transform robot morphology into a customized hardware accelerator morphology. We (i) present this design methodology, using robot topology and structure to exploit parallelism and matrix sparsity patterns in accelerator hardware; (ii) use the methodology to generate a parameterized accelerator design for the gradient of rigid body dynamics, a key kernel in motion planning; (iii) evaluate FPGA and synthesized ASIC implementations of this accelerator for an industrial manipulator robot; and (iv) describe how the design can be automatically customized for other robot models. Our FPGA accelerator achieves speedups of 8× and 86× over CPU and GPU when executing a single dynamics gradient computation. It maintains speedups of 1.9× to 2.9× over CPU and GPU, including computation and I/O round-trip latency, when deployed as a coprocessor to a host CPU for processing multiple dynamics gradient computations. ASIC synthesis indicates an additional 7.2× speedup for single computation latency. We describe how this principled approach generalizes to more complex robot platforms, such as quadrupeds and humanoids, as well as to other computational kernels in robotics, outlining a path forward for future robomorphic computing accelerators.

An Energy Efficient and Runtime Reconfigurable Accelerator for Robotic Localization

Eudoxus: Characterizing and Accelerating Localization in Autonomous Machines Industry Track Paper

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

An FPGA Based Energy Efficient DS-SLAM Accelerator for Mobile Robots in Dynamic Environment

Hardware Acceleration for SLAM in Mobile Systems

A Reconfigurable Visual-Inertial Odometry Accelerated Core with High Area and Energy Efficiency for Autonomous Mobile Robots

A Survey of FPGA-Based Robotic Computing

Efficient Hardware Accelerator Design of Non-Linear Optimization Correlative Scan Matching Algorithm in 2D LiDAR SLAM for Mobile Robots

An FPGA Acceleration and Optimization Techniques for 2D LiDAR SLAM Algorithm

RobotCore: An Open Architecture for Hardware Acceleration in ROS 2

Automatic generation of efficient accelerators for reconfigurable hardware

Real-Time Visual Inertial Odometry with a Resource-Efficient Harris Corner Detection Accelerator on FPGA Platform

ROPY-SLAM: a Heterogeneous CPU-FPGA System for Simultaneous Localization and Mapping

Design Space Exploration of Embedded SoC Architectures for Real-Time Optimal Control

Robomorphic computing: a design methodology for domain-specific accelerators parameterized by robot morphology

An FPGA-based Real-Time Simultaneous Localization and Mapping System.

Automatic Nested Loop Acceleration on FPGAs Using Soft CGRA Overlay

Design and Application Space Exploration of a Domain-Specific Accelerator System

Flexible Updating of Internet of Things Computing Functions through Optimizing Dynamic Partial Reconfiguration