Abstract:Robots and intelligent systems that sense or interact with the world are increasingly being used to automate a wide array of tasks. The ability of these systems to complete these tasks depends on a large range of technologies such as the mechanical and electrical parts that make up the physical body of the robot and its sensors, perception algorithms to perceive the environment, and planning and control algorithms to produce meaningful actions. Therefore, it is often necessary to consider the interactions between these components when designing an embodied system. This thesis explores work on the task-driven co-optimization of robotics systems in an end-to-end manner, simultaneously optimizing the physical components of the system with inference or control algorithms directly for task performance. We start by considering the problem of optimizing a beacon-based localization system directly for localization accuracy. Designing such a system involves placing beacons throughout the environment and inferring location from sensor readings. In our work, we develop a deep learning approach to optimize both beacon placement and location inference directly for localization accuracy. We then turn our attention to the related problem of task-driven optimization of robots and their controllers. In our work, we start by proposing a data-efficient algorithm based on multi-task reinforcement learning. Our approach efficiently optimizes both physical design and control parameters directly for task performance by leveraging a design-conditioned controller capable of generalizing over the space of physical designs. We then follow this up with an extension to allow for the optimization over discrete morphological parameters such as the number and configuration of limbs. Finally, we conclude by exploring the fabrication and deployment of optimized soft robots.

Investigating Premature Convergence in Co-optimization of Morphology and Control in Evolved Virtual Soft Robots

Scalable Co-Optimization of Morphology and Control in Embodied Machines

Modular Controllers Facilitate the Co-Optimization of Morphology and Control in Soft Robots

C^2:Co-design of Robots via Concurrent Networks Coupling Online and Offline Reinforcement Learning

C2: Co-design of Robots Via Concurrent-Network Coupling Online and Offline Reinforcement Learning

Deep Reinforcement Learning Based Co-Optimization of Morphology and Gait for Small-Scale Legged Robot

Simultaneous Optimization of Discrete and Continuous Parameters Defining a Robot Morphology and Controller

An Investigation of the Factors Influencing Evolutionary Dynamics in the Joint Evolution of Robot Body and Control

Evaluation of Frameworks That Combine Evolution and Learning to Design Robots in Complex Morphological Spaces

A Morphological Transfer-Based Multi-Fidelity Evolutionary Algorithm for Soft Robot Design

The dynamic of body and brain co-evolution

Soft Robots Learn to Crawl: Jointly Optimizing Design and Control with Sim-to-Real Transfer

Brains, Bodies, and Beyond: Competitive Co-Evolution of Robot Controllers, Morphologies and Environments

Environmental Adaptation of Robot Morphology and Control Through Real-World Evolution

On Designing a Learning Robot: Improving Morphology for Enhanced Task Performance and Learning

The Role of Morphological Variation in Evolutionary Robotics: Maximizing Performance and Robustness

No-brainer: Morphological Computation driven Adaptive Behavior in Soft Robots

Competitive Co-evolution of Predator and Prey Sensory-Motor Systems

Neural Approaches to Co-Optimization in Robotics

Computational co-design of structure and feedback controller for locomoting soft robots

Evolution and learning in differentiable robots