Abstract:In recent times, an increasing number of researchers have been devoted to utilizing deep neural networks for end-to-end flight navigation. This approach has gained traction due to its ability to bridge the gap between perception and planning that exists in traditional methods, thereby eliminating delays between modules. However, the practice of replacing original modules with neural networks in a black-box manner diminishes the overall system's robustness and stability. It lacks principled explanations and often fails to consistently generate high-quality motion trajectories. Furthermore, such methods often struggle to rigorously account for the robot's kinematic constraints, resulting in the generation of trajectories that cannot be executed satisfactorily. In this work, we combine the advantages of traditional methods and neural networks by proposing an optimization-embedded neural network. This network can learn high-quality trajectories directly from visual inputs without the need of mapping, while ensuring dynamic feasibility. Here, the deep neural network is employed to directly extract environment safety regions from depth images. Subsequently, we employ a model-based approach to represent these regions as safety constraints in trajectory optimization. Leveraging the availability of highly efficient optimization algorithms, our method robustly converges to feasible and optimal solutions that satisfy various user-defined constraints. Moreover, we differentiate the optimization process, allowing it to be trained as a layer within the neural network. This approach facilitates the direct interaction between perception and planning, enabling the network to focus more on the spatial regions where optimal solutions exist. As a result, it further enhances the quality and stability of the generated trajectories.

A time-dependent symplectic network for non-convex path planning problems with linear and nonlinear dynamics

SympOCnet: Solving optimal control problems with applications to high-dimensional multi-agent path planning problems

Efficient Optimization-Based Trajectory Planning for Unmanned Systems in Confined Environments

Trajectory Optimization with Complex Obstacle Avoidance Constraints Via Homotopy Network Sequential Convex Programming

A discrete-time neural network for optimization problems with hybrid constraints.

SympNets: Intrinsic structure-preserving symplectic networks for identifying Hamiltonian systems

Dynamically Constrained Motion Planning Networks for Non-Holonomic Robots

A Neurodynamic Approach for Solving Time-Dependent Nonlinear Equation System: A Distributed Optimization Perspective

Symplectic Neural Networks Based on Dynamical Systems

A Collective Neurodynamic System for Distributed Optimization with Applications in Model Predictive Control.

Partially Observable Planning and Learning for Systems with Non-Uniform Dynamics

Symplectic ODE-Net: Learning Hamiltonian Dynamics with Control

Convex Temporal Convolutional Network-Based Distributed Cooperative Learning Control for Multiagent Systems

Model-Based Control with Sparse Neural Dynamics

A Neurodynamic Approach to Nonsmooth Constrained Pseudoconvex Optimization Problem

A novel neural dynamical approach to convex quadratic program and its efficient applications.

Homotopy Method for Optimal Motion Planning With Homotopy Class Constraints

Real-time robot path planning based on a modified pulse-coupled neural network model.

Exploiting Group Symmetries to Improve Precision in Kinodynamic and Nonholonomic Planning

Learning to Plan Maneuverable and Agile Flight Trajectory with Optimization Embedded Networks

Adaptive Finite-Time Neural Network Control of Nonlinear Systems With Multiple Objective Constraints and Application to Electromechanical System