Abstract:Convolutional neural networks (CNNs) have been widely used for object recognition and grasping posture planning in intelligent robotic grasping (IRG). Compared with the traditional usage of CNNs in image recognition, IRGs require high recognition accuracy and computational efficiency. However, the existing methodologies for CNN architecture design often rely on human experience and numerous trial-and-error attempts, which make it a very challenging task to obtain an optimal CNN for IRGs. To tackle this challenge, this paper develops a new differentiable architecture search (DARTS) method considering the floating-point operations (FLOPs) of CNNs, named the DARTS-F method, which converts the discrete CNN architecture search to a gradient-based continuous optimization problem and considers both the prediction accuracy and the computational cost of the CNN during the optimization. To efficiently identify the optimal neural network, this paper adopts a bilevel optimization, which first trains the neural network weights in the inner level and then optimizes the neural network architecture by fine-tuning the operational variables in the outer level. In addition, a new digital twin (DT) of IRG is developed considering the physics of realistic robotic grasping in the DT’s virtual space, which could not only improve the IRG accuracy but also avoid the expensive training time. In the experiments, the proposed DARTS-F method could generate an optimized CNN with higher prediction accuracy and lower FLOPs than those obtained by the original DARTS method. The DT framework improves the accuracy of real robotic grasping from 61 to 71%.

Tree-Structure CNN for Automated Theorem Proving

DT-Solver: Automated Theorem Proving with Dynamic-Tree Sampling Guided by Proof-level Value Function

Automated Theorem Proving in Intuitionistic Propositional Logic by Deep Reinforcement Learning

Dynamic Compositional Neural Networks over Tree Structure

A new differentiable architecture search method for optimizing convolutional neural networks in the digital twin of intelligent robotic grasping

Improving Graph Neural Network Representations of Logical Formulae with Subgraph Pooling

TreeNet: Learning Sentence Representations with Unconstrained Tree Structure.

Attention-driven tree-structured convolutional LSTM for high dimensional data understanding

Convolutional Neural Networks over Tree Structures for Programming Language Processing

Absorption of buccal morphine

Reasoning with trees: interpreting CNNs using hierarchies

Tree-CNN: A Hierarchical Deep Convolutional Neural Network for Incremental Learning

Learning Program Representations with a Tree-Structured Transformer

A Goal-Driven Tree-Structured Neural Model for Math Word Problems

Learning to Compose Dynamic Tree Structures for Visual Contexts

Embedding Syntactic Tree Structures into CNN Architecture for Relation Classification.

Graph Representations for Higher-Order Logic and Theorem Proving

Modular Tree Network for Source Code Representation Learning

Structure Learning of Deep Networks via DNA Computing Algorithm

Graph-to-Tree Neural Networks for Learning Structured Input-Output Translation with Applications to Semantic Parsing and Math Word Problem.

A Survey on Deep Learning for Theorem Proving