Abstract:With the rise of various smart electronics and mobile/edge devices, many existing high-accuracy convolutional neural network (CNN) models are difficult to be applied in practice due to the limited resources, such as memory capacity, power consumption, and spectral efficiency. In order to meet these constraints, researchers have carefully designed some lightweight networks. Meanwhile, to reduce the reliance on manual design on expert experience, some researchers also work to improve neural architecture search (NAS) algorithms to automatically design small networks, exploiting the multiobjective approaches that consider both accuracy and other important goals during optimization. However, simply searching for smaller network models is not consistent with the current research belief of “the deeper the better” and may affect the effectiveness of the model and thus waste the limited resources available. In this article, we propose an automatic method for designing CNNs architectures under constraint handling, which can search for optimal network models meeting the preset constraint. Specifically, an adaptive penalty algorithm is used for fitness evaluation, and a selective repair operation is developed for infeasible individuals to search for feasible CNN architectures. As a case study, we set the complexity (the number of parameters) as a resource constraint and perform multiple experiments on CIFAR-10 and CIFAR-100, to demonstrate the effectiveness of the proposed method. In addition, the proposed algorithm is compared with a state-of-the-art algorithm, NSGA-Net, and several manual-designed models. The experimental results show that the proposed algorithm can successfully solve the problem of the uncertain size of the optimal CNN model under the random search strategy, and the automatically designed CNN model can satisfy the predefined resource constraint while achieving better accuracy.

Automatic Robust Designs of Template Parameters for a Type of Uncoupled Cellular Neural Networks

Robust Designs of Selected Objects Extraction Cnn

Small Object Remover Cnn And Robustness Designs

Edge Detection of Noisy Images Based on Cellular Neural Networks

A New Approach for Edge Detection of Noisy Image Based on Cnn

Tabu search for CNN template learning

Open-close by reconstruction on CNNUM

The Application of SA-PSO to CNN Edge Detection Template Design

Automated CNN Architectural Design: A Simple and Efficient Methodology for Computer Vision Tasks

Automatically Designing CNN Architectures Using the Genetic Algorithm for Image Classification

Automatic Design of Convolutional Neural Network Architectures under Resource Constraints.

Automatically designing CNN architectures using genetic algorithm for image classification

RCDN -- Robust X-Corner Detection Algorithm based on Advanced CNN Model

Bottom-up and Top-Down: Bidirectional Additive Net for Edge Detection

Image Target Recognition Based on Improved Convolutional Neural Network

Soft Prototyping Camera Designs for Car Detection Based on a Convolutional Neural Network

General Design Approach to Unit-Linking PCNN for Image Processing

Application of new advanced CNN structure with adaptive thresholds to color edge detection

A Visual Cortex-Attentive Deep Convolutional Neural Network for Digital Image Design

A New Method of PCNN's Parameter's Optimization

Bio-inspired interactive feedback neural networks for edge detection