Abstract:Deep learning methods, especially deep convolutional neural networks (DCNNs), have been widely used in high-resolution remote sensing image (HRSI) semantic segmentation. In literature, most successful DCNNs are artificially designed through a large number of experiments, which often consume lots of time and depend on rich domain knowledge. Recently, neural architecture search (NAS), as a direction for automatically designing network architectures, has achieved great success in different kinds of computer vision tasks. For HRSI semantic segmentation, NAS faces two major challenges: (1) The task's high complexity degree, which is caused by the pixel-by-pixel prediction demand in semantic segmentation, leads to a rapid expansion of the search space; (2) HRSI semantic segmentation often needs to exploit long-range dependency (i.e., a large spatial context), which means the NAS technique requires a lot of display memory in the optimization process and can be tough to converge. With the aforementioned considerations in mind, we propose a new decoupling NAS (DNAS) framework to automatically design the network architecture for HRSI semantic segmentation. In DNAS, a hierarchical search space with three levels is recommended: path-level, connection-level, and cell-level. To adapt to this hierarchical search space, we devised a new decoupling search optimization strategy to decrease the memory occupation. More specifically, the search optimization strategy consists of three stages: (1) a light super-net (i.e., the specific search space) in the path-level space is trained to get the optimal path coding; (2) we endowed the optimal path with various cross-layer connections and it is trained to obtain the connection coding; (3) the super-net, which is initialized by path coding and connection coding, is populated with kinds of concrete cell operators and the optimal cell operators are finally determined. It is worth noting that the well-designed search space can cover various network candidates and the optimization process can be done efficiently. Extensive experiments on the publicly open GID and FU datasets showed that our DNAS outperformed the state-of-the-art methods, including artificial networks and NAS methods.

Hierarchical Memory-Constrained Operator Scheduling of Neural Architecture Search Networks

A Hierarchical Neural Task Scheduling Algorithm in the Operating System of Neuromorphic Computers

Prioritized Architecture Sampling with Monto-Carlo Tree Search

Multi-Objective Neural Architecture Search for In-Memory Computing

Memory-aware Scheduling for Complex Wired Networks with Iterative Graph Optimization

Multi-Objective Architecture Search and Optimization for Heterogeneous Neuromorphic Architecture

Multi-objective Differentiable Neural Architecture Search

Multi-Objective Neural Architecture Search by Learning Search Space Partitions

Neural Architecture Search with In‐Memory Multiply–Accumulate and In‐Memory Rank Based on Coating Layer Optimized C‐Doped Ge2Sb2Te5 Phase Change Memory

MODULARNAS: TOWARDS MODULARIZED AND REUSABLE NEURAL ARCHITECTURE SEARCH

NAS-LID: Efficient Neural Architecture Search with Local Intrinsic Dimension

Multi-Objective Neural Architecture Search Based on Diverse Structures and Adaptive Recommendation

NeuroNAS: A Framework for Energy-Efficient Neuromorphic Compute-in-Memory Systems using Hardware-Aware Spiking Neural Architecture Search

Memory-Efficient Hierarchical Neural Architecture Search for Image Restoration

DNAS: Decoupling Neural Architecture Search for High-Resolution Remote Sensing Image Semantic Segmentation

CE-NAS: An End-to-End Carbon-Efficient Neural Architecture Search Framework

CMN: a co-designed neural architecture search for efficient computing-in-memory-based mixture-of-experts

SpikeNAS: A Fast Memory-Aware Neural Architecture Search Framework for Spiking Neural Network-based Autonomous Agents

A Survey on Computationally Efficient Neural Architecture Search

Evolutionary Search for Complete Neural Network Architectures with Partial Weight Sharing

Manas: multi-agent neural architecture search