Abstract:Deep neural networks achieve remarkable performance in many computer vision tasks. Most state-of-the-art (SOTA) semantic segmentation and object detection approaches reuse neural network architectures designed for image classification as the backbone, commonly pre-trained on ImageNet. However, performance gains can be achieved by designing network architectures specifically for detection and segmentation, as shown by recent neural architecture search (NAS) research for detection and segmentation. One major challenge though is that ImageNet pre-training of the search space representation (a.k.a. super network) or the searched networks incurs huge computational cost. In this paper, we propose a Fast Network Adaptation (FNA++) method, which can adapt both the architecture and parameters of a seed network (e.g., an ImageNet pre-trained network) to become a network with different depths, widths, or kernel sizes via a parameter remapping technique, making it possible to use NAS for segmentation and detection tasks a lot more efficiently. In our experiments, we apply FNA++ on MobileNetV2 to obtain new networks for semantic segmentation, object detection, and human pose estimation that clearly outperform existing networks designed both manually and by NAS. We also implement FNA++ on ResNets and NAS networks, which demonstrates a great generalization ability. The total computation cost of FNA++ is significantly less than SOTA segmentation and detection NAS approaches: 1737× less than DPC, 6.8× less than Auto-DeepLab, and 8.0× less than DetNAS. A series of ablation studies are performed to demonstrate the effectiveness, and detailed analysis is provided for more insights into the working mechanism. Codes are available at https://github.com/JaminFong/FNA.

Fanre: A Fast Adaptive Neural Regression Estimator

Feature-Level Attentive Neural Model for Session-Based Recommendation

FANNC: A Fast Adaptive Neural Network Classifier

Sparse Bayesian Approach to Fast Learning Network for Multiclassification.

FAN: Fourier Analysis Networks

Fast Perfekt: Regression-based refinement of fast simulation

Fast Neighborhood Reconstruction with Adaptive Weights Learning

Fuzzy RBF Neural Network Based Function Approximation

Online Adaptive Passive-Aggressive Methods for Non-Negative Matrix Factorization and Its Applications

A Fast Learning Algorithm of Neural Networks by Changing Error Functions

Research of field theory based adaptive resonance neural network

Fast Learning Algorithms for Feedforward Neural Networks

A Fast Learning Algorithm of Feedforward Neural Networks by Using Novel Error Functions

Factor Augmented Sparse Throughput Deep ReLU Neural Networks for High Dimensional Regression

Frequency Adaptive Normalization For Non-stationary Time Series Forecasting

Fast Approximate L_infty Minimization: Speeding Up Robust Regression

A Novel Neural Network Training Framework with Data Assimilation

FNA++: Fast Network Adaptation via Parameter Remapping and Architecture Search

A Fast Feedforward Small-World Neural Network for Nonlinear System Modeling

Finite Difference Neural Networks: Fast Prediction of Partial Differential Equations

Optimal parameters selection of back propagation algorithm in the feedforward neural network