Abstract:Recently, Deep Neural Networks (DNNs) based methods for modern video delivery systems have been acquiring remarkable performance due to their lower bandwidth requirements and better video quality. Specifically, these methods divide a low-resolution video into chunks, train a specific super-resolution model for each chunk on the server, and then stream low-resolution video chunks and corresponding content-aware models to the clients. The client uses their computing power to run the inference of models to super-resolve the low-resolution video chunks. However, the heavy model can achieve better super-resolution quality due to its high overfitting ability, which substantially poses a challenge for client-side computation power, increasing storage and consuming more bandwidth resources for data transmission. On the other hand, although some existing lightweight networks can deploy well to resource-constrained devices, the quality of the video generated is significantly subpar. To reconcile this, we propose a Partial Convolution based padding-based Residual Feature Network (PCRFN). The main idea is to use three partial convolution based padding layers for residual local feature learning to simplify network architecture, which achieves a better trade-off between model performance and efficiency. Moreover, we also analyze the impact of different activation functions and attention mechanisms on our network, which is an excellent guideline for designing a lightweight network. Extensive experimental results show that the proposed PCRFN achieves a better trade-off against state-of-the-art methods in terms of inference times, visual quality, and model complexity. Besides, we also conducted experiments applying our network to the latest neural video delivery, achieving comparatively good video quality and faster inference times across different video lengths. Therefore, PCRFN is a more suitable and efficient super-resolution network for neural video delivery. The Code is available is at https://github.com/Wenbin-Tian/PCRFN.

WPNets and PWNets: from the Perspective of Channel Fusion.

LPNet: A Remote Sensing Scene Classification Method Based on Large Kernel Convolution and Parameter Fusion

PSDNet and DPDNet: Efficient Channel Expansion, Depthwise-Pointwise-Depthwise Inverted Bottleneck Block

A Battle of Network Structures: An Empirical Study of CNN, Transformer, and MLP

W-shaped Network: a Lightweight Network for Real-Time Infrared and Visible Image Fusion.

PWNet: an Adaptive Weight Network for the Fusion of Panchromatic and Multispectral Images.

Wavelet J-Net: A Frequency Perspective on Convolutional Neural Networks

ChannelNets: Compact and Efficient Convolutional Neural Networks via Channel-Wise Convolutions

Channel Splitting-and-Merging Connection in Neural Networks

PFNet: a Novel Part Fusion Network for Fine-Grained Visual Categorization.

PolyNet: A Pursuit of Structural Diversity in Very Deep Networks

The Heterogeneity Hypothesis: Finding Layer-Wise Differentiated Network Architectures

Point-NAS: A Novel Neural Architecture Search Framework for Point Cloud Analysis.

Pi-NAS: Improving Neural Architecture Search by Reducing Supernet Training Consistency Shift

Efficient channel expansion and pyramid depthwise-pointwise-depthwise neural networks

PANetW: PANet with wider receptive fields for object detection

LightNets: the Concept of Weakening Layers

W-Net: Convolutional neural network for segmenting remote sensing images by dual path semantics

PICNN: A Pathway towards Interpretable Convolutional Neural Networks

A Suitable and Efficient Super-Resolution Network for Neural Video Delivery

A FEATURE EMBEDDING STRATEGY FOR HIGH-LEVEL CNN REPRESENTATIONS FROM MULTIPLE CONVNETS