Abstract:Image processing-based optical flow computation has been an appalling task so far. Nowadays, convolution neural network (CNNs), a deep learning method, is broadly applied for estimating optical flow. One of the frameworks of CNNs is the U-Net architecture. This architecture is comprised of encoder-decoder framework that can be trained endways. However, its encoder component utilizes an identical image categorization technique which is common in other categorization architectures. Moreover, the decoder unit is employed to augment the spatial feature maps to full scale of intake by executing successive deconvolution. This type of architecture yields blurred flow fields owing to unpolished features and low-resolution as it is noteworthy that optical flow is pixel-level stint instead. In this article, it has been strived to find a way out for this problem. For this, two architectures, dilated convolution neural network, and channel attention mechanism are introduced inside FlowNetCorr network to estimate optical flow and training loss. In our framework, dilation convolution is deployed to attain spatial precision, and also elaborate the receptive field without requiring huge computational means, and keeps the spatial resolution of feature map unmodified, while channel attention is founded on squeeze-and-excitation architecture for image categorization, which can accommodatingly readjust channel-wise feature by applying global channel knowledge. Comprehensive experiments are executed on MPI-Sintel (Clean and Final), and KITTI (2012 and 2015) test datasets to assess the efficiency of our framework. The experimental outcome denotes that our framework has gone par in performance for MPI-Sintel (Clean and Final) datasets in terms of minimizing training loss, accuracy, and visual betterment to many unsupervised methods, e.g., USCNN, UnSupFlownet, DSTFlow, etc., and cutting-edge supervised methods, e.g., SpyNet, SpyNet+ft, CaF-Full-41c, etc. However, having degraded performance than FlowNet2, while for KITTI (2012 and 2015) datasets, our framework has also achieved better performances over many methods except from UnFlow+ft. These consequences affirm the significance of dilated convolution, and channel attention strategies as well for estimating optical flow.

Parallel Multiscale Context-Based Edge-Preserving Optical Flow Estimation with Occlusion Detection

Self-Attention-Based Multiscale Feature Learning Optical Flow with Occlusion Feature Map Prediction

LCIF-Net: Local criss-cross attention based optical flow method using multi-scale image features and feature pyramid

CCMR: High Resolution Optical Flow Estimation via Coarse-to-Fine Context-Guided Motion Reasoning

Improved Discrete Optical Flow Estimation With Triple Image Matching Cost

Context-adaptive Matching for Optical Flow

SKFlow: Optical Flow Estimation Using Selective Kernel Networks

PWOC-3D: Deep Occlusion-Aware End-to-End Scene Flow Estimation

OPTICAL FLOW ESTIMATION USING CHANNEL ATTENTION MECHANISM

Efficient Coarse-to-Fine Patch Match for Large Displacement Optical Flow.

Multi-Scale Generalized Plane Match for Optical Flow

Stc-Flow: Spatio-Temporal Context-Aware Optical Flow Estimation

Simultaneous Occlusion Handling and Optical Flow Estimation.

Recurrent Partial Kernel Network for Efficient Optical Flow Estimation

Trustworthy Self-Attention: Enabling the Network to Focus Only on the Most Relevant References

Context-Aware Iteration Policy Network for Efficient Optical Flow Estimation

FPCR-Net: Feature pyramidal correlation and residual reconstruction for optical flow estimation

CMU-Flownet: Exploring Point Cloud Scene Flow Estimation in Occluded Scenario

Optical Flow Estimation Using Channel Attention Mechanism and Dilated Convolutional Neural Networks.

Optical Flow Estimation Via Motion Feature Recovery

Unsupervised Learning of Optical Flow with Patch Consistency and Occlusion Estimation.