CURRENT SITUATION AND TRENDS OF OPTICAL FLOW ESTIMATION USING COLOR IMAGES

陈震,高满屯,沈允文

DOI: https://doi.org/10.3321/j.issn:1002-0446.2001.06.016

2001-01-01

ROBOT

Abstract:In this paper, the current situation and trends of optical flow field estimation using color images are presented in overview. Some methods are described in this paper and described some problems in optical flow field estimation using color images are proposed also.

What problem does this paper attempt to address?

An Improved Algorithm for Optical Flow Estimation from Color Images

项学智,赵春晖,李康

DOI: https://doi.org/10.3969/j.issn.1006-7043.2008.06.014

2008-01-01

Abstract:An effective solution for the aperture problem in estimating flow using color image sequences is to estimate optical flow by determining the optical flow gradient constraint equations.The resulting solution may not be accurate at pixels where the equations are linearly correlated or the image gradient is lower than the noise amplitude.To improve the robustness of optical flow estimations we selectively used the normalized rgb method and the global smoothing method.With this technique,the matrix condition number of the matrix is derived in order to estimate the reliability of the outcome obtained from the normalized rgb method.Next,a threshold for condition numbers is applied to determine which method to employ.Finally,the result is filtered 10 times by a median filter.Experimental results showed that the new approach not only resolves dense optical flow fields,it also effectively improves the precision of the optical flow estimation.
Optical Flow Estimation Algorithm Using Color Gradient Invariance

XIANG Xue-zhi,ZHAO Chun-hui

DOI: https://doi.org/10.3969/j.issn.1006-7043.2008.04.015

2008-01-01

Abstract:In optical flow estimates,it is usually necessary to assume that the fluid being measured has an unvarying color.For the sake of improving the robustness of optical flow estimates,an additional assumption is adopted that the color gradient of the measured substance is also uniform.Based on these two assumptions,a new optical flow estimation method is presented in this paper,in which the basic optical flow equation is derived in terms of the color gradient,with global smooth constraints applied on it.The flow velocity is solved through Gauss-Seidel iteration and the abnormal velocity component is removed by median filtering.The results of experiments show that this method yields better estimating results than the classic gray image sequence method and the color image sequence method.
An Estimating Arithmetic for Improving Optical Flow Estimation of Color Imagery Based on HSV

XIANG Xuezhi,ZHAO Chunhui

DOI: https://doi.org/10.3969/j.issn.1673-9728.2008.02.061

2008-01-01

Abstract:Optical flow computation for color image improves the optical flow computation from gray image to color image.The traditional method is based on the traditional RGB color model invalidated at the position which equations are linear correlation or the image gradient is lower than noise.Considering naked eyes estimated motion by gray and color information at the same time, the traditional gray optical flow method was combined with HSV based method.Matrix condition number was used to estimate the reliability of color optical flow method.The result was replaced by the gray optical flow method at the position which reliability was poor.So a new optical flow estimation method was represented.Experimental results prove that the new method could improve the precision and density of the optical flow result effectively.
Location Uncertainty Principle: Toward the Definition of Parameter-Free Motion Estimators

Shengze Cai,Etienne Mémin,Pierre Dérian,Chao Xu

DOI: https://doi.org/10.1007/978-3-319-78199-0_11

2018-01-01

Abstract:In this paper, we propose a novel optical flow approach for estimating two-dimensional velocity fields from an image sequence, which depicts the evolution of a passive scalar transported by a fluid flow. The Eulerian fluid flow velocity field is decomposed into two components: a large-scale motion field and a small-scale uncertainty component. We define the small-scale component as a random field. Then the data term of the optical flow formulation is based on a stochastic transport equation, derived from a location uncertainty principle [17]. In addition, a specific regularization term built from the assumption of constant kinetic energy involves the same diffusion tensor as the one appearing in the data transport term. This enables us to devise an optical flow method dedicated to fluid flows in which the regularization parameter has a clear physical interpretation and can be easily estimated. Experimental evaluations are presented on both synthetic and real images. Results indicate very good performance of the proposed parameter-free formulation for turbulent flow motion estimation.
High-quality Texture-based Flow Visualization on Surfaces.

Dibin Zhou,Kangjian Wang,Yao Zheng,Yanni Wang

DOI: https://doi.org/10.1109/cadcg.2007.4407875

2008-01-01

Abstract:In this paper, we present a high-quality texture-based approach for the visualization of vector fields on surface. It adopts a scheme of streamline enhancement by applying a ID high-pass filter to flow textures along the orthogonal flow direction to enhance the intensity contrast among streamlines and improve the image quality of flow textures. The scheme of edge detection and supplement is used in our approach to modulate the characteristic of particles flow. Our algorithm is image space based and can achieve a real-time rendering performance on a personal computer by using parallel processing ability of current graphics hardware.
Color Optical Flow Estimation Based on Complex Value Wavelet

张磊,项学智,赵春晖,郭黎利

DOI: https://doi.org/10.3969/j.issn.1000-3428.2009.13.070

2009-01-01

Abstract:Using assumption of color invariance, basic optical flow equation based RGB color components is mapped to the field of wavelet.Complex value wavelet is used to produce over-determined system of equations and computes the optical flow in multi-resolution scheme.Complex value wavelet can also be used to reduce the effect of phase vibrating.The condition number of the linear system of equations composed by RGB color components is used to judge the reliability of the optical flow result.The reliable result is selected to be the final optical flow component value.Results of numeric experiments show that the method is efficient.
Optical Flow Estimation Between Images of Different Resolutions Via Variational Method

Rui Zhao,Ruiqin Xiong,Shuyuan Zhu,Bing Zeng,Tiejun Huang,Wen Gao

DOI: https://doi.org/10.1109/vcip49819.2020.9301771

2020-01-01

Abstract:Traditional optical flow estimation methods mostly focus on images of the same resolution. However, there are some situations requiring optical flow between images of different resolutions, where the traditional approaches suffer from the inequality of spectrum aliasing level. In this paper, we propose a method estimating the flow fields between a clear image and a highly undersampled one. The proposed method simultaneously describes the motion and integral relationship between the images via an integral form image under the assumption of brightness and gradient consistency as well as motion smoothness. We also derive the numerical solution briefly, through which we can solve the equations easily via linearizations. Experimental results on Middlebury and MPI-Sintel datasets demonstrate that our proposed method outperforms traditional methods preprocessing images of different resolutions to be the same size, offering more accurate results.
Models of Color Image Sequence Optical Flow with Local and Global Methods Combined

项学智,赵春晖

DOI: https://doi.org/10.3969/j.issn.1000-3428.2009.03.003

2009-01-01

Abstract:Referenced presented models of optical flow computing,three models of color image sequence optical flow computation with local and global methods combined for color optical flow computing are presented in this paper. The combined models have the advantages of high precision of local model and density of global model. And the models presented are compared with each other. The number experiments results are presented.
A Method of Color Optical Flow Computation with Local and Global Model Combined

Xuezhi Xiang,Chunhui Zhao,Lei Zhang

DOI: https://doi.org/10.1109/wcica.2008.4594261

2008-01-01

Abstract:It is a problem that the results are unstable when local method is used to estimate optical flow at smooth color points. A method was presented to estimate stability through the condition number of local coefficients matrix. And the color results of global smooth were used to replace the unstable results of local color method. The combined model was provided with the advantages of high precision of local model and density of global model. Finally, the fusion optical flow result was filtered by median filter. Experiments show that the method produces density optical flow field and precision of the result can be improved.
A PDE-Based Method for Optical Flow Estimation

Zongqing Lu,Weixin Xie,Jihong Pei

DOI: https://doi.org/10.1109/icpr.2006.149

2006-01-01

Abstract:In this paper, we proposed a new method for accurate optical flow estimation. The significance of this work is twofold. First in this paper we showed that the optical flow estimation could be viewed as a diffusion-reaction process (PDE-based) instead of a variational problem of minimizing some energy functions. The minimization often need the corresponding regularizer be restricted to some forms with convex and differentiate in view of convergence and the Euler-Lagrange equation. Second, we adopted coherence enhancing scheme as the diffusion part of the diffusion-reaction equation to encourage smoothing along motion boundaries and preserving them. Qualitative and quantitative results for synthetic and real-world scenes demonstrate that the new method can produce an accurate result
An Unsupervised Optical Flow Estimation For LiDAR Image Sequences

Xuezhou Guo,Xuhu Lin,Lili Zhao,Zezhi Zhu,Jianwen Chen

DOI: https://doi.org/10.1109/ICIP42928.2021.9506376

2021-05-28

Abstract:In recent years, the LiDAR images, as a 2D compact representation of 3D LiDAR point clouds, are widely applied in various tasks, e.g., 3D semantic segmentation, LiDAR point cloud compression (PCC). Among these works, the optical flow estimation for LiDAR image sequences has become a key issue, especially for the motion estimation of the inter prediction in PCC. However, the existing optical flow estimation models are likely to be unreliable for LiDAR images. In this work, we first propose a light-weight flow estimation model for LiDAR image sequences. The key novelty of our method lies in two aspects. One is that for the different characteristics (with the spatial-variation feature distribution) of the LiDAR images w.r.t. the normal color images, we introduce the attention mechanism into our model to improve the quality of the estimated flow. The other one is that to tackle the lack of large-scale LiDAR-image annotations, we present an unsupervised method, which directly minimizes the inconsistency between the reference image and the reconstructed image based on the estimated optical flow. Extensive experimental results have shown that our proposed model outperforms other mainstream models on the KITTI dataset, with much fewer parameters.

Image and Video Processing
Optical Flow Estimation Combining Spatial-Temporal Derivatives Based Nonlinear Filtering.

Kaihong Shi,Zongqing Lu,Qingyun She,Fei Zhou,Qingmin Liao

DOI: https://doi.org/10.1587/transinf.2014edl8030

2014-01-01

IEICE Transactions on Information and Systems

Abstract:This paper presents a novel filter to keep from over-smoothing the edges and corners and rectify the outliers in the flow field after each incremental computation step, which plays a key role during the process of estimating flow field. This filter works according to the spatial-temporal derivatives distance of the input image and velocity field distance, whose principle is more reasonable in filtering mechanism for optical flow than other existing nonlinear filters. Moreover, we regard the spatial-temporal derivatives as new powerful descriptions of different motion layers or regions and give a detailed explanation. Experimental results show that our proposed method achieves better performance.
Optical Flow Dataset and Benchmark for Visual Crowd Analysis

Gregory Schröder,Tobias Senst,Erik Bochinski,Thomas Sikora

DOI: https://doi.org/10.48550/arXiv.1811.07170

2018-11-17

Abstract:The performance of optical flow algorithms greatly depends on the specifics of the content and the application for which it is used. Existing and well established optical flow datasets are limited to rather particular contents from which none is close to crowd behavior analysis; whereas such applications heavily utilize optical flow. We introduce a new optical flow dataset exploiting the possibilities of a recent video engine to generate sequences with ground-truth optical flow for large crowds in different scenarios. We break with the development of the last decade of introducing ever increasing displacements to pose new difficulties. Instead we focus on real-world surveillance scenarios where numerous small, partly independent, non rigidly moving objects observed over a long temporal range pose a challenge. By evaluating different optical flow algorithms, we find that results of established datasets can not be transferred to these new challenges. In exhaustive experiments we are able to provide new insight into optical flow for crowd analysis. Finally, the results have been validated on the real-world UCF crowd tracking benchmark while achieving competitive results compared to more sophisticated state-of-the-art crowd tracking approaches.

Computer Vision and Pattern Recognition
Optical Flow Field Generation Method Based on Video Compression Information

Ziyi Tian,Hongwei Lin,Qicai Jia,Chuang Wang,Kunyu Gao,Haijiao Ren

DOI: https://doi.org/10.1109/iccasit58768.2023.10351510

2023-01-01

Abstract:In computer vision, optical flow is widely used in tasks such as action recognition and video super-resolution. Traditional optical flow calculations need each frames of the original video which restored from video compressed information to calculate the fine motion information between neighboring frames of the video. Reconstruction original video is time-consuming in practical applications. In video compression, motion vector(MV) and residual(RES) are generated. Both MV and optical flow can represent motion information between two frames, but MV are more coarse. Directly using the compression information to generate optical flow can save the time of generating original video in traditional optical flow calculation. Therefore, in order to solve the time-consuming problem in traditional optical flow reconstruction. In this paper, we propose a method to generate the optical flow by directly using the video compression information, the information is first extracted and fused in our network, then using the fused information to generation optical flow. The experimental results show that the proposed method consumes less time and achieves higher accuracy than traditional methods.
Traditional and modern strategies for optical flow: an investigation

Syed Tafseer Haider Shah,Xiang Xuezhi

DOI: https://doi.org/10.1007/s42452-021-04227-x

2021-02-08

SN Applied Sciences

Abstract:Abstract Optical Flow Estimation is an essential component for many image processing techniques. This field of research in computer vision has seen an amazing development in recent years. In particular, the introduction of Convolutional Neural Networks for optical flow estimation has shifted the paradigm of research from the classical traditional approach to deep learning side. At present, state of the art techniques for optical flow are based on convolutional neural networks and almost all top performing methods incorporate deep learning architectures in their schemes. This paper presents a brief analysis of optical flow estimation techniques and highlights most recent developments in this field. A comparison of the majority of pertinent traditional and deep learning methodologies has been undertaken resulting the detailed establishment of the respective advantages and disadvantages of the traditional and deep learning categories. An insight is provided into the significant factors that affect the success or failure of the two classes of optical flow estimation. In establishing the foremost existing and inherent challenges with traditional and deep learning schemes, probable solutions have been proposed indeed.
Optical Flow Estimation Based on Texture Constraints and Parametric Motion Model

杨波,徐光祐

DOI: https://doi.org/10.3969/j.issn.1006-8961.2004.06.010

2004-01-01

Abstract:This paper presents a new method for estimating dense and accurate optical flow based on the motion of planar regions. Different from previous approach, textural information are exploited to organize and constrain the interpretation of the motion. Regions with similar texture properties are supposed to be planar patches. This hypothesis is more reasonable and effective than those hypotheses using the brightness smooth region as planar patches. Parametric flow models are estimated in these textually consistent regions in two steps that first compute a coarse fit according to the coarse optical flow. Then this initial fit is refined using a generalization of the standard area-based regression approaches. Partial fit based on the texture information is employed all through the process. Accurate optical flows are computed finally according to the refined parametric motion models. Experimental results on a variety of images sequence indicate that our method produce accurate flow estimates especially in outdoor environment containing rich texture content. Furthermore the incorporation of the textural information through partial fit and image segmentation provides precise localization of motion boundaries and makes this method overmatch the previous brightness smooth hypothesis based approaches.
Optical Flow Computation Based On Bayesian Selecting Scheme

Lu Zongqing,Xie Weixin,Pei Jihong

IF: 1.019

2007-01-01

Chinese Journal of Electronics

Abstract:Dense optical flow schemes are challenged by the presence of motion boundaries. In state of the art optical flow approaches, over-smoothing of motion boundaries accounts for most of the error. A new optical flow estimation is proposed in this paper, which addresses some issues including the credible estimation of optical flow and the preservation of flow boundaries. Our main contribution is that a Bayesian selecting scheme is adopted to refine the optical flow by a local estimate scheme, which can help to preserve motion boundaries efficiently. Qualitative and quantitative results indicate that the method can produce a credible result.
A Quantitative Analysis of Current Practices in Optical Flow Estimation and the Principles Behind Them

Deqing Sun,Stefan Roth,Michael J. Black

DOI: https://doi.org/10.1007/s11263-013-0644-x

IF: 13.369

2013-09-03

International Journal of Computer Vision

Abstract:The accuracy of optical flow estimation algorithms has been improving steadily as evidenced by results on the Middlebury optical flow benchmark. The typical formulation, however, has changed little since the work of Horn and Schunck. We attempt to uncover what has made recent advances possible through a thorough analysis of how the objective function, the optimization method, and modern implementation practices influence accuracy. We discover that “classical” flow formulations perform surprisingly well when combined with modern optimization and implementation techniques. One key implementation detail is the median filtering of intermediate flow fields during optimization. While this improves the robustness of classical methods it actually leads to higher energy solutions, meaning that these methods are not optimizing the original objective function. To understand the principles behind this phenomenon, we derive a new objective function that formalizes the median filtering heuristic. This objective function includes a non-local smoothness term that robustly integrates flow estimates over large spatial neighborhoods. By modifying this new term to include information about flow and image boundaries we develop a method that can better preserve motion details. To take advantage of the trend towards video in wide-screen format, we further introduce an asymmetric pyramid downsampling scheme that enables the estimation of longer range horizontal motions. The methods are evaluated on the Middlebury, MPI Sintel, and KITTI datasets using the same parameter settings.

computer science, artificial intelligence
Optical flow modeling and computation: A survey

Denis Fortun,Patrick Bouthemy,Charles Kervrann

DOI: https://doi.org/10.1016/j.cviu.2015.02.008

IF: 4.886

2015-05-01

Computer Vision and Image Understanding

Abstract:Optical flow estimation is one of the oldest and still most active research domains in computer vision. In 35years, many methodological concepts have been introduced and have progressively improved performances, while opening the way to new challenges. In the last decade, the growing interest in evaluation benchmarks has stimulated a great amount of work. In this paper, we propose a survey of optical flow estimation classifying the main principles elaborated during this evolution, with a particular concern given to recent developments. It is conceived as a tutorial organizing in a comprehensive framework current approaches and practices. We give insights on the motivations, interests and limitations of modeling and optimization techniques, and we highlight similarities between methods to allow for a clear understanding of their behavior.

computer science, artificial intelligence,engineering, electrical & electronic
Guided Filtering: Toward Edge-Preserving for Optical Flow

Congxuan Zhang,Liyue Ge,Zhen Chen,Renzhi Qin,Ming Li,Wen Liu

DOI: https://doi.org/10.1109/access.2018.2831920

IF: 3.9

2018-01-01

IEEE Access

Abstract:Despite progress made in the accuracy and robustness of optical flow in past years, the problem of over-segmentation and the blurring of image edge and motion boundary caused by the illumination change, complex texture, large displacement, and motion occlusion still remain. Recently, we developed a guided filtering scheme for flow field estimation, which is implemented as an add-on optimal operation during the coarse-to-fine optical flow computation. In this paper, we first review the research progress in optical flow computation and discuss limitations of the currently popular median filtering heuristic for a flow field optimization. We then introduce a general formulation of the guided filtering and provide the detailed illustration. Furthermore, we explore the potential of the guided filtering optimization for the flow field estimation under the coarse-to-fine computing scheme. Finally, we modify some typical and state-of-the-art optical flow methods by applying the proposed guided filtering operation to the baseline models, and test the performances of the basic and developed models through the Middlebury, MPI-Sintel, and KITTI data. The experimental results demonstrate that the guided filtering scheme is able to preserve the image edges and motion boundaries, and to improve the accuracy and robustness of optical flow estimation.

CURRENT SITUATION AND TRENDS OF OPTICAL FLOW ESTIMATION USING COLOR IMAGES

An Improved Algorithm for Optical Flow Estimation from Color Images

Optical Flow Estimation Algorithm Using Color Gradient Invariance

An Estimating Arithmetic for Improving Optical Flow Estimation of Color Imagery Based on HSV

Location Uncertainty Principle: Toward the Definition of Parameter-Free Motion Estimators

High-quality Texture-based Flow Visualization on Surfaces.

Color Optical Flow Estimation Based on Complex Value Wavelet

Optical Flow Estimation Between Images of Different Resolutions Via Variational Method

Models of Color Image Sequence Optical Flow with Local and Global Methods Combined

A Method of Color Optical Flow Computation with Local and Global Model Combined

A PDE-Based Method for Optical Flow Estimation

An Unsupervised Optical Flow Estimation For LiDAR Image Sequences

Optical Flow Estimation Combining Spatial-Temporal Derivatives Based Nonlinear Filtering.

Optical Flow Dataset and Benchmark for Visual Crowd Analysis

Optical Flow Field Generation Method Based on Video Compression Information

Traditional and modern strategies for optical flow: an investigation

Optical Flow Estimation Based on Texture Constraints and Parametric Motion Model

Optical Flow Computation Based On Bayesian Selecting Scheme

A Quantitative Analysis of Current Practices in Optical Flow Estimation and the Principles Behind Them

Optical flow modeling and computation: A survey

Guided Filtering: Toward Edge-Preserving for Optical Flow