Pixel matching of stereo images based on bi-focal imaging

LI Xin,WANG Yuan-qing

DOI: https://doi.org/10.3969/j.issn.1001-3695.2007.09.097

2007-01-01

Abstract:A matching method based on doubule focus zooming imaging was introduced.Area matching method and gray level comparability were used to find the matching point.Meanwhile,a better searching method was applied,which reduced the computational complexity and improves the matching rate.

What problem does this paper attempt to address?

Dynamic Limited-Search Matching Algorithm Based on Geometric Properties of Stereo Imaging

王凌云,管业鹏,童林夙,顾伟康,刘济林,叶秀清

DOI: https://doi.org/10.3969/j.issn.1004-1699.2003.03.011

2003-01-01

Abstract:A dynamic limited search matching algorithm based on geometric properties of stereo imaging is developed in this paper. The approximate scope of disparity for matching feature points on the measurement object is ascertained according to the shape of measured object and correlated location spatially between the measured object and target of camera calibration. Based on the geometric properties of stereo imaging, the disparity is obtained by dynamic limited search method. After the disparity computed, the searching orientation and scope of disparity in right (left) image can be determined by way of the disparity difference horizontally between the feature point in left (or right) image and the computed matching point, so the next disparity can be confirmed by calculating correlation value of gray in some region. The rest may be deduced by analogy. In order to gained the correct correspondence, the restriction of geometric comparability should be taken into account due to the instability of gray and much difference from viewpoints also. It is proved that the algorithm proposed in the paper is feasible by computer imitated experiment on standard piece with given 3D coordinates.
Efficient Binocular Stereo Matching Based on Sad and Improved Census Transformation

Yun Zhang,Wenxiang Chen,Han Liu,Jinhua Liu,Hui Du

DOI: https://doi.org/10.1109/icmlc48188.2019.8949324

2019-01-01

Abstract:Binocular stereo matching aims to obtain disparities from two very close views. Existing stereo matching methods may cause false matching when there are much image noise and disparity discontinuities. This paper proposes a novel binocular stereo matching algorithm based on SAD and improved Census transformation. We first perform improved Census transformation, and then we get the matching costs by combining SAD and improved Census transformation. Finally we cluster the matching costs and calculate the disparities. To generate better disparities, we further propose the improved bilateral and selective filters to enhance the accuracy of disparities. Experimental results show that our binocular stereo matching can produce more accurate and complete disparities, and it works well in complex scenes with irregular shapes and more objects, thus it has wide applications in stereoscopic image processing.
Research on Zoom Algorithm Based on Dual Resolution Camera

Jin Zheyan,Xu Zhihai,Feng Huajun,Li Qi

DOI: https://doi.org/10.3788/irla.16_2019-0463

2020-01-01

Abstract:The dual resolution camera combines large field of view and high resolution. The coaxial optical fixed structure avoids many problems caused by the moving parts of the zoom lens, and has potential application value in deep space detection target tracking and smart terminals such as mobile phones. The existing dual resolution image zoom algorithm based on deep learning has slow speed, no increase in information, poor adaptability of image network structure and forgery of image information restoration. To join a solution in normal image algorithm based on depth information was tentatively proposed in this paper. The feasibility of using image focus sharpness as depth information into the dual resolution zoom algorithm was demonstrated, the accuracy and effect of focus depth information detection was explored by Laplace image evaluation, and the dual resolution zoom algorithm of deep learning and traditional methods based on depth information was tested. The new excellent zoom algorithm used the space during normal focus of the camera which did not affect the imaging speed of normal images. The algorithm complexity is reduced by 60%, the computational memory overhead is reduced by 35%. The spatial relationship super-resolution information is more realistic and reliable, and the image result evaluation is improved by 10% to 50%.
Stereo matching algorithm using improved guided filtering

Zhi WANG,Shi-qiang ZHU,Yan BU,Zhen-min GUO

DOI: https://doi.org/10.3785/j.issn.1008-973X.2016.12.003

2016-01-01

Abstract:An improved guided filter-based stereo matching algorithm was proposed to solve the problem of low accuracy and sensitivity to environmental change .The algorithm used the improved guiding filter to preprocess the raw images ; the gradient of the preprocessed images was combined with the Census transform in the matching cost computation .Furthermore ,an adaptive cross-based support window was constructed dependeding on the color similarity . The improved guided filter was adopted as the cost aggregation method . Accurate disparity maps were obtained after disparity refinement , which could achieve good performance in texture-less regions . The experiments on the Middlebury and KIT TI benchmark demonstrate that the proposed algorithm outperforms other filter-based methods ,which has better robustness and can be used in outdoor applications .In addition ,the computational complexity of the proposed method is independent on the window size ,which has good real-time performance .
A Fast Local Stereo Matching Insensitive to Illumination Conditions

LAI Xiaobo,ZHU Shiqiang,MA Xuan

DOI: https://doi.org/10.3724/sp.j.1218.2011.00292

2011-01-01

ROBOT

Abstract:Aiming at the problem that the similarity measures in the overwhelming majority of stereo matching approaches rely heavily on the statistical characteristics of image gray values,a stereo matching algorithm insensitive to differentiations in illumination is proposed.Firstly,the Census non-parametric transform is investigated and its limitations are analyzed. Secondly,in order to take the pixels' spatial location information into consideration when searching stereo correspondences, gray values of the neighborhood pixels,whose relative positions are one unit greater than the center pixel in the transformation window,are replaced by gray values' interpolation with the four pixels adjacent to them.Finally,the Census non-parametric transform of images and stereo matching are implemented,and then,dense disparity map is obtained.The experiment results show that the proposed method has simple mechanism,high computational efficiency and strong robustness;satisfactory stereo matching results also can be obtained even under non-ideal illumination conditions.
Mutual information based non-parametric transform stereo matching algorithm

LAI Xiao-bo,Shiqiang Zhu

DOI: https://doi.org/10.3785/j.issn.1008-973X.2011.09.021

2011-01-01

Abstract:Aiming at the limitations of the weak real-time and the low reliability in the traditional non-parametric transform stereo matching algorithms,a mutual information based non-parametric transform stereo matching algorithm was proposed.Gray values of all the pixels in the transform window were averaged,and then the mean value was taken as the gray value of the center pixel.In order to take the pixels' mutual information into consideration while finding stereo correspondence,the original gray value of the neighborhood pixels whose the relative position was one unit greater than that of the center pixel was replaced by the gray value through bilinear interpolation.The non-parametric transform of the gray values of the pixels in the transform window was implemented,and a dense map was obtained.The experimental results indicate that compared with other single area-based matching algorithms,the percentage of bad matching pixels is nearly equivalent to other algorithms while it can improve the robustness of the traditional non-parametric transform stereo matching approaches effectively.
A Two-Layer Descriptor and Two-Step Matching for Stereoscopic Images

Cheng-Liang Lin,Liang-Hao Wang,Dong-Xiao Li,Ming Zhang

DOI: https://doi.org/10.1109/IMCCC.2013.310

2013-01-01

Abstract:Among all the feature matching algorithms, SURF is famous for its computation efficiency in lots of practical applications. For recently popular stereoscopic videos, sparse feature matching, in which SURF is usually adopted, is the pre-processing of adjusting the 3D effect. However, significant improvement still can be made for SURF in stereo images. In this paper, a new two-layer feature descriptor and the corresponding two-step matching method which is based on the stereo images is proposed. Experimental results show that the proposed algorithm achieves comparable or even better performance of matching at much less time compared against the SURF in stereo images.
Stereo Matching Algorithm for Improved Census Transform and Gradient Fusion

Fan Hairui,Yang Fan,Pan Xuran,Wen Jie,Wang Xiaoyu

DOI: https://doi.org/10.3788/aos201838.0215006

2018-01-01

Acta Optica Sinica

Abstract:Aiming at the problems of noise-sensitive,easy distortion and with high false matching ratio in the disparity discontinuity region and weak texture region of the existing local matching algorithm,a multi-scale stereo matching algorithm for improved Census transform and gradient fusion is proposed.The weighted average gray value of all the pixels in the support window is used as the reference value of the Census transform.The Census cost is weighted combined with the gradient cost normalized by the horizontal and vertical directions,and a stable cost is obtained when the noise margin is set.Therefore,the reliability of the single pixel matching cost is obtained.Under the multi-scale,the improved guided filtering algorithm is used to complete the aggregation of the matching cost.The disparity map is obtained by parallax extraction.The experimental results demonstrate that the average false matching ratio of standard stereo image pairs obtained by the proposed algorithm is 4.74％ on the Middlebury testing benchmark,and the average false matching ratio of the 27 extended stereo image pairs is 8.67 ％.In the parallax discontinuity region and the weak texture region,the false matching ratio is further reduced by the proposed algorithm,and it shows better robustness for noise and light.
Ensemble Learning with Advanced Fast Image Filtering Features for Semi-Global Matching

Yao Peng,Feng Jieqing

DOI: https://doi.org/10.1007/s00138-021-01211-8

IF: 2.983

2021-01-01

Machine Vision and Applications

Abstract:For the past several years, a variety of algorithms have been focused on how to exploit two-dimensional scanline optimization to augment one-dimensional ones for semi-global matching. Different from the former contributions, an ensemble learning with advanced fast image filtering features for semi-global matching is proposed in this paper. Firstly, fewer categories of features (confidence measures) are extracted through various advanced fast image filters on the original scale of 8 directions’ semi-global matching disparity maps. Then, all the features are weaved together and divided into positive and negative samples for ensemble learning after comparing with ground truth. After that, the initial disparity map is obtained by leveraging the confidence probability of ensemble learning prediction. Finally, an efficient two-step single view disparity refinement strategy is employed, which no longer requires the right view’s disparity map for attaining the final refined results. Performance evaluations on Middlebury v.2 and v.3 stereo data sets demonstrate that the proposed algorithm outperforms other four most recent stereo matching algorithms. In addition, the presented algorithm shows relative high implementation efficiency compared with others.
Full-Image Guided Filtering for Fast Stereo Matching

Qingqing Yang,Dongxiao Li,Lianghao Wang,Ming Zhang

DOI: https://doi.org/10.1109/lsp.2013.2241759

2013-01-01

IEEE Signal Processing Letters

Abstract:A novel full-image guided filtering method is proposed. Different with many existing neighborhood filters, all input elements are employed during the proposed filtering approach. In addition, a novel scheme called weight propagation is proposed to compute support weights. It fulfills the requirements of edge preserving and low complexity. It is applied to the cost-volume filtering in the local stereo matching framework. The algorithm utilizing the proposed filtering method is currently one of the best local algorithms on the Middlebury stereo testbed in terms of both speed and accuracy.
Edge-preserving Guided Filtering Based Cost Aggregation for Stereo Matching.

Shiqiang Zhu,Zhi Wang,Xuequn Zhang,Yuehua Li

DOI: https://doi.org/10.1016/j.jvcir.2016.05.012

IF: 2.887

2016-01-01

Journal of Visual Communication and Image Representation

Abstract:Stereo matching has been widely used in various computer applications and it is still a challenging problem. In stereo matching, the filter-based stereo matching methods have achieved outstanding performance. A local stereo matching method based on adaptive edge-preserving guided filter is presented in this paper, which can achieve proper cost-volume filtering and keep edges well. We introduce a gradient vector of the enhanced image generated by the proposed filter into the cost computation and the Census transform is adopted in the cost measurement. This cost computation method is robust against radiometric variations and textureless areas. The edge-preserving guided filter approach is proposed to aggregate the cost volume, which further proves the effectiveness of edge-preserving filter for stereo matching. The experiments conducted on Middlebury benchmark and KITTI benchmark demonstrate that the proposed algorithm produces better results compared with other edge-aware filter based methods. (C) 2016 Elsevier Inc. All rights reserved.
Depth Extraction Method Based on Multi-view Stereo Matching

鞠芹,安平,张倩,吴妍菲,张兆杨

DOI: https://doi.org/10.3969/j.issn.1000-3428.2010.14.063

2010-01-01

Abstract:A method for generating the depth image from multi-view images based on color segmentation is presented.Mean-shift algorithm is used to extract homogenous regions in the reference image.The initial disparity maps applying local window-based matching algorithm is got.According to certain criteria,these initial depth maps are merged into one disparity map to improve the quality of disparity map,and optimized the disparity map by post processing.The disparity map is converted to a depth map.The algorithm can deal with the occlusion problem effectively,which increases the matching accuracy,and improves the quality of the disparity map.
Dense Stereo Matching Algorithm Based on Image Segmentation

Ma Ruihao,Zhu Feng,Wu Qingxiao,Lu Rongrong,Wei Jingyang

DOI: https://doi.org/10.3788/aos201939.0315001

2019-01-01

Acta Optica Sinica

Abstract:A dense stereo matching algorithm is proposed based on image segmentation. This algorithm combines the gray-gradient algorithm and the zero-mean normalized cross-correlation (ZNCC) algorithm to generate matching cost. The SLIC (Simple Liner Iterative Cluster) algorithm is used for image segmentation. A method based disparity map and superpixels is proposed to update the matching cost. At the disparity post-processing stage, the LRC (Left Right Check), hole filling and cross adaptive window weighted median filtering methods arc used to reduce the error matching rate of the disparity map. The performance evaluation experiments on four Middlebury stereo pairs demonstrate that the proposed algorithm achieves an average error matching rate of 4.99% Key words machine vision; stereo matching algorithm; matching cost computation method fusion; cross adaptive window weighted median filtering
Ambiguous Region Matching and Boundary Pixel Optimization for Stereo Computation

Xing Nian Cui,Fan Yang,Qing Min Liao

DOI: https://doi.org/10.4028/www.scientific.net/amr.546-547.735

2012-01-01

Advanced Materials Research

Abstract:In this paper, we present a stereo matching algorithm based on planar surface hypothesis. It improves the results of low texture regions and mixed pixels on object boundaries. First, regions are segmented by applying the mean-shift segmentation method. Then we propose a coarse-to-fine algorithm to increase the reliable correspondences in low texture regions. Third, the Belief Propagation algorithm is used to optimize disparity plane labeling. Finally, for a mixed pixel, we utilize the results of the depth plane and the local region of it to regulate its disparity. Experimental results using the Middlebury stereo test show that the performance of our method is high.
Fast Stereo Matching Algorithm Based on Adaptive Window

Peng-Fei Jin,Dong-Xiao Li,Liang-Hao Wang,Ming Zhang

DOI: https://doi.org/10.1109/icalip.2010.5684994

2011-01-01

Abstract:One of the key and difficult technologies in the 3DTV system is the generation of the depth. In general, the demands for accuracy and real-time execution cannot be satisfied at the same time. With the development of the algorithms, some local methods are more suitable, but the challenge is to decide an appropriate window for each pixel. We propose a novel local method, which constructs the support windows adaptively only based on the intensity. Our bilateral filtering algorithm is depending on the information of color image so that the edge can be kept clearly. All of the algorithms are based on GPU so that the effectiveness is higher. To demonstrate the effectiveness of the algorithm, it has been tested on the benchmark Middlebury stereo database. The results show that our algorithm has comparable efficiency, and hence it is promising for practical application.
Bilayer Stereo Matching

Dengfeng Chai,Qunsheng Peng

DOI: https://doi.org/10.1109/iccv.2007.4408999

2007-01-01

Abstract:This paper presents two novel approaches for stereo matching. First, a bitwise algorithm for stereo matching is proposed. It represents the disparity of each pixel as a binary number, treats each bit separately and determines them step by step, each step determines one bit of the disparities and involves only a single graph cut computation. It reduces the computation complexity to (9(log2 n). Second, bilayer stereo matching for scenes consisting of foreground and background is proposed. Disparity field of foreground and background layers are recovered independently, and the final disparity field is composed using the disparity field of two layers. Discontinuity between foreground and background can be preserved successfully by this schema. Experimental results show that the combination of bitwise algorithm and bilayer stereo matching can support realtime applications such as desktop-based 3D visual communication.
Stereo matching method based on high-precision occlusion-recovering and discontinuity-preserving

Li Dong,Yong Han,Maohai Hu,Hao Luo,Yi Wang

DOI: https://doi.org/10.1016/j.displa.2023.102573

IF: 3.074

2023-11-08

Displays

Abstract:Stereo matching is the core of machine vision, such as 3D reconstruction, posture perception and driverless technology in the future etc. Currently, there are still great difficulties in improving the matching accuracy of disparity discontinuity and occlusion regions. In this paper, we propose a new high-precision occlusion-recovering and discontinuity-preserving method for stereo matching. We focus on disparity refinement, and present an adaptability-based disparity reconstruction that achieves accurate occlusion-recovering by fusing color aberration, distance, and disparity value. For discontinuity-preserving, disparity-based secondary guided filtering is proposed, then introduce adaptive image enhancement and adaptive Canny edge detection to correct errors in discontinuous regions. The experiments on Middlebury standard dataset show that our algorithm has high overall accuracy, especially in the disparity discontinuity and occlusion regions. This novel method is more direct, efficient, and less sensitive to the accuracy of disparity estimation, and the live-action shooting shows the robustness of our algorithm. The method has the prospect of civil and engineering use, and presents scientific reference for high-precision target identification, target tracking, 3D measurement, etc.

engineering, electrical & electronic,instruments & instrumentation,optics,computer science, hardware & architecture
Stereo matching based on guided filter and segmentation

Yuan Zhou,Chunping Hou

DOI: https://doi.org/10.1016/j.ijleo.2015.01.030

IF: 3.1

2015-05-01

Optik

Abstract:For improving the accuracy of stereo matching and maintaining discontinuity of object edge and continuity of non-edge area in the matching result, a stereo matching method based on guided filter and mean shift is proposed in this paper. Matching cost function based on Markov random field (MRF) and guided filter are established, and the initial disparity value of each pixel is calculated by minimizing the corresponding matching cost function. Mean shift algorithm is used to segment the stereo images into independent areas, and improve the final disparity map. Results of the proposed method are tested on the international standard Middlebury stereo benchmark and compared with other methods. Comparative results show high accuracy of the proposed algorithm and its superiority to some prevailing algorithms.

optics
A Monocular Stereo Vision Algorithm Based on Bifocal Imaging

Jian WANG,Yuan-qing WANG

DOI: https://doi.org/10.3321/j.issn:1002-0446.2007.01.008

2007-01-01

Abstract:This paper analyzes the monocular stereo vision algorithm based on bifocal imaging. In the depth range less than 1 meter, this algorithm demonstrates excellent recovery of objects' depth, and the farther the object point is away from the center area of the frame, the more precise the depth value will be. In order to improve the algorithm precision, the center point of a pair of zoom images needs adjusting if it is not an ideal pair. This paper introduces the method of center point adjustment and illustrates the experimental result of depth recovery of a spatial object after adjustment.
Local PatchMatch Based on Superpixel Cut for Efficient High-resolution Stereo Matching

Xianjing Cheng,Yong Zhao,Raja Soosaimarian Peter Raj,Zhijun Hu,Xiaomin Yu,Wenbang Yang

DOI: https://doi.org/10.1590/1678-4324-202210409

2022-01-01

Brazilian Archives of Biology and Technology

Abstract:Obtaining the accurate disparity of each pixel quickly is the goal of stereo matching, but it is very difficult for the 3D labels-based methods due to huge search space of 3D labels, especially for highresolution images. We present an novel two-stage optimization strategy to get the accurate disparity map for highresolution stereo image efficiently, which includes feature points optimization and superpixel optimization. In the first stage, we construct the support points including edge points and robust points for triangulation, which is used to extract feature points and then perform spatial propagation and random refinement to get the candidate 3D label sets. In the stage of superpixel optimization, we update per pixel labels of the corresponding superpixels using the candidate label sets, and then perform spatial propagation and random refinement. In order to provide more prior information to identify weak texture and textureless areas, we design the weight combination of "intensity + gradient + binary image" for constructing an optimal minimum spanning tree (MST) to compute the aggregated matching cost, and obtain the labels of minimum aggregated matching cost. We also design local patch surrounding the corresponding superpixel to accelerate our algorithm in parallel. The experimental result shows that our method achieves a good trade-off between running time and accuracy, including KITTI and Middlebury benchmark, which are the standard benchmarks for testing the stereo matching methods.

Pixel matching of stereo images based on bi-focal imaging

Dynamic Limited-Search Matching Algorithm Based on Geometric Properties of Stereo Imaging

Efficient Binocular Stereo Matching Based on Sad and Improved Census Transformation

Research on Zoom Algorithm Based on Dual Resolution Camera

Stereo matching algorithm using improved guided filtering

A Fast Local Stereo Matching Insensitive to Illumination Conditions

Mutual information based non-parametric transform stereo matching algorithm

A Two-Layer Descriptor and Two-Step Matching for Stereoscopic Images

Stereo Matching Algorithm for Improved Census Transform and Gradient Fusion

Ensemble Learning with Advanced Fast Image Filtering Features for Semi-Global Matching

Full-Image Guided Filtering for Fast Stereo Matching

Edge-preserving Guided Filtering Based Cost Aggregation for Stereo Matching.

Depth Extraction Method Based on Multi-view Stereo Matching

Dense Stereo Matching Algorithm Based on Image Segmentation

Ambiguous Region Matching and Boundary Pixel Optimization for Stereo Computation

Fast Stereo Matching Algorithm Based on Adaptive Window

Bilayer Stereo Matching

Stereo matching method based on high-precision occlusion-recovering and discontinuity-preserving

Stereo matching based on guided filter and segmentation

A Monocular Stereo Vision Algorithm Based on Bifocal Imaging

Local PatchMatch Based on Superpixel Cut for Efficient High-resolution Stereo Matching