Research Articles

A local stereo matching algorithm based on shaped adaptive window

Expand
  • School of Mechanical and Electrical Engineering, Lanzhou University of Technology, Lanzhou 730050, China

Received date: 2020-01-06

  Online published: 2020-09-15

Abstract

Improving the accuracy of image field depth using a stereo matching algorithm is a key challenge in the field of machine vision. A so-called shaped adaptive window local stereo matching algorithm is proposed to solve the problem that traditional adaptive window algorithms are susceptible to uneven illumination, which affects their accuracy, and that the shape of the window does not accurately describe the boundary of the image that is to be matched. Because the traditional Census transform is vulnerable to fluctuations in illumination of the central pixel, a so-called three-dimensional pixel information technique which combines with the Census transform is proposed. The matching cost is obtained by comparing the central pixel with non-central pixels and by comparing the non-central pixels with one another. Moreover, for better conformance to the image contour, and to better approximate the image boundary of the examined object to obtain higher matching accuracy by the subsequent cost aggregation operation, a double helix path method is proposed. This method obtains a window that is shaped differently from the traditional rectangle or cross-based windows. In this method, the double paths which search and examine the pixel region simultaneously shorten the time required for window construction; meanwhile, the double helix path creates a more variable window shape, which more easily conforms to the image contour. The experimental results show that, compared with most conventional stereo matching algorithms on the Middlebury platform, the proposed algorithm is better able to characterise the image boundary to improve matching precision and is more robust in cases of uneven illumination.

Cite this article

LIU Jun, MIAO Zhiyong, ZHANG Yuqi, REN Jianhua . A local stereo matching algorithm based on shaped adaptive window[J]. Journal of Shanghai University, 2021 , 27(3) : 466 -480 . DOI: 10.12066/j.issn.1007-2861.2255

References

[1] Xu H T, Liu X, Zhu C F, et al. A real-time ranging method based on parallel binocular vision[C]// 10th International Symposium on Computational Intelligence and Design. 2017: 183-187.
[2] Shen S H. Accurate multiple view 3D reconstruction using patch-based stereo for large-scale scenes[J]. IEEE Transactions on Image Processing, 2013,22(5):1901-1914.
[3] Qu Y F, Huang J Y, Zhang X. Rapid 3D reconstruction for image sequence acquired from UAV camera[J]. Sensors, 2018,18(2):225-245.
[4] Lee D Y, Park S A, Lee S J, et al. Segmental tracheal reconstruction by 3D-printed scaffold: pivotal role of asymmetrically porous membrane[J]. The Laryngoscope, 2016,126(9):304-309.
[5] Gurrieri L E, Dubois E. Depth consistency and vertical disparities in stereoscopic panoramas[J]. Journal of Electronic Imaging, 2014,23(1):35-48.
[6] Scharstein D, Szeliski R. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms[J]. International Journal of Computer Vision, 2002,47(1/2/3):7-42.
[7] Affendi H R, Haidi I. Literature survey on stereo vision disparity map algorithms[J]. Journal of Sensors, 2016,2016(2):1-23.
[8] 吕鹏程, 厉小润. 基于 AD-census 和多权值的自适应窗口的立体匹配算法[J]. 工业控制计算机, 2018,31(3):49-52.
[8] Lyu P C, Li X R. Stereo matching algorithm based on AD-census and multi-weight adaptive window[J]. Industrial Control Computer, 2018,31(3):49-52.
[9] 祝世平, 李政. 一种基于改进梯度和自适应窗口的立体匹配方法[J]. 光学学报, 2015,35(1):115-123.
[9] Zhu S P, Li Z. A stereo matching algorithm using improved gradient and adaptive window[J]. Acta Optica Sinica, 2015,35(1):115-123.
[10] 曾凡志, 鲍苏苏. 一种自适应多窗口的立体匹配算法[J]. 计算机科学, 2012,39:519-521.
[10] Zeng F Z, Bao S S. Adaptive multiple windows stereo matching algorithm[J]. Computer Science, 2012,39:519-521.
[11] Boykov Y, Veksler O, Zabih R. A variable window approach to early vision[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1998,20(12):1283-1294.
[12] 门宇博, 张国印, 门朝光, 等. 像素扩展自适应窗口立体匹配算法[J]. 哈尔滨工程大学学报, 2018,39(3):547-553.
[12] Men Y B, Zhang G Y, Men C G, et al. Stereo matching algorithm for adaptive window based on pixel expansion[J]. Journal of Harbin Engineering University, 2018,39(3):547-553.
[13] He K M, Sun J, Tang X O. Guided image filtering[J]. IEEE Transactions on Software Engineering, 2013,35(6):1397-1409.
[14] 王志, 朱世强, 卜琰, 等. 改进导向滤波器立体匹配算法[J]. 浙江大学学报 (工学版), 2016,50(12):2262-2269.
[14] Wang Z, Zhu S Q, Bu Y, et al. Stereo matching algorithm using improved guided filtering[J]. Journal of Zhejiang University (Engineering Science), 2016,50(12):2262-2269.
[15] Hirschmuller H, Scharstein D. Evaluation of stereo matching costs on images with radiometric differences[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2009,31(9):1582-1599.
[16] 许小勇, 钟太勇. 三次样条插值函数的构造与 Matlab 实现[J]. 兵工自动化, 2006,25(11):76-78.
[16] Xu X Y, Zhong T Y. Construction and realization of cubic spline interpolation function[J]. Ordnance Industry Automation, 2006,25(11):76-78.
Outlines

/