收稿日期: 2020-01-06
网络出版日期: 2020-09-15
基金资助
国家自然科学基金资助项目(71861025)
A local stereo matching algorithm based on shaped adaptive window
Received date: 2020-01-06
Online published: 2020-09-15
如何通过立体匹配提高图像景深精度一直是机器视觉研究领域的一个难点, 针对自适应窗口算法易受光照不均和窗口形状难以有效描述待匹配图像边界等问题, 提出一种异形自适应窗口局部立体匹配算法. 由于传统 Census 变换易受中心像素波动影响, 因此提出一种像素信息三维化处理技术, 并通过窗口内非中心像素间差异和窗口间中心像素的差异信息计算匹配代价; 为更好地贴合图像轮廓, 提出了由双螺旋路径法确定的异形窗口进行代价聚合, 对像素区域同时沿两条搜索路径自适应确定形状大小, 形成比传统技术更加高效多变的匹配窗口. 实验结果表明, 相比 Middlebury 平台上其他算法, 所提算法具有更为准确的图像边界描述能力, 可有效提高立体匹配精度, 同时对于光照不均的情况具有更强的鲁棒性.
刘军, 苗志勇, 张煜祺, 任建华 . 一种异形自适应窗口局部立体匹配算法[J]. 上海大学学报(自然科学版), 2021 , 27(3) : 466 -480 . DOI: 10.12066/j.issn.1007-2861.2255
Improving the accuracy of image field depth using a stereo matching algorithm is a key challenge in the field of machine vision. A so-called shaped adaptive window local stereo matching algorithm is proposed to solve the problem that traditional adaptive window algorithms are susceptible to uneven illumination, which affects their accuracy, and that the shape of the window does not accurately describe the boundary of the image that is to be matched. Because the traditional Census transform is vulnerable to fluctuations in illumination of the central pixel, a so-called three-dimensional pixel information technique which combines with the Census transform is proposed. The matching cost is obtained by comparing the central pixel with non-central pixels and by comparing the non-central pixels with one another. Moreover, for better conformance to the image contour, and to better approximate the image boundary of the examined object to obtain higher matching accuracy by the subsequent cost aggregation operation, a double helix path method is proposed. This method obtains a window that is shaped differently from the traditional rectangle or cross-based windows. In this method, the double paths which search and examine the pixel region simultaneously shorten the time required for window construction; meanwhile, the double helix path creates a more variable window shape, which more easily conforms to the image contour. The experimental results show that, compared with most conventional stereo matching algorithms on the Middlebury platform, the proposed algorithm is better able to characterise the image boundary to improve matching precision and is more robust in cases of uneven illumination.
| [1] | Xu H T, Liu X, Zhu C F, et al. A real-time ranging method based on parallel binocular vision[C]// 10th International Symposium on Computational Intelligence and Design. 2017: 183-187. |
| [2] | Shen S H. Accurate multiple view 3D reconstruction using patch-based stereo for large-scale scenes[J]. IEEE Transactions on Image Processing, 2013,22(5):1901-1914. |
| [3] | Qu Y F, Huang J Y, Zhang X. Rapid 3D reconstruction for image sequence acquired from UAV camera[J]. Sensors, 2018,18(2):225-245. |
| [4] | Lee D Y, Park S A, Lee S J, et al. Segmental tracheal reconstruction by 3D-printed scaffold: pivotal role of asymmetrically porous membrane[J]. The Laryngoscope, 2016,126(9):304-309. |
| [5] | Gurrieri L E, Dubois E. Depth consistency and vertical disparities in stereoscopic panoramas[J]. Journal of Electronic Imaging, 2014,23(1):35-48. |
| [6] | Scharstein D, Szeliski R. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms[J]. International Journal of Computer Vision, 2002,47(1/2/3):7-42. |
| [7] | Affendi H R, Haidi I. Literature survey on stereo vision disparity map algorithms[J]. Journal of Sensors, 2016,2016(2):1-23. |
| [8] | 吕鹏程, 厉小润. 基于 AD-census 和多权值的自适应窗口的立体匹配算法[J]. 工业控制计算机, 2018,31(3):49-52. |
| [8] | Lyu P C, Li X R. Stereo matching algorithm based on AD-census and multi-weight adaptive window[J]. Industrial Control Computer, 2018,31(3):49-52. |
| [9] | 祝世平, 李政. 一种基于改进梯度和自适应窗口的立体匹配方法[J]. 光学学报, 2015,35(1):115-123. |
| [9] | Zhu S P, Li Z. A stereo matching algorithm using improved gradient and adaptive window[J]. Acta Optica Sinica, 2015,35(1):115-123. |
| [10] | 曾凡志, 鲍苏苏. 一种自适应多窗口的立体匹配算法[J]. 计算机科学, 2012,39:519-521. |
| [10] | Zeng F Z, Bao S S. Adaptive multiple windows stereo matching algorithm[J]. Computer Science, 2012,39:519-521. |
| [11] | Boykov Y, Veksler O, Zabih R. A variable window approach to early vision[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1998,20(12):1283-1294. |
| [12] | 门宇博, 张国印, 门朝光, 等. 像素扩展自适应窗口立体匹配算法[J]. 哈尔滨工程大学学报, 2018,39(3):547-553. |
| [12] | Men Y B, Zhang G Y, Men C G, et al. Stereo matching algorithm for adaptive window based on pixel expansion[J]. Journal of Harbin Engineering University, 2018,39(3):547-553. |
| [13] | He K M, Sun J, Tang X O. Guided image filtering[J]. IEEE Transactions on Software Engineering, 2013,35(6):1397-1409. |
| [14] | 王志, 朱世强, 卜琰, 等. 改进导向滤波器立体匹配算法[J]. 浙江大学学报 (工学版), 2016,50(12):2262-2269. |
| [14] | Wang Z, Zhu S Q, Bu Y, et al. Stereo matching algorithm using improved guided filtering[J]. Journal of Zhejiang University (Engineering Science), 2016,50(12):2262-2269. |
| [15] | Hirschmuller H, Scharstein D. Evaluation of stereo matching costs on images with radiometric differences[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2009,31(9):1582-1599. |
| [16] | 许小勇, 钟太勇. 三次样条插值函数的构造与 Matlab 实现[J]. 兵工自动化, 2006,25(11):76-78. |
| [16] | Xu X Y, Zhong T Y. Construction and realization of cubic spline interpolation function[J]. Ordnance Industry Automation, 2006,25(11):76-78. |
/
| 〈 |
|
〉 |