Multi-view images captured by a parallel multi-camera array manually placed tend to produce vertical parallax. To eliminate vertical parallax, the multi-view images must be rectified. This paper presents a simple and effective algorithm for multi-view rectification, and builds a stereoscopic display system based on this algorithm. A multithread technique is used to achieve soft synchronization of the cameras, and to perform real-time optimization. When image resolution is 1 280×960, the upload rate is 25 frame/s, and the target 3D display resolution is 1 920×1 080, the display rate of the system can reach 20 frame/s by using the bilinear interpolation. If interpolation methods with low complexity are used, the display rate can reach more than 20 frame/s. A 3DTV system with real-time rectification of eight cameras and stereoscopic display is built by using the proposed algorithm.
YAN Ji-chen1, AN Ping1, LI Chun-hua1,2, ZHAO Bing1,LIU Chao1, ZHANG Zhao-yang1
. Real-Time Rectification and Stereoscopic Display for Multi-view Imaging[J]. Journal of Shanghai University, 2014
, 20(1)
: 92
-98
.
DOI: 10.3969/j.issn.1007-2861.2014.07.015
[1] 张兆杨, 安平, 张之江, 等. 二维和三维视频处理及立体显示技术[M]. 北京: 科学出版社, 2010: 1-6.
[2] Fusiello A, Trucco E, Verri A. A compact algorithm for rectification of stereo pairs [J]. Machine Vision and Application, 2000, 12(1): 16-22.
[3] Loop C, Zhang Z. Computing rectifying homographies for stereo vision [C]//IEEE Conference on Computer Vision and Pattern Recognition. 1999: 125-131.
[4] Papadimitriou D V, Dennis T J. Epipolar line estimation and rectification for stereo image pairs [J]. IEEE Transactions on Image Processing, 1996, 5(4): 672-676.
[5] Zhang Y, An P, Wang H, et al. A rectification algorithm for un-calibrated multi-view images based on SIFT features [C]//International Conference onAudio Language and Image Processing. 2010: 143-147.
[6] Wang H, Wang G Z, Liu L L, et al. Fast automatic elimination of vertical parallax of multiview images [C]//IEEE 10th International Conference on Signal Processing. 2010: 1004-1007.
[7] 程明明, 王贺, 安平, 等. 基于特征点匹配的多视图像校正[J]. 液晶与显示, 2010, 25(4): 593-596.
[8] Kang Y S, Ho Y S. An efficient image rectification algorithm for parallel multi-camera arrangement [J]. IEEE Transactions on Consumer Electronics, 2011, 57(3): 1041-1048.
[9] Choi M, Kim J, Cho W K, et al. Low complexity image rectification for multi-view video coding [C]//IEEE International Symposium on Circuits and Systems. 2012: 381-384.
[10] Zhang Z Y. A flexible new technique for camera calibration [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(11): 1330-1334.