Depth maps typically consist of homogeneous areas partitioned by sharp edges representing depth discontinuities, and sharp discontinuities are important in the view rendering. As different depth distortions have different impacts on the virtual view synthesis, an edge based depth coding method is proposed for virtual view synthesis. The depth map is first divided into edge regions and smooth regions. Full search is used for edge regions in which SKIP and 16×16 modes are used in smooth regions. Besides, a median trilateral filter is designed according to the structure similarity between depth and corresponding
video. Experimental results indicate that, compared with JM, the proposed algorithm improves coding efficiency and can achieve high-quality 3D rendering.
LIU Chao, AN Ping, ZHAO Bing, YAN Ji-chen, ZHANG Zhao-yang
. Edge Based Depth Coding for Virtual View Synthesis[J]. Journal of Shanghai University, 2014
, 20(4)
: 450
-457
.
DOI: 10.3969/j.issn.1007-2861.2103.07.043
[1] He X, Jin X, Wang M H, et al. A novel depth-Image based view synthesis scheme for multiview and 3DTV [J]. Computer Science, Advances in Multimedia Modeling, 2011, 6523: 161-170.
[2] Daribo I, Saito H. A novel inpainting-based layered depth video for 3DTV [J]. IEEE Transactions on Broadcasting, 2011, 57(2): 533-541.
[3] 王奎, 安平, 张兆杨. Kinect深度图像快速修复算法[J]. 上海大学学报: 自然科学版, 2012, 18(5): 454-458.
[4] Fehn C. Depth-image-based rendering(DIBR), compression and transmission for a new approach on 3DTV [C]//Proceedings in SPIE Stereoscopic Displays and Virtual Reality Systems XI. 2004: 93-104.
[5] Shao F, Jiang G Y, Mei H, et al. Asymmetric coding of multi-view video plus depth based 3-D video for view rendering [J]. IEEE Transactions on Multimedia, 2012, 14(1): 157-167.
[6] Wang Z, Zhou J. A novel approach for depth image based rendering, based on non-linear transformation of depth values [C]//2011 International Conference on Image Analysis and Signal Processing. 2011: 138-142.
[7] Merkle P, Morvan Y, Smolic A, et al. The effects of multiview depth video compression on multiview rendering [J]. Signal Processing: Image Communication, 2009, 24: 73-88.
[8] Morvan Y, Farin D, Peter H, et al. Depth-image compression based on an R-D optimized quadtree decomposition for the transmission of multiview images [C]//IEEE International Conference on Image Processing. 2007: 105-108.
[9] Liu S J, Lai P L, Tian D, et al. Joint trilateral filtering for depth map compression [C]//Proc SPIE, Visual Communications and Image Processing 2010. 2010, DOI:
10.1117/12.863341.
[10] Effendi L P. Non-geometric distortion smoothing approach for depth map preprocessing [J]. IEEE Transactions on Multimedia, 2011, 13(2): 246-254.
[11] Lee P J, Huang X X. 3D motion estimation algorithm in 3D video coding [C]//2011 International Conference on System Science and Engineering. 2011: 338-341.
[12] Fan Y C, Wu S F, Lin B L. Three-dimensional depth map motion estimation and compensation for 3D video compression [J]. IEEE Transactions on Magnetics, 2011, 47(3): 691-695.
[13] Jager F, Wien M, Kosse P. Model-based intra coding for depth maps in 3D video using a depth lookup table [C]//The True Vision-Capture, Transmission and Display of 3D Video
(3DTV-CON). 2012: 15-17.
[14] Tomasi C, Manduchi R. Bilateral filtering for gray and colour images [C]//Proc IEEE Int Conf Comput Vision. 1998: 839-846.
[15] Daribo I, Tillier C, Pesquet-Popescu B. Adaptive wavelet coding of the depth map for stereoscopic view synthesis [C]//IEEE 10th Workshop on Multimedia Signal Processing. 2008:
1244-1245.
[16] Liu S J, Lai P L, Tian D, et al. New depth coding techniques with utilization of corresponding video [J]. IEEE Transactions on Broadcasting, 2011, 57(2): 551-561.
[17] Kwan-Jung O, Vetro A, Yo-Sung H. Depth coding using a boundary reconstruction filter for 3-D video systems [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2011, 21(3): 350-359.
