基于边缘的面向虚拟视绘制的深度编码算法

doi:10.3969/j.issn.1007-2861.2103.07.043

上海大学学报(自然科学版) ›› 2014, Vol. 20 ›› Issue (4): 450-457.doi: 10.3969/j.issn.1007-2861.2103.07.043

基于边缘的面向虚拟视绘制的深度编码算法

刘超, 安平, 赵冰, 闫吉辰, 张兆杨

上海大学通信与信息工程学院新型显示技术及应用集成教育部重点实验室, 上海 200072

收稿日期:2013-10-22 出版日期:2014-08-25 发布日期:2014-08-25
通讯作者: 安平(1968—), 女, 教授, 博士生导师, 博士, 研究方向为图像及视频处理. E-mail: anping@shu.edu.cn E-mail:anping@shu.edu.cn
作者简介:安平(1968—), 女, 教授, 博士生导师, 博士, 研究方向为图像及视频处理. E-mail: anping@shu.edu.cn
基金资助:
国家自然科学基金资助项目(61172096, 61171084); 上海市科委公共服务平台建设专项基金资助项目(12DZ2293500)

Edge Based Depth Coding for Virtual View Synthesis

LIU Chao, AN Ping, ZHAO Bing, YAN Ji-chen, ZHANG Zhao-yang

School of Communication and Information Engineering, Key Laboratory of Ministry of Education for Advanced Display and System Application, Shanghai University, Shanghai 200072, China

Received:2013-10-22 Online:2014-08-25 Published:2014-08-25

摘要/Abstract

摘要： 深度图由锐边缘包围纹理的匀质区域组成, 因此边缘信息对于虚拟视的绘制至关重要. 由于深度图不同区域的失真会对绘制虚拟视质量产生不同的影响, 提出一种基于边缘的面向虚拟视绘制的深度编码算法. 将深度图划分为边缘区域和平坦区域: 对于边缘区域, 采用全搜索策略, 以提高边缘区域的编码质量; 对于平坦区域, 采用SKIP模式和16×16模式, 以提高编码效率. 除此之外, 在去块滤波中, 提出一种利用纹理图和深度图边缘相似性的可保护深度图片边缘的中值三边滤波器. 实验结果表明, 与JM编码方案相比, 该方法在码率基本不变的前提下, 提高了编码效率和虚拟视绘制的主观质量.

关键词: 边缘检测, 深度编码, 虚拟视绘制, 中值三边滤波器

Abstract: Depth maps typically consist of homogeneous areas partitioned by sharp edges representing depth discontinuities, and sharp discontinuities are important in the view rendering. As different depth distortions have different impacts on the virtual view synthesis, an edge based depth coding method is proposed for virtual view synthesis. The depth map is first divided into edge regions and smooth regions. Full search is used for edge regions in which SKIP and 16×16 modes are used in smooth regions. Besides, a median trilateral filter is designed according to the structure similarity between depth and corresponding
video. Experimental results indicate that, compared with JM, the proposed algorithm improves coding efficiency and can achieve high-quality 3D rendering.

Key words: edge detection, median trilateral filter, virtual view synthesis, depth coding

中图分类号:

TN 919.8

刘超, 安平, 赵冰, 闫吉辰, 张兆杨. 基于边缘的面向虚拟视绘制的深度编码算法[J]. 上海大学学报(自然科学版), 2014, 20(4): 450-457.

LIU Chao, AN Ping, ZHAO Bing, YAN Ji-chen, ZHANG Zhao-yang. Edge Based Depth Coding for Virtual View Synthesis[J]. Journal of Shanghai University（Natural Science Edition）, 2014, 20(4): 450-457.

参考文献

[1] He X, Jin X, Wang M H, et al. A novel depth-Image based view synthesis scheme for multiview and 3DTV [J]. Computer Science, Advances in Multimedia Modeling, 2011, 6523: 161-170.

[2] Daribo I, Saito H. A novel inpainting-based layered depth video for 3DTV [J]. IEEE Transactions on Broadcasting, 2011, 57(2): 533-541.
[3] 王奎, 安平, 张兆杨. Kinect深度图像快速修复算法[J]. 上海大学学报: 自然科学版, 2012, 18(5): 454-458.

[4] Fehn C. Depth-image-based rendering(DIBR), compression and transmission for a new approach on 3DTV [C]//Proceedings in SPIE Stereoscopic Displays and Virtual Reality Systems XI. 2004: 93-104.

[5] Shao F, Jiang G Y, Mei H, et al. Asymmetric coding of multi-view video plus depth based 3-D video for view rendering [J]. IEEE Transactions on Multimedia, 2012, 14(1): 157-167.

[6] Wang Z, Zhou J. A novel approach for depth image based rendering, based on non-linear transformation of depth values [C]//2011 International Conference on Image Analysis and Signal Processing. 2011: 138-142.

[7] Merkle P, Morvan Y, Smolic A, et al. The effects of multiview depth video compression on multiview rendering [J]. Signal Processing: Image Communication, 2009, 24: 73-88.

[8] Morvan Y, Farin D, Peter H, et al. Depth-image compression based on an R-D optimized quadtree decomposition for the transmission of multiview images [C]//IEEE International Conference on Image Processing. 2007: 105-108.

[9] Liu S J, Lai P L, Tian D, et al. Joint trilateral filtering for depth map compression [C]//Proc SPIE, Visual Communications and Image Processing 2010. 2010, DOI:

10.1117/12.863341.

[10] Effendi L P. Non-geometric distortion smoothing approach for depth map preprocessing [J]. IEEE Transactions on Multimedia, 2011, 13(2): 246-254.

[11] Lee P J, Huang X X. 3D motion estimation algorithm in 3D video coding [C]//2011 International Conference on System Science and Engineering. 2011: 338-341.

[12] Fan Y C, Wu S F, Lin B L. Three-dimensional depth map motion estimation and compensation for 3D video compression [J]. IEEE Transactions on Magnetics, 2011, 47(3): 691-695.

[13] Jager F, Wien M, Kosse P. Model-based intra coding for depth maps in 3D video using a depth lookup table [C]//The True Vision-Capture, Transmission and Display of 3D Video

(3DTV-CON). 2012: 15-17.

[14] Tomasi C, Manduchi R. Bilateral filtering for gray and colour images [C]//Proc IEEE Int Conf Comput Vision. 1998: 839-846.

[15] Daribo I, Tillier C, Pesquet-Popescu B. Adaptive wavelet coding of the depth map for stereoscopic view synthesis [C]//IEEE 10th Workshop on Multimedia Signal Processing. 2008:

1244-1245.

[16] Liu S J, Lai P L, Tian D, et al. New depth coding techniques with utilization of corresponding video [J]. IEEE Transactions on Broadcasting, 2011, 57(2): 551-561.

[17] Kwan-Jung O, Vetro A, Yo-Sung H. Depth coding using a boundary reconstruction filter for 3-D video systems [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2011, 21(3): 350-359.

基于边缘的面向虚拟视绘制的深度编码算法

Edge Based Depth Coding for Virtual View Synthesis

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 2

编辑推荐

Metrics

本文评价

[1]	徐良玉1, 马录坤1, 谢燮1, 彭艳1, 彭艳青2, 崔建祥1. 基于结构森林边缘检测和Hough变换的海天线检测[J]. 上海大学学报(自然科学版), 2017, 23(1): 47-55.
[2]	陈颖;陆亨立. 一种新的虹膜定位算法[J]. 上海大学学报(自然科学版), 2007, 13(2): 148-150 .