一种深度图失真引入的虚拟视失真估计方法

doi:10.3969/j.issn.1007-2861.2014.03.016

上海大学学报(自然科学版) ›› 2015, Vol. 21 ›› Issue (4): 402-413.doi: 10.3969/j.issn.1007-2861.2014.03.016

一种深度图失真引入的虚拟视失真估计方法

李春华1,2, 安平1,3, 张兆扬1,3

(1. 上海大学通信与信息工程学院, 上海200444; 2. 河北科技大学信息科学与工程学院, 石家庄050018; 3. 上海大学新型显示技术及应用集成教育部重点实验室, 上海200072)

收稿日期:2014-02-19 出版日期:2015-08-31 发布日期:2015-08-31
通讯作者: 安平(1968—), 女, 教授, 博士生导师, 博士, 研究方向为3D视频处理. E-mail:anping@shu.edu.cn
基金资助:
国家自然科学基金资助项目(61172096)

Estimation of view synthesis distortion caused by depth map distortion

LI Chun-hua1,2, AN Ping1,3, ZHANG Zhao-yang1,3

(1. School of Communication and Information Engineering, Shanghai University, Shanghai 200444, China; 2. College of Information Science and Engineering, Hebei University of Science and Technology, Shijiazhuang 050018, China; 3. Key Laboratory of Advanced Display and System Applications, Shanghai University, Shanghai 200072, China)

Received:2014-02-19 Online:2015-08-31 Published:2015-08-31

摘要/Abstract

摘要： 提出了一种深度图失真引入的虚拟视失真估计方法. 该方法依据能量一致性假设要求, 将深度图宏块划分为平坦宏块和非平坦宏块. 平坦宏块使用频域块级方法, 非平坦宏块使用时域像素级方法估计由深度图失真造成的绘制视失真. 虚拟视失真采用左右绘制视融合计算, 并计入虚拟视中空洞修复引入的失真. 该方法在宏块分类判据中综合了相机参数, 对于不同拍摄条件下的视频序列可以使用相同的判别阈值获得最佳区域划分, 通用性较强. 实验结果证明, 该方法兼顾了估计准确性和复杂度, 对于在有限码率预算条件下提高深度视频编码效率、优化三维视频码率分配具有重要的指导意义.

关键词: 三维视频, 深度图失真, 失真估计, 虚拟视失真, 自由视点电视

Abstract: A method for estimating the virtual view image distortion caused by the depth map coding distortion is proposed. The depth map is divided into macro blocks according to the coding unit. These macroblocks are then classified into uniform macroblocks and nonuniform macroblocks according to the energy density consistency constraint. The rendered view distortion in the uniform macroblocks is estimated by a block-level frequency domain method, while that in the non-uniform macroblocks by a pixel-level time domain method. Finally, the virtual view distortion is combined with both rendered view distortions. The distortion introduced by inpainting is also computed. With a shooting parameter, it can correctly classify the macroblocks of depth map sequences acquired from different shooting conditions. Simulation results show that the proposed method can accurately estimate virtual view distortion caused by depth map distortion. It achieves effective balance between accuracy and algorithm complexity, which is important to guide 3D video (3DV) coding and rate allocation under the limited bit rate budget.

Key words: 3D video (3DV), depth map distortion, distortion estimation, freeview TV (FTV), virtual view image distortion

中图分类号:

TN 941.1

李春华1,2, 安平1,3, 张兆扬1,3. 一种深度图失真引入的虚拟视失真估计方法[J]. 上海大学学报(自然科学版), 2015, 21(4): 402-413.

LI Chun-hua1,2, AN Ping1,3, ZHANG Zhao-yang1,3. Estimation of view synthesis distortion caused by depth map distortion[J]. Journal of Shanghai University（Natural Science Edition）, 2015, 21(4): 402-413.

参考文献

[1] 张兆扬, 安平, 张之江, 等. 二维和三维视频处理及立体显示技术[M]. 北京: 科学出版社, 2010: 1-100.

[2] MPEG. Applications and requirements on 3D video coding [C]//ISO/IEC JTC1/SC29/WG11. 2009: 13-29.

[3] Fehn C. Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3D-TV [C]//Proceedings of SPIE Stereoscopic Displays and Virtual Reality Systems Ⅺ. 2004: 93-104.

[4] Rusanovskyy D, Zhang L, Chen F C, et al. 3D-AVC test model 8 [C]//Joint Collaborative Team on 3D Video Coding Extension Development of ITU-T SG 16 WP 3 and ISO/IEC JTC

1/SC 29/WG 11 JCT3V-F1003. 2013: 1-62.

[5] Zhang L, Tech G, Wegner K, et al. Test model 7 of 3D-HEVC and MV-HEVC [C]//Joint Collaborative Team on 3D Video Coding Extension Development of ITU-T SG 16 WP 3 and

ISO/IEC JTC 1/SC 29/WG 11 JCT3V-G1005. 2014: 3-40.

[6] Liu Y W, Huang Q M, Ma S W, et al. Joint video/depth rate allocation for 3D video coding based on view synthesis distortion model [J]. Signal Proc Image Comm, 2009, 24(8): 666-681.

[7] Tech G, Schwerz H, Muller K, et al. 3D video coding using the synthesized view distortion change [C]//PCS. 2012: 25-28.

[8] Merkle P, Morvan Y, Smolic A, et al. The effects of multiview depth video compression on multiview rendering [J]. Singal Proc Image Comm, 2009, 24(1/2): 73-88.

[9] Lai P, Ortega A, Dore A, et al. Improving view rendering quality and coding efficiency by suppressing compression artifacts in depth-image coding [C]//Proc of Visual Communic and

Image. 2009: 894-897.

[10] Wang Q F, Ji X Y, Dai Q H, et al. Free viewpoint video coding with rate-distortion analysis [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2012, 22(6):

875-889.

[11] Kim W S, Ortega A, Lai P, et al. Depth map distortion analysis for view rendering and depth coding [C]//ICIP. 2009: 721-724.

[12] Kim W S, Ortega A, Lai P, et al. Depth map coding with distortion estimation of rendered view [C]//Proc of SPIE Visual Information Processing and Communication. 2010: 3534-3545.

[13] Oh B T, Lee J, Park D. Depth map coding based on synthesized view distortion function [J]. IEEE Journal of Selected Topics in Signal Processing, 2011, 5(7): 1344-1352.

[14] Oh B T, Lee J, Dusik P. Fast joint bit-allocation between texture and depth maps for 3D video coding [C]. ICCE. 2013: 193-194.

一种深度图失真引入的虚拟视失真估计方法

Estimation of view synthesis distortion caused by depth map distortion

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 0

编辑推荐

Metrics

本文评价