上海大学学报(自然科学版) ›› 2012, Vol. 18 ›› Issue (5): 454-458.doi: 10.3969/j.issn.1007-2861.2012.05.003

• 通信与信息工程 • 上一篇    下一篇

Kinect深度图像快速修复算法

王奎1,安平1,2,张兆杨1,2,程浩1,李贺建1   

  1. 1.上海大学 通信与信息工程学院,上海 200072; 2.新型显示技术及应用集成教育部重点实验室,上海 200072
  • 收稿日期:2011-11-18 出版日期:2012-10-30 发布日期:2012-10-30
  • 通讯作者: 安平(1968~),女,教授,博士生导师,博士,研究方向为数字视频处理及立体视觉.E-mail:anping@shu.edu.cn E-mail:anping@shu.edu.cn
  • 基金资助:

    国家自然科学基金资助项目(60832003,61172096,61171084);上海市科委重点资助项目(10510500500);上海市教委重点资助项目(09ZZ90)

Fast Inpainting Algorithm for Kinect Depth Map

WANG Kui1,AN Ping1,2,ZHANG Zhao-yang1,2,CHENG Hao1,LI He-jian1   

  1. 1. School of Communication and Information Engineering, Shanghai University, Shanghai 200072, China;
    2. Key Laboratory of Advanced Display and System Applications, Ministry of Education, Shanghai 200072, China
  • Received:2011-11-18 Online:2012-10-30 Published:2012-10-30

摘要: 深度提取是基于“纹理+深度”自由立体视频系统的关键技术,而立体视频实际应用系统需要高效快速的深度图提取.提出一种针对Kinect提取深度图的快速修复算法.首先,对Kinect提取的彩色纹理图和深度图进行对齐裁剪,并采用背景填充算法对裁剪后的深度图进行初步修复;然后,对初步修复后的深度图进行基于颜色匹配的快速修复,得到质量较好的可用深度图.实验结果表明,本算法能有效修复原始深度图中由于遮挡而引起的空洞,获取的深度图整体平滑度好、边缘清晰;在普通PC机上达到25~30 帧/s的处理帧率,实现了深度图的实时提取.

关键词: Kinect, 立体视频, 深度图修复, 实时获取, 颜色匹配

Abstract: Depth extraction is a key step in 3D video system based on texture plus depth. Real application systems require high efficiency and fast depth extraction. This paper presents a fast inpainting algorithm for Kinect depth map. This paper clips and aligns the origin color and depth images captured by Kinect, and partially fill holes in the clipped depth image using a background based method. Then this paper uses a fast inpainting algorithm based on color match to fill the remaining holes in the depth image to obtain a better depth image. Experimental results show that the proposed algorithm can efficiently repair errors in the original depth map such as holes caused by occlusion. Finally we obtain a smooth depth map with clear edges. The processing speed can reach 25~30 frame/s by using an ordinary desktop computer to realize real-time depth map extraction.

Key words: color match, depth map inpainting, Kinect, real-time capture, stereo video

中图分类号: