VR 影像深度跳跃与观众感知反应时间的模型构建

doi:10.12066/j.issn.1007-2861.2177

摘要/Abstract

摘要：

为了探索虚拟现实(virtual reality, VR)影像中深度跳跃对人体视觉系统的影响, 提出了一个新型深度感知模型, 研究了基于 HTC Vive 头戴显示器的视差变化对深度感知的影响, 揭示了跳跃视差变化条件下的感知规律. 实验结果表明: 反应时间与视差变化的绝对值成正比; 逼近视角的视差跳变反应时间较长; 目标深度和深度变化与生理舒适度呈负相关, 深度变化与情绪影响力呈正相关. 将模型应用于实际影像的创作与评估, 可以得到基于水平视差的剪辑后逐像素反应时间分布图.

关键词: 虚拟现实, 视差变化, 深度感知, 反应时间, 视觉舒适度

Abstract:

A new depth perception model was developed to investigate the effect of deep jump on the human visual system in virtual reality images. In addition, the effect of parallax change on depth perception based on HTC Vive head-mounted display was evaluated, and the variation of the perception with jump parallax was analysed. The experimental results showed that the reaction time was proportional to the absolute value of parallax change. Furthermore, the parallax transition response time of the approaching angle of view was longer, the target depth and depth variations were negatively correlated with the physiological comfort, and the variation in the depth was positively correlated with the emotional influence. The model was applied to the creation and evaluation of actual images, and a pixel-by-pixel reaction time distribution map based on horizontal parallax was obtained.

Key words: virtual reality, parallax change, depth perception, reaction time, visual comfort

中图分类号:

TP391.9

田丰, 戴帅凡, 张焱. VR 影像深度跳跃与观众感知反应时间的模型构建[J]. 上海大学学报(自然科学版), 2020, 26(5): 702-714.

TIAN Feng, DAI Shuaifan, ZHANG Yan. Modelling of deep jump and audience perception reaction time in virtual reality images[J]. Journal of Shanghai University（Natural Science Edition）, 2020, 26(5): 702-714.

图/表 9

图1

图2

图3

表1

图4

图5

图6

图7

图8

参考文献 41

[1]	丁妮, 周雯. 虚拟现实艺术到来了吗?——试论 VR 电影创作的视听语言与交互性[J]. 当代电影, 2019(2):160-163.
[2]	田丰, 戴帅凡, 董凤龙, 等. 虚拟现实电影中穿越事件对观众感知的影响[J]. 上海大学学报(自然科学版), 2018,24(4):535-544.
[3]	李晋林. VR 电影叙事面临的挑战与变革[J]. 现代电影技术, 2018(12):4-7.
[4]	Ukai K, Howarth P A. Visual fatigue caused by viewing stereoscopic motion images: background, theories, and observations[J]. Displays, 2008,29(2):106-116.
[5]	Ujike H, Watanabe H. 3D visual fatigue: interaction between ranges of binocular disparity and interocular rotational difference[C]// 2015 IEEE 4th Global Conference on Consumer Electronics (GCCE). 2015: 668-669.
[6]	Kim T, Park J, Lee S, et al. 3D visual discomfort prediction based on physiological optics of binocular vision and foveation[C]// Signal and Information Processing Association Annual Summit and Conference (APSIPA). 2014: 1-4.
[7]	Cho S H, Kang H B. Subjective evaluation of visual discomfort caused from stereoscopic 3D video using perceptual importance map[C]// TENCON 2012 IEEE Region 10 Conference. 2012: 1-6.
[8]	Yano S, Emoto M, Mitsuhashi T. Two factors in visual fatigue caused by stereoscopic HDTV images[J]. Displays, 2004,25(4):141-150.
[9]	Tam W J, Speranza F, Carlos V, et al. Visual comfort: stereoscopic objects moving in the horizontal and mid-sagittal planes[C]// Proc SPIE 8288, Stereoscopic Displays and Applications. 2012: 828813.
[10]	Li J, Barkowsky M, Le Callet P. Visual discomfort of stereoscopic 3D videos: influence of 3D motion[J]. Displays, 2014,35(1):49-57.
[11]	张地. 3D 显示视觉感知特性研究[D]. 北京: 北京邮电大学, 2017: 122.
[12]	Wibirama S, Hamamoto K. Investigation of visually induced motion sickness in dynamic 3D contents based on subjective judgment, heart rate variability, and depth gaze behavior[C]// 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 2014: 4803-4806.
[13]	石国忠. 3D 观看中的视觉疲劳研究[D]. 北京: 北京邮电大学, 2015: 48.
[14]	Liu A, Lin W, Paul M, et al. Just noticeable difference for images with decomposition model for separating edge and textured regions[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2010,20(11):1648-1652.
[15]	De Silva D V S X Ekmekcioglu E, Fernando W A C, et al. Display dependent preprocessing of depth maps based on just noticeable depth difference modeling[J]. IEEE Journal of Selected Topics in Signal Processing, 2011,5(2):335-351.
[16]	Silva V D, Fernando A, Worrall S, et al. Sensitivity analysis of the human visual system for depth cues in stereoscopic 3-D displays[J]. IEEE Transactions on Multimedia, 2011,13(3):498-506.
[17]	Jung S W, Ko S J. Depth sensation enhancement using the just noticeable depth difference[J]. IEEE Transactions on Image Processing, 2012,21(8):3624-3637. doi: 10.1109/TIP.2012.2191569 pmid: 22453640
[18]	Jung S W. A modified model of the just noticeable depth difference and its application to depth sensation enhancement[J]. IEEE Transactions on Image Processing, 2013,22(10):3892-3903. doi: 10.1109/TIP.2013.2263150 pmid: 23686954
[19]	Sohn H, Jung Y J, Lee S I, et al. Predicting visual discomfort using object size and disparity information in stereoscopic images[J]. IEEE Transactions on Broadcasting, 2013,59(1):28-37.
[20]	Oh H, Lee S, Bovik A C. Stereoscopic 3D visual discomfort prediction: a dynamic accommodation and vergence interaction model[J]. IEEE Transactions on Image Processing, 2016,25(2):615-629. doi: 10.1109/TIP.2015.2506340 pmid: 26672036
[21]	Park H, Lee H, Sull S. Efficient viewer-centric depth adjustment based on virtual fronto-parallel planar projection in stereo 3D images[J]. IEEE Transactions on Multimedia, 2014,16(2):326-336.
[22]	李素梅, 李永达, 朱丹. 基于深度感知和主观评价的影响立体图像舒适度的视差范围研究[J]. 光电子·激光, 2017,28(9):1045-1054.
[23]	戴帅凡, 田丰, 黄超, 等. 3D 电影视觉舒适性研究综述[J] . 上海大学学报(自然科学版), 2017,23(3):364-377.
[24]	Naceri A, Chellali R. The effect of isolated disparity on depth perception in real and virtual environments[C]// 2012 IEEE Virtual Reality Workshops (VRW). 2012: 107-108.
[25]	Rousset T, Bourdin C, Cédric G, et al. Does virtual reality affect visual perception of egocentric distance?[C]// 2015 IEEE Virtual Reality (VR). 2015: 277-278.
[26]	Jones J A, Swan J E I, Singh G, et al. Peripheral visual information and its effect on the perception of egocentric depth in virtual and augmented environments[C]//2011 IEEE Virtual Reality Conference. 2011: 215-216.
[27]	Li B, Zhang R, Kuhl S. Minication affects action-based distance judgments in Oculus Rift HMDs[C]//ACM Symposium on Applied Perception. 2014: 91-94.
[28]	Creem-Regehr S H, Stefanucci J K, Thompson W B, et al. Egocentric distance perception in the Oculus Rift (DK2)[C]// ACM Symposium on Applied Perception. 2015: 47-50.
[29]	Peer A, Ponto K. Evaluating perceived distance measures in room-scale spaces using consumer-grade head mounted displays[C]// 2017 IEEE Symposium on 3D User Interfaces (3DUI). 2017: 83-86.
[30]	Renner R S, Velichkovsky B M, Helmert J R. The perception of egocentric distances in virtual environments: a review[J]. ACM Computing Surveys, 2013,46(2):1-40.
[31]	Valkov D, Martens J, Hinrichs K. Evaluation of the effect of a virtual avatar's representation on distance perception in immersive virtual environments[C]// 2016 IEEE Virtual Reality (VR). 2016: 305-306.
[32]	Kelly J W, Hammel W W, Siegel Z D, et al. Recalibration of perceived distance in virtual environments occurs rapidly and transfers asymmetrically across scale[J]. IEEE Transactions on Visualization and Computer Graphics, 2014,20(4):588-595. pmid: 24650986
[33]	Park J, Lee S, Bovik A C. 3D visual discomfort prediction: vergence, foveation, and the physiological optics of accommodation[J]. IEEE Journal of Selected Topics in Signal Processing, 2014,8(3):415-427.
[34]	Berthouzoz F, Li W, Agrawala M. Tools for placing cuts and transitions in interview video[J]. ACM Transactions on Graphics, 2012,31(4):1-8.
[35]	Men L, Bryan-Kinns N, Hassard A S, et al. The impact of transitions on user experience in virtual reality[C]// 2017 IEEE Virtual Reality (VR). 2017: 285-286.
[36]	Moghadam K R, Ragan E D. Towards understanding scene transition techniques in immersive 360 movies and cinematic experiences[C]// 2017 IEEE Virtual Reality (VR). 2017: 375-376.
[37]	Sitzmann V, Serrano A, Pavel A, et al. Saliency in VR: how do people explore virtual environments ?[J]. IEEE Transactions on Visualization and Computer Graphics, 2018,24(4):1633-1642. doi: 10.1109/TVCG.2018.2793599 pmid: 29553930
[38]	Mu T J, Sun J J, Martin R R. A response time model for abrupt changes in binocular disparity[J]. The Visual Computer, 2015,31(5):675-687.
[39]	Lee E C, Heo H, Park K R. The comparative measurements of eyestrain caused by 2D and 3D displays[J]. IEEE Transactions on Consumer Electronics, 2010,56(3):1677-1683.
[40]	Inoue T, Kato Y O, Ozawa J. Evaluating visual fatigue by sensing eye movement during viewing of 3D images[C]// The 1st IEEE Global Conference on Consumer Electronics 2012. 2012:486-490.
[41]	Eskicioglu A M, Fisher P S. Image quality measures and their performance[J]. IEEE Transactions on Communications, 1995,43(12):2959-2965.