VR 影像深度跳跃与观众感知反应时间的模型构建

doi:10.12066/j.issn.1007-2861.2177

Abstract

Abstract:

A new depth perception model was developed to investigate the effect of deep jump on the human visual system in virtual reality images. In addition, the effect of parallax change on depth perception based on HTC Vive head-mounted display was evaluated, and the variation of the perception with jump parallax was analysed. The experimental results showed that the reaction time was proportional to the absolute value of parallax change. Furthermore, the parallax transition response time of the approaching angle of view was longer, the target depth and depth variations were negatively correlated with the physiological comfort, and the variation in the depth was positively correlated with the emotional influence. The model was applied to the creation and evaluation of actual images, and a pixel-by-pixel reaction time distribution map based on horizontal parallax was obtained.

Key words: virtual reality, parallax change, depth perception, reaction time, visual comfort

CLC Number:

TP391.9

TIAN Feng, DAI Shuaifan, ZHANG Yan. Modelling of deep jump and audience perception reaction time in virtual reality images[J]. Journal of Shanghai University（Natural Science Edition）, 2020, 26(5): 702-714.

Figures/Tables 9

Fig. 1

Fig. 2

Fig. 3

Table 1

Fig. 4

Fig. 5

Fig. 6

Fig. 7

Fig. 8

References 41

[1]	丁妮, 周雯. 虚拟现实艺术到来了吗?——试论 VR 电影创作的视听语言与交互性[J]. 当代电影, 2019(2):160-163.
[2]	田丰, 戴帅凡, 董凤龙, 等. 虚拟现实电影中穿越事件对观众感知的影响[J]. 上海大学学报(自然科学版), 2018,24(4):535-544.
[3]	李晋林. VR 电影叙事面临的挑战与变革[J]. 现代电影技术, 2018(12):4-7.
[4]	Ukai K, Howarth P A. Visual fatigue caused by viewing stereoscopic motion images: background, theories, and observations[J]. Displays, 2008,29(2):106-116.
[5]	Ujike H, Watanabe H. 3D visual fatigue: interaction between ranges of binocular disparity and interocular rotational difference[C]// 2015 IEEE 4th Global Conference on Consumer Electronics (GCCE). 2015: 668-669.
[6]	Kim T, Park J, Lee S, et al. 3D visual discomfort prediction based on physiological optics of binocular vision and foveation[C]// Signal and Information Processing Association Annual Summit and Conference (APSIPA). 2014: 1-4.
[7]	Cho S H, Kang H B. Subjective evaluation of visual discomfort caused from stereoscopic 3D video using perceptual importance map[C]// TENCON 2012 IEEE Region 10 Conference. 2012: 1-6.
[8]	Yano S, Emoto M, Mitsuhashi T. Two factors in visual fatigue caused by stereoscopic HDTV images[J]. Displays, 2004,25(4):141-150.
[9]	Tam W J, Speranza F, Carlos V, et al. Visual comfort: stereoscopic objects moving in the horizontal and mid-sagittal planes[C]// Proc SPIE 8288, Stereoscopic Displays and Applications. 2012: 828813.
[10]	Li J, Barkowsky M, Le Callet P. Visual discomfort of stereoscopic 3D videos: influence of 3D motion[J]. Displays, 2014,35(1):49-57.
[11]	张地. 3D 显示视觉感知特性研究[D]. 北京: 北京邮电大学, 2017: 122.
[12]	Wibirama S, Hamamoto K. Investigation of visually induced motion sickness in dynamic 3D contents based on subjective judgment, heart rate variability, and depth gaze behavior[C]// 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 2014: 4803-4806.
[13]	石国忠. 3D 观看中的视觉疲劳研究[D]. 北京: 北京邮电大学, 2015: 48.
[14]	Liu A, Lin W, Paul M, et al. Just noticeable difference for images with decomposition model for separating edge and textured regions[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2010,20(11):1648-1652.
[15]	De Silva D V S X Ekmekcioglu E, Fernando W A C, et al. Display dependent preprocessing of depth maps based on just noticeable depth difference modeling[J]. IEEE Journal of Selected Topics in Signal Processing, 2011,5(2):335-351.
[16]	Silva V D, Fernando A, Worrall S, et al. Sensitivity analysis of the human visual system for depth cues in stereoscopic 3-D displays[J]. IEEE Transactions on Multimedia, 2011,13(3):498-506.
[17]	Jung S W, Ko S J. Depth sensation enhancement using the just noticeable depth difference[J]. IEEE Transactions on Image Processing, 2012,21(8):3624-3637. doi: 10.1109/TIP.2012.2191569 pmid: 22453640
[18]	Jung S W. A modified model of the just noticeable depth difference and its application to depth sensation enhancement[J]. IEEE Transactions on Image Processing, 2013,22(10):3892-3903. doi: 10.1109/TIP.2013.2263150 pmid: 23686954
[19]	Sohn H, Jung Y J, Lee S I, et al. Predicting visual discomfort using object size and disparity information in stereoscopic images[J]. IEEE Transactions on Broadcasting, 2013,59(1):28-37.
[20]	Oh H, Lee S, Bovik A C. Stereoscopic 3D visual discomfort prediction: a dynamic accommodation and vergence interaction model[J]. IEEE Transactions on Image Processing, 2016,25(2):615-629. doi: 10.1109/TIP.2015.2506340 pmid: 26672036
[21]	Park H, Lee H, Sull S. Efficient viewer-centric depth adjustment based on virtual fronto-parallel planar projection in stereo 3D images[J]. IEEE Transactions on Multimedia, 2014,16(2):326-336.
[22]	李素梅, 李永达, 朱丹. 基于深度感知和主观评价的影响立体图像舒适度的视差范围研究[J]. 光电子·激光, 2017,28(9):1045-1054.
[23]	戴帅凡, 田丰, 黄超, 等. 3D 电影视觉舒适性研究综述[J] . 上海大学学报(自然科学版), 2017,23(3):364-377.
[24]	Naceri A, Chellali R. The effect of isolated disparity on depth perception in real and virtual environments[C]// 2012 IEEE Virtual Reality Workshops (VRW). 2012: 107-108.
[25]	Rousset T, Bourdin C, Cédric G, et al. Does virtual reality affect visual perception of egocentric distance?[C]// 2015 IEEE Virtual Reality (VR). 2015: 277-278.
[26]	Jones J A, Swan J E I, Singh G, et al. Peripheral visual information and its effect on the perception of egocentric depth in virtual and augmented environments[C]//2011 IEEE Virtual Reality Conference. 2011: 215-216.
[27]	Li B, Zhang R, Kuhl S. Minication affects action-based distance judgments in Oculus Rift HMDs[C]//ACM Symposium on Applied Perception. 2014: 91-94.
[28]	Creem-Regehr S H, Stefanucci J K, Thompson W B, et al. Egocentric distance perception in the Oculus Rift (DK2)[C]// ACM Symposium on Applied Perception. 2015: 47-50.
[29]	Peer A, Ponto K. Evaluating perceived distance measures in room-scale spaces using consumer-grade head mounted displays[C]// 2017 IEEE Symposium on 3D User Interfaces (3DUI). 2017: 83-86.
[30]	Renner R S, Velichkovsky B M, Helmert J R. The perception of egocentric distances in virtual environments: a review[J]. ACM Computing Surveys, 2013,46(2):1-40.
[31]	Valkov D, Martens J, Hinrichs K. Evaluation of the effect of a virtual avatar's representation on distance perception in immersive virtual environments[C]// 2016 IEEE Virtual Reality (VR). 2016: 305-306.
[32]	Kelly J W, Hammel W W, Siegel Z D, et al. Recalibration of perceived distance in virtual environments occurs rapidly and transfers asymmetrically across scale[J]. IEEE Transactions on Visualization and Computer Graphics, 2014,20(4):588-595. pmid: 24650986
[33]	Park J, Lee S, Bovik A C. 3D visual discomfort prediction: vergence, foveation, and the physiological optics of accommodation[J]. IEEE Journal of Selected Topics in Signal Processing, 2014,8(3):415-427.
[34]	Berthouzoz F, Li W, Agrawala M. Tools for placing cuts and transitions in interview video[J]. ACM Transactions on Graphics, 2012,31(4):1-8.
[35]	Men L, Bryan-Kinns N, Hassard A S, et al. The impact of transitions on user experience in virtual reality[C]// 2017 IEEE Virtual Reality (VR). 2017: 285-286.
[36]	Moghadam K R, Ragan E D. Towards understanding scene transition techniques in immersive 360 movies and cinematic experiences[C]// 2017 IEEE Virtual Reality (VR). 2017: 375-376.
[37]	Sitzmann V, Serrano A, Pavel A, et al. Saliency in VR: how do people explore virtual environments ?[J]. IEEE Transactions on Visualization and Computer Graphics, 2018,24(4):1633-1642. doi: 10.1109/TVCG.2018.2793599 pmid: 29553930
[38]	Mu T J, Sun J J, Martin R R. A response time model for abrupt changes in binocular disparity[J]. The Visual Computer, 2015,31(5):675-687.
[39]	Lee E C, Heo H, Park K R. The comparative measurements of eyestrain caused by 2D and 3D displays[J]. IEEE Transactions on Consumer Electronics, 2010,56(3):1677-1683.
[40]	Inoue T, Kato Y O, Ozawa J. Evaluating visual fatigue by sensing eye movement during viewing of 3D images[C]// The 1st IEEE Global Conference on Consumer Electronics 2012. 2012:486-490.
[41]	Eskicioglu A M, Fisher P S. Image quality measures and their performance[J]. IEEE Transactions on Communications, 1995,43(12):2959-2965.

Modelling of deep jump and audience perception reaction time in virtual reality images

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 9

References 41

Related Articles 6

Recommended Articles

Metrics

Comments

[1]	Tingting ZHANG, Yan ZHANG, Feng TIAN. Axis rules of VR film editing of scenes [J]. Journal of Shanghai University（Natural Science Edition）, 2019, 25(6): 888-897.
[2]	TIAN Feng, DAI Shuaifan, DONG Fenglong, ZHANG Zhiyi, CHU Lingwei. Effect of crossing event in VR on perception of the audience [J]. Journal of Shanghai University（Natural Science Edition）, 2018, 24(4): 535-544.
[3]	TIAN Feng1,2, XU Haojun1, WANG Pan1, HOU Xiaofei1, HUA Minlei1. Evaluation criteria for visual comfort in 3D-VR [J]. Journal of Shanghai University（Natural Science Edition）, 2017, 23(3): 324-332.
[4]	ZHANG Tingting1, TIAN Feng1,2, Lü Wei3, WANG Yihua4, HUANG Chao1. Survey of VR applications in interactive films and games [J]. Journal of Shanghai University（Natural Science Edition）, 2017, 23(3): 342-.
[5]	DAI Shuaifan1, TIAN Feng1,2, HUANG Chao1, TANG Haifeng3, Lü Wei4. Survey on visual comfort of 3D movies [J]. Journal of Shanghai University（Natural Science Edition）, 2017, 23(3): 364-377.
[6]	SHE Shen-si;WU Jia-qi;ZHANG Wang-ling;YUAN Zheng-peng;CHEN Jin-bo. Control of Interactive Platform for Motion Simulation [J]. Journal of Shanghai University（Natural Science Edition）, 2007, 13(3): 263-268 .