沉浸式VR电力训练中的注意力引导

doi:10.12066/j.issn.1007-2861.2009

摘要/Abstract

摘要：

由于电力运检过程中存在人身危险, 工作者要求具有极高的专业技能. 传统的视频培训缺乏沉浸感, 培训效率低, 而实操培训成本高, 对初学者风险较大. 研制沉浸式虚拟变电站运检训练系统, 实现序列训练、信息提示和评价打分等功能, 并应用于电力运检安全培训. 提出并设计了6种视觉引导和1种声音引导方式, 并进行了对比分析. 实验结果表明: 相较于无引导方式, 7种引导方式都明显提高了训练的效率; 聚光灯、边缘高亮、边缘闪烁引导在平衡训练效率和沉浸感方面表现优异.

关键词: 沉浸式VR, 变电站运检, 注意力引导, 用户评价

Abstract:

There is personal danger in the process of electric power inspection, which puts forward very high professional skill requirements for workers. Traditional video training lacks immersion and training efficiency is low, while the actual training cost is high with huge risk for beginners. An immersion virtual substation training system has been developed, which has the functions of sequence training, information prompting and evaluation scoring, and has been applied to the safety training of electric power inspection. 6 visual guidance and 1 sound guidance methods are designed, and a comparative study of attention guidance in VR training was conducted. The experimental results show that compared with the non boot mode, the 7 guidance methods can significantly improve the training efficiency, and spotlights, edge highlight, edge flashing guide in balance training efficiency and immersion performance is excellent.

Key words: immersive VR, substation inspection, attention guidance, user evaluation

中图分类号:

TP391.41

张婷婷, 侯晓菲, 田丰, 王轶华. 沉浸式VR电力训练中的注意力引导[J]. 上海大学学报(自然科学版), 2018, 24(4): 553-563.

ZHANG Tingting, HOU Xiaofei, TIAN Feng, WANG Yihua. Attention guidance of immersive electricity training in VR[J]. Journal of Shanghai University（Natural Science Edition）, 2018, 24(4): 553-563.

图/表 9

图1

图2

图3

图4

图5

图6

表1

图7

表2

参考文献 45

[1]	Tanaka E H, Paludo J A, Bacchetti R , et al. Immersive virtual training for substation electricians[C] // IEEE Virtual Reality. 2017: 451-452.
[2]	Li Y Z, Du H J . A state-of-art on the virtual reality and design of a vr system based on internet[J]. Journal of Environmental Sciences, 2002,38(15):127-129.
[3]	Wu H P . What video games have to teach us about learning and literacy[J]. New England Reading Association Journal, 2006,42(1):20.
[4]	Kishishita N, Kiyokawa K, Orlosky J , et al. Analysing the effects of a wide field of view augmented reality display on search performance in divided attention tasks[C] // IEEE International Symposium on Mixed and Augmented Reality. 2014: 177-186.
[5]	Zhao J, Lafemina P, Wallgrun J O , et al. iVR for the geosciences[C] // IEEE Virtual Reality Workshop on K-12 Embodied Learning Through Virtual & Augmented Reality (KELVAR). 2017: 1-6.
[6]	Hu X Q, Su R, He L . The design and implementation of the 3D educational game based on VR headsets[J]. International Symposium on Educational Technology (ISET). 2016, DOI: 10.1109/ISET.2016.15.
[7]	Parmar D, Isaac J, Babu S V , et al. Programming moves: design and evaluation of applying embodied interaction in virtual environments to enhance computational thinking in middle school students[C] // IEEE Virtual Reality. 2016: 131-140.
[8]	Coles C D, Strickland D C, Padgett L , et al. Games that "work": using computer games to teach alcohol-affected children about fire and street safety[J]. Research in Developmental Disabilities, 2007,28(5):518-530.
[9]	杜宝江, 查亮, 林灵 . 消防安全教育虚拟火灾逃生体验舱系统的设计[J]. 系统仿真学报, 2017,29(2):453-461.
[10]	Sharma S, Jerripothula S, Mackey S , et al. Immersive virtual reality environment of a subway evacuation on a cloud for disaster preparedness and response training[C] // IEEE Symposium on Computational Intelligence for Human-like Intelligence (CIHLI). 2015: 1-6.
[11]	Alvarez N, Sanchez-Ruiz A, Cavazza M , et al. Narrative balance management in an intelligent biosafety training application for improving user performance[J]. International Journal of Artificial Intelligence in Education, 2015,25(1):35-59.
[12]	Chittaro L, Buttussi F . Assessing knowledge retention of an immersive serious game vs. a traditional education method in aviation safety[J]. IEEE Transactions on Visualization and Computer Graphics, 2015,21(4):529-538. doi: 10.1109/TVCG.2015.2391853 pmid: 26357103
[13]	Le Q T, Pedro A . A social virtual reality based construction safety education system for experiential learning[J]. Journal of Intelligent & Robotic Systems, 2015,79(3):1-20.
[14]	Cha M Y, Han S H, Lee J Y , et al. A virtual reality based fire training simulator integrated with fire dynamics data[J]. Fire Safety Journal, 2012,50:12-24. doi: 10.1016/j.firesaf.2012.01.004
[15]	Silverstein J C, Dech F, Edison M , et al. Virtual reality: immersive hepatic surgery educational environment[J]. Surgery, 2002,132(2):274-277. doi: 10.1067/msy.2002.125723 pmid: 12219023
[16]	Kruglikova I, Grantcharov T P, Drewes A M , et al. The impact of constructive feedback on training in gastrointestinal endoscopy using high-fidelity Virtual-Reality simulation: a randomised controlled trial[J]. Gut, 2010,59(2):181-185. doi: 10.1136/gut.2009.191825 pmid: 19828469
[17]	Lange B, Koenig S, Mc Connell E , et al. Interactive game-based rehabilitation using the Microsoft Kinect[C] // IEEE Virtual Reality Short Papers and Posters (VRW). 2012: 171-172.
[18]	Schroeder D, Korsakov F . Creating widely accessible spatial interfaces mobile VR for managing persistent pain[J]. IEEE Computer Graphics and Applications, 2013,33(3):82-88. doi: 10.1109/MCG.2013.38 pmid: 24807994
[19]	Shin J H . Effects of game-based virtual reality on health-related quality of life in chronic stroke patients: a randomized, controlled study[J]. Computers in Biology and Medicine, 2015,63(1):92-98.
[20]	Quarles J . Shark punch: a virtual reality game for aquatic rehabilitation[C] // IEEE Virtual Reality (VR). 2015: 265-266.
[21]	Mathur A S . Low cost virtual reality for medical training[C] // IEEE Virtual Reality. 2015: 345-346.
[22]	Khan M I, Prado A, Agrawal S K . Effects of virtual reality training with trunk support trainer (TruST) on postural kinematics[J]. IEEE Robotics and Automation Letters, 2017,2(4):2240-2247.
[23]	Harrison B, Oehmen R, Robertson A , et al. Through the eye of the master: the use of virtual reality in the teaching of surgical hand preparation[C] // IEEE 5th International Conference on Serious Games and Applications for Health. 2017, DOI: 10.1109/SeGAH.2017.7939269.
[24]	Covaci A, Olivier A H, Multon F . Visual perspective and feedback guidance for VR free-throw training[J]. IEEE Computer Graphics & Applications, 2015,35(5):55-65. doi: 10.1109/MCG.2015.95 pmid: 26416362
[25]	BideauB, Kulpa R, Vignais N , et al. Using virtual reality to analyze sports performance[J]. IEEE Journals & Magazines, 2010,30(2):14-21.
[26]	He T, Chen X, Chen Z , et al. Immersive and collaborative Taichi motion learning in various VR environments[C] // IEEE Virtual Reality. 2017: 307-308.
[27]	Jackson B, Keeffe D F . Lift-off: using reference imagery and freehand sketching to create 3D models in VR[J]. IEEE Transactions on Visualization and Computer Graphics, 2016,22(4):1442-1451. doi: 10.1109/TVCG.2016.2518099 pmid: 26780801
[28]	Lee G A, Yang U Y, Son W H , et al. Virtual reality content-based training for spray painting tasks in the shipbuilding industry[J]. ETRI Journal, 2010,32(5):695-703.
[29]	陈学文, 刘玉庆, 朱秀庆 , 等. 航天员太空协同操作虚拟训练仿真系统研究[J]. 系统仿真学报, 2013,25(10):88-94.
[30]	Greunke L, Sadagic A . Taking immersive VR leap in training of landing signal officers[J]. IEEE Transactions on Visualization and Computer Graphics, 2016,22(4):1482-1491. doi: 10.1109/TVCG.2016.2518098 pmid: 26780800
[31]	Grabowski A, Jankowski J . Virtual Reality-based pilot training for underground coal miners[J]. Safety Science, 2015,72(72):310-314. doi: 10.1016/j.ssci.2014.09.017
[32]	Sportillo D, Avveduto G, Tecchia F , et al. Training in VR: a preliminary study on learning assembly/disassembly sequences[M]. Augmented and Virtual Reality, 2015: 332-343.
[33]	Grajewski D, Górski F, Hamrol A , et al. Immersive and haptic educational simulations of assembly workplace conditions[J]. Procedia Computer Science, 2015,75:359-368. doi: 10.1016/j.procs.2015.12.258
[34]	Borba E Z, Cabral M, Montes A , et al. Immersive and interactive procedure training simulator for high risk power line maintenance[C] // ACM SIGGRAPH VR Village. 2016: 1-7.
[35]	Mossel A, Froeschl M, Schoenauer C , et al. VROnSite: towards immersive training of first responder squad leaders in untethered virtual reality[C] // IEEE Virtual Reality. 2017: 357-358.
[36]	Cabral M, Belloc O . VR THOR-virtual reality training with hotstick on operations risks[C] // IEEE Virtual Reality. 2016: 327.
[37]	Feiner S, Macintyre B, Seligmann D . Knowledge-based augmented reality[J]. Communications of the ACM, 1993,36(7):53-62.
[38]	Feiner S, Macintyre B, Höllerer T , et al. A touring machine: prototyping 3d mobile augmented reality systems for exploring the urban environment[J]. Personal Technologies, 1997,1(4):208-217.
[39]	Rutishauser U, Koch C . Probabilistic modeling of eye movement data during conjunction search via feature-based attention[J]. Journal of Vision, 2007, DOI: 10.1167/7.6.5. doi: 10.1167/jov.20.7.1 pmid: 32609303
[40]	Nuthmann A, Malcolm G L . Eye guidance during real-world scene search: the role color plays in central and peripheral vision[J]. Journal of Vision, 2016, DOI: 10.1167/16.2.3. doi: 10.1167/jov.20.7.1 pmid: 32609303
[41]	Veas E E, Mendez E, Feiner S K , et al. Directing attention and influencing memory with visual saliency modulation[C] // Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2011: 1471-1480.
[42]	Nielsen L T, Hartmeyer S D, Ljung T C M , et al. Missing the point: an exploration of how to guide users' attention during cinematic virtual reality[C] // ACM Conference on Virtual Reality Software and Technology. 2016: 229-232.
[43]	Danieau F, Guillo A, Dore R . Attention guidance for immersive video content in head-mounted displays[C] // IEEE Virtual Reality. 2017: 205-206.
[44]	Hillaire S, Lécuyer A, Cozot R , et al. Depth-of-field blur effects for first-person navigation in virtual environments[J]. IEEE Computer Graphics and Applications, 2008,28(1):47-55.
[45]	Sridharan S, Pieszala J, Bailey R . Depth-based subtle gaze guidance in virtual reality environments[C] // ACM SIGGRAPH Symposium on Applied Perception. 2015: 132.