收稿日期: 2018-03-05
网络出版日期: 2018-08-31
基金资助
上海市科委"科技创新行动计划"高新技术领域资助项目(17511103002);上海大学电影学高峰学科和上海电影特效工程技术研究中心资助项目(16dz2251300)
Attention guidance of immersive electricity training in VR
Received date: 2018-03-05
Online published: 2018-08-31
张婷婷, 侯晓菲, 田丰, 王轶华 . 沉浸式VR电力训练中的注意力引导[J]. 上海大学学报(自然科学版), 2018 , 24(4) : 553 -563 . DOI: 10.12066/j.issn.1007-2861.2009
There is personal danger in the process of electric power inspection, which puts forward very high professional skill requirements for workers. Traditional video training lacks immersion and training efficiency is low, while the actual training cost is high with huge risk for beginners. An immersion virtual substation training system has been developed, which has the functions of sequence training, information prompting and evaluation scoring, and has been applied to the safety training of electric power inspection. 6 visual guidance and 1 sound guidance methods are designed, and a comparative study of attention guidance in VR training was conducted. The experimental results show that compared with the non boot mode, the 7 guidance methods can significantly improve the training efficiency, and spotlights, edge highlight, edge flashing guide in balance training efficiency and immersion performance is excellent.
Key words： immersive VR; substation inspection; attention guidance; user evaluation
| [1] | Tanaka E H, Paludo J A, Bacchetti R , et al. Immersive virtual training for substation electricians[C] // IEEE Virtual Reality. 2017: 451-452. |
| [2] | Li Y Z, Du H J . A state-of-art on the virtual reality and design of a vr system based on internet[J]. Journal of Environmental Sciences, 2002,38(15):127-129. |
| [3] | Wu H P . What video games have to teach us about learning and literacy[J]. New England Reading Association Journal, 2006,42(1):20. |
| [4] | Kishishita N, Kiyokawa K, Orlosky J , et al. Analysing the effects of a wide field of view augmented reality display on search performance in divided attention tasks[C] // IEEE International Symposium on Mixed and Augmented Reality. 2014: 177-186. |
| [5] | Zhao J, Lafemina P, Wallgrun J O , et al. iVR for the geosciences[C] // IEEE Virtual Reality Workshop on K-12 Embodied Learning Through Virtual & Augmented Reality (KELVAR). 2017: 1-6. |
| [6] | Hu X Q, Su R, He L . The design and implementation of the 3D educational game based on VR headsets[J]. International Symposium on Educational Technology (ISET). 2016, DOI: 10.1109/ISET.2016.15. |
| [7] | Parmar D, Isaac J, Babu S V , et al. Programming moves: design and evaluation of applying embodied interaction in virtual environments to enhance computational thinking in middle school students[C] // IEEE Virtual Reality. 2016: 131-140. |
| [8] | Coles C D, Strickland D C, Padgett L , et al. Games that "work": using computer games to teach alcohol-affected children about fire and street safety[J]. Research in Developmental Disabilities, 2007,28(5):518-530. |
| [9] | 杜宝江, 查亮, 林灵 . 消防安全教育虚拟火灾逃生体验舱系统的设计[J]. 系统仿真学报, 2017,29(2):453-461. |
| [10] | Sharma S, Jerripothula S, Mackey S , et al. Immersive virtual reality environment of a subway evacuation on a cloud for disaster preparedness and response training[C] // IEEE Symposium on Computational Intelligence for Human-like Intelligence (CIHLI). 2015: 1-6. |
| [11] | Alvarez N, Sanchez-Ruiz A, Cavazza M , et al. Narrative balance management in an intelligent biosafety training application for improving user performance[J]. International Journal of Artificial Intelligence in Education, 2015,25(1):35-59. |
| [12] | Chittaro L, Buttussi F . Assessing knowledge retention of an immersive serious game vs. a traditional education method in aviation safety[J]. IEEE Transactions on Visualization and Computer Graphics, 2015,21(4):529-538. |
| [13] | Le Q T, Pedro A . A social virtual reality based construction safety education system for experiential learning[J]. Journal of Intelligent & Robotic Systems, 2015,79(3):1-20. |
| [14] | Cha M Y, Han S H, Lee J Y , et al. A virtual reality based fire training simulator integrated with fire dynamics data[J]. Fire Safety Journal, 2012,50:12-24. |
| [15] | Silverstein J C, Dech F, Edison M , et al. Virtual reality: immersive hepatic surgery educational environment[J]. Surgery, 2002,132(2):274-277. |
| [16] | Kruglikova I, Grantcharov T P, Drewes A M , et al. The impact of constructive feedback on training in gastrointestinal endoscopy using high-fidelity Virtual-Reality simulation: a randomised controlled trial[J]. Gut, 2010,59(2):181-185. |
| [17] | Lange B, Koenig S, Mc Connell E , et al. Interactive game-based rehabilitation using the Microsoft Kinect[C] // IEEE Virtual Reality Short Papers and Posters (VRW). 2012: 171-172. |
| [18] | Schroeder D, Korsakov F . Creating widely accessible spatial interfaces mobile VR for managing persistent pain[J]. IEEE Computer Graphics and Applications, 2013,33(3):82-88. |
| [19] | Shin J H . Effects of game-based virtual reality on health-related quality of life in chronic stroke patients: a randomized, controlled study[J]. Computers in Biology and Medicine, 2015,63(1):92-98. |
| [20] | Quarles J . Shark punch: a virtual reality game for aquatic rehabilitation[C] // IEEE Virtual Reality (VR). 2015: 265-266. |
| [21] | Mathur A S . Low cost virtual reality for medical training[C] // IEEE Virtual Reality. 2015: 345-346. |
| [22] | Khan M I, Prado A, Agrawal S K . Effects of virtual reality training with trunk support trainer (TruST) on postural kinematics[J]. IEEE Robotics and Automation Letters, 2017,2(4):2240-2247. |
| [23] | Harrison B, Oehmen R, Robertson A , et al. Through the eye of the master: the use of virtual reality in the teaching of surgical hand preparation[C] // IEEE 5th International Conference on Serious Games and Applications for Health. 2017, DOI: 10.1109/SeGAH.2017.7939269. |
| [24] | Covaci A, Olivier A H, Multon F . Visual perspective and feedback guidance for VR free-throw training[J]. IEEE Computer Graphics & Applications, 2015,35(5):55-65. |
| [25] | BideauB, Kulpa R, Vignais N , et al. Using virtual reality to analyze sports performance[J]. IEEE Journals & Magazines, 2010,30(2):14-21. |
| [26] | He T, Chen X, Chen Z , et al. Immersive and collaborative Taichi motion learning in various VR environments[C] // IEEE Virtual Reality. 2017: 307-308. |
| [27] | Jackson B, Keeffe D F . Lift-off: using reference imagery and freehand sketching to create 3D models in VR[J]. IEEE Transactions on Visualization and Computer Graphics, 2016,22(4):1442-1451. |
| [28] | Lee G A, Yang U Y, Son W H , et al. Virtual reality content-based training for spray painting tasks in the shipbuilding industry[J]. ETRI Journal, 2010,32(5):695-703. |
| [29] | 陈学文, 刘玉庆, 朱秀庆 , 等. 航天员太空协同操作虚拟训练仿真系统研究[J]. 系统仿真学报, 2013,25(10):88-94. |
| [30] | Greunke L, Sadagic A . Taking immersive VR leap in training of landing signal officers[J]. IEEE Transactions on Visualization and Computer Graphics, 2016,22(4):1482-1491. |
| [31] | Grabowski A, Jankowski J . Virtual Reality-based pilot training for underground coal miners[J]. Safety Science, 2015,72(72):310-314. |
| [32] | Sportillo D, Avveduto G, Tecchia F , et al. Training in VR: a preliminary study on learning assembly/disassembly sequences[M]. Augmented and Virtual Reality, 2015: 332-343. |
| [33] | Grajewski D, Górski F, Hamrol A , et al. Immersive and haptic educational simulations of assembly workplace conditions[J]. Procedia Computer Science, 2015,75:359-368. |
| [34] | Borba E Z, Cabral M, Montes A , et al. Immersive and interactive procedure training simulator for high risk power line maintenance[C] // ACM SIGGRAPH VR Village. 2016: 1-7. |
| [35] | Mossel A, Froeschl M, Schoenauer C , et al. VROnSite: towards immersive training of first responder squad leaders in untethered virtual reality[C] // IEEE Virtual Reality. 2017: 357-358. |
| [36] | Cabral M, Belloc O . VR THOR-virtual reality training with hotstick on operations risks[C] // IEEE Virtual Reality. 2016: 327. |
| [37] | Feiner S, Macintyre B, Seligmann D . Knowledge-based augmented reality[J]. Communications of the ACM, 1993,36(7):53-62. |
| [38] | Feiner S, Macintyre B, H?llerer T , et al. A touring machine: prototyping 3d mobile augmented reality systems for exploring the urban environment[J]. Personal Technologies, 1997,1(4):208-217. |
| [39] | Rutishauser U, Koch C . Probabilistic modeling of eye movement data during conjunction search via feature-based attention[J]. Journal of Vision, 2007, DOI: 10.1167/7.6.5. |
| [40] | Nuthmann A, Malcolm G L . Eye guidance during real-world scene search: the role color plays in central and peripheral vision[J]. Journal of Vision, 2016, DOI: 10.1167/16.2.3. |
| [41] | Veas E E, Mendez E, Feiner S K , et al. Directing attention and influencing memory with visual saliency modulation[C] // Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2011: 1471-1480. |
| [42] | Nielsen L T, Hartmeyer S D, Ljung T C M , et al. Missing the point: an exploration of how to guide users' attention during cinematic virtual reality[C] // ACM Conference on Virtual Reality Software and Technology. 2016: 229-232. |
| [43] | Danieau F, Guillo A, Dore R . Attention guidance for immersive video content in head-mounted displays[C] // IEEE Virtual Reality. 2017: 205-206. |
| [44] | Hillaire S, Lécuyer A, Cozot R , et al. Depth-of-field blur effects for first-person navigation in virtual environments[J]. IEEE Computer Graphics and Applications, 2008,28(1):47-55. |
| [45] | Sridharan S, Pieszala J, Bailey R . Depth-based subtle gaze guidance in virtual reality environments[C] // ACM SIGGRAPH Symposium on Applied Perception. 2015: 132. |
/
| 〈 |
|
〉 |
