Abstract
Head-mounted display (HMD)-based virtual reality (VR) is ideally suited for presence and generating compelling visual experiences of self-motion, but users can suffer from side effects associated with head-to-display lag. We used the Oculus Rift HMD (consumer release – CV1) to simulate forward self-motion in depth. Observers made continuous yaw head movements at approximately 0.5 Hz or 1.0 Hz while viewing these self-motion simulations. We examined the perceptual effects of increasing the display lag, by adding lag to the baseline lag of the system (estimated to be approximately 5.3 ms or 0.5 frames per second). We found that increasing the head-to-display lag up to 212 ms reduced the presence and the strength of vection. In addition, faster (1.0 Hz) head oscillations were found to generate weaker presence and vection in the virtual environment than the slower (0.5 Hz) head oscillations. We also found that a positive correlation between vection and presence (found previously) persists across a wide range of head-to-display lags, and, increasing lag from a very low baseline level still impaired both experiences. Both vection and presence in virtual environments can therefore be impaired by either increasing head-display lag or making more rapid angular head movements.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Availability of data
Will be made available upon request.
Code availability
Can be made available upon request.
References
Adelstein BD, Lee TG, Ellis SR (2003) Head tracking latency in Virtual Environments: psychophysics and a model. Proceedings of the Human Factors and Ergonomics Society 47th Annual Meeting; Santa Monica, CA:HFES;2083–2087
Allison RS, Harris LR, Jenkin M (2001) Tolerance of temporal delay in virtual environments. In: 2001 IEEE virtual reality, pp 247–253. https://doi.org/10.1109/VR.2001.913793
Ash A, Palmisano S, Kim J (2011a) Vection in depth during consistent and inconsistent multisensory stimulation. Perception 40(2):155–174. https://doi.org/10.1068/p6837
Ash A, Palmisano S, Govan DG, Kim J (2011b) Display lag and gain effects on vection experienced by active observers. Aviat Space Environ Med 82(8):763–769. https://doi.org/10.3357/ASEM.3026.2011
Barfield W, Weghorst S (1993) The sense of presence within virtual environments: a conceptual framework. In Salvendy G, Smith M (eds) Human computer interaction: software and hardware interfaces, pp 699–704
Basting O, Fuhrmann A, Grünvogel SM (2017) The effectiveness of changing the field of view in a HMD on the perceived self-motion. In: 2017 IEEE Symposium on 3D User Interfaces (3DUI), pp 225–226. https://doi.org/10.1109/3DUI.2017.7893353
Bouchard S, Robillard G, St-Jacques J, Dumoulin S, Patry MJ, Renaud P (2001) Reliability and validity of a single-item measure of presence in VR. The 3rd IEEE International Workshop on Haptic, Audio and Visual Environments and Their Applications, Ottawa, Ontario, Canada, pp 59–61. https://doi.org/10.1109/HAVE.2004.1391882
Carnegie K, Rhee T (2015) Reducing visual discomfort with HMDs using dynamic depth of field. IEEE Comput Graphics Appl 35(5):34–41. https://doi.org/10.1109/MCG.2015.98
Chen E, Luu W, Chen R, Rafik A, Ryu Y, Zangerl B, Kim J (2020) Virtual reality improves clinical assessment of the optic nerve. Front Virtual Reality. https://doi.org/10.3389/frvir.2020.00004
Clifton J, Palmisano S (2020) Effects of Steering locomotion and teleporting on cybersickness and presence in HMD-based virtual reality. Virtual Reality 24(3):453–468. https://doi.org/10.1007/s10055-019-00407-8
Cook R (1992) Serious Entertainment. Comput Gr World 15(5):40–53
Coyne L, Merritt TA, Parmentier BL, Sharpton RA, Takemoto JK (2019) The past, present, and future of virtual reality in pharmacy education. Am J Pharm Educ 83(3):7456. https://doi.org/10.5688/ajpe7456
Crump WJ, Pfiel T (1995) A telemedicine primer: An introduction to the technology and an overview of the literature. Arch Fam Med 4(9):796–803. https://doi.org/10.1001/archfami.4.9.796
Dichgans J, Brandt T (1978) Visual-vestibular interaction: effects on self-motion perception and postural control. In: Held R, Leibowitz H, Teuber H-L (eds) Handbook of sensory physiology, vol 8, Perception. Springer, pp 755–804.
Freiwald JP, Katzakis N, Steinicke F (2018) Camera time warp: compensating latency in video see-through head-mounted-displays for reduced cybersickness effects. In: 2018 IEEE International symposium on mixed and augmented reality adjunct (ISMAR-adjunct), pp 49–50. https://doi.org/10.1145/3281505.3281521
Feng J, Kim J, Luu W, Palmisano S (2019) Method for estimating display lag in the Oculus Rift S and CV1. In: 2019 SIGGRAPH Asia 39:1–2. https://doi.org/10.1145/3355056.3364590
Fujii Y, Seno T, Allison R (2018) Smoothness of stimulus motion can affect vection strength. Exp Brain Res 236:243–252. https://doi.org/10.1007/s00221-017-5122-1
Garcia-Agundez A, Westmeier A, Caserman P, Konrad R, Göbel S (2017) An Evaluation of Extrapolation and Filtering Techniques in Head Tracking for Virtual Environments to Reduce Cybersickness. In: Alcañiz M, Göbel S, Ma M, Fradinho Oliveira M, Baalsrud Hauge J, Marsh T (eds) Serious Games. JCSG 2017. Lecture Notes in Computer Science, vol 10622. Springer, Cham
Hackman MZ, Walker KB (1990) Instructional communication in the televised classroom: The effects of system design and teacher immediacy on student learning and satisfaction. Commun Educ 39:196–206. https://doi.org/10.1080/03634529009378802
Hamit F (1995) From telemedicine to remote telepresence surgery. Advanced Imaging 10(8):21–35
Hettinger LJ, Berbaum KS, Kennedy RS, Dunlap WP, Nolan MD (1990) Vection and simulator sickness. Mil Psychol 2(3):171–181. https://doi.org/10.1207/s15327876mp0203_4
Hildebrandt J, Schmitz P, Calero Valdez A, Kobbelt L, Ziefle M (2018) Get Well Soon! Human Factors’ Influence on Cybersickness After Redirected Walking Exposure in Virtual Reality. In: Chen J., Fragomeni G. (eds) Virtual, augmented and mixed reality: interaction, navigation, visualization, embodiment, and simulation. VAMR 2018. Lecture Notes in Computer Science, vol 10909. Springer, Cham. https://doi.org/10.1007/978-3-319-91581-4_7
IJsselsteijn W, de Ridder H, Freeman J, Avons SE, Bouwhuis D (2001) Effects of stereoscopic presentation, image motion, and screen size on subjective and objective corroborative measures of presence. Presence 10(3):298–311.https://doi.org/10.1162/105474601300343621
Keshavarz B, Philipp-Muller AE, Hemmerich W, Riecke BE, Campos JL (2018) The effect of visual motion stimulus characteristics on vection and visually induced motion sickness. Displays 58:71–81. https://doi.org/10.1016/j.displa.2018.07.005
Kim J, Palmisano S (2008) Effects of active and passive viewpoint jitter on vection in depth. Brain Res Bull 77(6):335–342. https://doi.org/10.1016/j.brainresbull.2008.09.011
Kim J, Palmisano S (2010) Visually mediated eye movements regulate the capture of optic flow in self-motion perception. Exp Brain Res 202(2):355–361. https://doi.org/10.1007/s00221-009-2137-2
Kim J, Palmisano S, Bonato F (2012) Simulated angular head oscillation enhances vection in depth. Perception 41(4):402–414. https://doi.org/10.1068/p6919
Kim J, Chung CY, Nakamura S, Palmisano S, Khuu SK (2015) The Oculus Rift: A cost-effective tool for studying visual-vestibular interactions in self-motion perception. Front Psychol 6(248):1–7. https://doi.org/10.3389/fpsyg.2015.00248
Kim J, Khuu S (2014) A new spin on vection in depth. J vis 14(5):5. https://doi.org/10.1167/14.5.5
Kim J, Tran MTT (2016) A new angle on object-background effects in vection. i-Perception 7:1–8. https://doi.org/10.1177/2041669516631695
Kim J, Luu W, Palmisano S (2020) Multisensory integration and the experience of scene instability, presence and cybersickness in virtual environments. Comput Hum Behav 113:106484. https://doi.org/10.1016/j.chb.2020.106484
Kim J, Palmisano S, Luu W, Iwasaki S (2021) Effects of linear visual-vestibular conflict on presence, perceived scene stability and cybersickness in the Oculus Go and Oculus Quest. Frontiers in Virtual Reality 2:582156. https://doi.org/10.3389/frvir.2021.582156
Kinsella A, Mattfeld R, Muth E, Hoover A (2016) Frequency, not amplitude, of latency affects subjective sickness in a head-mounted display. Aerosp Med Hum Perform 87(7):604–609. https://doi.org/10.3357/AMHP.4351.2016
LaViola JJ Jr (2000) A discussion of cybersickness in virtual environments. ACM SIGCHI Bull 32(1):47–56. https://doi.org/10.1145/333329.333344
Lee D, Lishman J (1975) Visual proprioceptive control of stance. J Hum Mov Stud 1(2):87–95
Lombard M, Ditton T (1997) At the heart of it all: The concept of presence. J Comput Mediat Commun 3(2):1. https://doi.org/10.1111/j.1083-6101.1997.tb00072.x
Lorch RF, Myers JL (1990) Regression analyses of repeated measures data in cognitive research. J Exp Psychol Learn Mem Cogn 16:149–157. https://doi.org/10.1037/0278-7393.16.1.149
Mania K, Adelstein BD, Ellis SR, Hill MI (2004) Perceptual sensitivity to head tracking latency in virtual environments with varying degrees of scene complexity. In: Proceedings of the ACM APGV; 1st Symposium, Los Angeles, CA; 39–48. https://doi.org/10.1145/1012551.1012559
Moss JD, Muth ER, Tyrrell RA, Stephens BR (2010) Perceptual thresholds for display lag in a real visual environment are not affected by field of view or psychophysical technique. Displays 31:143–149. https://doi.org/10.1016/j.displa.2010.04.002
Moss JD, Austin J, Salley J, Coats J, Williams K, Muth ER (2011) The effects of display delay on simulator sickness. Displays 32:159–168. https://doi.org/10.1016/j.displa.2011.05.010
Moroz M, Garzorz I, Folmer E, MacNeilage P (2018) Sensitivity to visual gain modulation in head-mounted displays depends on fixation. Displays 58:12–19. https://doi.org/10.1016/j.displa.2018.09.001
Munafo J, Diedrick M, Stoffregen TA (2017) The virtual reality head-mounted display Oculus Rift induces motion sickness and is sexist in its effects. Exp Brain Res 235:889–901. https://doi.org/10.1007/s00221-016-4846-7
Nooij SAE, Pretto P, Oberfeld D, Hecht H, Bülthoff HH (2017) Vection is the main contributor to motion sickness induced by visual yaw rotation: Implications for conflict and eye movement theories. PLoS ONE 12(4):e0175305. https://doi.org/10.1371/journal.pone.0175305
Palmisano S (1996) Perceiving self-motion in depth: the role of stereoscopic motion and changing-size cues. Percept Psychophys 58(8):1168–1176. https://doi.org/10.3758/BF03207550
Palmisano S (2002) Consistent stereoscopic information increases the perceived speed of vection in depth. Perception 31(4):463–480. https://doi.org/10.1068/p3321
Palmisano S, Allison RS, Schira MM, Barry RJ (2015) Future challenges for vection research: definitions, functional significance, measures, and neural bases. Front Psychol 6(193):1–15. https://doi.org/10.3389/fpsyg.2015.00193
Palmisano S, Kim J (2009) Effects of gaze on vection from jittering, oscillating, and purely radial optic flow. Atten Percept Psychophys 71:1842–1853. https://doi.org/10.3758/APP.71.8.1842
Palmisano S, Allison RS, Kim J, Bonato F (2011) Simulated viewpoint jitter shakes sensory conflict accounts of vection. Seeing Perceiv 24(2):173–200. https://doi.org/10.1163/187847511X570817
Palmisano S, Riecke BE (2018) The search for instantaneous vection: an oscillating visual prime reduces vection onset latency. PLoS ONE 13(5):e0195886. https://doi.org/10.1371/journal.pone.0195886
Palmisano S, Summersby S, Davies RG, Kim J (2016) Stereoscopic advantages for vection induced by radial, circular, and spiral optic flows. J vis 16(14):7. https://doi.org/10.1167/16.14.7
Palmisano S, Mursic R, Kim J (2017) Vection and cybersickness generated by head-and-display motion in the oculus rift. Displays 46:1–8. https://doi.org/10.1016/j.displa.2016.11.001
Palmisano S, Szalla L, Kim J (2019) Monocular viewing protects against cybersickness produced by head movements in the oculus rift. In: 2019 ACM Symposium on Virtual Reality Software and Technology (VRST ’19). Association for Computing Machinery, New York, NY, USA, Article 81:1–2. https://doi.org/10.1145/3359996.3364699
Pedram S, Palmisano S, Perez P, Mursic R, Farrelly M (2020) Examining the potential of virtual reality to deliver remote rehabilitation. Comput Hum Behav 105:106223. https://doi.org/10.1016/j.chb.2019.106223
Prothero, J. D. (1998). The Role of Rest Frames in Vection, Presence and Motion Sickness (PhD thesis). University of Washington.
Riecke BE, Schulte-Pelkum J, Avraamides MN, Heyde MVD, Bülthoff HH (2006) Cognitive factors can influence self-motion perception (vection) in virtual reality. ACM Transactions on Applied Perception (TAP) 3:194–216. https://doi.org/10.1145/1166087.1166091
Riecke BE, Freiberg JB, Grechkin TY (2015) Can walking motions improve visually induced rotational self-motion illusions in virtual reality? J vis 15(3):1. https://doi.org/10.1167/15.2.3
Riecke BE, Jordan JD (2015) Comparing the effectiveness of different displays in enhancing illusions of self-movement (vection). Front Psychol 6(713):1. https://doi.org/10.3389/fpsyg.2015.00713
Rietzler M, Gugenheimer J, Hirzle T, Deubzer M, Langbehn E, Rukzio E (2018) Rethinking redirected walking: on the use of curvature gains beyond perceptual limitations and revisiting bending gains. 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp 115–122. https://doi.org/10.1109/ISMAR.2018.00041
Sakamoto S, Osada Y, Suzuki Y, Gyoba J (2004) The effects of linearly moving sound images on self-motion perception. Acoust Sci Technol 25:100–102. https://doi.org/10.1250/ast.25.100
Seno T (2013) Music modulates the strength of vection. Psychology 4(7):566–568
Seno T, Sawai K, Kanaya H, Wakebe T, Ogawa M, Fujii Y, Palmisano S (2017) The oscillating potential model of visually induced vection. i-Perception 8:1–24. https://doi.org/10.1177/2041669517742176
Sheridan T (1992) Musings on Telepresence and Virtual Presence. Presence 1:120–125. https://doi.org/10.1162/pres.1992.1.1.120
Skarbez R, Brooks Jr FP, Whitton MC (2017) A survey of presence and related concepts. ACM Computing Surveys (CSUR) 50(6):1–39. https://doi.org/10.1145/3134301
Slater M (2009) Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philos Trans R Soc b: Biol Sci 364:3549–3557. https://doi.org/10.1098/rstb.2009.0138
Slater M, Wilbur S (1997) A framework for immersive virtual environments (FIVE): Speculations on the role of presence in virtual environments. Presence Teleoper Virt Environ 6(6):603–616. https://doi.org/10.1162/pres.1997.6.6.603
St Pierre ME, Banerjee S, Hoover AW, Muth ER (2015) The effects of 0.2 Hz varying latency with 20–100 ms varying amplitude on simulator sickness in a helmet mounted display. Displays 36:1–8. https://doi.org/10.1016/j.displa.2014.10.005
Steinicke F, Visell Y, Campos J, Lécuyer A (2013) Human walking in virtual environments, vol 56, no. 7, pp 976–985. Springer
Witmer BG, Singer MJ (1998) Measuring presence in virtual environments: a presence questionnaire. Presence Teleoper Virt Environ 7(3):225–240. https://doi.org/10.1162/105474698565686
Wu W, Dong Y, Hoover AW (2013) Measuring digital system latency from sensing to actuation at continuous 1-ms resolution. Presence 22(1):20–35. https://doi.org/10.1162/PRES_a_00131
Yokokohji Y,Sugawara Y, Yoshikawa T (2000) Accurate image overlay on video see-through HMDs using vision and accelerometers. In: 2000 Proceedings IEEE Virtual Reality (Cat. No.00CB37048): 247–254. https://doi.org/10.1109/VR.2000.840505
Funding
This research was funded by an Australian Research Council (ARC) Discovery Project grant awarded to SP and JK (DP210101475). This research was supported in part by the Sensory Processes Innovation Network (SPINet).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Kim, J., Charbel-Salloum, A., Perry, S. et al. Effects of display lag on vection and presence in the Oculus Rift HMD. Virtual Reality 26, 425–436 (2022). https://doi.org/10.1007/s10055-021-00570-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10055-021-00570-x