Abstract
This research analyzes the psychological reactions of participants to the neutral, positive, or negative attitudes of a virtual audience recorded in 360°-video. Participants were asked to deliver three speeches, each accompanied by a different type of reaction from the virtual audience. Measures of user state included questionnaires, psychophysiological measures, and voice recordings. The results showed that, compared to the neutral audience, the negative audience elicited increases in skin conductance level and heart rate variability, decreases in voice intensity, and a higher ratio of silent parts in the speech, as well as a more negative self-reported valence, higher anxiety, and lower social presence. These findings evidence that, even if some attributes that are considered to be central to immersive experiences are lacking, (i.e., interactivity or avatar representation of the user), 360°-video recreations of virtual environments lead to realistic reactions on users. These results support the effectiveness of 360°-video virtual audiences for public speaking training and social anxiety treatment.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
AcqKnowledge 4.2 [Computer software] (2011). Biopac Systems, Inc
Anderson PL, Edwards SM, Goodnight JR (2017) Virtual reality and exposure group therapy for social anxiety disorder: results from a 4–6 year follow-up. Cogn Ther Res 41(2):230–236. https://doi.org/10.1007/s10608-016-9820-y
Aymerich-Franch L, Kizilcec RF, Bailenson JN (2014) The relationship between virtual self-similarity and social anxiety. Front Human Neurosci 8:944. https://doi.org/10.3389/fnhum.2014.00944
Bailenson JN, Aharoni E, Beall AC, Guadagno RE, Dimov A, Blascovich J (2004) Comparing behavioral and self-report measures of embodied agents’ social presence in immersive virtual environments. In: Proceedings of the 7th annual international workshop on PRESENCE, October 13–15, Valencia, Spain
Baños RM, Botella C, Alcañiz M, Liaño V, Guerrero B, Rey B (2004) Immersion and emotion: their impact on the sense of presence. Cyberpsychol Behav 7(6):734–741. https://doi.org/10.1089/cpb.2004.7.734
Barreda-Ángeles M, Redondo-Tejedor R, Pereda-Baños A (2018) Psychophysiological methods for quality of experience research in virtual reality systems and applications. MMCT COMSOC Comm Front 13(1):14–20
Battisti F, Carli M, Le Callet P, Paudyal P (2018) Toward the assessment of quality of experience for asymmetric encoding in immersive media. IEEE Trans Broadcast 64(2):392–406. https://doi.org/10.1109/TBC.2018.2828607
Baumeister RF, Bratslavsky E, Finkenauer C, Vohs KD (2001) Bad is stronger than good. Rev Gen Psychol 5(4):323–370. https://doi.org/10.1037//1089-2680.5.4.323
Biocca F, Burgoon JK, Harms C, Stoner M (2001) Criteria and scope conditions for a theory and measure of social presence. Paper presented at presence 2001 Conference, Philadelphia, PA
Bliese P (2016) Multilevel Modeling in R (2.6): a brief introduction to R, the multilevel package and the nlme package. Retrieved from https://cran.r-project.org/doc/contrib/Bliese_Multilevel.pdf
Boersma P, Weenink D (2017) Praat: doing phonetics by computer [Computer program]. Version 6.0.28. Retrieved from http://www.praat.org/
Bonato F, Bubka A, Palmisano S (2009) Combined pitch and roll and cybersickness in a virtual environment. Aviat Space Environ Med 80(11):941–945. https://doi.org/10.3357/ASEM.2394.2009
Bos JE, De Vries SC, van Emmerik ML, Groen EL (2010) The effect of internal and external fields of view on visually induced motion sickness. Appl Ergon 41(4):516–521. https://doi.org/10.1016/j.apergo.2009.11.007
Bradley MM, Lang PJ (1994) Measuring emotion: the self-assessment manikin and the semantic differential. J Behav Ther Exp Psychiatry 25(1):49–59. https://doi.org/10.1016/0005-7916(94)90063-9
Brunnström K, Beker SA, De Moor K, Dooms A, Egger S, Garcia MN et al (2013) Qualinet white paper on definitions of quality of experience. Retrieved from https://hal.archives-ouvertes.fr/hal-00977812/
Bui G, Huang Z (2018) L2 fluency as influenced by content familiarity and planning: performance, measurement, and pedagogy. Lang Teach Res 22:94–114
Carreiras C, Alves AP, Lourenço A, Canento F, Silva H, Fred A (2015) BioSPPy—biosignal processing in python [Computer software]. https://github.com/PIA-Group/BioSPPy/. Accessed 9 Feb 2018
Carretié L (2014) Exogenous (automatic) attention to emotional stimuli: a review. Cogn Affect Behav Neurosci 14(4):1228–1258. https://doi.org/10.3758/s13415-014-0270-2
Craske MG, Kircanski K, Zelikowsky M, Mystkowski J, Chowdhury N, Baker A (2008) Optimizing inhibitory learning during exposure therapy. Behav Res Ther 46(1):5–27. https://doi.org/10.1016/j.brat.2007.10.003
Cummings JJ, Bailenson JN (2016) How immersive is enough? A meta-analysis of the effect of immersive technology on user presence. Media Psychol 19(2):272–309. https://doi.org/10.1080/15213269.2015.1015740
Dawson ME, Schell AM, Filion DL (2007) The electrodermal system. In: Cacioppo JT, Tassinary LG, Berntson GG (eds) Handbook of psychophysiology, 3rd edn. Cambridge University Press, New York, pp 200–223
Development Core Team R (2008) R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna
Dickerson SS, Kemeny ME (2004) Acute stressors and cortisol responses: a theoretical integration and synthesis of laboratory research. Psychol Bull 130(3):355–391. https://doi.org/10.1037/0033-2909.130.3.355
Ferdinando H, Alasaarela E (2018) Emotion recognition using cvxEDA-based features. J Telecommun Electron Comput Eng 10(2–3):19–23
Freeman J, Avons SE, Meddis R, Pearson DE, IJsselsteijn W (2000) Using behavioral realism to estimate presence: a study of the utility of postural responses to motion stimuli. Presence Teleoper Virtual Environ 9(2):149–164. https://doi.org/10.1162/105474600566691
Gavgani AM, Walker FR, Hodgson DM, Nalivaiko E (2018) A comparative study of cybersickness during exposure to virtual reality and “classic” motion sickness: are they different? J Appl Physiol 125(6):1670–1680. https://doi.org/10.1152/japplphysiol.00338.2018
Greco A, Valenza G, Lanata A, Scilingo EP, Citi L (2016) cvxEDA: a convex optimization approach to electrodermal activity processing. IEEE Trans Biomed Eng 63(4):797–804. https://doi.org/10.1109/TBME.2015.2474131
Guadagno RE, Blascovich J, Bailenson JN, Mccall C (2007) Virtual humans and persuasion: the effects of agency and behavioral realism. Media Psychol 10(1):1–22
Guadagno RE, Swinth KR, Blascovich J (2011) Social evaluations of embodied agents and avatars. Comput Hum Behav 27(6):2380–2385. https://doi.org/10.1016/j.chb.2011.07.017
Harris SR, Kemmerling RL, North MM (2002) Brief virtual reality therapy for public speaking anxiety. Cyberpsychol Behav 5(6):54. https://doi.org/10.1089/1094931023210181873-550
Hartanto D, Kampmann IL, Morina N, Emmelkamp PG, Neerincx MA, Brinkman WP (2014) Controlling social stress in virtual reality environments. PLoS ONE 9(3):e92804. https://doi.org/10.1371/journal.pone.0092804
Hartmann T, Wirth W, Schramm H, Klimmt C, Vorderer P, Gysbers A et al (2016) The spatial presence experience scale (SPES): a short self-report measure for diverse media settings. J Media Psychol 28:1–15. https://doi.org/10.1027/1864-1105/a000137
Hoffman DM, Girshick AR, Akeley K, Banks MS (2008) Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. J Vis 8(3):834–862. https://doi.org/10.1167/8.3.33
Hofmann SG, Gerlach AL, Wender A, Roth WT (1997) Speech disturbances and gaze behavior during public speaking in subtypes of social phobia. J Anxiety Disord 11(6):573–585. https://doi.org/10.1016/S0887-6185(97)00040-6
Kang N, Brinkman WP, van Riemsdijk MB, Neerincx M (2016) The design of virtual audiences: noticeable and recognizable behavioral styles. Comput Hum Behav 55:680–694. https://doi.org/10.1016/j.chb.2015.10.008
Kim J, Timmerman CE (2018) Effects of supportive feedback messages on exergame experiences: a mediating role of social presence. J Media Psychol 30(1):29–40. https://doi.org/10.1027/1864-1105/a000175
Kothgassner OD, Felnhofer A, Beutl L, Hlavacs H, Lehenbauer M, Stetina B (2012) A virtual training tool for giving talks. In: Herrlich M, Malaka R, Masuch M (eds) Entertainment computing- ICEC 2012. Lectures notes in Computer Science, vol 7522. Springer, Berlin, pp 53–66
La Viola JJ Jr (2000) A discussion of cybersickness in virtual environments. ACM SIGCHI Bull 32(1):47–56. https://doi.org/10.1145/333329.333344
Laborde S, Mosley E, Thayer JF (2017) Heart rate variability and cardiac vagal tone in psychophysiological research: recommendations for experiment planning, data analysis, and data reporting. Front Psychol. https://doi.org/10.3389/fpsyg.2017.00213
Laghari KUR, Connelly K (2012) Toward total quality of experience: a QoE model in a communication ecosystem. IEEE Commun Mag 50(4):58–65. https://doi.org/10.1109/MCOM.2012.6178834
Lambooij M, Fortuin M, Heynderickx I, IJsselsteijn W (2009) Visual discomfort and visual fatigue of stereoscopic displays: a review. J Imaging Sci Technol 53(3):30201-1. https://doi.org/10.2352/j.imagingsci.technol.2009.53.3.030201
Lang PJ (1968) Fear reduction and fear behavior: problems in treating a construct. In: Shilen JUH (ed) Research in psychotherapy, vol 3. American Psychological Association, Washington, pp 90–102
Lang PJ (1995) The emotion probe: studies of motivation and attention. Am Psychol 50(5):372–385. https://doi.org/10.1037//0003-066X.50.5.372
Lang A, Potter RF, Bolls P (2009) Where psychophysiology meets the media: Taking the effects out of mass media research. In: Bryant J, Oliver MB (eds) Media effects: advances in theory and research. Routledge, New York, pp 185–206
Laukka P, Linnman C, Åhs F, Pissiota A, Frans Ö, Faria V et al (2008) In a nervous voice: acoustic analysis and perception of anxiety in social phobics’ speech. J Nonverbal Behav 32(4):195–214. https://doi.org/10.1007/s10919-008-0055-9
Lee KM (2004) Presence, explicated. Commun Theory 14(1):27–50. https://doi.org/10.1111/j.1468-2885.2004.tb00302.x
Lepecq JC, Bringoux L, Pergandi JM, Coyle T, Mestre D (2009) Afforded actions as a behavioral assessment of physical presence in virtual environments. Virtual Real 13(3):141–151. https://doi.org/10.1007/s10055-009-0118-1
Morewedge CK, Kahneman D (2010) Associative processes in intuitive judgment. Trends Cogn Sci 14(10):435–440. https://doi.org/10.1016/j.tics.2010.07.004
Morina N, Ijntema H, Meyerbröker K, Emmelkamp PM (2015) Can virtual reality exposure therapy gains be generalized to real-life? A meta-analysis of studies applying behavioral assessments. Behav Res Ther 74:18–24. https://doi.org/10.1016/j.brat.2015.08.010
Nisbett RE, Wilson TD (1977) The halo effect: evidence for unconscious alteration of judgments. J Pers Soc Psychol 35(4):250–256. https://doi.org/10.1037/0022-3514.35.4.250
Opriş D, Pintea S, García-Palacios A, Botella C, Szamosközi Ş, David D (2012) Virtual reality exposure therapy in anxiety disorders: a quantitative meta-analysis. Depress Anxiety 29(2):85–93. https://doi.org/10.1002/da.20910
Page-Gould E (2017) Multilevel modeling. In: Cacioppo JT, Tassinary LG, Berntson GG (eds) Handbook of psychophysiology, 4th edn. Cambridge University Press, New York, pp 628–661
Pan X, Gillies M, Barker C, Clark DM, Slater M (2012) Socially anxious and confident men interact with a forward virtual woman: an experimental study. PLoS ONE 7(4):e32931. https://doi.org/10.1371/journal.pone.0032931
Pan X, Slater M, Beacco A, Navarro X, Rivas AIB, Swapp D et al (2016) The responses of medical general practitioners to unreasonable patient demand for antibiotics-a study of medical ethics using immersive virtual reality. PLoS ONE 11(2):e0146837. https://doi.org/10.1371/journal.pone.0146837
Pertaub DP, Slater M, Barker C (2002) An experiment on public speaking anxiety in response to three different types of virtual audience. Presence Teleoper Virtual Environ 11(1):68–78. https://doi.org/10.1162/105474602317343668
Pinheiro J, Bates D, DebRoy S, Sarkar D, R Core Team (2018) nlme: linear and nonlinear mixed effects models. R package version 3.1-137. Retrieved from https://CRAN.R-project.org/package=nlme
Poeschl S (2017) Virtual reality training for public speaking: a QUEST-VR framework validation. Front ICT 4:13. https://doi.org/10.3389/fict.2017.00013
Poeschl S, Doering N (2012) Designing virtual audiences for fear of public speaking training–an observation study on realistic nonverbal behavior. In: Wiederhold BK, Riva G (eds) Annual review cybertherapy telemedicine 2012. IOS Press, Washington, pp 218–222
Qiu X (2019) Functions of oral monologic tasks: effects of topic familiarity on L2 speaking performance. Lang Teach Res. https://doi.org/10.1177/1362168819829021
Ravaja N (2004) Contributions of psychophysiology to media research: review and recommendations. Media Psychol 6(2):193–235. https://doi.org/10.1207/s1532785xmep0602_4
Revelle W, Zinbarg RE (2009) Coefficients alpha, beta, omega, and the glb: comments on Sijtsma. Psychometrika 74(1):145–154. https://doi.org/10.1007/s11336-008-9102-z
Riva G, Mantovani F, Capideville CS, Preziosa A, Morganti F, Villani D et al (2007) Affective interactions using virtual reality: the link between presence and emotions. Cyberpsychol Behav 10(1):45–56. https://doi.org/10.1089/cpb.2006.9993
Robinson P (2001) Task complexity, cognitive resources, and syllabus design: a triadic framework for examining task influences on SLA. In: Robinson P (ed) Cognition and second language instruction. Cambridge University Press, Cambridge, pp 287–318
Scherer KR (2000) Psychological models of emotion. In: Borod JC (ed) The neuropsychology of emotion. Oxford University Press, New York, pp 137–162
Skarbez R, Neyret S, Brooks FP, Slater M, Whitton MC (2017) A psychophysical experiment regarding components of the plausibility illusion. IEEE Trans Visual Comput Graphics 23(4):1369–1378. https://doi.org/10.1109/TVCG.2017.2657158
Slater M (2004) How colorful was your day? Why questionnaires cannot assess presence in virtual environments. Presence Teleoperat Virtual Environ 13(4):484–493. https://doi.org/10.1162/1054746041944849
Slater M (2009) Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philos Trans R Soc B Biol Sci 364(1535):3549–3557. https://doi.org/10.1098/rstb.2009.0138
Slater M, Garau M (2007) The use of questionnaire data in presence studies: do not seriously Likert. Presence Teleoper Virtual Environ 16(4):447–456. https://doi.org/10.1162/pres.16.4.447
Slater M, Sánchez-Vives MV (2016) Enhancing our lives with immersive virtual reality. Front Robot AI 3:74. https://doi.org/10.3389/frobt.2016.00074
Slater M, Pertaub DP, Steed A (1999) Public speaking in virtual reality: facing an audience of avatars. IEEE Comput Graph Appl 19(2):6–9. https://doi.org/10.1109/38.749116
Slater M, Antley A, Davison A, Swapp D, Guger C, Barker C et al (2006a) A virtual reprise of the Stanley Milgram obedience experiments. PLoS ONE 1(1):e39. https://doi.org/10.1371/journal.pone.0000039
Slater M, Pertaub DP, Barker C, Clark DM (2006b) An experimental study on fear of public speaking using a virtual environment. Cyberpsychol Behav 9(5):627–633. https://doi.org/10.1089/cpb.2006.9.627
Slater M, Spanlang B, Corominas D (2010) Simulating virtual environments within virtual environments as the basis for a psychophysics of presence. ACM Trans Graph 29(4):92. https://doi.org/10.1145/1778765.1778829
Stanney KM, Hale KS, Nahmens I, Kennedy RS (2003) What to expect from immersive virtual environment exposure: influences of gender, body mass index, and past experience. Hum Factors 45(3):504–520. https://doi.org/10.1518/hfes.45.3.504.27254
Stupar-Rutenfrans S, Ketelaars LE, van Gisbergen MS (2017) Beat the fear of public speaking: mobile 360° video virtual reality exposure training in home environment reduces public speaking anxiety. Cyberpsychol Behav Soc Network 20(10):624–633. https://doi.org/10.1089/cyber.2017.0174
Sundar SS, Kang J, Oprean D (2017) Being there in the midst of the story: how immersive journalism affects our perceptions and cognitions. Cyberpsychol Behav Soc Network 20(11):672–682. https://doi.org/10.1089/cyber.2017.0271
Team Audacity (2015) Audacity (Version 2.1.0). Audio Editor and Recorder [Computer software]. https://audacityteam.org/
Urvoy M, Barkowsky M, Le Callet P (2013) How visual fatigue and discomfort impact 3D-TV quality of experience: a comprehensive review of technological, psychophysical, and psychological factors. Ann Telecommun 68(11–12):641–655. https://doi.org/10.1007/s12243-013-0394-3
Wiederhold BK, Wiederhold MD (eds) (2005) Virtual reality therapy for anxiety disorders: advances in evaluation and treatment. American Psychological Association, Washington
Wilhelm FH, Roth WT (2001) The somatic symptom paradox in DSM-IV anxiety disorders: suggestions for a clinical focus in psychophysiology. Biol Psychol 57(1–3):105–140. https://doi.org/10.1016/S0301-0511(01)00091-6
Wirth W, Hartmann T, Böcking S, Vorderer P, Klimmt C, Schramm H et al (2007) A process model of the formation of spatial presence experiences. Media Psychol 9(3):493–525. https://doi.org/10.1080/15213260701283079
Acknowledgements
This research was partially supported by the Agència per a la Competivitat de l´Empresa, ACCIÓ (Grant No. VR360).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Barreda-Ángeles, M., Aleix-Guillaume, S. & Pereda-Baños, A. Users’ psychophysiological, vocal, and self-reported responses to the apparent attitude of a virtual audience in stereoscopic 360°-video. Virtual Reality 24, 289–302 (2020). https://doi.org/10.1007/s10055-019-00400-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10055-019-00400-1