Abstract
Serious games, professional entertainment (e.g. e-sport), or the immersive simulation of critical scenarios by means of virtual reality belong to the scope of the video game industry. With implications in economic (gambling) and professional careers (e-sports), researchers have focused on the high-level analysis of the win/lose chances and on the player’s profile (good/bad performers). At the low-level analysis, the prediction of player’s performance at single-action level, such as in the case of hits in a first-person shooter (FPS) video game, to the best of our knowledge, has not been undertaken yet. In this study we hypothesize that VR video games, embed enough contextual information to predict performance in an FPS game at single-action level. For this purpose, we developed an FPS video game and a single-shoot level prediction model based on virtual world contextual information. Eighteen students of the University of Granada without previous experience in the game played for 45–50 min and generated 600–1200 events each. Every event, which was composed of twenty-contextual-player-centred components of the virtual scenario, were transmitted on-line to a remote server to perform predictions. Data from fifteen out of eighteen participants were used to train the model prediction model. After training, the model predicted “hit”/”miss” with a mean accuracy of 74.1%. In a broad vision, our results suggest that immersive virtual environments bear enough contextual information for accurate predictions even at single-action level. In a closed-loop design, this finding could be used (e.g. in defence, professional e-sports, etc.) to anticipate participant’s actions/decisions before they are taken, and modify the virtual scenario (e.g. abort mission, change environmental conditions) or drive the player (e. g. suggest options, relieve of command, etc.) according to the purpose of the mission.
Similar content being viewed by others
References
The Year Virtual Reality Gets Real (2019) https://www.forbes.com/sites/solrogers/2019/06/21/2019-the-year-virtual-reality-gets-real/ Accessed 14 Jan 2020
Amin H, Earnshaw RA (2000) Enhanced avatar control using neural networks. Virtual Reality 5(1):47–53. https://doi.org/10.1007/BF01418976
Aryanata GA, Rahadi PSAD, Sudarmojo YP (2017) Prediction of DOTA 2 match result by using analytical hierarchy process method. Int J Eng Emerg Technol 2(1):22. https://doi.org/10.24843/IJEET.2017.v02.i01.p05
Augmented Reality, Virtual Reality and eSports | Business Magazine (2019) https://www.insightssuccess.com/augmented-reality-virtual-reality-esports-buzzwords-gaming-industry-future-lies/ Accessed 14 Jan 2020
Buckley D (2016) Skill capture in first-person shooters. Dissertation, University of Manchester.
Buckley D, Chen K, Knowles J (2014) Rapid Skill Capture in a First-Person Shooter. ArXiv:1411.1316 [Cs]. https://arxiv.org/abs/1411.1316
Buckley D, Chen K, Knowles J (2013) Predicting skill from gameplay input to a first-person shooter. In: 2013 IEEE Conference on Computational Inteligence in Games (CIG), pp. 1–8. https://doi.org/10.1109/CIG.2013.6633655
Cai H, Lin Y (2012) An integrated head pose and eye gaze tracking approach to non-intrusive visual attention measurement for wide FOV simulators. Virtual Real 16(1):25–32. https://doi.org/10.1007/s10055-010-0171-9
Clopper CJ, Pearson ES (1934) The use of confidence or fiducial limits illustrated in the case of the binomial. Biometrika 26(4):404–413. https://doi.org/10.1093/biomet/26.4.404
Demirdjian D, Ko T, Darrell T (2005) Untethered gesture acquisition and recognition for virtual world manipulation. Virtual Real 8(4):222–230. https://doi.org/10.1007/s10055-005-0155-3
Efficacy and Usability of a Virtual Simulation Training System for Health and Safety Hazards Encountered by Healthcare Workers | Games for Health Journal. (2019) https://www.liebertpub.com/doi/10.1089/g4h.2018.0068 Accessed 14 Jan 2020
Felbrich B, Jahn G, Newnham C, Menges A (2018) Self-organizing maps for intuitive gesture-based geometric modelling in augmented reality. In: 2018 IEEE international conference on artificial intelligence and virtual reality (AIVR), pp. 61–67. https://doi.org/10.1109/AIVR.2018.00016
Heath, G. (2015). How many neurons in the hidden layer? https://es.mathworks.com/matlabcentral/answers/251247-how-many-neurons-in-the-hidden-layer
Hodge V, Devlin S, Sephton N, Block F, Cowling P, Drachen A (2019) Win prediction in multi-player esports: live professional match prediction. IEEE Trans Games. https://doi.org/10.1109/TG.2019.2948469
How Virtual Reality Is Transforming Sports Betting | VRROOM (2019) https://vrroom.buzz/vr-news/sports/how-virtual-reality-transforming-sports-betting Accessed 14 Jan 2020
Jiang Y, Jiang J, Palmer IJ (2008) Computerized interactive gaming via supporting vector machines. Int J Comput Games Technol. https://doi.org/10.1155/2008/186941
Liarokapis F, Evans A (2018) Editorial for special issue on interactive virtual environments for serious games. Virtual Real 22(2):89–90. https://doi.org/10.1007/s10055-018-0340-9
Lopez MA, Pomares H, Damas M, Prieto A, Plaza Hernandez EM (2007) Use of kohonen maps as feature selector for selective attention brain-computer interfaces. In: Mira J, Álvarez JR (eds) Bio-inspired modeling of cognitive tasks, vol 4527. Springer, Berlin Heidelberg, pp 407–415
Lopez-Gordo MA, Pelayo F (2013) A binary phase-shift keying receiver for the detection of attention to human speech. Int J Neural Syst 23(04):1350016. https://doi.org/10.1142/S0129065713500160
Lopez-Gordo MA, Pelayo F, Fernandez E, Padilla P (2015) Phase-shift keying of EEG signals: Application to detect attention in multitalker scenarios. Signal Process 117:165–173. https://doi.org/10.1016/j.sigpro.2015.05.004
Lopez-Gordo MA, Pelayo F, Prieto A, Fernandez E (2012) An auditory brain-computer interface with accuracy prediction. Int J Neural Syst 22(3):1–14. https://doi.org/10.1142/S0129065712500098
Mandrekar JN (2010) Receiver operating characteristic curve in diagnostic test assessment. J Thorac Oncol 5(9):1315–1316. https://doi.org/10.1097/JTO.0b013e3181ec173d
Minguillon J, Perez E, Lopez-Gordo M, Pelayo F, Sanchez-Carrion M (2018) Portable system for real-time detection of stress level. Sensors 18(8):2504. https://doi.org/10.3390/s18082504
Patle DS, Manca D, Nazir S, Sharma S (2019) Operator training simulators in virtual reality environment for process operators: a review. Virtual Real 23(3):293–311. https://doi.org/10.1007/s10055-018-0354-3
Pinheiro A, Fernandes P, Maia A, Cruz G, Pedrosa D, Fonseca B, Paredes H, Martins P, Morgado L, Rafael J (2014) Development of a mechanical maintenance training simulator in OpenSimulator for F-16 aircraft engines. Entertain Comput 5(4):347–355. https://doi.org/10.1016/j.entcom.2014.06.002
Ron-Angevin R, Lopez MA, Pelayo F (2009) The training issue in brain-computer interface: a multi-disciplinary field. In: Cabestany J, Sandoval F, Prieto A, Corchado JM (eds) Bio-inspired systems: computational and ambient intelligence, vol 5517. Springer, Berlin Heidelberg, pp 666–673. https://doi.org/10.1007/978-3-642-02478-8_83
Sagayam KM, Hemanth DJ (2017) Hand posture and gesture recognition techniques for virtual reality applications: A survey. Virtual Real 21(2):91–107. https://doi.org/10.1007/s10055-016-0301-0
Sarkar A, Cooper S (2017) Level Difficulty and Player Skill Prediction in Human Computation Games. AIIDE.
Sathia Bhama PRK, Hariharasubramanian V, Mythili OP, Ramachandran M (2017) Users’ domain knowledge prediction in e-learning with speech-interfaced augmented and virtual reality contents. Virtual Real. https://doi.org/10.1007/s10055-017-0321-4
Taylor TL (2012) Raising the stakes: E-sports and the professionalization of computer gaming. MIT Press, Cambridge
Velasco-Alvarez F, Ron-Angevin R, Lopez-Gordo MA (2013) BCI-based navigation in virtual and real environments. In: Rojas I, Joya G, Cabestany J (eds) Advances in computational intelligence, vol 7903. Springer, Berlin Heidelberg, pp 404–412. https://doi.org/10.1007/978-3-642-38682-4_43
Virtual reality: Game-changing revolution in eSports—France 24 (2019). https://www.france24.com/en/20191101-virtual-reality-game-changing-revolution-in-esports Accessed 14 Jan 2020
Wang T (2018). Predictive analysis on esports games—a case study on league of legends (LOL) esports tournaments. Master Dissertation, University of North Carolina.
Yang Y, Qin T, Lei Y-H (2016). Real-time eSports Match Result Prediction. ArXiv: 1701.03162 [Cs, Stat]. https://arxiv.org/abs/1701.03162
Zhao J, Allison RS (2019) Comparing head gesture, hand gesture and gamepad interfaces for answering Yes/No questions in virtual environments. Virtual Real. https://doi.org/10.1007/s10055-019-00416-7
Acknowledgements
This work was supported by project PGC2018-098813-B-C31 (Spanish “Ministerio de Ciencia, Innovación y Universidades”'), by European Regional Development Funds (ERDF) and by the Nicolo Association for the R&D in Neurotechnologies for disability.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Lopez-Gordo, M.A., Kohlmorgen, N., Morillas, C. et al. Performance prediction at single-action level to a first-person shooter video game. Virtual Reality 25, 681–693 (2021). https://doi.org/10.1007/s10055-020-00482-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10055-020-00482-2