Skip to main content
Log in

Unveiling the implicit knowledge, one scenario at a time

  • Original article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

When defining virtual reality applications with complex procedures, such as medical operations or mechanical assembly or maintenance procedures, the complexity and the variability of the procedures make the definition of the scenario difficult and time-consuming. Indeed, the variability complicates the definition of the scenario by the experts, and its combinatorics demand a comprehension effort for the developer, which is often out of reach. Additionally, the experts have a hard time explaining the procedures with a sufficient level of details, as they usually forget to mention some actions that are, in fact, important for the application. To ease the creation of scenario, we propose a complete methodology, based on (1) an iterative process composed of: (2) the recording of actions in virtual reality to create sequences of actions and (3) the use of mathematical tools that can generate a complete scenario from a few of those sequences, with (4) graphical visualization of the scenarios and complexity indicators. This process helps the expert to determine the sequences that must be recorded to obtain a scenario with the required variability.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

Notes

  1. https://www.omg.org/spec/BPMN/2.0/About-BPMN/.

References

  1. Angros Jr., R., Johnson, W.L., Rickel, J., Scholer, A.: Learning domain knowledge for teaching procedural skills. In: Proceedings of the first international joint conference on autonomous agents and multiagent systems: part 3, AAMAS’02, pp. 1372–1378. ACM, New York, NY, USA (2002)

  2. Badouel, E., Bernardinello, L., Darondeau, P.: The synthesis problem for elementary net systems is np-complete. Theor. Comput. Sci. 186(1–2), 107–134 (1997)

    Article  MathSciNet  Google Scholar 

  3. Badouel, E., Bernardinello, L., Darondeau, P.: Petri Net Synthesis. Texts in Theoretical Computer Science. An EATCS Series. Springer, Berlin (2015)

    MATH  Google Scholar 

  4. Bailenson, J.N., Yee, N., Blascovich, J., Beall, A.C., Lundblad, N., Jin, M.: The use of immersive virtual reality in the learning sciences: digital transformations of teachers, students, and social context. J. Learn. Sci. 17(1), 102–141 (2008)

    Article  Google Scholar 

  5. Brom, C., Šisler, V., Holan, T.: Story Manager in ‘Europe 2045‘ Uses Petri Nets. In: M. Cavazza, S. Donikian (eds.) Virtual Storytelling. Using Virtual Reality Technologies for Storytelling: 4th International Conference, ICVS 2007, Saint-Malo, France, December 5–7, 2007. Proceedings, pp. 38–50. Springer, Berlin (2007)

  6. Caillaud, B.: Surgical process mining with test and flip net synthesis. In: R. Bergenthum, J. Carmona (eds.) Application of Region Theory (ART), pp. 43–54. Barcelona, Spain (2013). https://hal.inria.fr/hal-00872284

  7. Chan, J.C.P., Leung, H., Tang, J.K.T., Komura, T.: A virtual reality dance training system using motion capture technology. IEEE Trans. Learn. Technol. 4(2), 187–195 (2011)

    Article  Google Scholar 

  8. Chevaillier, P., Trinh, T.H., Barange, M., De Loor, P., Devillers, F., Soler, J., Querrec, R.: Semantic modeling of Virtual Environments using MASCARET. In: 2012 5th Workshop on Software Engineering and Architectures for Realtime Interactive Systems (SEARIS), pp. 1–8 (2012)

  9. Claude, G., Gouranton, V., Bouville Berthelot, R., Arnaldi, B.: Short Paper: #SEVEN, a sensor effector based scenarios model for driving collaborative virtual environment. In: T. Nojima, D. Reiners, O. Staadt (eds.) ICAT-EGVE, International Conference on Artificial Reality and Telexistence, Eurographics Symposium on Virtual Environments, pp. 1–4. Bremen, Germany (2014). https://hal.archives-ouvertes.fr/hal-01086237

  10. Cremer, J., Kearney, J., Papelis, Y.: HCSM: a framework for behavior and scenario control in virtual environments. ACM Trans. Model. Comput. Simul. (TOMACS) 5(3), 242–267 (1995)

    Article  Google Scholar 

  11. Dijkman, R.M., Dumas, M., Ouyang, C.: Formal semantics and analysis of bpmn process models using Petri nets. Queensland University of Technology, Tech. Rep pp. 1–30 (2007)

  12. Gerbaud, S., Mollet, N., Arnaldi, B.: Virtual Environments for Training: From Individual Learning to Collaboration with Humanoids, pp. 116–127. Springer, Berlin (2007)

    Google Scholar 

  13. Green, T.R.G., Petre, M.: Usability analysis of visual programming environments: a ‘Cognitive Dimensions’ framework. J. Vis. Lang. Comput. 7(2), 131–174 (1996)

    Article  Google Scholar 

  14. Klopfer, E., Perry, J., Squire, K., Jan, M.F., Steinkuehler, C.: Mystery at the museum: a collaborative game for museum education. In: Proceedings of the 2005 Conference on Computer support for collaborative learning, pp. 316–320. International Society of the Learning Sciences (2005). http://dl.acm.org/citation.cfm?id=1149293.1149334

  15. Klopfer, E., Squire, K.: Environmental detectives-the development of an augmented reality platform for environmental simulations. Educ. Technol. Res. Dev. 56, 203–228 (2007)

    Article  Google Scholar 

  16. Lamarche, F., Donikian, S.: Automatic orchestration of behaviours through the management of resources and priority levels. In: Proceedings of the First International Joint Conference on Autonomous Agents and Multiagent Systems: Part 3, pp. 1309–1316. ACM (2002). https://doi.org/10.1145/545056.545124

  17. Lécuyer, F., Gouranton, V., Reuzeau, A., Gaugne, R., Arnaldi, B.: Authoring AR by AR: Abstraction and Libraries. In: Y. Kakehi, A. Hiyama (eds.) ICAT-EGVE 2019 (2019)

  18. Lécuyer, F., Gouranton, V., Reuzeau, A., Gaugne, R., Arnaldi, B.: Create by doing-action sequencing in VR. In: Gavrilova, M., Chang, J., Thalmann, N.M., Hitzer, E., Ishikawa, H. (eds.) Advances in Computer Graphics, pp. 329–335. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-22514-8_27

    Chapter  Google Scholar 

  19. Lugrin, J.L., Cavazza, M.: Making sense of virtual environments: action representation, grounding and common sense. In: Proceedings of the 12th International Conference on Intelligent User Interfaces, pp. 225–234. ACM (2007). https://doi.org/10.1145/1216295.1216336

  20. Mateas, M., Stern, A.: A behavior language for story-based believable agents. IEEE Intell. Syst. 17(4), 39–47 (2002)

    Article  Google Scholar 

  21. Paiva, A., Machado, I., Prada, R.: Heroes, Villians, Magicians, and Dramatis Personae in a Virtual Story Creation Environment. In: Proceedings of the 6th International Conference on Intelligent User Interfaces, IUI ’01, pp. 129–136. ACM, New York, NY, USA (2001)

  22. Schmitt, V.: Flip-flop nets. In: C. Puech, R. Reischuk (eds.) STACS 96, 13th Annual Symposium on Theoretical Aspects of Computer Science, Grenoble, France, February 22-24, 1996, Proceedings, Lecture Notes in Computer Science, vol. 1046, pp. 517–528. Springer (1996)

  23. Soos, M., Nohl, K., Castelluccia, C.: Extending SAT solvers to cryptographic problems. In: O. Kullmann (ed.) Theory and Applications of Satisfiability Testing - SAT 2009, 12th International Conference, SAT 2009, Swansea, UK, June 30 - July 3, 2009. Proceedings, Lecture Notes in Computer Science, vol. 5584, pp. 244–257. Springer (2009)

  24. van der Aalst, W.M.P.: Process Mining: Discovery, Conformance and Enhancement of Business Processes, 1st edn. Springer, Berlin (2011)

    Book  Google Scholar 

Download references

Acknowledgements

This work is part of the ANR-16-FRQC-0004 INTROSPECT Project and the SUNSET project funded by the ANR-10-LABX-07-01 “Investing for the Future” program. We would also like to thank people from the Hybrid team who provided relevant feedback on this work.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Flavien Lécuyer.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (mp4 36580 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lécuyer, F., Gouranton, V., Lamercerie, A. et al. Unveiling the implicit knowledge, one scenario at a time. Vis Comput 36, 1951–1963 (2020). https://doi.org/10.1007/s00371-020-01904-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-020-01904-7

Keywords

Navigation