Skip to main content
SpringerLink
Log in

Robot Semantic Protocol (RoboSemProc) for Semantic Environment Description and Human–Robot Communication

  • Original research
  • Published:
International Journal of Social Robotics Aims and scope Submit manuscript

Abstract

In the last decades, the focus has shifted towards mobile robots to link predictions, imagination, and expectations to human life in different aspects. A tremendous amount of research on mobile robots indicates their importance in various industrial and non-industrial fields such as production, medicine and agriculture. Despite all of these innovations in the field of robotics, intelligent mobile robots are facing challenges in processing the vast amount of sensory data from their sensory inputs. Due to the increasing amount of sensory data, a new demand is to process sensory inputs in an understandable form for both humans and robots. One approach to processing sensory data in a way that is understandable for both robots and humans is through the use of semantic technology, which is a major technology for building semantic knowledge bases in a machine-readable form. The success of semantic technology is highly reliant on ontologies which are considered the semantic knowledge representation. The huge amount of research in this field proves the undeniable impact of ontologies in the field of robotics. Yet, the work concerning the conversion of the sensory inputs from a mobile robot into semantic information in real-time are scarce. This transformation becomes more challenging when converting the sensory input of multiple sensors to a single semantic statement. The collection of semantic information for real-time ontology population is another challenge. In this regard, there is also a lack of work in transferring and using this information for natural language communication between humans and robots. This work addresses these challenges and employs semantic technology in the field of robotics to enable a mobile robot to create semantic information during exploration. In addition, the resulted semantic information is used for communicating information as well as facilitating communication between other robots and humans in a natural language.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Notes

  1. https://www.eti.uni-siegen.de/ezls/forschung/amor/.

  2. https://www.openrobots.org/wiki/morse.

  3. https://protege.stanford.edu.

  4. https://github.com/brmson/label-lookup.

References

  1. Wolfgang E (2018) Introduction to artificial intelligence. Springer, Berlin, pp 1–7

    Google Scholar 

  2. Losey DP, McDonald CG, Battaglia E, O’Malley MK (2018) A review of intent detection, arbitration, and communication aspects of shared control for physical human-robot interaction. Appl Mech Rev 70(1):010804

    Google Scholar 

  3. Prestes E, Fiorini SR, Carbonera J (2014) Core ontology for robotics and automation. In: International program committee, p 7

  4. Robotics SPARC (2016) Robotics 2020 Multi–annual roadmap for robotics in Europe. Technical report SPARC, The partnership for Robotics in Europe

  5. Schlenoff C, Prestes E, Madhavan R et al (2012) An IEEE standard ontology for robotics and automation. In: IEEE/RSJ international conference on intelligent robots and systems, IEEE, pp 1337–1342

  6. Carbonera JL, Fiorini SR, Prestes E, et al. (2013) Defining positioning in a core ontology for robotics. In: 2013 IEEE/RSJ an IEEE standard ontology for robotics and automation, pp 1867– 1872

  7. Goodrich MA, Schultz AC (2007) Human–robot interaction: a survey. Found Trends Human-Computer Interact 1(3):203–275

    MATH  Google Scholar 

  8. Liu Y, Nejat G (2013) Robotic urban search and rescue: a survey from the control perspective. J Intell Robot Syst Theory Appl 72(2):147–165

    Google Scholar 

  9. Saez-Pons J, Alboul L, Penders J, Nomdedeu L (2010) Multi-robot team formation control in the GUARDIANS project. Ind Rob Int J 37(4):372–383

    Google Scholar 

  10. Rosenfeld A, Agmon N, Maksimov O, Kraus S (2017) Intelligent agent supporting human-multi-robot team collaboration. Artif Intell 252:211–231

    MathSciNet  MATH  Google Scholar 

  11. Practical RDF (2003) Solving problems with the resource description framework. O’Reilly Media Inc, Newton, pp 19–25

    Google Scholar 

  12. Marin D (2006) A note on the history of the document : RDF formalization. Comput Sci Dept Univ Chile

  13. Varga LZ, Sztaki AH (2005) Semantic web services description based on web services description. In: W3C workshop on frameworks for semantics in web services

  14. Mohammed Saeed N, Fathi M, Kuhnert KD (2018) An approach for instant conversion of sensory data of a simulated sensor of a mobile robot into semantic information. In: 61st IEEE international midwest symposium on circuits and systems

  15. Mohammed Saeed N, Weber C, Fathi M, Kuhnert KD (2018) An approach for modeling spatial prepositions with RDF reification and blank nodes based on the environment perception of a simulated mobile robot. In: IEEE 61st International Midwest Symposium on Circuits and Systems (MWSCAS)

  16. Mohammed Saeed N, Weber C, Fathi M, Kuhnert KD (2019) An efficient alternative for modeling spatial prepositions with RDF helper nodes based on the environment perception of a mobile robot. In: 28th International symposium on industrial electronics (ISIE)

  17. Genesereth MR, Nilsson NJ (1987) Logical foundations of artificial intelligence. J Symb Logic 55(03):1304–1307

    MATH  Google Scholar 

  18. Gruber TR (1993) A translation approach to portable ontology specifications. Knowl Acquis 5(2):199–220

    Google Scholar 

  19. Berners-Lee TJ (2001) The semantic web. Sci Am 284:34–43

    Google Scholar 

  20. Hitzler P, Krotzsch M, Rudolph S (2009) Foundations of semantic web technologies. Chapman and Hall, London, p 456

    Google Scholar 

  21. Fiorini SR, Bermejo-Alonso J, Paulo G, de Freitas EP (2017) A suite of ontologies for robotics and automation. IEEE Robot Autom Mag 24:8–11

    Google Scholar 

  22. Prestes E, Fiorini SR, Carbonera J (2014) Core ontology for robotics and automation. In: international program committee

  23. Kuipers B, Byun Y-T, Froom R et al (2000) The spatial semantic hierarchy spatial semantic hierarchy. Technical report

  24. Paull L, Severac G, Raffo GV (2012) Towards an ontology for autonomous robots. In: 2012 IEEE/RSJ international conference on intelligent robots and systems, pp 1359–1364

  25. Litzel N (2018) Was ist natural language processing? https://www.bigdata-insider.de/was-ist-natural-language-processing-a-590102/ (visited on Nov 10, 2018)

  26. Trischler A, Wang T, Yuan X, et al (2016) NewsQA: a machine comprehension dataset. In: arXiv:1611.09830

  27. Schlaefer N, Gieselmann P, Schaaf T, Waibel A (2006) A pattern learning approach to question answering within the ephyra framework. In: International conference on text, speech, and dialogue. Springer, Berlin, pp 687–694

  28. Ferrucci D, Nyberg E, Allan J, Barker K (2009) Towards the open advancement of question answering systems. In: IBM, Armonk, NY, IBM Research Report

  29. Marx E, Usbeck R, Ngomo ACN et al (2014) Towards an open question answering architecture. In: Press ACM (ed) Proceedings 10th International Conference on Semantic Systems–SEM ’14., New York, pp 57–60

  30. Lally A (2011) Natural language processing with prolog in the IBM Watson system. In: Associates Log Programme

  31. Baudiš P, Šedivỳ J (2015) Modeling of the question answering task in the Yodaqa system. In: International conference of the cross-language evaluation forum European language

  32. Franz Inc (2019) AG semantic graph database. https://franz.com/agraph/allegrograph/ (visited on March. 5, 2019)

  33. Holsapple CW, Joshi KD (2002) A collaborative approach to ontology design. Commun ACM 45(2):42–47

    Google Scholar 

  34. Bast H, Haussmann E (2015) More accurate question answering on freebase. In: proceedings of the 24th ACM international conference on information and knowledge management, ACM

  35. Spitkovsky VI, Chang AX (2012) A cross-lingual dictionary for english wikipedia concepts, pp 3168–3175

  36. Yao X (2015) Lean question answering over freebase from scratch. In: Proceedings of the 2015 conference of the North American chapter of the association for computational linguistics: demonstration. QAlabel–lookupyao

  37. Gomez-Perez A (2001) Evaluation of ontologies. Int J Intell Syst 16(3):391–409

    MATH  Google Scholar 

  38. Haase P, Stojanovic L (2005) Consistent evolution of OWL ontologies. In: ESWC 2005 Semantic Web Resarch Application. Springer, Berlin, pp 182–197

  39. Fahad M, Qadir MA (2008) A framework for ontology evaluation. In: ICCS supplement 149–158

  40. Mohammed Saeed N, (2019) Semantic description and communication of going around in a simulated world. PhD thesis, University of Siegen, Siegen, Germany

Download references

Author information

Authors and Affiliations

  1. Institute of Real-time Learning Systems, University of Siegen, Hőlderlinstr.3, 57076, Siegen, Germany

    Nazeer T. Mohammed Saeed, Masoud Fathi Kazerouni & Klaus-Dieter Kuhnert

  2. Institute of Knowledge Based Systems and Knowledge Management, University of Siegen, Hőlderlinstr.3, 57076, Siegen, Germany

    Madjid Fathi

Authors
  1. Nazeer T. Mohammed Saeed
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Masoud Fathi Kazerouni
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Madjid Fathi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Klaus-Dieter Kuhnert
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nazeer T. Mohammed Saeed.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mohammed Saeed, N.T., Fathi Kazerouni, M., Fathi, M. et al. Robot Semantic Protocol (RoboSemProc) for Semantic Environment Description and Human–Robot Communication. Int J of Soc Robotics 12, 599–612 (2020). https://doi.org/10.1007/s12369-019-00580-5

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12369-019-00580-5

Keywords

Search

Navigation