Skip to main content

Advertisement

SpringerLink
Log in

Knowledge Acquisition and Design Using Semantics and Perception: A Case Study for Autonomous Robots

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

The pervasive use of artificial intelligence and neural networks in several different research fields has noticeably improved multiple aspects of human life. The application of these techniques to machines has made them progressively more “intelligent” and able to solve tasks considered extremely complex for a human being. This technological evolution has deeply influenced the way we interact with machines. Purely symbolic artificial intelligence and techniques like ontologies, have also been successfully used in the past applied to robotics, but have also shown some limitations and failings in the knowledge construction task. In fact, the exhibited “intelligence” is rarely the result of a real autonomous decision, but it is rather hard-encoded in the machine. While a number of approaches have already been proposed in literature concerning knowledge acquisition from the surrounding environment, they are either exclusively based on low-level features or they involve solely high-level semantics-based attributes. Moreover, they often don’t use a general high-level knowledge base for grounding the acquired knowledge. In this contexts, the use of semantics technologies, such as ontologies, is mostly employed for action-oriented tasks. In this article we propose an extension of a novel approach for knowledge acquisition based on a general semantic knowledge-base and the fusion of semantics and visual information by means of neural networks and ontologies. The proposed approach has been implemented on a humanoid robotic platform and the experimental results are shown and discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Wu Y, Giger ML, Dois K, Vyborny CJ, Schmidt RA, Metz CE (1993) Artificial neural networks in mammography: application to decision making in the diagnosis of breast cancer. Radiology 187(1):81–87

    Article  Google Scholar 

  2. Akay MF (2009) Support vector machines combined with feature selection for breast cancer diagnosis. Expert Syst Appl 36(2):3240–3247

    Article  Google Scholar 

  3. Trippi Robert R, Efraim T (1992) Neural networks in finance and investing: using artificial intelligence to improve real world performance. McGraw-Hill Inc., New York

    Google Scholar 

  4. Raza MQ, Khosravi A (2015) A review on artificial intelligence based load demand forecasting techniques for smart grid and buildings. Renew Sustain Energy Rev 50:1352–1372

    Article  Google Scholar 

  5. Peguin-Feissolle A (1999) A comparison of the power of some tests for conditional heteroskedasticity. Econ Lett 63(1):5–17

    Article  MathSciNet  Google Scholar 

  6. Chinmoy P, Vishwakarma GK (2017) Back propagation neural networks and multiple regressions in the case of heteroskedasticity. Commun Stat Simulat Comput 46(9):6772–6789

    Article  MathSciNet  Google Scholar 

  7. Ajay K D, Bhalla VK (2010) Financial time series forecasting: comparison of neural networks and arch models. Int R J Finance Econ 49:185–202

    Google Scholar 

  8. Shiroishi Y, Uchiyama K, Suzuki N (2018) Society 5.0: For human security and well-being. Computer 51(7):91–95

    Article  Google Scholar 

  9. Iwano K, Kimura Y, Takashima Y, Bannai S, Yamada N (2017) Future services & societal systems in society 5.0. In: Workshop Report. Center for Research and Development Strategy Japan Science and Technology Agency

  10. Gruber T (2008) Collective knowledge systems: where the social web meets the semantic web. Web Semant Sci Serv Agents World Wide Web 6(1):4–13

    Article  Google Scholar 

  11. Antonio L, Mehul B, Alessandro O, Vernon D (2017) The role of cognitive architectures in general artificial intelligence. Cognit Syst Res 48:1–9

    Google Scholar 

  12. Oltramari A, Lebiere C (2012) Pursuing artificial general intelligence by leveraging the knowledge capabilities of act-r. In: International conference on artificial general intelligence. Springer, pp 199–208

  13. Vernon D (2014) Artificial cognitive systems: a primer. MIT Press, Cambridge

    Google Scholar 

  14. Langley P (2006) Cognitive architectures and general intelligent systems. AI Mag 27(2):33

    MathSciNet  Google Scholar 

  15. IBM Power System Bits: concepts and definitions for this computing era (2019). https://www.7wdata.be/data-analysis/how-cognition-as-a-service-could-change-business-intelligence/. Accessed: 11 Sept 2019

  16. Russo C, Madani K, Rinaldi AM (2019) Knowledge construction through semantic interpretation of visual information. In: International work-conference on artificial neural network. Springer, pp 246–257

  17. Albus James S (1991) Outline for a theory of intelligence. IEEE Trans Syst Man Cybern 21(3):473–509

    Article  MathSciNet  Google Scholar 

  18. Brooks R (1986) A robust layered control system for a mobile robot. IEEE J Robot Autom 2(1):14–23

    Article  Google Scholar 

  19. Brooks Rodney A (1990) Elephants don’t play chess. Robot Autonom Syst 6(1–2):3–15

    Article  Google Scholar 

  20. Brooks Rodney A (1991) Intelligence without representation. Artif Intell 47(1–3):139–159

    Article  Google Scholar 

  21. Ramík DM, Sabourin C, Moreno R, Madani K (2014) A machine learning based intelligent vision system for autonomous object detection and recognition. Appl Intell 40(2):358–375

    Article  Google Scholar 

  22. Ramík DM, Madani K, Sabourin C (2013) From visual patterns to semantic description: a cognitive approach using artificial curiosity as the foundation. Pattern Recogn Lett 34(14):1577–1588

    Article  Google Scholar 

  23. Ramík DM, Sabourin C, Madani K (2013) Autonomous knowledge acquisition based on artificial curiosity: Application to mobile robots in an indoor environment. Robot Autonom Syst 61(12):1680–1695

    Article  Google Scholar 

  24. Bodiroza S, Schillaci G, Hafner VV (2011) Robot ego-sphere: an approach for saliency detection and attention manipulation in humanoid robots for intuitive interaction. In: 2011 11th IEEE-RAS international conference on humanoid robots. IEEE, pp 689–694

  25. Ruesch J, Lopes M, Bernardino A, Hornstein J, Santos-Victor J, Pfeifer R (2008) Multimodal saliency-based bottom-up attention a framework for the humanoid robot icub. In: 2008 IEEE international conference on robotics and automation. IEEE, pp 962–967

  26. Metta G, Sandini G, Vernon D, Natale L, Nori F (2008) The ICUB humanoid robot: an open platform for research in embodied cognition. In: Proceedings of the 8th workshop on performance metrics for intelligent systems, pp 50–56

  27. Chella A, Lanza F, Pipitone A, Seidita V (2018) Knowledge acquisition through introspection in human-robot cooperation. Biol Inspired Cognit Arch 25:1–7

    Google Scholar 

  28. Lemaignan S, Ros R, Mösenlechner L, Alami R, Beetz M (2010) Oro, a knowledge management platform for cognitive architectures in robotics. In: 2010 IEEE/RSJ international conference on intelligent robots and systems. IEEE, pp 3548–3553

  29. Lemaignan S, Alami R (2013) Explicit knowledge and the deliberative layer: lessons learned. In: 2013 IEEE/RSJ international conference on intelligent robots and systems. IEEE, pp 5700–5707

  30. Lemaignan S, Warnier M, Sisbot EA, Clodic A, Alami R (2017) Artificial cognition for social human–robot interaction: an implementation. Artif Intell 247:45–69

    Article  MathSciNet  Google Scholar 

  31. Tenorth M (2011) Knowledge processing for autonomous robots. PhD thesis, Technische Universität München

  32. Milliez G, Warnier M, Clodic A, Alami R (2014) A framework for endowing an interactive robot with reasoning capabilities about perspective-taking and belief management. In: The 23rd IEEE international symposium on robot and human interactive communication. IEEE, pp 1103–1109

  33. Hasanuzzaman Md, Zhang T, Ampornaramveth V, Ueno H (2006) Gesture-based human-robot interaction using a knowledge-based software platform. Ind Robot Int J 33(1):37–49

    Article  Google Scholar 

  34. Bauer A, Wollherr D, Buss M (2008) Human-robot collaboration: a survey. Int J Humanoid Rob 5(01):47–66

    Article  Google Scholar 

  35. Chandrasekaran B, Conrad JM (2015) Human-robot collaboration: a survey. In: SoutheastCon 2015. IEEE, pp 1–8

  36. Bülthoff HH, Wallraven C, Giese MA (2008) Perceptual robotics. In: Springer Handbook of Robotics. Springer, pp 1481–1498

  37. Taniguchi A, Taniguchi T, Inamura T (2016) Spatial concept acquisition for a mobile robot that integrates self-localization and unsupervised word discovery from spoken sentences. IEEE Trans Cognit Dev Syst 8(4):285–297

    Google Scholar 

  38. Vanzo A, Part JL, Yu Y, Nardi D, Lemon O (2018) Incrementally learning semantic attributes through dialogue interaction. In: Proceedings of the 17th international conference on autonomous agents and multiagent systems. International foundation for autonomous agents and multiagent systems, pp 865–873

  39. Qiu J, Sun K, Rudas IJ, Gao H (2019) Command filter-based adaptive NN control for mimo nonlinear systems with full-state constraints and actuator hysteresis. IEEE Trans Cybern. https://doi.org/10.1109/TCYB.2019.2944761

    Article  Google Scholar 

  40. Qiu J, Sun K, Wang T, Gao H (2019) Observer-based fuzzy adaptive event-triggered control for pure-feedback nonlinear systems with prescribed performance. IEEE Trans Fuzzy Syst 27(11):2152–2162

    Article  Google Scholar 

  41. Sun K, Mou S, Qiu J, Wang T, Gao H (2018) Adaptive fuzzy control for nontriangular structural stochastic switched nonlinear systems with full state constraints. IEEE Trans Fuzzy Syst 27(8):1587–1601

    Article  Google Scholar 

  42. Caldarola EG, Rinaldi AM (2016) An approach to ontology integration for ontology reuse. In: 2016 IEEE 17th international conference on information reuse and integration (IRI). IEEE, pp 384–393

  43. Rinaldi AM, Russo C (2018) A matching framework for multimedia data integration using semantics and ontologies. In: 2018 IEEE 12th international conference on semantic computing (ICSC). IEEE, pp 363–368

  44. Rinaldi AM, Russo C (2018) A semantic-based model to represent multimedia big data. In: Proceedings of the 10th international conference on management of digital ecosystems. ACM, pp 31–38

  45. Rinaldi AM, Russo C (2018) User-centered information retrieval using semantic multimedia big data. In: 2018 IEEE international conference on big data (Big Data). IEEE, pp 2304–2313

  46. Rinaldi Antonio M (2014) Using multimedia ontologies for automatic image annotation and classification. In: 2014 IEEE International Congress on Big Data (BigData Congress). IEEE, pp 242–249

  47. Rinaldi AM (2015) A complete framework to manage multimedia ontologies in digital ecosystems. Int J Bus Process Integrat Manag 7(4):274–288

    Article  Google Scholar 

  48. Fan J, Luo H, Gao Y (2005) Learning the semantics of images by using unlabeled samples. In: CVPR 2005. IEEE computer society conference on computer vision and pattern recognition, 2005, vol 2. IEEE, pp 704–710

  49. Nöth E, De Mori R, Fischer J, Gebhard A, Harbeck S, Kompe R, Kuhn R, Niemann H, Mast M (1996) An integrated model of acoustics and language using semantic classification trees

  50. Rinaldi Antonio M (2014) A multimedia ontology model based on linguistic properties and audio-visual features. Inf Sci 277:234–246

    Article  Google Scholar 

  51. Miller GA (1995) Wordnet: a lexical database for english. Commun ACM 38(11):39–41

    Article  Google Scholar 

  52. Danesi M, Perron P (1999) Analyzing cultures: an introduction and handbook. Indiana University Press, Bloomington

    Google Scholar 

  53. Deng J, Dong W, Socher R, Li Li-J, Li K, Fei-FL (2009) Imagenet: a large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition. IEEE, pp 248–255

  54. Kohonen T (1990) The self-organizing map. Proc IEEE 78(9):1464–1480

    Article  Google Scholar 

  55. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556

  56. Donahue J, Jia Y, Vinyals O, Hoffman J, Zhang N, Tzeng E, Darrell T (2014) Decaf: a deep convolutional activation feature for generic visual recognition. In: International conference on machine learning, pp 647–655

Download references

Author information

Authors and Affiliations

  1. LISSI Laboratory (EA 3956), Université Paris-Est, Champs-sur-Marne, France

    Cristiano Russo & Kurosh Madani

  2. Department of Electrical Engineering and Information Technologies, University of Naples Federico II, Naples, Italy

    Antonio M. Rinaldi

  3. IKNOS-LAB Intelligent and Knowledge Systems (LUPT), Naples, Italy

    Antonio M. Rinaldi

Authors
  1. Cristiano Russo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kurosh Madani
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Antonio M. Rinaldi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Cristiano Russo.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Russo, C., Madani, K. & Rinaldi, A.M. Knowledge Acquisition and Design Using Semantics and Perception: A Case Study for Autonomous Robots. Neural Process Lett 53, 3153–3168 (2021). https://doi.org/10.1007/s11063-020-10311-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-020-10311-x

Keywords

Search

Navigation