Skip to main content

Advertisement

Log in

A Bayesian Trust Inference Model for Human-Multi-Robot Teams

  • Published:
International Journal of Social Robotics Aims and scope Submit manuscript

Abstract

In this paper, we develop a Bayesian inference model for the degree of human trust in multiple mobile robots. A linear model for robot performance in navigation and perception is first devised. We then propose a computational trust model for the human multi-robot team based on a dynamic Bayesian network (DBN). In the trust DBN, the robot performance is the network input, the human trust feedback to each individual robot and the human intervention are the outputs (observations). The categorical Boltzmann machine is used to capture the multinomial distributions that model the conditional dependencies of the DBN. We introduce the expectation maximization (EM) algorithm for the model learning and personalization. A factorial form of the EM algorithm is adopted for the multi-robot system where each robot has its corresponding latent trust state in the human mind. Bayesian inference is conducted to find the trust states, i.e., the trust belief. Based on the inferred trust states, we further derive the formulation to predict human interventions for model validation. A simulated human-UAV collaborative search mission is conducted with humans-in-the-loop. The experiment results show the Bayesian trust inference model can infer the degrees of human trust in multiple mobile robots and also predict human interactions with relatively high accuracy (72.2\(\%\)). These findings confirm the effectiveness of DBNs in modeling human trust towards multi-robot systems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. Interested readers are referred to [6] for the derivation of this exact forward-backward algorithm.

References

  1. Baggenstoss PM (2001) A modified Baum–Welch algorithm for hidden Markov models with multiple observation spaces. IEEE Trans Speech Audio Process 9(4):411–416

    Article  Google Scholar 

  2. Bengio Y, Frasconi P (1995) An input output hmm architecture. In: Advances in neural information processing systems. Neural Information Processing Systems Foundation, Inc., pp 427–434

  3. Chen JY, Barnes MJ, Harper-Sciarini M (2010) Supervisory control of multiple robots: human-performance issues and user-interface design. IEEE Trans Syst Man Cybern Part C (Appl Rev) 41(4):435–454

    Article  Google Scholar 

  4. de Visser E, Parasuraman R (2011) Adaptive aiding of human-robot teaming: effects of imperfect automation on performance, trust, and workload. J Cogn Eng Decis Mak 5(2):209–231

    Article  Google Scholar 

  5. de Visser E.J, Peeters M.M, Jung M.F, Kohn S, Shaw T.H, Pak R, Neerincx M.A (2019) Towards a theory of longitudinal trust calibration in human–robot teams. Int J Soc Robot pp 1–20

  6. Desai M (2012) Modeling trust to improve human-robot interaction. Ph.D. thesis, University of Massachusetts Lowell

  7. Eslami SA, Heess N, Williams CK, Winn J (2014) The shape Boltzmann machine: a strong model of object shape. Int J Comput Vis 107(2):155–176

    Article  MathSciNet  Google Scholar 

  8. Ghahramani Z, Jordan M.I (1996) Factorial hidden Markov models. In: Advances in neural information processing systems, pp 472–478

  9. Hancock PA, Ross JM, Szalma JL (2007) A meta-analysis of performance response under thermal stressors. Hum Factors 49(5):851–877

    Article  Google Scholar 

  10. Hsieh MA, Cowley A, Keller JF, Chaimowicz L, Grocholsky B, Kumar V, Taylor CJ, Endo Y, Arkin RC, Jung B et al (2007) Adaptive teams of autonomous aerial and ground robots for situational awareness. J Field Robot 24(11–12):991–1014

    Article  Google Scholar 

  11. Katz Y, Golbeck J (2006) Social network-based trust in prioritized default logic. AAAI 6:1345–1350

    Google Scholar 

  12. Khasawneh A, Rogers H, Bertrand J, Madathil KC, Gramopadhye A (2019) Human adaptation to latency in teleoperated multi-robot human-agent search and rescue teams. Autom Constr 99:265–277

    Article  Google Scholar 

  13. Kumar P, Gauba H, Roy PP, Dogra DP (2017) Coupled hmm-based multi-sensor data fusion for sign language recognition. Pattern Recogn Lett 86:1–8

    Article  Google Scholar 

  14. Kuter U, Golbeck J (2010) Using probabilistic confidence models for trust inference in web-based social networks. ACM Trans Internet Technol 10(2):8

    Article  Google Scholar 

  15. Larochelle H, Mandel M, Pascanu R, Bengio Y (2012) Learning algorithms for the classification restricted Boltzmann machine. J Mach Learn Res 13(Mar):643–669

    MathSciNet  MATH  Google Scholar 

  16. Lee J, Moray N (1992) Trust, control strategies and allocation of function in human-machine systems. Ergonomics 35(10):1243–1270

    Article  Google Scholar 

  17. Lee JD, See KA (2004) Trust in automation: designing for appropriate reliance. Hum Factors 46(1):50–80

    Article  MathSciNet  Google Scholar 

  18. Mahani M.F, Wang Y (2018) Trust-based runtime verification for multi-quad-rotor motion planning with a human-in-the-loop. In: ASME 2018 dynamic systems and control conference. American society of mechanical engineers digital collection

  19. Mercado JE, Rupp MA, Chen JY, Barnes MJ, Barber D, Procci K (2016) Intelligent agent transparency in human-agent teaming for multi-UxV management. Hum Factors 58(3):401–415

    Article  Google Scholar 

  20. Moon TK (1996) The expectation-maximization algorithm. IEEE Signal Process Mag 13(6):47–60

    Article  Google Scholar 

  21. Murphy K.P, Russell S (2002) Dynamic Bayesian networks: representation, inference and learning

  22. Nam C, Walker P, Li H, Lewis M, Sycara K (2019) Models of trust in human control of swarms with varied levels of autonomy. IEEE Trans Hum-Mach Syst 50:194–204

    Article  Google Scholar 

  23. Nam C, Walker P, Lewis M, Sycara K (2017) Predicting trust in human control of swarms via inverse reinforcement learning. In: 2017 26th IEEE international symposium on robot and human interactive communication (RO-MAN). IEEE, pp 528–533

  24. Rabiner L, Juang B (1986) An introduction to hidden Markov models. IEEE ASSP Mag 3(1):4–16

    Article  Google Scholar 

  25. Rosenfeld A, Agmon N, Maksimov O, Kraus S (2017) Intelligent agent supporting human-multi-robot team collaboration. Artif Intell 252:211–231

    Article  MathSciNet  Google Scholar 

  26. Sadrfaridpour B, Saeidi H, Burke J, Madathil K, Wang Y (2016) Modeling and control of trust in human-robot collaborative manufacturing. In: Robust intelligence and trust in autonomous systems. Springer, pp 115–141

  27. Saeidi H, Wang Y (2018) Incorporating trust and self-confidence analysis in the guidance and control of (semi) autonomous mobile robotic systems. IEEE Robot Autom Lett 4(2):239–246

    Article  Google Scholar 

  28. Spencer D.A, Wang Y, Humphrey L.R (2016) Trust-based human-robot interaction for multi-robot symbolic motion planning. In: 2016 IEEE/RSJ international conference on intelligent robots and systems (IROS). IEEE, pp 1443–1449

  29. Springenberg J.T (2015) Unsupervised and semi-supervised learning with categorical generative adversarial networks. arXiv preprint arXiv:1511.06390

  30. Steinfeld A, Fong T, Kaber D, Lewis M, Scholtz J, Schultz A, Goodrich M (2006) Common metrics for human-robot interaction. In: Proceedings of the 1st ACM SIGCHI/SIGART conference on human-robot interaction. ACM, pp 33–40

  31. Wang Y, Singh MP (2007) Formal trust model for multiagent systems. IJCAI 7:1551–1556

    Google Scholar 

  32. Wang X, Shi Z, Zhang F, Wang Y (2015) Dynamic real-time scheduling for human-agent collaboration systems based on mutual trust. Cyber-Phys Syst 1(2–4):76–90

    Article  Google Scholar 

  33. Wang Y, Humphrey LR, Liao Z, Zheng H (2018) Trust-based multi-robot symbolic motion planning with a human-in-the-loop. ACM Trans Interact Intell Syst 8(4):1–33

    Article  Google Scholar 

  34. Wang N, Pynadath D.V, Hill S.G (2016) Trust calibration within a human-robot team: Comparing automatically generated explanations. In: 2016 11th ACM/IEEE international conference on human-robot interaction (HRI). IEEE, pp 109–116

  35. Xu A, Dudek G (2015) Optimo: Online probabilistic trust inference model for asymmetric human-robot collaborations. In: 2015 10th ACM/IEEE international conference on human-robot interaction, pp. 221–228. IEEE

  36. Zhang W, Du T, Wang J (2016) Deep learning over multi-field categorical data. In: European conference on information retrieval. Springer, pp 45–57

Download references

Funding

This study was partially funded by the Air Force Office of Scientific Research Young Investigator Program under Grant No. FA9550-17-1-0050.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yue Wang.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Fooladi Mahani, M., Jiang, L. & Wang, Y. A Bayesian Trust Inference Model for Human-Multi-Robot Teams. Int J of Soc Robotics 13, 1951–1965 (2021). https://doi.org/10.1007/s12369-020-00705-1

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12369-020-00705-1

Keywords

Navigation