Abstract
In this paper, we develop a Bayesian inference model for the degree of human trust in multiple mobile robots. A linear model for robot performance in navigation and perception is first devised. We then propose a computational trust model for the human multi-robot team based on a dynamic Bayesian network (DBN). In the trust DBN, the robot performance is the network input, the human trust feedback to each individual robot and the human intervention are the outputs (observations). The categorical Boltzmann machine is used to capture the multinomial distributions that model the conditional dependencies of the DBN. We introduce the expectation maximization (EM) algorithm for the model learning and personalization. A factorial form of the EM algorithm is adopted for the multi-robot system where each robot has its corresponding latent trust state in the human mind. Bayesian inference is conducted to find the trust states, i.e., the trust belief. Based on the inferred trust states, we further derive the formulation to predict human interventions for model validation. A simulated human-UAV collaborative search mission is conducted with humans-in-the-loop. The experiment results show the Bayesian trust inference model can infer the degrees of human trust in multiple mobile robots and also predict human interactions with relatively high accuracy (72.2\(\%\)). These findings confirm the effectiveness of DBNs in modeling human trust towards multi-robot systems.
Similar content being viewed by others
Notes
Interested readers are referred to [6] for the derivation of this exact forward-backward algorithm.
References
Baggenstoss PM (2001) A modified Baum–Welch algorithm for hidden Markov models with multiple observation spaces. IEEE Trans Speech Audio Process 9(4):411–416
Bengio Y, Frasconi P (1995) An input output hmm architecture. In: Advances in neural information processing systems. Neural Information Processing Systems Foundation, Inc., pp 427–434
Chen JY, Barnes MJ, Harper-Sciarini M (2010) Supervisory control of multiple robots: human-performance issues and user-interface design. IEEE Trans Syst Man Cybern Part C (Appl Rev) 41(4):435–454
de Visser E, Parasuraman R (2011) Adaptive aiding of human-robot teaming: effects of imperfect automation on performance, trust, and workload. J Cogn Eng Decis Mak 5(2):209–231
de Visser E.J, Peeters M.M, Jung M.F, Kohn S, Shaw T.H, Pak R, Neerincx M.A (2019) Towards a theory of longitudinal trust calibration in human–robot teams. Int J Soc Robot pp 1–20
Desai M (2012) Modeling trust to improve human-robot interaction. Ph.D. thesis, University of Massachusetts Lowell
Eslami SA, Heess N, Williams CK, Winn J (2014) The shape Boltzmann machine: a strong model of object shape. Int J Comput Vis 107(2):155–176
Ghahramani Z, Jordan M.I (1996) Factorial hidden Markov models. In: Advances in neural information processing systems, pp 472–478
Hancock PA, Ross JM, Szalma JL (2007) A meta-analysis of performance response under thermal stressors. Hum Factors 49(5):851–877
Hsieh MA, Cowley A, Keller JF, Chaimowicz L, Grocholsky B, Kumar V, Taylor CJ, Endo Y, Arkin RC, Jung B et al (2007) Adaptive teams of autonomous aerial and ground robots for situational awareness. J Field Robot 24(11–12):991–1014
Katz Y, Golbeck J (2006) Social network-based trust in prioritized default logic. AAAI 6:1345–1350
Khasawneh A, Rogers H, Bertrand J, Madathil KC, Gramopadhye A (2019) Human adaptation to latency in teleoperated multi-robot human-agent search and rescue teams. Autom Constr 99:265–277
Kumar P, Gauba H, Roy PP, Dogra DP (2017) Coupled hmm-based multi-sensor data fusion for sign language recognition. Pattern Recogn Lett 86:1–8
Kuter U, Golbeck J (2010) Using probabilistic confidence models for trust inference in web-based social networks. ACM Trans Internet Technol 10(2):8
Larochelle H, Mandel M, Pascanu R, Bengio Y (2012) Learning algorithms for the classification restricted Boltzmann machine. J Mach Learn Res 13(Mar):643–669
Lee J, Moray N (1992) Trust, control strategies and allocation of function in human-machine systems. Ergonomics 35(10):1243–1270
Lee JD, See KA (2004) Trust in automation: designing for appropriate reliance. Hum Factors 46(1):50–80
Mahani M.F, Wang Y (2018) Trust-based runtime verification for multi-quad-rotor motion planning with a human-in-the-loop. In: ASME 2018 dynamic systems and control conference. American society of mechanical engineers digital collection
Mercado JE, Rupp MA, Chen JY, Barnes MJ, Barber D, Procci K (2016) Intelligent agent transparency in human-agent teaming for multi-UxV management. Hum Factors 58(3):401–415
Moon TK (1996) The expectation-maximization algorithm. IEEE Signal Process Mag 13(6):47–60
Murphy K.P, Russell S (2002) Dynamic Bayesian networks: representation, inference and learning
Nam C, Walker P, Li H, Lewis M, Sycara K (2019) Models of trust in human control of swarms with varied levels of autonomy. IEEE Trans Hum-Mach Syst 50:194–204
Nam C, Walker P, Lewis M, Sycara K (2017) Predicting trust in human control of swarms via inverse reinforcement learning. In: 2017 26th IEEE international symposium on robot and human interactive communication (RO-MAN). IEEE, pp 528–533
Rabiner L, Juang B (1986) An introduction to hidden Markov models. IEEE ASSP Mag 3(1):4–16
Rosenfeld A, Agmon N, Maksimov O, Kraus S (2017) Intelligent agent supporting human-multi-robot team collaboration. Artif Intell 252:211–231
Sadrfaridpour B, Saeidi H, Burke J, Madathil K, Wang Y (2016) Modeling and control of trust in human-robot collaborative manufacturing. In: Robust intelligence and trust in autonomous systems. Springer, pp 115–141
Saeidi H, Wang Y (2018) Incorporating trust and self-confidence analysis in the guidance and control of (semi) autonomous mobile robotic systems. IEEE Robot Autom Lett 4(2):239–246
Spencer D.A, Wang Y, Humphrey L.R (2016) Trust-based human-robot interaction for multi-robot symbolic motion planning. In: 2016 IEEE/RSJ international conference on intelligent robots and systems (IROS). IEEE, pp 1443–1449
Springenberg J.T (2015) Unsupervised and semi-supervised learning with categorical generative adversarial networks. arXiv preprint arXiv:1511.06390
Steinfeld A, Fong T, Kaber D, Lewis M, Scholtz J, Schultz A, Goodrich M (2006) Common metrics for human-robot interaction. In: Proceedings of the 1st ACM SIGCHI/SIGART conference on human-robot interaction. ACM, pp 33–40
Wang Y, Singh MP (2007) Formal trust model for multiagent systems. IJCAI 7:1551–1556
Wang X, Shi Z, Zhang F, Wang Y (2015) Dynamic real-time scheduling for human-agent collaboration systems based on mutual trust. Cyber-Phys Syst 1(2–4):76–90
Wang Y, Humphrey LR, Liao Z, Zheng H (2018) Trust-based multi-robot symbolic motion planning with a human-in-the-loop. ACM Trans Interact Intell Syst 8(4):1–33
Wang N, Pynadath D.V, Hill S.G (2016) Trust calibration within a human-robot team: Comparing automatically generated explanations. In: 2016 11th ACM/IEEE international conference on human-robot interaction (HRI). IEEE, pp 109–116
Xu A, Dudek G (2015) Optimo: Online probabilistic trust inference model for asymmetric human-robot collaborations. In: 2015 10th ACM/IEEE international conference on human-robot interaction, pp. 221–228. IEEE
Zhang W, Du T, Wang J (2016) Deep learning over multi-field categorical data. In: European conference on information retrieval. Springer, pp 45–57
Funding
This study was partially funded by the Air Force Office of Scientific Research Young Investigator Program under Grant No. FA9550-17-1-0050.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Fooladi Mahani, M., Jiang, L. & Wang, Y. A Bayesian Trust Inference Model for Human-Multi-Robot Teams. Int J of Soc Robotics 13, 1951–1965 (2021). https://doi.org/10.1007/s12369-020-00705-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12369-020-00705-1