Skip to main content
SpringerLink
Log in

Improving Interactions with Healthcare Robots: A Review of Communication Behaviours in Social and Healthcare Contexts

  • Published:
International Journal of Social Robotics Aims and scope Submit manuscript

Abstract

A growing shortfall exists between the number of older individuals who require healthcare support and the number of qualified healthcare professionals who can provide this. Robots offer the potential to provide healthcare support to patients both at home and in healthcare settings. However, in order for robots to be successfully implemented in these environments, they need to behave in ways that are appropriate and acceptable to human users. One way to identify appropriate social behaviours for healthcare robots is to model their behaviour on interactions between healthcare professionals and patients. This literature review aimed to inform healthcare robotics research by highlighting communication behaviours that are important within the context of healthcare. The review focussed on relevant research in human clinical interactions, followed by a review of similar factors in social robotics research. Three databases were searched for terms relating to healthcare professional communication behaviours associated with patient outcomes. The results identified key communication behaviours that can convey clinical empathy, including humour, self-disclosure, facial expressions, eye gaze, body posture, and gestures. A further search was conducted to identify research examining these key behaviours within the context of social and healthcare robotics. Research into these factors in human–robot interaction in healthcare is limited to date, and this review provides a useful guide for future research.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. United Nations Department of Economic and Social Affairs, Population Division (2015) World population prospects. United Nations. https://esa.un.org/unpd/wpp/Publications/Files/WPP2015_Volume-I_Comprehensive-Tables.pdf. Accessed 27 Mar 2019

  2. World Health Organization (2013) Third global forum on human resources for health report—a universal truth: No health without a work force. World Health Organization. https://www.who.int/workforcealliance/knowledge/resources//hrhreport2013/en/. Accessed 27 Aug 2019

  3. Balasubramanian S, Klein J, Burdet E (2010) Robot-assisted rehabilitation of hand function. Curr Opin Neurol 23:661–670. https://doi.org/10.1097/WCO.0b013e32833e99a4

    Article  Google Scholar 

  4. Mukai T, Hirano S, Nakashima H, Kato Y, Sakaida Y, Guo S, Hosoe S (2010) Development of a nursing-care assistance robot RIBA that can lift a human in its arms. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems. https://doi.org/10.1109/iros.2010.5651735

  5. Yanco HA (1998) A robotic wheelchair system: Indoor navigation and user interface. In: Mittal VO, Yanco HA, Simpson R (eds) Assistive technology and artificial intelligence. Springer, Berlin, pp 256–268. https://doi.org/10.1007/BFb0055983

    Chapter  Google Scholar 

  6. Guizzo E, Goldstein H (2005) The rise of the body bots. IEEE Spectrum 42:51–56. https://doi.org/10.1109/MSPEC.2005.151961

    Article  Google Scholar 

  7. Blanson Henkemans OA, Bierman BPB, Janssen J, Neerinx MA, Looije R, van der Bosch H, van der Giessen JAM (2013) Using a robot to personalist health education for children with diabetes type 1: a pilot study. Patient Educ Couns 92:174–181. https://doi.org/10.1016/j.pec.2013.04.012

    Article  Google Scholar 

  8. Broadbent E, Peri K, Kerse N, Jayawardena C, Kuo I, Datta C, MacDonald B (2014) Robots in older people’s homes to improve medication adherence and quality of life: a randomised cross-over trial. In: Proceedings of the 6th international conference in social robotics (ICSR), pp 64–73. https://doi.org/10.1007/978-3-319-11973-1_7

  9. Broadbent E, Orejana JR, Ahn HS, Xie J, Rouse P, MacDonald BA (2015) The cost-effectiveness of a robot measuring vital signs in a rural medical practice. In: Proceedings of the robot and human interactive communication (RO-MAN) conference, pp 577–581. https://doi.org/10.1109/roman.2015.7333668

  10. Eriksson J, Mataric MJ, Winstein CJ (2005). Hands-off assistive robotics for post-stroke arm rehabilitation. In: Proceedings of the 2005 IEEE 9th international conference on rehabilitation robotics, pp 21–24. https://doi.org/10.1109/icorr.2005.1501042

  11. Tapus A, Tapus C, Mataric MJ (2008) User-robot personality matching and assistive robot behavior adaptation for post-stroke rehabilitation therapy. Intell Serv Robot 1:169–183

    Article  Google Scholar 

  12. Fasola J, Mataric MJ (2013) A socially assistive robot exercise coach for the elderly. J Hum Robot Interact 2:3–32. https://doi.org/10.5898/JHRI.2.Fasola

    Article  Google Scholar 

  13. Lara SJ, Casas J, Aguirre A, Munera M, Rincon-Roncancio M, Irfan B, Senft E, Belpaeme T, Cifentes CA (2017) Human–robot sensor interface for cardia rehabilitation. In: Proceedings of the 2017 international conference on rehabilitation robotics (ICORR), pp 1013–1018. https://doi.org/10.1109/icorr.2017.8009382

  14. Kachouie R, Sedighadeli S, Khosla R, Chu M (2014) Socially assistive robots in elderly care: a mixed-method systematic literature review. Int J Hum Comput Interact 5:369–393. https://doi.org/10.1080/10447318.2013.873278

    Article  Google Scholar 

  15. Dawe J, Sutherland C, Barco A, Broadbent E (2019) Can social robots help children in healthcare contexts? A scoping review. BMJ Paediatr Open 3:1–16. https://doi.org/10.1136/bmjpo-2018-000371

    Article  Google Scholar 

  16. Thill S, Pop CA, Belpaeme T, Ziemke T, Vanderborght B (2012) Robot-assisted therapy for autism spectrum disorders with (partially) autonomous control: challenges and outlook. Paladyn 3:209–217. https://doi.org/10.2478/s13230-013-0107-7

    Article  Google Scholar 

  17. Scassellati B, Boccanfuso L, Huang C, Mademtzi M, Qin M, Salomons N, Ventola P, Shic F (2018) Improving social skills in children with ASD using a long-term, in-home social robot. Sci Robot 3:eaat7544. https://doi.org/10.1126/scirobotics.aat7544

    Article  Google Scholar 

  18. Cao H, Van de Perre G, Kennedy J, Senft E, Esteban PG, De Beir A, Simut R, Belpaeme T, Lefeber D, Vanderborght B (2019) A personalized and platform-independent behavior control system for social robots in therapy: development and applications. IEEE Trans Cogn Dev Syst 11:334–346. https://doi.org/10.1109/TCDS.2018.2795343

    Article  Google Scholar 

  19. Walters ML, Syrdal DS, Dautenhahn K, Te Boekhorst R, Koay KL (2008) Avoiding the uncanny valley: robot appearance, personality and consistency of behavior in an attention-seeking home scenario for a robot companion. Auton Robots 24:159–178. https://doi.org/10.1007/s10514-007-9058-3

    Article  Google Scholar 

  20. Broadbent E, Johanson D, Shah J (2018) A new model to enhance robot-patient communication: applying insights from the medical world. In: Proceedings of the 10th international conference on social robotics, pp 308–317. https://doi.org/10.1007/978-3-030-05204-1_30

  21. Ha JF, Longnecker N (2010) Doctor–patient communication: a review. Ochsner J 1:38–43. https://doi.org/10.1016/0277-9536(94)00155-M

    Article  Google Scholar 

  22. Simpson M, Buckman R, Stewart M, Maguire P, Lipkin M, Novack D, Till J (1991) Doctor patient communication: the Toronto consensus agreement. BMJ 303:1385–1387. https://doi.org/10.1136/bmj.303.6814.1385

    Article  Google Scholar 

  23. Stewart M, Brown JB, Boon H, Galajda J, Meredith L, Sangster M (1999) Evidence on patient–doctor communication. Cancer Prev Control 3:25–30

    Google Scholar 

  24. Leite I, Pereira A, Mascarenhas S, Martinho C, Prada R, Paiva A (2013) The influence of empathy in human–robot relations. Int J Hum Comput Stud 71:250–260. https://doi.org/10.1016/j.ijhcs.2012.09.005

    Article  Google Scholar 

  25. Steinhausen S, Ommen O, Thm S, Lefering R, Koehler T, Neugebauer E, Pfaff H (2014) Physician empathy and subjective evaluation of medical treatment outcome in trauma surgery patients. Patient Educ Couns 95:53–60. https://doi.org/10.1016/j.pec.2013.12.007

    Article  Google Scholar 

  26. Mercer SW, Reynolds WJ (2002) Empathy and quality of care. Br J Gen Pract 52:S9–S13

    Google Scholar 

  27. Marci CD, Ham J, Moran E, Orr SP (2007) Physiologic correlates of perceived therapist empathy and social-emotional process during psychotherapy. J Nerv Ment Disease 15:103–111. https://doi.org/10.1097/01.nmd.0000253731.71025.fc

    Article  Google Scholar 

  28. Coulehan JL, Platt FW, Egener B, Frankel R, Lin C, Lown B, Salazar WH (2000) ‘Let me see if I have this right…’ Words that build empathy. Ann Intern Med 135:221–227. https://doi.org/10.7326/0003-4819-135-3-200108070-00022

    Article  Google Scholar 

  29. Zachariae R, Pedersen CG, Jensen AB, Ehrnrooth E, Rossen PB, von der Maase H (2003) Association of perceived physician communication style with patient satisfaction, distress, cancer-related self-efficacy, and perceived control over the disease. Br J Cancer 88:658–665. https://doi.org/10.1038/sj.bjc.6600798

    Article  Google Scholar 

  30. Wan Q, Jiang L, Zeng Y, Wu X (2019) A big-five personality model-based study of empathy behaviours in clinical nurses. Nurse Educ Pract 38:66–71. https://doi.org/10.1016/j.nepr.2019.06.005

    Article  Google Scholar 

  31. Travaline JM, Ruchinskas R, D’Alonzo GE (2005) Patient–physician communication: Why and how. JAOA Clin Pract 105:13–18

    Google Scholar 

  32. Rakel DP, Hoeft TJ, Barrett BP, Chewning BA, Craig BM, Niu M (2009) Practitioner empathy and the duration of the common cold. Fam Med 41:494–501

    Google Scholar 

  33. Mercer SW, Maxwell M, Heaney D, Watt GC (2004) The consultation and relational empathy (CARE) measure: development and preliminary validation and reliability of an empathy-based consultation process measure. Fam Pract 21:699–705. https://doi.org/10.1093/fampra/cmh621

    Article  Google Scholar 

  34. Bikker AP, Fitzpatrick B, Murphy D, Mercer SW (2015) Measuring empathic, person-centred communication in primary care nurses: validity and reliability of the consultation and relational empathy (CARE) measure. BMC Fam Pract 16:149. https://doi.org/10.1186/s12875-015-0374-y

    Article  Google Scholar 

  35. Wirtz M, Boecker M, Forkmann T, Neumann M (2011) Evaluation of the “Consultation and relational empathy” (CARE) measure by means of Rasch-analysis at the example of cancer patients. Patient Educ Couns 82:298–306. https://doi.org/10.1016/j.pec.2010.12.009

    Article  Google Scholar 

  36. Beck RS, Daughtridge R, Sloane PD (2001) Physician–patient communication in the primary care office: a systematic review. J Am Board Fam Pract 15:25–38. https://doi.org/10.24911/IJMDC.51-1544387594

    Article  Google Scholar 

  37. Deladisma AM, Cohen M, Stevens A, Wagner P, Lok B, Bernard T, Oxedine C, Schumacher L, Johnsen K, Dickerson R, Raij A, Wells R, Duerson M, Harper G, Lind S (2007) Do medical students respond empathetically to a virtual patient? Am J Surg 193:756–760. https://doi.org/10.1016/j.amjsurg.2007.01.021

    Article  Google Scholar 

  38. Vera LM, Boccaccini MT, Laxton K, Bryson C, Pennington C, Ridge B, Murrie DC (2019) How does evaluator empathy impact a forensic interview? Law Hum Behav 43:56–68. https://doi.org/10.1037/lhb0000310

    Article  Google Scholar 

  39. Marci CD, Orr SP (2006) The effect of emotional distance on psychophysiologic concordance and perceived empathy between patient and interviewer. Appl Psychophysiol Biofeedback 31:115–128. https://doi.org/10.1007/s10484-006-9008-4

    Article  Google Scholar 

  40. Riek LD, Robinson P (2008) Real time empathy: facial mimicry on a robot. In: Workshop on affective interaction in natural environments, the international ACM conference on multimodal interfaces. https://www.cl.cam.ac.uk/~pr10/publications/affine08.pdf. Accessed 20 Aug 2019

  41. Alves-Oliveira P, Sequeira P, Melo FS, Castellano G, Paiva A (2019) Empathetic robot for group learning: a field study. ACM Trans Hum Robot Interact 8:3:1–3:34. https://doi.org/10.1145/3300188

    Article  Google Scholar 

  42. Klein J, Moon Y, Picard RW (2002) This computer responds to user frustration: theory, design, and results. Interact Comput 14:119–140. https://doi.org/10.1016/s0953-5438(01)00053-4

    Article  Google Scholar 

  43. Niculescu A, van Dijk B, Nijholt A, Li H, See SL (2013) Making social robots more attractive: the effects of voice pitch, humor and empathy. Int J Soc Robot 5:171–191. https://doi.org/10.1007/s12369-012-0171-x

    Article  Google Scholar 

  44. Philips KA, Ospina NS, Rodrigues-Gutierrez R, Castaneda-Guarderas A, Gionfriddo MR, Branda M, Montori V (2018) Humour during clinical practice: analysis of recorded clinical encounters. J Am Board Fam Pract 31:270–278. https://doi.org/10.3122/jabfm.2018.02.170313

    Article  Google Scholar 

  45. Lynch OH (2002) Humorous communication: finding a place for humour in communication research. Commun Theory 4:423–445. https://doi.org/10.1111/j.1468-2885.2002.tb00277.x

    Article  Google Scholar 

  46. McGee Shevlin M (2009) Effect of humor on interpersonal attraction and mate selection. J Psychol 143:67–77. https://doi.org/10.3200/JRLP.143.1.67-77

    Article  Google Scholar 

  47. Zeigler-Hill V, Besser A, Jett SE (2013) Laughing at the looking glass: does humor style serve as an interpersonal signal? Evol Psychol 11:201–226. https://doi.org/10.1177/147470491301100118

    Article  Google Scholar 

  48. Borins M (1995) Humour in the doctor’s office. Can Med Assoc J 152:588–589

    Google Scholar 

  49. Hassed C (2001) How humour keeps you well. Aust Fam Phys 30:25–28

    Google Scholar 

  50. Dionigi A, Sangiorgi D, Flangini R (2014) Clown intervention to reduce preoperative anxiety in children and parents: a randomized controlled trial. J Health Psychol 19:369–380. https://doi.org/10.1177/1359105312471567

    Article  Google Scholar 

  51. Fernandes SC, Arriaga P (2010) The effects of clown intervention on worries and emotional responses in children undergoing surgery. J Health Psychol 15:405–415. https://doi.org/10.1177/1359105309350231

    Article  Google Scholar 

  52. Vagnoli L, Caprilli S, Robiglio A, Messeri A (2005) Clown doctors as a treatment for preoperative anxiety in children: a randomized, prospective study. Paediatrics 116:563–567. https://doi.org/10.1542/peds.2005-0466

    Article  Google Scholar 

  53. Hackathorn J, Garcyzynski AM, Blankmeyer K, Tennial RD, Soloman ED (2011) All kidding aside: humour increases learning at knowledge and comprehension levels. J Scholarsh Teach Learn 11:116–123

    Google Scholar 

  54. Neumann DL, Hood M, Neumann MM (2009) Statistics? You must be joking: The application and evaluation of humour when teaching statistics. J Stat Educ 1:1. https://doi.org/10.1080/10691898.2009.11889525

    Article  Google Scholar 

  55. Cai C, Yu L, Rong L, Zhong H (2014) Effectiveness of humour intervention for patient with schizophrenia: a randomized controlled trail. J Psychiatr Med 59:174–178. https://doi.org/10.1016/j.jpsychires.2014.09.010

    Article  Google Scholar 

  56. Bennett HJI (2003) Humour in medicine. South Med J 12:1257–1261. https://doi.org/10.1097/01.SMJ.0000066657.70073.14

    Article  Google Scholar 

  57. Berger JT, Coulehan J, Belling C (2004) Humour in the physician–patient encounter. JAMA Intern Med 164:825–830. https://doi.org/10.1001/archinte.164.8.825

    Article  Google Scholar 

  58. Dean RAK, Major JE (2007) From critical care to comfort care: the sustaining value of humour. J Clin Nurs 17:1088–1095. https://doi.org/10.1111/j.1365-2702.2007.02090.x

    Article  Google Scholar 

  59. Astedt-Kurki P, Isol A (2001) Humour between nurse and patient, and amount staff: analysis of nurses diaries. J Adv Nurs 35:452–458. https://doi.org/10.1046/j.1365-2648.2001.01860.x

    Article  Google Scholar 

  60. Mirnig N, Stadler S, Stollnberger G, Guiliani M, Tscheligi M (2016) Robot humour: how self-irony and Schadenfreude influence peoples rating of robot likability. In: Proceedings of the 25th IEEE international symposium on robot and human interactive communication (RO-MAN), pp 166–171. https://doi.org/10.1109/roman.2016.7745106

  61. Wendt CS, Berg G (2009) Nonverbal humor as a new dimension of HRI. In: Proceedings of the 18th IEEE international symposium on robot and human interactive communication, pp 183–188. https://doi.org/10.1109/roman.2009.5326230

  62. Fung P, Bertero D, Wan Y, Dey A, Chan RHY, Siddique FB, Yang Y, Wu C, Lin R (2016). Towards empathetic human–robot interactions. In: Proceedings of the 17th international conference on computational linguistics and intelligent text processing, pp 173–193. https://doi.org/10.1007/978-3-319-75487-1_14

  63. Bertero D, Fung P (2016) A long short-term memory framework for predicting humour in dialogues. In: 2016 NAACL-HLT human language technologies, pp 130–135. https://doi.org/10.18653/v1/n16-1016

  64. Devilliers L, Rosset S, Duplessis GD, Sehili MA, Bechade L, Delaborde A et al (2015) Multimodal data collection of human–robot humorous interactions in the JOKER project. In: The 6th international conference on affective computing and intelligent interactions, pp 348–354. https://doi.org/10.1109/acii.2015.7344594

  65. Tay BTC, Low SC, Ko KH, Park T (2016) Types of humour that robots can play. Comput Hum Behav 60:19–28. https://doi.org/10.1016/j.chb.2016.01.042

    Article  Google Scholar 

  66. Sjoberg J, Araki K (2009) Robots make things funnier. In: 2008 Annual conference of the Japanese Society for Artificial Intelligence, pp 306–313. https://doi.org/10.1007/978-3-642-00609-8_27

  67. Johanson DL, Ahn HS, Lim J, Lee C, Sebaratnam G, MacDonald BA, Broadbent E (in press) Use of humour by a healthcare robot positively affects user perceptions. Technol Mind Behav. https://doi.org/10.1037/tmb0000021

  68. Eyssel F, Wullenkord R, Nitsch V (2017) The role of self-disclosure in human–robot interaction. In: Proceedings of the 26th IEEE international symposium on robot and human interactive communication, pp 922–927. https://doi.org/10.1109/roman.2017.8172413

  69. Johanson DL, Ahn HS, MacDonald BA, Ahn BK, Lim J, Hwang E, Sutherland CJ, Broadbent E (2019) The effect of robot attentional behaviours on user perceptions and behaviours in a simulated health care interaction: randomized controlled trial. J Med Internet Res 21:e13667. https://doi.org/10.2196/13667

    Article  Google Scholar 

  70. Zhao R, Papangelis A, Cassell J (2014) Towards a dyadic computational model of rapport management for human–virtual agent interaction. In: Proceedings of the international conference on intelligent virtual agents, pp 514–527. https://doi.org/10.1007/978-3-319-09767-1_62

  71. Bronstein I, Nelson N, Livnat Z, Ben-Ari R (2012) Rapport in negotiation: the contribution of the verbal channel. J Confl Resolut 56:1089–1115. https://doi.org/10.1177/0022002712448913

    Article  Google Scholar 

  72. Allen EF, Arroll B (2015) Physician self-disclosure in primary care: a mixed methods study of GP’s attitudes, skills, and behaviours. Br J Gen Pract 65:601–608. https://doi.org/10.3399/bjgp15X686521

    Article  Google Scholar 

  73. Audet CT, Everall RD (2010) Therapist self-disclosure and therapeutic relationship: a phenome logical study from the client perspective. Br J Guid Counc 38:327–342. https://doi.org/10.1080/0306885.2010.482450

    Article  Google Scholar 

  74. Siino RM, Chung J, Hinds P (2008). Colleague versus tool: effects of disclosure in human–robot collaboration. In: Proceedings of the 17th IEEE international symposium on robot and human interactive communication, pp 558–562. https://doi.org/10.1109/roman.2008.4600725

  75. Gueguen N, De Gail M (2003) The effect of smiling on helping behaviour: smiling and good Samaritan behaviour. Commun Rep 16:133–140. https://doi.org/10.1080/08934210309384496

    Article  Google Scholar 

  76. Martelaro N, Nneji VC, Ju W, Hinds P (2016) Tell me more: designing HRI to encourage more trust, disclosure, and companionship. In: Proceedings of the ACM/IEEE international conference on human–robot interaction, pp 577–578. https://doi.org/10.1109/hri.2016.7451864

  77. Lapakko D (1997) Three cheers for language: a closer examination of a widely cited study of nonverbal communication. Commun Educ 46:63–67. https://doi.org/10.1080/03634529709379073

    Article  Google Scholar 

  78. Liu C, Ishi CT, Ishiguro H, Hagita N (2013) Generation of nodding, head tilting and gazing for human–robot speech interaction. Int J Hum Robot 10:135–140. https://doi.org/10.1142/S0219843613500096

    Article  Google Scholar 

  79. Moshkina L, Trickett S, Trafton JG (2014) Social engagement in public places: a tale of one robot. In: Proceedings of the 2014 ACM/IEEE international conference on human–robot interaction, pp 382–389. https://doi.org/10.1145/2559636.2559678

  80. Cassell J (1999) Embodied conversation: integrating face and gesture into automatic spoken dialogue systems. Unpublished manuscript, Massachusetts Institute of Technology. https://www.media.mit.edu/gnl/discint99/papers/cassell_toappear.pdf. Accessed 30 Aug 2019

  81. Horstmann G, Bauland A (2006) Search asymmetries with real faces: testing the anger-superiority effect. Emotion 6:193–207. https://doi.org/10.1037/1528-3542.6.2.193

    Article  Google Scholar 

  82. Schmidt-Daffy M (2011) Modelling automatic threat detection: development of a face-in-the-crowd task. Emotion 11:153–168. https://doi.org/10.1037/a0022018

    Article  Google Scholar 

  83. Carr JM, McCormick CM (2008) In your face: facial metrics predict aggressive behaviour in the laboratory and in varsity and professional hockey players. Proc R Soc Lond B Biol Sci 275:2651–2656. https://doi.org/10.1098/rspb.2008.0873

    Article  Google Scholar 

  84. Pound N, Penton-Voak IS, Surridge AK (2009) Testosterone responses to competition in men are related to facial masculinity. Proc R Soc Lond B Biol Sci 276:153–159. https://doi.org/10.1098/rspb.2008.0990

    Article  Google Scholar 

  85. Rule NO, Ambady N (2009) She’s got the look: inferences from female chief executive officers’ faces predict their success. Sex Roles 61:644–652. https://doi.org/10.1007/s11199-009-9658-9

    Article  Google Scholar 

  86. Zebrowitz LA, Rhodes G (2004) Sensitivity to “bad genes” and the anomalous face overgeneralization effect: cue validity, cue utilization, and accuracy in judging intelligence and health. J Nonverbal Behav 28:167–185. https://doi.org/10.1023/B:JONB.0000039648.30935.1b

    Article  Google Scholar 

  87. Rule NO, Ambady N, Adams RB Jr, Macrae CN (2008) Accuracy and awareness in the perception and categorization of male sexual orientation. J Personal Soc Psychol 95:1019–1028. https://doi.org/10.1037/a0013194

    Article  Google Scholar 

  88. Smith ML, Perrett DI, Jones BC, Cornwell RE, Moore FR, Feinberg DR, Boothroyd LG, Durrani SJ, Stirrat MR, Whiten S, Pitman RM, Hillier SG (2006) Facial appearance is a cue to oestrogen levels in women. Proc R Soc Lond B Biol Sci 273:135–140. https://doi.org/10.1098/rspb.2005.3296

    Article  Google Scholar 

  89. Faigin G, Larrabee WF (2020) The art of the smile. Fac Plast Surg Aesthet Med 22:3–5. https://doi.org/10.1089/fpsam.2019.29008.lar

    Article  Google Scholar 

  90. Beamish AJ, Foster JJ, Edwards H, Olbers T (2019) What’s in a smile? A review of the benefits of the clinician’s smile. Postgrad Med J 95:91–95. https://doi.org/10.1136/postgradmedj-2018-136286

    Article  Google Scholar 

  91. Dimberg U, Thunberg M (1998) Rapid facial reactions to emotional facial expressions. Scand J Psychol 39:39–45. https://doi.org/10.1111/1467-9450.00054

    Article  Google Scholar 

  92. de Lemus S, Spears R, Moya M (2012) The power of a smile to move you: complementary submissiveness in women’s posture as a function of gender salience and facial expression. Personal Soc Psychol Bull 38:1480–1494. https://doi.org/10.1177/0146167212454178

    Article  Google Scholar 

  93. Lau S (1982) The effect of smiling on person perception. J Soc Psychol 117:63–67. https://doi.org/10.1080/00224545.1982.9713408

    Article  Google Scholar 

  94. Reis HT, Wilson IM, Monestere C, Bernstein S, Clark K, Seidl E, Franco M, Gioioso E, Freeman L, Radoane K (1990) What is smiling is beautiful and good. Eur J Soc Psychol 20:259–267. https://doi.org/10.1002/ejsp.2420200307

    Article  Google Scholar 

  95. Wysong PR, Driver E (2009) Patients perceptions of nurses skill. Crit Care Nurse 29:24–38. https://doi.org/10.4037/ccn2009241

    Article  Google Scholar 

  96. Scharlemann JPW, Eckel CC, Wilson RK (2001) The value of a smile: game theory with a human face. Psychology 22:617–640. https://doi.org/10.1016/S0167-4870(01)00059-9

    Article  Google Scholar 

  97. Ambady N, Koo L, Rosenthal R, Winograd CH (2002) Physical therapists nonverbal communication predicts geriatric patients health outcomes. Psychol Aging 17:443–452. https://doi.org/10.1037/0882-7974.17.3.443

    Article  Google Scholar 

  98. Ahn HS, Choi JY (2012) Can we teach what emotions a robot should express? In: Proceedings of the 2012 IEEE international conference on intelligent robots and systems (IROS 2012), pp 1407–1412. https://doi.org/10.1109/iros.2012.6385691

  99. Ahn HS, Lee DW, Choi D, Lee DY, Hur M, Lee H (2012) Appropriate emotions for facial expressions of 33-DOFs android head EveR-4 H33. In: Proceedings of the 2012 IEEE international symposium on robot and human interactive communication (ROMAN 2012), pp 1115–1120. https://doi.org/10.1109/roman.2012.6343898

  100. Breazeal C, Scassellati B (2000) Infant-like social interactions between a robot and human caretaker. Adapt Behav 8:47–72. https://doi.org/10.1177/105971230000800104

    Article  Google Scholar 

  101. Breazeal C, Kidd CD, Thomaz AL, Hoffman G, Berlin M (2005) Effects of nonverbal communication on efficiency and robustness in human–robot teamwork. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems. https://doi.org/10.1109/iros.2005.1545011

  102. Blow M, Dautenhahn K, Appleby A, Nehaniv CL, Lee D (2006) Perceptions of robot smiles and dimensions for human–robot interaction design. In: Proceedings of the 15th IEEE international symposium on robot and human interactive communication, pp 469–474. https://doi.org/10.1109/roman.2006.314372

  103. Riek LD, Paul PC, Robinson P (2009) When my robot smiles at me: enabling human robot rapport via real time head gesture mimicry. J Multimodal User Interface 3:99–108. https://doi.org/10.1007/s12193-009-0028-2

    Article  Google Scholar 

  104. Johanson DL, Ahn HS, Sutherland CJ, Brown B, MacDonald BA, Lim J, Ahn, BK, Broadbent E (2020) Smiling and use of first-name by a healthcare receptionist robot: effects on user perceptions, attitudes, and behaviours. Paladyn J Behav Robot 11(1):40–51. https://doi.org/10.1515/pjbr-2020-0008

    Article  Google Scholar 

  105. Striano T, Reid VM, Hoehl S (2006) Neural mechanisms of joint attention in infancy. Eur J Neurosci 2:2819–2823. https://doi.org/10.1111/j.1460-9568.2006.04822.x

    Article  Google Scholar 

  106. Uono S, Hietanen JK (2015) Eye contact perception in the west and east: a cross-cultural study. PLOS ONE 10:44–49. https://doi.org/10.1371/journal.pone.0118094

    Article  Google Scholar 

  107. Zeifman D, Delaney S, Blass EM (1996) Sweet taste, looking, and calm in 2-and 4-week-old infants: the eyes have it. Dev Psychol 32:1090–1099. https://doi.org/10.1037/0012-1649.32.6.1090

    Article  Google Scholar 

  108. Griffith CH, Wilson JF, Langer S, Haist SA (2003) House staff nonverbal communication skills and standardized patient satisfaction. J Gen Intern Med 18:170–174. https://doi.org/10.1046/j.1525-1497.2003.10506.x

    Article  Google Scholar 

  109. Harrigan JA, Oxman TE, Rosenthal R (1985) Rapport expressed through nonverbal behavior. J Nonverbal Behav 9:95–110. https://doi.org/10.1007/BF00987141

    Article  Google Scholar 

  110. Adams RB, Kleck RE (2005) Effects of direct and averted gaze on the perception of facially communicated emotion. Emotion 5:3–11. https://doi.org/10.1037/1528-3542.5.1.3

    Article  Google Scholar 

  111. Sander D, Grandjean D, Kaiser S, Wehrle T, Scherer KR (2007) Interaction effects of perceived gaze direction and dynamic facial expression: evidence for appraisal theories of emotion. Eur J Cogn Psychol 19:470–480. https://doi.org/10.1080/09541440600757426

    Article  Google Scholar 

  112. Driver J (2001) A selective review of selective attention research from the past century. Br J Psychol 92:53–78. https://doi.org/10.1348/000712601162103

    Article  Google Scholar 

  113. Mundy P, Newell L (2007) Attention, joint attention, and social cognition. Curr Dir Psychol Sci 16:269–274. https://doi.org/10.1111/j.1468-8721.2007.00518.x

    Article  Google Scholar 

  114. Rohlfing KJ, Longo MR, Bertenthal BI (2012) Dynamic pointing triggers shifts of visual attention in young infants. Dev Sci 15:426–435. https://doi.org/10.1111/j467-7687.2012.01139.x

    Article  Google Scholar 

  115. Ruhland K, Peters CE, Andrist S, Badler JB, Badler N, Gleicher M, Mutlu B, McDonnell R (2015) A review of eye gaze in virtual agents, social robotics and HCI: behaviour generation, user interaction and perception. Comput Graph Forum 34:299–326. https://doi.org/10.1111/cgf.12603

    Article  Google Scholar 

  116. Hoque MM, Kobayashi Y, Kuno Y (2014) A proactive approach of robotic framework for making eye contact with humans. Adv Hum Comput Interact 5:1–19. https://doi.org/10.1155/2014/694046

    Article  Google Scholar 

  117. Karreman DE, Sepulveda BG, van Dijk EMAG, Lohse M, Evers V (2013) Picking favourites: the influence of robot eye-gaze on interactions with multiple users. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems, pp 123–128. https://doi.org/10.1109/iros.2013.6696342

  118. Bruce A, Nourbakhsh I, Simmons R (2002) The role of expressiveness and attention in human–robot interaction. In: Proceedings of the IEEE international conference on robotics and automation, pp 4138–4142. https://doi.org/10.1109/robot.2002.1014396

  119. Staudte M, Crocker MW (2011) Investigating joint attention mechanisms through spoken human–robot interaction. Cognition 120:268–291. https://doi.org/10.1016/j.cognition.2011.05.005

    Article  Google Scholar 

  120. Moon A, Troniak DM, Gleeson B, Pan MKXJ, Zheng M, Blumer BA, MacLEan K, Croft EZ (2014) Meet me where I’m gazing: how shared attention gaze affects human–robot handover timing. In: Proceedings of the 2014 ACM/IEEE international conference on human–robot interaction, pp 334–341. https://doi.org/10.1145/25559636.2559656

  121. Imai M, Ono Ishiguro H (2003) Physical relation and expression: joint attention for human–robot interaction. IEEE Trans Ind Electron 50:636–643. https://doi.org/10.1109/TIE.2003.814769

    Article  Google Scholar 

  122. Andrist S, Tan XZ, Gleicher M, Mutlu B (2014) Conversational gaze aversion for humanlike robots. In: Proceedings of the 2014 ACM/IEEE international conference on human–robot interaction, pp 25–32. https://doi.org/10.1145/2559636.2559666

  123. Holthaus P, Ltkebohle I, Hanheide M, Wachsmuth S (2010) Can I help you? In: Proceedings of international conference on social robotics, pp 325–334. https://doi.org/10.1007/978-3-642-17248-9_34

  124. Werry I, Dautenhahn K, Harwin W (2001) Investigating a robot as a therapy partner for children with Autism. In: Proceedings of the 12th European AAATE conference (AAATE). https://researchprofiles.herts.ac.uk/portal/en/publications/investigating-a-robot-as-a-therapy-partner-for-children-with-autism(131052a8-f253-4523-bd60-e8dd7632c8f2).html. Accessed 2 Oct 2020

  125. Robins B, Dautenhahn K, Boekhorst R, Billard A (2004) Effects of repeated exposure to a humanoid robot on children with Autism. In: Keates S, Clarkson J, Langdon P, Robinson P (eds) Designing a more inclusive world. Springer, London. https://doi.org/10.1007/978-0-85729-372-5-23

    Chapter  Google Scholar 

  126. Whitlock J, Lloyd-Richardson E (2018) Adolescent communication 101: tips for the holidays. Psychologytoday. https://www.psychologytoday.com/us/blog/youth-and-consequences/201812/adolescent-communication-101-tips-the-holidays. Accessed 2 Oct 2020

  127. Kooji E, Crasborn O, Emmerik W (2005) Explaining prosodic body leans in sign language of the Netherlands: pragmatics required. J Pragmat 38:1598–1614. https://doi.org/10.1016/j.pragma.2005.07.006

    Article  Google Scholar 

  128. Wilbur RB, Patschke CG (1998) Body lean and the marking of contrast in American sign language. J Pragmat 30:275–303. https://doi.org/10.1016/S0378-2166(98)00003-4

    Article  Google Scholar 

  129. Sommers-Flanagan J, Sommers-Flanagan R (2012) Clinical interviewing: 2012–2013 update. Wiley, Hoboken. ISBN-13: 978-1118390115

  130. Sharpley CF, Sagris A (2007) When does counsellor forward lean influence client-perceived rapport? Br J Guid Counc 23:387–394. https://doi.org/10.1080/03069889508253696

    Article  Google Scholar 

  131. Hall JA, Harrigan JA, Rosenthal R (1995) Nonverbal behavior in clinician–patient interaction. Appl Prev Psychol 4:21–37. https://doi.org/10.1016/S09621849(05)80049-6

    Article  Google Scholar 

  132. Novack MA, Goldin-Meadow S (2017) Gesture as representational action: a paper about function. Psychon Bull Rev 24:656–665. https://doi.org/10.3758/s13423-016-1145-z

    Article  Google Scholar 

  133. Goldin-Meadow S (1999) The role of gesture in communication and thinking. Trends Cogn Sci 3:419–429. https://doi.org/10.1016/S1364-6613(99)01397-2

    Article  Google Scholar 

  134. Cassell J, McNeill D, McCullough K (1999) Speech-gesture mismatches: evidence for one underlying representation of linguistic and non-linguistic information. Pragmat Cogn 7:1–34. https://doi.org/10.1075/pc.7.1.03cas

    Article  Google Scholar 

  135. Rohlfing KJ, Grimminger A, Luke C (2017) An interactive view on the development of deictic pointing in infancy. Front Psychol 8:1319–1321. https://doi.org/10.3389/fpsyg.2017.013919

    Article  Google Scholar 

  136. Holler J, Schubotz L, Kelly S, Hagoort P, Schuetze M, Özyürek A (2014) Social eye gaze modulates processing of speech and co-speech gesture. Cognition 133:692–697. https://doi.org/10.1016/j.cognition.2014.08.008.Epub.2014

    Article  Google Scholar 

  137. Kelly SD, Barr DJ, Chruch RB, Lynch K (1999) Offering a hand to pragmatic understanding: the role of speech and gesture in comprehension and memory. J Mem Lang 40:577–592. https://doi.org/10.1006/jmla.1999.2634

    Article  Google Scholar 

  138. Morissette P, Ricard M, Decarie TG (1995) Joint visual attention and pointing in infancy: a longitudinal study of comprehension. Br J Dev Psychol 13:163–175. https://doi.org/10.1111/j.2044-835X.1995.tb00671.x

    Article  Google Scholar 

  139. Bohn M, Call J, Tomasello M (2015) Communication about absent entities in great apes and human infants. Cognition 145:63–72. https://doi.org/10.1016/j.cognition.2015.08.009

    Article  Google Scholar 

  140. Weinberger M, Greene JY, Mamlin JJ (1981) The impact of clinical encounter events on patient and physician satisfaction. Soc Sci Med 15E:239–244. https://doi.org/10.1016/0271-5384(81)90019-3

    Article  Google Scholar 

  141. Robinson JD (2006) Nonverbal communication and physician–patient interaction: review and new directions. In: Manusov V, Patterson ML (eds) The Sage handbook of nonverbal communication. Sage Publications, Thousand Oaks, pp 635–679

    Google Scholar 

  142. Huang C, Mutlu B (2014) Multivariate evaluation of interactive robot systems. Auton Robots 37:335–349. https://doi.org/10.1007/s10514-014-9415-y

    Article  Google Scholar 

  143. Nickel K, Stiefelhagen R (2007) Visual recognition of pointing gestures for human–robot interaction. Image Vis Comput 25:1875–1884. https://doi.org/10.1016/j.imavis.2005.12.020

    Article  Google Scholar 

  144. Sato E, Yamaguchi T, Harashima F (2007) Natural interface using pointing behavior for human–robot gestural interaction. IEEE Trans Ind Electron 54:1105–1112. https://doi.org/10.1109/TIE.2007.892728

    Article  Google Scholar 

  145. Bennewitz M, Faber F, Joho D, Schreiber M, Behnke S (2005) Integrating vision and speech for conversations with multiple persons. In: Proceedings of the international conference on intelligent robots and systems, pp 2523–2528. https://doi.org/10.1167/3.9.574

  146. Hasegawa D, Cassell J, Araki K (2010). The role of embodiment and perspective in direction-giving systems. In: Proceedings of the AAAI fall symposium: dialog with robots, pp 236–246. https://www.aaai.org/ocs/index.php/FSS/FSS10/paper/view/2186/2768. Accessed on 30 Aug 2019

  147. Sidner CL, Kidd CD, Lee C, Lesh N (2004) Where to look: a study of human–robot engagement. In: Proceedings of the 9th international conference on intelligent user interfaces, pp 78–84. https://doi.org/10.1145/964442.964458

  148. Salem M, Eyssel F, Rohlfing K, Kopp S, Joublin F (2011) Effects of gesture on the perception of psychological anthropomorphism: a case study with a humanoid robot. In: Proceeds of the international conference on social robotics, pp 31–41. https://doi.org/10.1007/978-3-642-25504-5_4

  149. Bottorff JL, Oliffe JL, Kelly MT, Greaves L, Johnson JL, Ponic P, Chan A (2010) Men’s business, women’s work: gender influences and fathers’ smoking. Sociol Health Illn 32:583–596. https://doi.org/10.1111/j.1467-9566.2009.01234.x

    Article  Google Scholar 

  150. Mroz LW, Chapman GE, Oliffe JL, Bottorff JL (2011) Men, food, and prostate cancer: gender influences on men’s diets. Am J Men’s Health 5:177–187. https://doi.org/10.1177/1557988310379152

    Article  Google Scholar 

  151. Franks P, Bertakis KD (2003) Physician gender, patient gender, and primary care. J Woman’s Health 12:73–80. https://doi.org/10.1089/154099903321154167

    Article  Google Scholar 

  152. Bertakis KD (2008) The influence of gender on the doctor–patient interaction. Patient Educ Couns 76:356–360. https://doi.org/10.1016/j.pec.2009.07.022

    Article  Google Scholar 

  153. Greenwood BN, Camahan S, Huang L (2018) Patient–physician gender concordance and increased mortality among female heart attack patients. Proc Natl Acad Sci U S Am 115:8569–8574. https://doi.org/10.1073/pnas.1800097115

    Article  Google Scholar 

  154. Siegel M, Breazeal C, Norton M (2009) Persuasive behaviour: the influence of robot gender on human behavior. In: Proceedings of the 2009 IEEE/RSJ international conference on intelligent robots and systems, pp 2563–2568. https://doi.org/10.1109/iros.2009.5354116

  155. Tay B, Jung Y, Park T (2014) When stereotypes meet robots: the double-edged sword of robot gender and personality in human–robot interaction. Comput Hum Behav 38:75–84. https://doi.org/10.1016/j.chb.2014.05.014

    Article  Google Scholar 

  156. Eyssel F, Hegel F (2012) J(S)he’s got the look: gender stereotyping of robots. J Appl Soc Psychol 42:2213–2230. https://doi.org/10.1111/j.1559-1816.2012.00937.x

    Article  Google Scholar 

  157. Powers A, Kramer ADI, Lim S, Kuo J, Lee S, Kiesler S (2018) Eliciting information from people with a gendered humanoid robot. In: Proceedings of the IEEE international workshop on robot and human interactive communication, 2005, pp 158–163. https://doi.org/10.1109/ROMAN.2005.151377

  158. Kort NS, Nagarajan SS, Houde JF (2014) A bilateral cortical network responds to pitch perceptions in speech feedback. NeuroImage 86:525–535. https://doi.org/10.1016/j.neuroimage.2013.09.042

    Article  Google Scholar 

  159. Williams S, Weinman J, Dale J (1998) Doctor–patient communication and patient satisfaction: a review. Fam Pract 15:480–492. https://doi.org/10.1093/fampra/15.5.480

    Article  Google Scholar 

  160. Ambady N, LaPlante D, Nguyen T, Rosenthal R, Chaumeton N, Levinson W (2002) Surgeons tone of voice: a clue to malpractice history. Surgery 132:5–9. https://doi.org/10.1067/msy.2002.124733

    Article  Google Scholar 

  161. Otta E, Lira BBP, Delevati NM, Cesar OP, Pires CSG (1994) The effect of smiling and of head tilting on person perception. J Psychol 128:323–331. https://doi.org/10.1080/00223980.1994.9712736

    Article  Google Scholar 

  162. Krumhuber E, Manstead AS, Kappas A (2007) Temporal aspects of facial displays in person and expression perception: the effects of smile dynamics, head-tilt, and gender. J Nonverbal Behav 31:39–56. https://doi.org/10.1007/s10919-006-0019-x

    Article  Google Scholar 

  163. Mara M, Appel M (2015) Effects of lateral head tilt on user perceptions of humanoid and android robots. Comput Hum Behav 44:326–334. https://doi.org/10.1016/j.chb.2014.09.025

    Article  Google Scholar 

Download references

Funding

This study was supported by the Technology Innovation Program (10077553, Development of Social Robot Intelligence for Social Human–Robot Interaction of Service Robots) funded by the Ministry of Trade, Industry and Energy (MOTIE, Korea).

Author information

Authors and Affiliations

  1. Department of Psychological Medicine, Faculty of Health Psychology, The University of Auckland, Auckland, New Zealand

    Deborah L. Johanson & Elizabeth Broadbent

  2. Department of Electrical and Computer Engineering, Faculty of Engineering, The University of Auckland, Auckland, New Zealand

    Ho Seok Ahn

Authors
  1. Deborah L. Johanson
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ho Seok Ahn
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Elizabeth Broadbent
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Deborah L. Johanson.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Johanson, D.L., Ahn, H.S. & Broadbent, E. Improving Interactions with Healthcare Robots: A Review of Communication Behaviours in Social and Healthcare Contexts. Int J of Soc Robotics 13, 1835–1850 (2021). https://doi.org/10.1007/s12369-020-00719-9

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12369-020-00719-9

Keywords

Search

Navigation