Skip to main content

Advertisement

SpringerLink
Log in

Eye Machines: Robot Eye, Vision and Gaze

  • Published:
International Journal of Social Robotics Aims and scope Submit manuscript

Abstract

This article analyses three aspects of human and robotic eyes: (1) the eye as an object that evokes visceral reactions from observers when it is exposed or threatened; (2) the eye and brain, sensor and computer as mediators of vision and interpreters of visual worlds; and (3) the gaze as a mode of communication in interpersonal/human–robot interaction. Taking an interdisciplinary approach, this article draws on neuroscience, human–robot interaction, critical humanities, feminism and film studies to interrogate these three aspects of eyes as they relate to the design, theorisation and experience of social robots. We argue that some of the meanings and imaginaries associated with biological eyes are transferred and translated into robotic eyes, vision and gaze, or eye machines, following the tendency towards anthropomorphism. These imaginaries are made visible particularly in science fiction. We argue that photography, the cinematic apparatus, digital sensors and artificial intelligence are not only engineering innovations but have also contributed to transformations in the contemporary collective visual world. Our multimethod cultural studies analysis of eye machines has relevance for cultural theorists, designers and engineers.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Emery NJ (2000) The eyes have it: the neuroethology, function and evolution of social gaze. Neuroscience and Biobehavioral Reviews. Neurosci Biobehav Rev 24:581–604

    Article  Google Scholar 

  2. Vacek S, Schimmel C, Dillmann R (2007) Road-marking analysis for autonomous vehicle guidance. Proc Eur Conf Mob Robot 1–6

  3. Bertozzi M, Broggi A, Fasciol A, Nichele S (2000) Stereo Vision-based Vehicle Detection. IEEE Intelligent Vehicles Symposium. Dearbon, MI, pp 39–44

    Google Scholar 

  4. Aryananda L (2002) Recognizing and remembering individuals: Online and unsupervised face recognition for humanoid robot. IEEE Int Conf Intell Robot Syst 2:1202–1207. https://doi.org/10.1109/irds.2002.1043897

    Article  Google Scholar 

  5. Bartlett MS, Littlewort G, Fasel I, Movellan JR (2003) Real time face detection and facial expression recognition: development and applications to human computer interaction. IEEE Comput Soc Conf Comput Vis Pattern Recognit Work. https://doi.org/10.1109/CVPRW.2003.10057

    Article  Google Scholar 

  6. Foucault M (1977) Discipline and Punish. Vintage Books, New York

    Google Scholar 

  7. Shimada M, Yoshikawa Y, Asada M et al (2011) Effects of observing eye contact between a robot and another person. Int J Soc Robot 3:143–154. https://doi.org/10.1007/s12369-010-0072-9

    Article  Google Scholar 

  8. Zwickel J, Müller HJ (2009) Eye movements as a means to evaluate and improve robots. Int J Soc Robot 1:357–366. https://doi.org/10.1007/s12369-009-0033-3

    Article  Google Scholar 

  9. Lang C, Wachsmuth S, Hanheide M, Wersing H (2012) Facial communicative signals: valence recognition in task-oriented human-robot interaction. Int J Soc Robot 4:249–262. https://doi.org/10.1007/s12369-012-0145-z

    Article  Google Scholar 

  10. Pugh A (1983) Robot vision. Springer, Berlin

    Book  Google Scholar 

  11. Gunkel DJ (2016) Another alterity: Rethinking ethics in the face of the machine. In: Gunkel DJ, Marcondes Filho C, Mersch D (eds) The changing face of alterity: communication, technology and other subjects. IOS Press, Amsterdam, pp 197–218

    Google Scholar 

  12. Dinnen Z, McBean S (2018) The Face as Technology New Form 93:122–137. https://doi.org/10.3898/newf:93.07.2017

    Article  Google Scholar 

  13. Chesher C, Andreallo F (2020) Robotic faciality: The philosophy, science and art of robot faces. Int J Soc Robot. https://doi.org/10.1007/s12369-020-00623-2

    Article  Google Scholar 

  14. Rose G (2016) Visual methodologies. Sage, London

    Google Scholar 

  15. Jenks C (1995) Visual culture. Taylor & Francis, Abington

    Google Scholar 

  16. Lister M, Wells L (2004) Seeing beyond belief: Cultural Studies as an approach to analysing the visual. In: van Leeuwen T, Tewitt C (eds) The handbook of visual analysis. Sage, London, pp 61–91

    Chapter  Google Scholar 

  17. Dixon W (1995) It looks at you: the returned gaze of cinema. State University of New York Press, Albany, NY

    Google Scholar 

  18. Gray A (2003) Research practice for cultural studies: Ethnographic methods and lived cultures. Sage, London

    Book  Google Scholar 

  19. Kristeva J (1982) Powers of horror : an essay on abjection / Julia Kristeva

  20. Heidegger M, Macquarrie J, Robinson E (1962) Being and time. Basil Blackwell, Oxford

    Google Scholar 

  21. Todo T (2018) SEER: Simulative Emotional Expression Robot. https://doi.org/https://doi.org/10.1145/3214907.3214921

  22. Personal Robotics Group (2008) Official MDS Robot Video—First test of expressive ability. In: [YouTube video]. https://youtu.be/aQS2zxmrrrA

  23. Softbank Robotics (2020) Humanoid and programmable robots

  24. Hall ET (1982) The hidden dimension. Anchor, New York NY

    Google Scholar 

  25. Gibson JJ (1950) The perception of the visual world. Riverside Press, Cambridge MA

    Google Scholar 

  26. Aaland M (2007) Shooting digital: Pro tips for taking great pictures with your digital camera. Sybex, Indianapolis IN

    Google Scholar 

  27. Lehoux D (2007) Observers, objects, and the embedded eye; or, seeing and knowing in Ptolemy and Galen. Isis 98:447–467

    Article  Google Scholar 

  28. Illich I (1995) The scopic past and the ethics of the gaze: A plea for the historical study of ocular perception. Work Pap No 6 Univ Park PA Sci Technol Soc Stud

  29. Ruocco SR (1987) Robot sensors and transducers. Springer, Netherlands

    Book  Google Scholar 

  30. Adams M (2012) Robotic navigation and mapping with radar. Artech House, Norwood

    Google Scholar 

  31. Tzafestas SG (2013) Introduction to mobile robot control. Elsevier, Saint Louis

    Google Scholar 

  32. Young A (2019) Retinal prosthetics: science fiction or a vision for the future? In: Eyenews

  33. Hassaballah M, Awad AI (2020) Computer vision: Principles and applications. Taylor & Francis, Boca Raton

    Google Scholar 

  34. Dreyfus H (1995) What computers still can’t do. MIT Press, Cambridge

    Google Scholar 

  35. Raji ID, Gebru T, Mitchell M, et al (2020) Saving Face: Investigating the ethical concerns of facial recognition auditing. AIES 2020—Proc AAAI/ACM Conf AI, Ethics, Soc 145–151. https://doi.org/https://doi.org/10.1145/3375627.3375820

  36. de Castro LN, Von Zuben FJ (2004) Recent developments in biologically inspired computing. Idea Group Publishing, Hershey PA

    Google Scholar 

  37. Haxby JV, Hoffman EA, Gobbini MI (2000) The distributed human neural system for face perception. Trends Cogn Sci 4223–233(4):223–233. https://doi.org/10.1016/S1364-6613(00)01482-0

    Article  Google Scholar 

  38. Senju A, Vernetti A, Kikuchi Y et al (2013) Cultural background modulates how we look at other persons’ gaze. Int J Behav Dev 37:131–136. https://doi.org/10.1177/0165025412465360

    Article  Google Scholar 

  39. Kovács ÁZ, Sári LB (2017) Space, gender, and the gaze in literature and art. Cambridge Scholars Publisher, Newcastle-upon-Tyne

    Google Scholar 

  40. Srinivasan V, Murphy RR, Bethel CL (2015) A reference architecture for social head gaze generation in social robotics. Int J Soc Robot 7:601–616. https://doi.org/10.1007/s12369-015-0315-x

    Article  Google Scholar 

  41. Zheng M, AjJ M, Croft EA, Meng MQH (2015) Impacts of robot head gaze on robot-to-human handovers. Int J Soc Robot 7:783–798. https://doi.org/10.1007/s12369-015-0305-z

    Article  Google Scholar 

  42. Duarte N, Raković M, Tasevski J et al (2018) Action anticipation: Reading the intentions of humans and robots. IEEE Robot Autom Lett 3:4132–4139

    Article  Google Scholar 

  43. Billing E, Sciutti A, Sandini G (2019) Proactive eye-gaze in human-robot interaction. Anticipation and anticipatory systems: humans meet Artificial Intelligence. Örebro, Sweden, pp 10–13

    Google Scholar 

  44. Tamura Y, Akashi T, Yano S, Osumi H (2016) Human visual attention model based on analysis of magic for smooth human–robot interaction. Int J Soc Robot 8:685–694. https://doi.org/10.1007/s12369-016-0354-y

    Article  Google Scholar 

  45. Mutlu B, Shiwa T, Kanda T, et al. (2009) Footing in human-robot conversations. 2009 4th ACM/IEEE Int Conf Human-Robot Interact 2:61. https://doi.org/https://doi.org/10.1145/1514095.1514109

  46. Admoni H, Scassellati B (2017) Social Eye Gaze in Human-Robot Interaction: a review. J Human-Robot Interact 6:25. https://doi.org/10.5898/jhri.6.1.admoni

    Article  Google Scholar 

  47. Sartre J-P (2011) Being and nothingness: An essay on phenomenological ontology

  48. Eggers D (2013) The circle. Knopf, New York

    Google Scholar 

  49. Lacan J (1978) The four fundamental concepts of psychoanalysis. Norton & Co, New York

    Google Scholar 

  50. Mulvey L (1975) Visual pleasure and narrative cinema. Screen 16:6–18

    Article  Google Scholar 

  51. Doane MA (1999) Film and the masquerade: Theorising the female spectator. In: Thornam S (ed) Feminist film theory: A reader. pp 132–145

  52. Mulvey L Afterthoughts on “Visual pleasure and narrative cinema” inspired by ‘Duel in the Sun’ (King Vidor, 1946). Framework 0:12–15

  53. Halberstam J (2005) In a queer time and place: transgender bodies, subcultural lives. New York University Press, New York and London

    Google Scholar 

  54. The Tonight Show Starring Jimmy Fallom (2017) Tonight Showbotics: Jimmy Meets Sophia the Human-Like Robot. In: [YouTube video]. https://youtu.be/Bg_tJvCA8zw. Accessed 5 Apr 2020

  55. Softbank Robotics (2018) Understanding autonomous life settings. http://doc.aldebaran.com/2-1/nao/nao_life.html. Accessed 6 May 2020

  56. Andreallo F, Chesher C (2019) Prosthetic soul mates: sex robots as media for companionship. M/C J 22:

  57. Foxx 11 Los Angeles (2017) Realistic-looking robot with soft skin, soothing voice. In: [YouTube video]. https://youtu.be/851Tx479ivM

  58. Sparrow R (2017) Robots, rape, and representation. Int J Soc Robot 9:465–477. https://doi.org/10.1007/s12369-017-0413-z

    Article  Google Scholar 

  59. Kubes T (2019) New materialist perspectives on sex robots. A feminist dystopia/utopia? Soc Sci, https://doi.org/https://doi.org/10.3390/socsci8080224

Download references

Funding

No external funding.

Author information

Authors and Affiliations

  1. Digital Cultures, The University of Sydney, Sydney, Australia

    Chris Chesher & Fiona Andreallo

Authors
  1. Chris Chesher
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fiona Andreallo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chris Chesher.

Ethics declarations

Conflicts of interest

Chris Chesher is the main guest editor of this special issue. He has removed himself from reviewing this article.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chesher, C., Andreallo, F. Eye Machines: Robot Eye, Vision and Gaze. Int J of Soc Robotics 14, 2071–2081 (2022). https://doi.org/10.1007/s12369-021-00777-7

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12369-021-00777-7

Keyword

Search

Navigation