Towards understanding the design of bodily integration
Section snippets
Bodily integration
The term “integration” is increasingly used to describe an emergent paradigm in HCI in which the human and the computer are tightly coupled (Mueller, Lopes, et al., 2020). Farooq and Grudin (2016) characterize this change as a transition from the computer working for the user to with the user. They point out, as an example, how voice assistants have gone beyond taking orders (Human: “Wake me up at 7 am”) to working with humans (Assistant: “It is 6:40 am. You should get up now because bad
Related work
The research presented in this article was inspired by prior work concerning the design of bodily integration systems. These works describe opportunities to extend the human body through computational machinery, and specific uses of physical actuators that directly interact with the body. Despite the existing initial explorations, the approaches outlined in these works do not readily provide a complete answer on how to design bodily integration. Hence, our work is still needed.
As early as the
Developing the design space
We investigated the design space by reviewing existing example systems, assembling three case studies, reflecting on the case studies, and in-person meetings with experts in actuation systems. We present an overview of the development process of the design space in Fig. 1.
We started from a review of existing example systems, assembled following prior work by Marshall et al. (Marshall et al., 2011) who collected systems where users experience limited control over their body. This review was
Bodily Integration
Based on our own prior work and the extended literature, we argue that it can be helpful to examine bodily agency and ownership to understand the user experience of bodily integration systems. Both agency and ownership are concerned with a coupling between human body and computing machinery, but from different angles: bodily agency in terms of “who is controlling whom”, and bodily ownership in terms of “that is me”.
Prior work has highlighted the importance of control in understanding embodied
The bodily integration design space
Combining the bodily agency and bodily ownership dimensions produces the bodily integration design space (Figure 2).
We argue that designers should consider both, bodily agency and ownership, in the design of bodily integrated systems. Prior work in psychology points out that both can play an important role (Blanke & Metzinger, 2009) in any self-experience (Braun et al., 2018), which we argue includes bodily integrated experiences. We acknowledge that prior work has highlighted that the
Four user experiences based on the design space's quadrants
The design space enables designers to identify the quadrant for which they are designing, which can help adapt the design process (Figure 3).
The following sections describe the opportunities and challenges designers might face when designing for each quadrant, summarized below (Table 1).
Applying the bodily integration Design Space
This section describes how our bodily integration design space with its four quadrants can be applied to existing design examples to demonstrate the framework's usefulness for design practice. Our three systems support various application domains and employ different technologies, showcasing the general applicability of the framework.
We begin with a summary of the three systems (Table 2).
Design Strategies for Bodily Integrated Systems based on bodily agency and ownership
While the design space can be used to determine the “What?” of the design process, we must also consider the “How?”. We now present a set of strategies for consideration by designers interested in developing bodily integrated systems. We base these strategies on our experiences of designing, developing, trialing, and widely exhibiting bodily integrated systems. Furthermore, we also base these strategies on our experiences of conducting associated studies. Combining our research and practice
Discussion
Our framework around bodily integration has helped us in analyzing existing designs we have developed in our respective labs. By looking at the design space, we have determined where many existing systems sit and where we could “move” them to in the design space to facilitate different user experiences. The design space dimensions have helped to discuss our designs, providing a way to articulate design differences. We hope other designers and researchers will benefit from this work.
We
Conclusion
Our work was motivated by the potential for human-computer integration fostered by contemporary technological advances, particularly those in which the human and the computing machinery are coupled in a way that allows them to act on each other physically. We believe that an integration approach can facilitate novel user experiences, and in particular, that bodily integration can offer exciting new opportunities for users to experience their body, and hence themselves, in interesting new ways.
CRediT authorship contribution statement
Florian ‘Floyd’ Mueller: Conceptualization, Methodology, Investigation, Resources, Writing – original draft, Writing – review & editing, Visualization, Supervision, Project administration. Pedro Lopes: Conceptualization, Writing – original draft, Writing – review & editing, Visualization. Josh Andres: Investigation, Writing – review & editing. Richard Byrne: Investigation, Writing – review & editing. Nathan Semertzidis: Investigation, Writing – review & editing. Zhuying Li: Investigation,
Declaration of Competing Interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Acknowledgements
Florian ‘Floyd’ Mueller thanks the Australian Research Council for their support. Pedro Lopes acknowledges the support in part by NSF grant 2047189. Richard Byrne, Josh Andres, Nathan Semertzidis and Florian ‘Floyd’ Mueller thank RMIT University's School of Design. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of any funding agencies.
References (113)
Man-Machine teaming: a problem of Agency
IFAC-PapersOnLine
(2019)- et al.
Full-body illusions and minimal phenomenal selfhood
Trends in cognitive sciences
(2009) - et al.
Active control as evidence in favor of sense of ownership in the moving Virtual Hand Illusion
Consciousness and cognition
(2019) - et al.
E-bikes in the mainstream: reviewing a decade of research
Transport Reviews
(2016) - et al.
Traffic conflicts and their contextual factors when riding conventional vs. electric bicycles
Transportation research part F: traffic psychology and behaviour
(2017) - et al.
Human augmentation: Past, present and future
International Journal of Human-Computer Studies
(2019) - et al.
Grand challenges in shape-changing interface research
- et al.
Hearing colors: an example of brain plasticity
Frontiers in Systems Neuroscience
(2015) - et al.
Exploring Human: eBike Interaction to Support Rider Autonomy
- et al.
"I had super-powers when eBike riding" Towards Understanding the Design of Integrated Exertion
(2018)
Co-riding With My eBike to Get Green Lights
Projecting sensations to external objects: evidence from skin conductance response. Proceedings of the Royal Society of London
Series B: Biological Sciences
Temporary-tattoo for long-term high fidelity biopotential recordings
Scientific reports
Contesting Control: Journeys through Surrender, Self-Awareness and Looseness of Control in Embodied Interaction
Expected, sensed, and desired: A framework for designing sensing-based interaction
ACM Transactions on Computer-Human Interaction (TOCHI)
Interdependence as a frame for assistive technology research and design
Tool extension in human-computer interaction
I Really did That: Sense of Agency with Touchpad, Keyboard, and On-skin Interaction
Rubber hands ‘feel’ touch that eyes see
Nature
The senses of agency and ownership: a review
Frontiers in psychology
Manifesting the cyborg through techno-body modification: From human-computer interaction to integration
What do audiences want from a virtual reality entertainment experience?
Balance Ninja: Towards the Design of Digital Vertigo Games via Galvanic Vestibular Stimulation
Designing the Vertigo Experience: Vertigo as a Design Resource for Digital Bodily Play
AR Fighter: Using HMDs to create Vertigo Play Experiences
Designing Digital Vertigo Experiences
ACM Transactions on Computer-Human Interaction (TOCHI)
I did that! Measuring users' experience of agency in their own actions
INFERNO: I was a robot at Elektra Festival
Where the Action Is: The Foundations of Embodied Interaction
Implications for design
Should Oscar Pistorius be excluded from the 2008 Olympic games?
Sports Ethics and Philosophy
Workshop on Whole-Body Interactions
Human-computer integration
interactions
Video game induced seizures
Journal of Neurology, Neurosurgery & Psychiatry
The danger of intimate algorithms
Game Design Workshop (Second Edition: A Playcentric Approach to Creating Innovative Games ed.)
Ambiguity in the sense of agency
Decomposing the will
i-dentity: innominate movement representation as engaging game element
Annotated portfolios
interactions
Dark patterns in proxemic interactions: a critical perspective
Human-Computer Integration
The illusion of owning a third arm
PloS one
Utilizing Gravity in Movement-Based Games and Play
Exoskeletons and orthoses: classification, design challenges and future directions
Journal of neuroengineering and rehabilitation
Designing with the body: somaesthetic interaction design
Getting a grip on tangible interaction: a framework on physical space and social interaction
Strong concepts: Intermediate-level knowledge in interaction design research
ACM Trans. Comput.-Hum. Interact.
Move to get moved: a search for methods, tools and knowledge to design for expressive and rich movement-based interaction
Personal and Ubiquitous Computing
Guidelines for the Design of Movement-Based Games and Their Relevance to HCI
Human–Computer Interaction
Cited by (19)
Grand challenges in human-food interaction
2024, International Journal of Human Computer StudiesExploring Superpower Design Through Wi-Fi Twinge
2024, ACM International Conference Proceeding SeriesDesigning as trading-off: a practice-based view on smart service systems
2024, European Journal of Information SystemsGame with Breathing Control System for Learning Circular Breathing
2023, CHI PLAY 2023 - Companion Proceedings of the Annual Symposium on Computer-Human Interaction in Play