While interacting with the world our senses and nervous system are constantly challenged to identify the origin and coherence of sensory input signals of various intensities. This problem becomes apparent when stimuli from different modalities need to be combined, e.g., to find out whether an auditory stimulus and a visual stimulus belong to the same object. To cope with this problem, humans and most

Today, climate change has caused a decrease in agricultural output or overall yields that are not as expected; however, with the ongoing population explosion, many undeveloped countries have transformed into emerging countries and have transformed farmland to be used in other types of applications. The resulting decline in agricultural output further increases the severity of the food crisis. In this

Similar to specific natural language instructions, intention-related natural language queries also play an essential role in our daily life communication. Inspired by the psychology term “affordance” and its applications in Human-Robot interaction, we propose an object affordance-based natural language visual grounding architecture to ground intention-related natural language queries. Formally, we

Brain-Computer Interface (BCI), in essence, aims at controlling different assistive devices through the utilization of brain waves. It is worth noting that the application of BCI is not limited to medical applications, and hence, the research in this field has gained due attention. Moreover, the significant number of related publications over the past two decades further indicates the consistent improvements

Mastectomy often leads to a complete desensitization of the chest, which in turn can give rise to diminished sexual function and to disembodiment of the breasts. One approach to mitigate the sensory consequences of mastectomy is to leverage technology that has been developed for the restoration of sensation in bionic hands. Specifically, sensors embedded under the skin of the nipple-areolar complex

3D objects (artifacts) are made to fulfill functions. Designing an object often starts with defining a list of functionalities or affordances (action possibilities) that it should provide, known as functional requirements. Today, designing 3D object models is still a slow and difficult activity, with few Computer-Aided Design (CAD) tools capable to explore the design solution space. The purpose of

Torsion adapters in lower limb prostheses aim to increase comfort, mobility and health of users by allowing rotation in the transversal plane. A preliminary study with two transtibial amputees indicated correlations between torsional stiffness and foot alignment to increase comfort and stability of the user depending on the gait situation and velocity. This paper presents the design and proof-of-concept

There has been substantial growth in research on the robot automation, which aims to make robots capable of directly interacting with the world or human. Robot learning for automation from human demonstration is central to such situation. However, the dependence of demonstration restricts robot to a fixed scenario, without the ability to explore in variant situations to accomplish the same task as

In physical human–robot interaction environment, ankle joint muscle reflex control remains significant and promising in human bipedal stance. The reflex control mechanism contains rich information of human joint dynamic behavior, which is valuable in the application of real-time decoding motion intention. Thus, investigating the human muscle reflex mechanism is not only meaningful in human physiology

Stroke affects one out of every six people on Earth. Approximately 90% of stroke survivors have some functional disability with mobility being a major impairment, which not only affects important daily activities but also increases the likelihood of falling. Originally intended to supplement traditional post-stroke gait rehabilitation, robotic systems have gained remarkable attention in recent years

In perceptual psychology, estimations of visual depth and size under different spatial layouts have been extensively studied. However, research evidence in virtual environments (VE) is relatively lacking. The emergence of human-computer interaction (HCI) and virtual reality (VR) has raised the question of how human operators perform actions based on the estimation of visual properties in VR, especially

Based on interlimb neural coupling, gait robotic systems should produce walking-like movement in both upper and lower limbs for effective walking restoration. Two orthoses were previously designed in our lab to provide passive walking with arm swing. However, an active system for walking with arm swing is desirable to serve as a testbed for investigation of interlimb neural coupling in response to

In attempting to build neurorobotic systems based on flying animals, engineers have come to rely on existing firmware and simulation tools designed for miniature aerial vehicles (MAVs). Although they provide a valuable platform for the collection of data for Deep Learning and related AI approaches, such tools are deliberately designed to be general (supporting air, ground, and water vehicles) and feature-rich

Walking is one of the most relevant tasks that a person performs in their daily routine. Despite its mechanical complexities, any change in the external conditions that applies some external perturbation, or in the human musculoskeletal system that limits an individual's movement, entails a motor response that can either be compensatory or adaptive in nature. Incidentally, with aging or due to the

The emergence of cross-modal learning capabilities requires the interaction of neural areas accounting for sensory and cognitive processing. Convergence of multiple sensory inputs is observed in low-level sensory cortices including primary somatosensory (S1), visual (V1), and auditory cortex (A1), as well as in high-level areas such as prefrontal cortex (PFC). Evidence shows that local neural activity

This paper presents an intuitive end-to-end interaction system between a human and a hexacopter Unmanned Aerial Vehicle (UAV) for field exploration in which the UAV can be commanded by natural human poses. Moreover, LEDs installed on the UAV are used to communicate the state and intents of the UAV to the human as feedback throughout the interaction. A real time multi-human pose estimation system is

Understanding the brain is a fascinating challenge, captivating the scientific community and the public alike. The lack of effective treatment for most brain disorders makes the training of the next generation of neuroscientists, engineers and physicians a key concern. Over the past decade there has been a growing effort to introduce neuroscience in primary and secondary schools, however, hands-on

Evolved living beings can anticipate the consequences of their actions in complex multilevel dynamic situations. This ability relies on abstracting the meaning of an action. The underlying brain mechanisms of such semantic processing of information are poorly understood. Here we show how our novel concept, known as time compaction, provides a natural way of representing semantic knowledge of actions

Self-organization of locomotion characterizes the feature of automatically spontaneous gait generation without preprogrammed limb movement coordination. To study this feature in quadruped locomotion, we propose here a new open-source, small-sized reconfigurable quadruped robot, called Lilibot, with multiple sensory feedback and its physical simulation. Lilibot was designed as a friendly quadrupedal

This paper focuses on the design, modeling, and control of a novel remote actuation, including a compact rotary series elastic actuator (SEA) and Bowden cable. This kind of remote actuation is used for an upper limb rehabilitation robot (ULRR) with four powered degrees of freedom (DOFs). The SEA mainly consists of a DC motor with planetary gearheads, inner/outer sleeves, and eight linearly translational

When humans touch an object with their fingertips, they can immediately describe its tactile properties using haptic adjectives, such as hardness and roughness; however, human perception is subjective and noisy, with significant variation across individuals and interactions. Recent research has worked to provide robots with similar haptic intelligence but was focused on identifying binary haptic adjectives

For achieving motor recovery in individuals with sensorimotor deficits, augmented activation of the appropriate sensorimotor system, and facilitated induction of neural plasticity are essential. An emerging procedure that combines peripheral nerve stimulation and its associative stimulation with central brain stimulation is known to enhance the excitability of the motor cortex. In order to effectively

Evidence from empirical literature suggests that explainable complex behaviors can be built from structured compositions of explainable component behaviors with known properties. Such component behaviors can be built to directly perceive and exploit affordances. Using six examples of recent research in legged robot locomotion, we suggest that robots can be programmed to effectively exploit affordances

Crossmodal interaction in situated language comprehension is important for effective and efficient communication. The relationship between linguistic and visual stimuli provides mutual benefit: While vision contributes, for instance, information to improve language understanding, language in turn plays a role in driving the focus of attention in the visual environment. However, language and vision

Objective: Despite numerous recent advances in the field of rehabilitation robotics, simultaneous, and proportional control of hand and/or wrist prostheses is still unsolved. In this work we concentrate on myocontrol of combined actions, for instance power grasping while rotating the wrist, by only using training data gathered from single actions. This is highly desirable since gathering data for all

Autonomous and remotely operated underwater vehicles allow us to reach places which have previously been inaccessible and perform complex repair, exploration and analysis tasks. As their navigation is not infallible, they may cause severe damage to themselves and their often fragile surroundings, such as flooded caves, coral reefs, or even accompanying divers in case of a collision. In this study,

Recent developments in the non-muscular human-robot interface (HRI) and shared control strategies have shown potential for controlling the assistive robotic arm by people with no residual movement or muscular activity in upper limbs. However, most non-muscular HRIs only produce discrete-valued commands, resulting in non-intuitive and less effective control of the dexterous assistive robotic arm. Furthermore

Robotic assisted minimally invasive surgery (RAMIS) systems present many advantages to the surgeon and patient over open and standard laparoscopic surgery. However, haptic feedback, which is crucial for the success of many surgical procedures, is still an open challenge in RAMIS. Understanding the way that haptic feedback affects performance and learning can be useful in the development of haptic feedback

We propose an automatic method to identify people who are potentially-infected by droplet-transmitted diseases. This high-risk group of infection was previously identified by conducting large-scale visits/interviews, or manually screening among tons of recorded surveillance videos. Both are time-intensive and most likely to delay the control of communicable diseases like influenza. In this paper, we

Traditionally investigated in philosophy, body ownership and agency—two main components of the minimal self—have recently gained attention from other disciplines, such as brain, cognitive and behavioral sciences, and even robotics and artificial intelligence. In robotics, intuitive human interaction in natural and dynamic environments becomes more and more important, and requires skills such as self-other

Human machine interfaces (HMIs) are employed in a broad range of applications, spanning from assistive devices for disability to remote manipulation and gaming controllers. In this study, a new piezoresistive sensors array armband is proposed for hand gesture recognition. The armband encloses only three sensors targeting specific forearm muscles, with the aim to discriminate eight hand movements. Each

In recent years, lots of multifactorial optimization evolutionary algorithms have been developed to optimize multiple tasks simultaneously, which improves the overall efficiency using implicit genetic complementarity between different tasks. In this paper, a novel multitask fireworks algorithm is proposed with novel transfer sparks to solve multitask optimization problems. For each task, some transfer

Recently, multi-task learning (MTL) has been extensively studied for various face processing tasks, including face detection, landmark localization, pose estimation, and gender recognition. This approach endeavors to train a better model by exploiting the synergy among the related tasks. However, the raw face dataset used for training often contains sensitive and private information, which can be maliciously

Machine learning deals with datasets characterized by high dimensionality. However, in many cases, the intrinsic dimensionality of the datasets is surprisingly low. For example, the dimensionality of a robot's perception space can be large and multi-modal but its variables can have more or less complex non-linear interdependencies. Thus multidimensional data point clouds can be effectively located

Brain-controlled wheelchair (BCW) has the potential to improve the quality of life for people with motor disabilities. A lot of training is necessary for users to learn and improve BCW control ability and the performances of BCW control are crucial for patients in daily use. In consideration of safety and efficiency, an indoor simulated training environment is built up in this paper to improve the

In this paper, we present a gecko-inspired soft robot that is able to climb inclined, flat surfaces. By changing the design of the previous version, the energy consumption of the robot could be reduced, and at the same time, its ability to climb and its speed of movement could be increased. As a result, the new prototype consumes only about a third of the energy of the previous version and manages

This paper presents a feature classification method based on vision sensor in dynamic environment. Aiming at the detected targets, a double-projection error based on orb and surf is proposed, which combines texture constraints and region constraints to achieve accurate feature classification in four different environments. For dynamic targets with different velocities, the proposed classification framework

Neuromusculoskeletal simulation provides a promising platform to inform the design of assistive devices or inform rehabilitation. For these applications, a simulation must be able to accurately represent the person of interest, such as an individual with a neurologic injury. If a simulation fails to predict how an individual recruits and coordinates their muscles during movement, it will have limited

Conventional mobile robots have difficulties adapting to unpredictable environments or performing adequately after undergoing physical damages in realtime operation, unlike animals. We address this issue by focusing on brittle stars, an echinoderm related to starfish. Most brittle stars have five flexible arms, and they can coordinate among the arms (i.e., inter-arm coordination) as well as the many

Object recognition in containers is extremely difficult for robots. Dynamic audio signals are more responsive to an object's internal property. Therefore, we adopt the dynamic contact method to collect acoustic signals in the container and recognize objects in containers. Traditional machine learning is to recognize objects in a closed environment, which is not in line with practical applications.

Musculoskeletal models enable movement scientists to examine muscle function by computing the mechanical work done by muscles during motor tasks. To estimate muscle work accurately requires a model that is physiologically plausible. Previous models of the human shoulder have coupled scapula movement to humeral movement. While coupled movement produces a stereotypical scapulohumeral rhythm, it cannot

The maximum cooperative grasping mass and diameter of the human thumb and index finger were investigated by 7560 grasp-release trials on various masses of solid cylinders and various sizes of rings. The maximum grasping mass of the participants' thumb-index finger depended on gender, age and the sum of thumb-index finger lengths (P < 0.05), but not on the hand-used and ratio of index finger to thumb

Despite substantial advances in many different fields of neurorobotics in general, and biomimetic robots in particular, a key challenge is the integration of concepts: to collate and combine research on disparate and conceptually disjunct research areas in the neurosciences and engineering sciences. We claim that the development of suitable robotic integration platforms is of particular relevance to

Locusts are a kind of agile insects that can move and maneuver so efficiently in the unstructured terrain and complex environment. This marvel survivability of locusts benefits from their flying-jumping multi-modal locomotion. But until recently, the main influences of the locomotion performance are still a controversial and unknown issue. In this paper, the idea of hybrid inspired method that combines

Predicting future behavior and positions of other traffic participants from observations is a key problem that needs to be solved by human drivers and automated vehicles alike to safely navigate their environment and to reach their desired goal. In this paper, we expand on previous work on an automotive environment model based on vector symbolic architectures (VSAs). We investigate a vector-representation

Object tracking based on the event-based camera or dynamic vision sensor (DVS) remains a challenging task due to the noise events, rapid change of event-stream shape, chaos of complex background textures, and occlusion. To address the challenges, this paper presents a robust event-stream object tracking method based on correlation filter mechanism and convolutional neural network (CNN) representation

Appropriate robot behavior during human-robot interaction is a key part in the development of human-compliant assistive robotic systems. This study poses the question of how to continuously evaluate the quality of robotic behavior in a hybrid brain-computer interfacing (BCI) task, combining brain and non-brain signals, and how to use the collected information to adapt the robot's behavior accordingly

The endeavor to understand the brain involves multiple collaborating research fields. Classically, synaptic plasticity rules derived by theoretical neuroscientists are evaluated in isolation on pattern classification tasks. This contrasts with the biological brain which purpose is to control a body in closed-loop. This paper contributes to bringing the fields of computational neuroscience and robotics

Stroke is a leading cause of long-term disability worldwide and often impairs walking ability. To improve recovery of walking function post-stroke, researchers have investigated the use of treatments such as fast functional electrical stimulation (FastFES). During FastFES treatments, individuals post-stroke walk on a treadmill at their fastest comfortable speed while electrical stimulation is delivered

The human motor system is robust, adaptive and very flexible. The underlying principles of human motion provide inspiration for robotics. Pointing at different targets is a common robotics task, where insights about human motion can be applied. Traditionally in robotics, when a motion is generated it has to be validated so that the robot configurations involved are appropriate. The human brain, in

Bipedal locomotion is a basic motor activity that requires simultaneous control of multiple muscles. Physiological experiments suggest that the nervous system controls bipedal locomotion efficiently by using motor modules of synergistic muscle activations. If these modules were merged, abnormal locomotion patterns would be realized as observed in patients with neural impairments such as chronic stroke

Modern engineering problems require solutions with multiple functionalities in order to meet their practical needs to handle a variety of applications in different scenarios. Conventional design paradigms for single design purpose may not be able to satisfy this requirement efficiently. This paper proposes a novel system-of-systems bio-inspired design method framed in a solution-driven bio-inspired

Surface ElectroMyoGraphy (EMG) signals from the forearm used in prosthetic hand and finger control systems require precise anatomy data of finger muscles that are small and located deep within the forearm. The main problem of this method is that the signal quality depends on the placement of EMG sensor, which can significantly affects the accuracy and precision to estimate joint angles or forces. Moreover

In traditional robotics, model-based controllers are usually needed in order to bring a robotic plant to the next desired state, but they present critical issues when the dimensionality of the control problem increases and disturbances from the external environment affect the system behavior, in particular during locomotion tasks. It is generally accepted that the motion control of quadruped animals

One of the big challenges in robotics is to endow agents with autonomous and adaptive capabilities. With this purpose, we embedded a cerebellum-based control system into a humanoid robot that becomes capable of handling dynamical external and internal complexity. The cerebellum is the area of the brain that coordinates and predicts the body movements throughout the body-environment interactions. Different

Motivation: Hand amputations can dramatically affect the quality of life of a person. Researchers are developing surface electromyography and machine learning solutions to control dexterous and robotic prosthetic hands, however long computational times can slow down this process. Objective: This paper aims at creating a fast signal feature extraction algorithm that can extract widely used features

The hardness recognition is of great significance to tactile sensing and robotic control. The hardness recognition methods based on deep learning have demonstrated a good performance, however, a huge amount of manually labeled samples which require lots of time and labor costs are necessary for the training of deep neural networks. In order to alleviate this problem, a semi-supervised generative adversarial