Human-Human, Human-Robot and Robot-Robot Interaction While Walking: Data Analysis, Modelling and Control

In everyday life humans perform many tasks with other partners which involve coordination, involuntary communication and mutual control adaptation, as the case of carrying objects together with another person. Humanoid robots may help with such activities by collaborating with humans or even substitute them. With this in mind, understanding how humans perform such tasks would be useful not only to better understand human motor control strategies but also to extract useful information for the implementation of robotic controllers. This Thesis aims to investigate if and how the haptic interaction among two subjects cooperating with each other while walking (e.g. while carrying objects) (a) alter their walking gaits, (b) is exploited by humans to understand the intentions of the other partners (e.g. to start/stop walking, accelerate/decelerate, etc.), (c) determine a walking synchronization and (d) whether such a synchronization can improve the overall task (e.g. by reducing the interaction forces). Moreover the feasibility of applying human-human strategies to develop robotic controllers is investigated. \Human-human studies are performed to assess the research objectives and replicate them through simple mechanical models. The main features extracted from the human experiments are then used to develop control modules for humanoid robots doing similar tasks with humans or with other robots. Robotic experiments are then used not only to assess the feasibility of using humans strategies in robotic control but also to try to answer some questions related to human behaviour. The obtained results show that most of the subjects analyzed (a) alter their walking gait while mechanically paired with another human subject, (b) communicate their intention through a combination of interaction forces and hand velocity, (c) coordinate their walking gait with their partner, (d) selecting specific quadrupedal animals types of gaits. Moreover human-humanoid robot and humanoid robot-robot experiments are successfully performed and used to show the importance of walking synchronization in reducing the interaction forces and guaranteeing more symmetric motion of the two bipedal agents.

Imitation Learning of Motion Coordination in Robots

Elena Gribovskaya

The ease with which humans coordinate all their limbs is fascinating. Such a simplicity is the result of a complex process of motor coordination, i.e. the ability to resolve the biomechanical redundancy in an efficient and repeatable manner. Coordination enables a wide variety of everyday human activities from filling in a glass with water to pair figure skating. Therefore, it is highly desirable to endow robots with similar skills. Despite the apparent diversity of coordinated motions, all of them share a crucial similarity: these motions are dictated by underlying constraints. The constraints shape the formation of the coordination patterns between the different degrees of freedom. Coordination constraints may take a spatio-temporal form; for instance, during bimanual object reaching or while catching a ball on the fly. They also may relate to the dynamics of the task; for instance, when one applies a specific force profile to carry a load. In this thesis, we develop a framework for teaching coordination skills to robots. Coordination may take different forms, here, we focus on teaching a robot intra-limb and bimanual coordination, as well as coordination with a human during physical collaborative tasks. We use tools from well-established domains of Bayesian semiparametric learning (Gaussian Mixture Models and Regression, Hidden Markov Models), nonlinear dynamics, and adaptive control. We take a biologically inspired approach to robot control. Specifically, we adopt an imitation learning perspective to skill transfer, that offers a seamless and intuitive way of capturing the constraints contained in natural human movements. As the robot is taught from motion data provided by a human teacher, we exploit evidence from human motor control of the temporal evolution of human motions that may be described by dynamical systems. Throughout this thesis, we demonstrate that the dynamical system view on movement formation facilitates coordination control in robots. We explain how our framework for teaching coordination to a robot is built up, starting from intra-limb coordination and control, moving to bimanual coordination, and finally to physical interaction with a human. The dissertation opens with the discussion of learning discrete task-level coordination patterns, such as spatio-temporal constraints emerging between the two arms in bimanual manipulation tasks. The encoding of bimanual constraints occurs at the task level and proceeds through a discretization of the task as sequences of bimanual constraints. Once the constraints are learned, the robot utilizes them to couple the two dynamical systems that generate kinematic trajectories for the hands. Explicit coupling of the dynamical systems ensures accurate reproduction of the learned constraints, and proves to be crucial for successful accomplishment of the task. In the second part of this thesis, we consider learning one-arm control policies. We present an approach to extracting non-linear autonomous dynamical systems from kinematic data of arbitrary point-to-point motions. The proposed method aims to tackle the fundamental questions of learning robot coordination: (i) how to infer a motion representation that captures a multivariate coordination pattern between degrees of freedom and that generalizes this pattern to unseen contexts; (ii) whether the policy learned directly from demonstrations can provide robustness against spatial and temporal perturbations. Finally, we demonstrate that the developed dynamical system approach to coordination may go beyond kinematic motion learning. We consider physical interactions between a robot and a human in situations where they jointly perform manipulation tasks; in particular, the problem of collaborative carrying and positioning of a load. We extend the approach proposed in the second part of this thesis to incorporate haptic information into the learning process. As a result, the robot adapts its kinematic motion plan according to human intentions expressed through the haptic signals. Even after the robot has learned the task model, the human still remains a complex contact environment. To ensure robustness of the robot behavior in the face of the variability inherent to human movements, we wrap the learned task model in an adaptive impedance controller with automatic gain tuning. The techniques, developed in this thesis, have been applied to enable learning of unimanual and bimanual manipulation tasks on the robotics platforms HOAP-3, KATANA, and i-Cub, as well as to endow a pair of simulated robots with the ability to perform a manipulation task in the physical collaboration.

EPFL2012

Coupled dynamical system based hand-arm grasp planning under real-time perturbations

Aude Billard, Ashwini Shukla

Robustness to perturbation has been advocated as a key element to robot control and efforts in that direction are numerous. While in essence these approaches aim at "endowing robots with a flexibility similar to that displayed by humans", few have actually looked at how humans react in the face of fast perturbations. We recorded the kinematic data from human subjects during grasping motions under very fast perturbations. Results show a strong coupling between the reach and grasp components of the task that enables rapid adaptation of the fingers in coordination with the hand posture when the target object is perturbed. We develop a robot controller based on Coupled Dynamical Systems that exploits coupling between two dynamical systems driving the hand and finger motions. This offers a compact encoding for a variety of reach and grasp motions that adapts on-the-fly to perturbations without the need for any re-planning. To validate the model we control the motion of the iCub robot when reaching for different objects.

MIT Press2011

A Control and Optimization Framework for Robot Locomotion

Soha Pouya

Despite great efforts in designing legged robots, we are still far from the adaptivity, efficiency and robustness with which animals can move. Observations from successful biomimetic designs highlight the significant role of clever morphological design in achieving such performance. In addition, the important role of the controller in improving the locomotion performance is undoubtable. In fact, there is a complex link between morphology and motor control of locomoting systems. In animals’ locomotion, there is a large number of evidence showing the effective link between their morphology and functionality. Motivated by biological observations, similar questions can be posed from a robotics perspective: “what are the relative and complementary roles of robot control and morphology (similar to animal’s brain and body) in the generated locomotor behavior?”, and more pragmatically, “how can we take lessons from these observations to reduce the current gap between robots’ locomotion performance and what is observed in their biological counterparts?”. These are the fundamental questions that have motivated studies in this thesis. While empirical studies are essential to address aforementioned questions, they require simplifying contexts to yield insightful predictions and examinable theories. Both theoretical and physical models (i.e. simulations and robots) can significantly contribute in providing such insights. While robot experiments are essential to evaluate and explore the involved biological concept, they are usually time-consuming and costly. Hence, it would be advantageous if one could exploit the power of theoretical models for development of ideas and hypotheses before their implementation on the real robot. In this thesis, we aim at leveraging the strength of theoretical models to study the above-mentioned questions, namely, the relative role of control and morphology in improving the robot locomotion functionalities. To provide useful theoretical models, we take a step-wise approach, where we start from model-free methods and proceed with advancing the locomotion control by incorporating dynamics models at different levels of complexity. In particular, we develop a pool of robot models, starting from a simplified massless leg to a detailed dynamics model of the leg, to a 2D quadruped with spine joint and eventually to a 3D detailed dynamics model of a quadruped. Along with developing dynamics model of the robot, we devise a set of control and optimization techniques with the main goal of improving locomotion performance. There are several performance criteria to consider (such as energy efficiency, maneuverability, adaptivity to unknown terrains) and a key question is how to build the control architecture to hold a proper trade-off between these partially contradicting criteria. We take advantage of the developed dynamic models in both (i) improving the controller performance and (ii) implementing analytical tools to evaluate and compare different locomotion performance criteria. The central outcome of this thesis is a bio-inspired modeling, control, and optimization framework for legged robot locomotion, which is evaluated on a set of robots with different morphologies. In all cases, we explore how the locomotion performance can be improved by introducing new control techniques or be influenced by the morphological aspects (such as joint configuration and mass distribution). In particular, we show the effect of using more detailed dynamics model to improve the predictive performance of the simulations both for analyzing morphological factors and for robustness of the controller to internal (e.g. change in the inertial parameters) and external (e.g. walking on rough terrains) perturbations. The framework is generic and is used to model, control and analyze locomotion gaits for three compliant quadruped robots (Locomorph, Cheetah-Cub and Bobcat robots) and a modular robot (Roombots).