Modeling a diversity of salamander motor behaviors with coupled abstract oscillators and a robot

Salamanders are capable of a variety of locomotor behaviors including swimming, underwater stepping, and forward and backward land stepping. According to electromyographic and kinematic recordings of the trunk, each of these behaviors is characterized by a pattern of muscle activation and body curvature with specific values of cycle duration and trunk intersegmental phase lag. A wider, continuous range of intersegmental phase lags is also observed in recordings of isolated spinal cords. Previous models have typically been limited to the generation of two stereotypical behaviors and transitions between them. In contrast, the present work specifically addresses the flexibility of the spinal cord locomotor networks. We investigate how a flexible central pattern generator (CPG) can be modulated by a higher regulation mechanism to generate appropriate patterns of muscle activation. We then look at the effect of the muscles properties and interactions with the environment on the kinematic pattern, and how local proprioceptive feedback can shape the CPG activity. We propose a CPG model based on abstract oscillators that reproduces the main features of recordings from isolated spinal cords, and that scales well to the higher frequencies of locomotion in the intact animal. The model reproduces the distribution of intersegmental phase lags, the correlation between phase lags and cycle frequencies, and the spontaneous switches between slow and fast rhythms. Using numerical simulations of a salamander robot with a simple muscle model and proprioceptive sensory feedback, we show that the CPG model can reproduce the different motor behaviors of the animal. We find that local proprioceptive feedback, together with the mechanical properties of the muscles, can play an important role in reducing the variability of intersegmental phase lags towards values appropriate for locomotion. To validate the simulation results in the real world, we implement the CPG model as a completely distributed controller on a salamander robot. We show that the animal behaviors can be reproduced using only two simple drive signals and local sensory feedback. We find that local proprioceptive sensory feedback can reduce or replace the need for different levels of drive. In particular, good swimming gaits are achieved with the robot using only one level of drive by introducing a strong proprioceptive feedback in the axial oscillators. The model suggests that the same principles govern the shaping of the motor pattern by descending drive signals and local sensory feedback.

Controlling swimming and crawling in a fish robot using a central pattern generator

Alessandro Crespi, Auke Ijspeert, Daisy Lachat, Ariane Pasquier

Online trajectory generation for robots with multiple degrees of freedom is still a difficult and unsolved problem, in particular for non-steady state locomotion, that is, when the robot has to move in a complex environment with continuous variations of the speed, direction, and type of locomotor behavior. In this article we address the problem of controlling the non-steady state swimming and crawling of a novel fish robot. For this, we have designed a control architecture based on a central pattern generator (CPG) implemented as a system of coupled nonlinear oscillators. The CPG, like its biological counterpart, can produce coordinated patterns of rhythmic activity while being modulated by simple control parameters. To test our controller, we designed BoxyBot, a simple fish robot with three actuated fins capable of swimming in water and crawling on firm ground. Using the CPG model, the robot is capable of performing and switching between a variety of different locomotor behaviors such as swimming forwards, swimming backwards, turning, rolling, moving upwards/downwards, and crawling. These behaviors are triggered and modulated by sensory input provided by light, water, and touch sensors. Results are presented demonstrating the agility of the robot and interesting properties of a CPG-based control approach such as stability of the rhythmic patterns due to limit cycle behavior, and the production of smooth trajectories despite abrupt changes of control parameters. The robot is currently used in a temporary 20-month long exhibition at the EPFL. We present the hardware setup that was designed for the exhibition, and the type of interactions with the control system that allow visitors to influence the behavior of the robot. The exhibition is useful to test the robustness of the robot for long term use, and to demonstrate the suitability of the CPG-based approach for interactive control with a human in the loop. This article is an extended version of an article presented at BioRob2006 the first IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics.

2008

Rich and Robust Bio-Inspired Locomotion Control for Humanoid Robots

Nicolas Benoît Dominique Van der Noot

Bipedal locomotion is a challenging task in the sense that it requires to maintain dynamic balance while steering the gait in potentially complex environments. Yet, humans usually manage to move without any apparent difficulty, even on rough terrains. This requires a complex control scheme which is far from being understood. In this thesis, we take inspiration from the impressive human walking capabilities to design neuromuscular controllers for humanoid robots. More precisely, we control the robot motors to reproduce the action of virtual muscles commanded by stimulations (i.e. neural signals), similarly to what is done during human locomotion. Because the human neural circuitry commanding these muscles is not completely known, we make hypotheses about this control scheme to simplify it and progressively refine the corresponding rules. This thesis thus aims at developing new walking algorithms for humanoid robots in order to obtain fast, human-like and energetically efficient gaits. In particular, gait robustness and richness are two key aspects of this work. In other words, the gaits developed in the thesis can be steered by an external operator, while being resistant to external perturbations. This is mainly tested during blind walking experiments on COMAN, a 95 cm tall humanoid robot. Yet, the proposed controllers can be adapted to other humanoid robots. In the beginning of this thesis, we adapt and port an existing reflex-based neuromuscular model to the real COMAN platform. When tested in a 2D simulation environment, this model was capable of reproducing stable human-like locomotion. By porting it to real hardware, we show that these neuromuscular controllers are viable solutions to develop new controllers for robotics locomotion. Starting from this reflex-based model, we progressively iterate and transform the stimulation rules to add new features. In particular, gait modulation is obtained with the inclusion of a central pattern generator (CPG), a neural circuit capable of producing rhythmic patterns of neural activity without receiving rhythmic inputs. Using this CPG, the 2D walker controllers are incremented to generate gaits across a range of forward speeds close to the normal human one. By using a similar control method, we also obtain 2D running gaits whose speed can be controlled by a human operator. The walking controllers are later extended to 3D scenarios (i.e. no motion constraint) with the capability to adapt both the forward speed and the heading direction (including steering curvature). In parallel, we also develop a method to automatically learn stimulation networks for a given task and we study how flexible feet affect the gait in terms of robustness and energy efficiency. In sum, we develop neuromuscular controllers generating human-like gaits with steering capabilities. These controllers recruit three main components: (i) virtual muscles generating torque references at the joint level, (ii) neural signals commanding these muscles with reflexes and CPG signals, and (iii) higher level commands controlling speed and heading. Interestingly, these developments target humanoid robots locomotion but can also be used to better understand human locomotion. In particular, the recruitment of a CPG during human locomotion is still a matter open to debate. This question can thus benefit from the experiments performed in this thesis.

EPFL2017

Synthesis, modeling, and experimental validation of distributed robotic search

James Pugh

The work of this thesis centers around the research subject of distributed robotic search. Within the field of distributed robotic systems, a task of particular interest is attempting to locate one or more targets in a possibly unknown environment. While numerous studies have proposed and analyzed methods to accomplish this, there is currently a lack of a strong foundation of tools and techniques that can be used to facilitate the development and evaluation of different approaches to distributed robotic search. In this work, we aim to provide such a foundation through tools, methods, models, and analysis of experimentation. An often overlooked aspect of the distributed robotic research process is the development and analysis of tools and modules to be used with robotic systems. These may include plug-ins for realistic robotic simulators, software/hardware systems to track multiple mobile robots in real-time, extension boards for robotic platforms, and the robots themselves. Along with other tools developed and used for this work, we focus particularly on the development, characterization, and validation of a fast, accurate on-board system for relative positioning and communication between robots, a capability which is critical for effective distributed robotic search. Designing individual robot controllers to generate a specific group behavior is a difficult and often counter-intuitive process. A possible alternative to hand-crafting distributed search controllers is automatic synthesis using machine-learning techniques. We explore the effectiveness of using a noise-resistant version of the Particle Swarm Optimization algorithm to optimize the weights of an embedded Artificial Neural Network, allowing the robot to learn obstacle avoidance behavior (a common benchmark for robotic learning techniques); we find that this technique appears to offer superior performance as compared to the canonical approach of using Genetic Algorithms for this type of learning. A method for faster learning using distributed evaluation in a robot team is tested and is found to offer comparable performance using only a fraction of the original learning time. This technique can be used for fast, effective learning and adaptation in a distributed robotic system performing search. The process of designing and analyzing algorithms for distributed robotic systems can be greatly facilitated if models are available to describe the dynamics of the algorithm at an abstract level. Inspired by previous examples in the distributed robotic field, we work to design a model of robotic search that captures the system at different levels of abstraction, ranging from accurately recreating the details of individual robots to describing the entire system as an indivisible whole. To capture the entire search process, we model both the exploration phase, where robots cover an environment in an effort to detect traces of targets, and the localization phase, where robots use target emission sensing to navigate towards the target. The utility of our models is demonstrated by using them to develop an effective technique for the declaration phase of search, where robots decide that a target has been accurately localized and announce its position. In distributed robotics research, it is important that techniques developed with abstracted simulations and models are ultimately validated using real robotic platforms in order to verify their correctness. In that spirit, we run systematic sound search experiments using teams of up to ten real robots. These experiments utilize the tools developed throughout the research process, demonstrate the utility of our learning technique for fast search adaptation, and serve to validate our models of distributed robotic localization. In addition, they allow us to analyze and better understand the subtle dynamics of the search process, providing information which should be useful for any future work on distributed robotic search.

EPFL2008