Online optimization of swimming and crawling in an amphibious snake robot

An important problem in the control of locomotion of robots with multiple degrees of freedom (e.g., biomimetic robots) is to adapt the locomotor patterns to the properties of the environment. This article addresses this problem for the locomotion of an amphibious snake robot, and aims at identifying fast swimming and crawling gaits for a variety of environments. Our approach uses a locomotion controller based on the biological concept of central pattern generators (CPGs) together with a gradient-free optimization method, Powell’s method. A key aspect of our approach is that the gaits are optimized online, i.e., while moving, rather than as an off-line optimization process. We present various experiments with the real robot and in simulation: swimming, crawling on horizontal ground, and crawling on slopes. For each of these different situations, the optimized gaits are compared with the results of systematic explorations of the parameter space. The main outcomes of the experiments are: 1) optimal gaits are significantly different from one medium to the other; 2) the optimums are usually peaked, i.e., speed rapidly becomes suboptimal when the parameters are moved away from the optimal values; 3) our approach finds optimal gaits in much fewer iterations than the systematic search; and 4) the CPG has no problem dealing with the abrupt parameter changes during the optimization process. The relevance for robotic locomotion control is discussed.

Rich and Robust Bio-Inspired Locomotion Control for Humanoid Robots

Nicolas Benoît Dominique Van der Noot

Bipedal locomotion is a challenging task in the sense that it requires to maintain dynamic balance while steering the gait in potentially complex environments. Yet, humans usually manage to move without any apparent difficulty, even on rough terrains. This requires a complex control scheme which is far from being understood. In this thesis, we take inspiration from the impressive human walking capabilities to design neuromuscular controllers for humanoid robots. More precisely, we control the robot motors to reproduce the action of virtual muscles commanded by stimulations (i.e. neural signals), similarly to what is done during human locomotion. Because the human neural circuitry commanding these muscles is not completely known, we make hypotheses about this control scheme to simplify it and progressively refine the corresponding rules. This thesis thus aims at developing new walking algorithms for humanoid robots in order to obtain fast, human-like and energetically efficient gaits. In particular, gait robustness and richness are two key aspects of this work. In other words, the gaits developed in the thesis can be steered by an external operator, while being resistant to external perturbations. This is mainly tested during blind walking experiments on COMAN, a 95 cm tall humanoid robot. Yet, the proposed controllers can be adapted to other humanoid robots. In the beginning of this thesis, we adapt and port an existing reflex-based neuromuscular model to the real COMAN platform. When tested in a 2D simulation environment, this model was capable of reproducing stable human-like locomotion. By porting it to real hardware, we show that these neuromuscular controllers are viable solutions to develop new controllers for robotics locomotion. Starting from this reflex-based model, we progressively iterate and transform the stimulation rules to add new features. In particular, gait modulation is obtained with the inclusion of a central pattern generator (CPG), a neural circuit capable of producing rhythmic patterns of neural activity without receiving rhythmic inputs. Using this CPG, the 2D walker controllers are incremented to generate gaits across a range of forward speeds close to the normal human one. By using a similar control method, we also obtain 2D running gaits whose speed can be controlled by a human operator. The walking controllers are later extended to 3D scenarios (i.e. no motion constraint) with the capability to adapt both the forward speed and the heading direction (including steering curvature). In parallel, we also develop a method to automatically learn stimulation networks for a given task and we study how flexible feet affect the gait in terms of robustness and energy efficiency. In sum, we develop neuromuscular controllers generating human-like gaits with steering capabilities. These controllers recruit three main components: (i) virtual muscles generating torque references at the joint level, (ii) neural signals commanding these muscles with reflexes and CPG signals, and (iii) higher level commands controlling speed and heading. Interestingly, these developments target humanoid robots locomotion but can also be used to better understand human locomotion. In particular, the recruitment of a CPG during human locomotion is still a matter open to debate. This question can thus benefit from the experiments performed in this thesis.

EPFL2017

Pattern Generation for Rough Terrain Locomotion with Quadrupedal Robots

Mostafa Ajallooeian

Animals are able to locomote on rough terrain without any apparent difficulty, but this does not mean that the locomotor system is simple. The locomotor system is actually a complex multi-input multi-output closed-loop control system. This thesis is dedicated to the design of controllers for rough terrain locomotion, for animal-like quadrupedal robots. We choose the problem of blind rough terrain locomotion as the target of experiments. Blind rough terrain locomotion requires continuous and momentary corrections of leg movements and body posture, and provides a proper testbed to observe the interaction of different mod- ules involved in locomotion control. As for the specific case of this thesis, we have to design rough terrain locomotion controllers that do not depend on the torque-control capability, have limited sensing, and have to be computationally light, all due to the properties of the robotics platform that we use. We propose that a robust locomotion controller, taking into account the aforementioned constraints, is constructed from at least three modules: 1) pattern generators providing the nominal patterns of locomotion; 2) A posture controller continuously adjusting the attitude of the body and keeping the robot upright; and 3) quick reflexes to react to unwanted momentary events like stumbling or an external force impulse. We introduce the framework of morphed oscillators to systematize the design of pattern gen- erators realized as coupled nonlinear oscillators. Morphed oscillators are nonlinear oscillators that can encode arbitrary limit cycle shapes and simultaneously have infinitely large basins of attraction. More importantly, they provide dynamical systems that can assume the role of feedforward locomotion controllers known as Central Pattern Generators (CPGs), and accept discontinuous sensory feedback without the risk of producing discontinuous output. On top of the CPG module, we add a kinematic model-based posture controller inspired by virtual model control (VMC), to control the body attitude. Virtual model control produces forces, and through the application of the Jacobian transpose method, generates torques which are added to the CPG torques. However, because our robots do not have a torque- control capability, we adapt the posture controller by producing task-space velocities instead of forces, thus generating joint-space velocity feedback signals. Since the CPG model used for locomotion generates joint velocities and accepts feedback without the fear of instability or discontinuity, the posture control feedback is easily integrated into the CPG dynamics. More- over, we introduce feedback signals for adjusting the posture by shifting the trunk positions, which directly update the limit cycle shape of the morphed oscillator nodes of the CPG. Reflexes are added, with minimal complexity, to react to momentary events. We implement simple impulse-based feedback mechanisms inspired by animals and successful rough terrain robots to 1) flex the leg if the robot is stumbling (stumbling correction reflex); 2) extend the leg if an expected contact is missing (leg extension reflex); or 3) initiate a lateral stepping sequence in response to a lateral external perturbation. CPG, posture controller, and reflexes are put together in a modular control architecture alongside additional modules that estimate inclination, control speed and direction, maintain timing of feedback signals, etc. [...]

EPFL2015

Control of Bio-Inspired Sprawling Posture Quadruped Robots with an Actuated Spine

Tomislav Horvat

Sprawling posture robots are characterized by upper limb segments protruding horizontally from the body, resulting in lower body height and wider support on the ground. Combined with an actuated segmented spine and tail, such morphology resembles that of salamanders or crocodiles. Although bio-inspired salamander-like robots with simple rotational limbs have been created, not much research has been done on kinematically redundant bio-mimetic robots that can closely replicate kinematics of sprawling animal gaits. Being bio-mimetic could allow a robot to have some of the locomotion skills observed in those animals, expanding its potential applications in challenging scenarios. At the same time, the robot could be used to answer questions about the animal's locomotion. This thesis is focused on developing locomotion controllers for such robots. Due to their high number of degrees of freedom (DoF), the control is based on solving the limb and spine inverse kinematics to properly coordinate different body parts. It is demonstrated how active use of a spine improves the robot's walking and turning performance. Further performance improvement across a variety of gaits is achieved by using model predictive control (MPC) methods to dictate the motion of the robot's center of mass (CoM). The locomotion controller is reused on an another robot (OroBOT) with similar morphology, designed to mimic the kinematics of a fossil belonging to Orobates, an extinct early tetrapod. Being capable of generating different gaits and quantitatively measuring their characteristics, OroBOT was used to find the most probable way the animal moved. This is useful because understanding locomotion of extinct vertebrates helps to conceptualize major transitions in their evolution. To tackle field applications, e.g. in disaster response missions, a new generation of field-oriented sprawling posture robots was built. The robustness of their initial crocodile-inspired design was tested in the animal's natural habitat (Uganda, Africa) and subsequently enhanced with additional sensors, cameras and computer. The improvements to the software framework involved a smartphone user interface visualizing the robot's state and camera feed to improve the ease of use for the operator. Using force sensors, the locomotion controller is expanded with a set of reflex control modules. It is demonstrated how these modules improve the robot's performance on rough and unstructured terrain. The robot's design and its low profile allow it to traverse low passages. To also tackle narrow passages like pipes, an unconventional crawling gait is explored. While using it, the robot lies on the ground and pushes against the pipe walls to move the body. To achieve such a task, several new control and estimation modules were developed. By exploring these problems, this thesis illustrates fruitful interactions that can take place between robotics, biology and paleontology.

EPFL2018