Natural user interface for lighting control: Case study on desktop lighting using modular robots

Roombots (RB) are self-reconfigurable modular robots designed to explore physical structure change by robotic reconfiguration and adaptive locomotion on structured grid environment or unstructured environment. The primary goal of RB is to create adaptive furniture. In this study, we propose a novel and user-friendly interface to control position and intensity of a mobile desk light using RB modules. In the proposed method, the user interacts with the RB with only hand/arm gestures. The user’s arm is tracked with a single Kinect having bird’s eye view. We demonstrate the effectiveness of the proposed interface in real hardware setup and discuss contributions of it.

Natural User Interface for Roombots

Stéphane Bonardi, Auke Ijspeert, Rico Möckel, Ayberk Özgür, Massimo Vespignani

Roombots (RB) are self-reconfigurable modular robots designed to study robotic reconfiguration on a structured grid and adaptive locomotion off grid. One of the main goals of this platform is to create adaptive furniture inside living spaces such as homes or offices. To ease the control of RB modules in these environments, we propose a novel and more natural way of interaction with the RB modules on a RB grid, called the Natural Roombots User Interface. In our method, the user commands the RB modules using pointing gestures. The user's body is tracked using multiple Kinects. The user is also given real-time visual feedback of their physical actions and the state of the system via LED illumination electronics installed on both RB modules and the grid. We demonstrate how our interface can be used to efficiently control RB modules on simple point-to-point grid locomotion and conclude by discussing future extensions.

IEEE2014

Compliance, locomotion and local computation in (self-) reconfigurable modular robots

Simon Lukas Hauser

Animals display an enormous versatility and a remarkable ability to adapt to changes in environment and terrain. Research in bio-inspired robotics strives to transfer these skills to robots, including legged systems. Even though animals seemingly effortlessly perform most of their activities on rough terrain, this feature seems to be particularly difficult to achieve in their robotic counterparts. We hypothesize that perturbations caused by e.g. rough terrain are not handled by the central nervous system, but rather by local modifications of the locomotion system such as legs and feet. Modifications can include changing mechanical properties such as spring and damping characteristics, as well as adjustments in the movement pattern of the locomotion. In this thesis, we isolate instances where a specific component, in our view, needs such modifications to fulfill different functionalities in a locomotion cycle. Further, we introduce the concept of mode-switches: a local computation is performed to induce these changes in functionalities by changing the dynamical response of the component. We then present one mode-switch method in hardware, jamming of granular media, that can switch the functionality of a foot between impact damping'' and propulsion force transmission'', and we show how this regularizes step sizes on rough terrain. We then present one mode-switch method in control, a force feedback strategy named tegotae''. This switches the functionality of leg movement between displacing the leg'' and

displacing the body'', and we show how this informs the controller about which legs are bearing less weight and thus are more suited to be moved. We suggest that these methods can be applied to any legged structure and use modular robots to demonstrate these concepts. In parallel, we also improved our previously developed self-reconfigurable modular robot platform

Roombots'' such that they perform a variety of tasks centered around adaptive and assistive furniture with up to 12 modules. This includes demonstrations of self-reconfiguration, mobile furniture, object manipulation, interaction capabilities and the development of a user interface. With these improvements, this platform can in the future also be used for further locomotion research where the shape-shifting ability could be of major importance.

EPFL2019

A Control and Optimization Framework for Robot Locomotion

Soha Pouya

Despite great efforts in designing legged robots, we are still far from the adaptivity, efficiency and robustness with which animals can move. Observations from successful biomimetic designs highlight the significant role of clever morphological design in achieving such performance. In addition, the important role of the controller in improving the locomotion performance is undoubtable. In fact, there is a complex link between morphology and motor control of locomoting systems. In animals’ locomotion, there is a large number of evidence showing the effective link between their morphology and functionality. Motivated by biological observations, similar questions can be posed from a robotics perspective: “what are the relative and complementary roles of robot control and morphology (similar to animal’s brain and body) in the generated locomotor behavior?”, and more pragmatically, “how can we take lessons from these observations to reduce the current gap between robots’ locomotion performance and what is observed in their biological counterparts?”. These are the fundamental questions that have motivated studies in this thesis. While empirical studies are essential to address aforementioned questions, they require simplifying contexts to yield insightful predictions and examinable theories. Both theoretical and physical models (i.e. simulations and robots) can significantly contribute in providing such insights. While robot experiments are essential to evaluate and explore the involved biological concept, they are usually time-consuming and costly. Hence, it would be advantageous if one could exploit the power of theoretical models for development of ideas and hypotheses before their implementation on the real robot. In this thesis, we aim at leveraging the strength of theoretical models to study the above-mentioned questions, namely, the relative role of control and morphology in improving the robot locomotion functionalities. To provide useful theoretical models, we take a step-wise approach, where we start from model-free methods and proceed with advancing the locomotion control by incorporating dynamics models at different levels of complexity. In particular, we develop a pool of robot models, starting from a simplified massless leg to a detailed dynamics model of the leg, to a 2D quadruped with spine joint and eventually to a 3D detailed dynamics model of a quadruped. Along with developing dynamics model of the robot, we devise a set of control and optimization techniques with the main goal of improving locomotion performance. There are several performance criteria to consider (such as energy efficiency, maneuverability, adaptivity to unknown terrains) and a key question is how to build the control architecture to hold a proper trade-off between these partially contradicting criteria. We take advantage of the developed dynamic models in both (i) improving the controller performance and (ii) implementing analytical tools to evaluate and compare different locomotion performance criteria. The central outcome of this thesis is a bio-inspired modeling, control, and optimization framework for legged robot locomotion, which is evaluated on a set of robots with different morphologies. In all cases, we explore how the locomotion performance can be improved by introducing new control techniques or be influenced by the morphological aspects (such as joint configuration and mass distribution). In particular, we show the effect of using more detailed dynamics model to improve the predictive performance of the simulations both for analyzing morphological factors and for robustness of the controller to internal (e.g. change in the inertial parameters) and external (e.g. walking on rough terrains) perturbations. The framework is generic and is used to model, control and analyze locomotion gaits for three compliant quadruped robots (Locomorph, Cheetah-Cub and Bobcat robots) and a modular robot (Roombots).

EPFL2013