Publication

From High-Level to Low-Level Robot Learning of Complex Tasks: Leveraging Priors, Metrics and Dynamical Systems

Abstract

Humans have a remarkable way of learning, adapting and mastering new manipulation tasks. With the current advances in Machine Learning (ML), the promise of having robots with such capabilities seems to be on the cusp of reality. Transferring human-level skills to robots, however, is complicated as they involve a level of complexity that cannot be tackled by classical ML methods in an unsupervised way. Such complexities involve: (i) automatically decomposing tasks into control-oriented encodings, (ii) extracting invariances and handling idiosyncrasies of data acquired from human demonstrations, and (iii) learning models that guarantee stability and convergence. In this thesis, we push the boundaries in the learning from demonstration (LfD) domain by addressing these challenges with minimal human intervention and parameter tuning. We introduce novel learning approaches based on Bayesian non-parametrics and kernel-methods while encoding novel metrics and priors, leveraging them with dynamical systems (DS) theory.

In the first part of this thesis we focus on learning complex sequential manipulation tasks from heterogeneous and unstructured demonstrations. Such tasks are those composed of a sequence of discrete actions. The particular challenge is learning these tasks without any prior knowledge on the number of actions (unstructuredness) or restrictions as to how the human is demonstrating the task (heterogeneous), e.g. changes in reference frames. We propose a Bayesian non-parametric learning framework that can jointly segment and discover unique discrete actions (and their sequence) in continuous demonstrations of the task. Hence, we learn an entire task from a continuous, unrestricted natural demonstration. The learned structure of the complex tasks and the segmented data were then used to parametrize a hybrid controller to execute two cooking tasks of increasing complexity: (i) single-arm pizza dough rolling, and (ii) a dual-arm vegetable peeling task.

Throughout this thesis, we assume that both the human and robot motions are driven by autonomous state-dependent DS. Hence, in the second part of this thesis we offer two novel DS formulations to represent and execute a complex task. We begin by proposing a DS-based motion generator formulation and learning scheme that is capable of automatically encoding continuous and complex motions while ensuring global asymptotic stability. The type of tasks that can be learned with this approach are unparalleled to previous work in DS-based LfD and are validated on production line and household activities. Further, we propose a novel DS formulation and learning scheme that can encode both complex motions and varying impedance requirements along the task; i.e., the robot must be compliant in some regions of the task, while stiff in others. This approach is validated on trajectory tracking tasks where a robot arm must precisely draw letters on a surface. Due to the generalization power and straight-forward learning schemes of the proposed DS-based motion generators, we also apply them to more complex application. Such applications include providing adaptive (i) navigation strategies for mobile agents, and (ii) locomotion and co-manipulation tasks of biped robots. These applications are particularly novel in the LfD domain, as most work is solely focused on robotic arm control.

In the last part of the thesis, we explore learning complex behaviors in joint space for single and multi-arm systems.

About this result
This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.
Related concepts (37)
Robot
A robot is a machine—especially one programmable by a computer—capable of carrying out a complex series of actions automatically. A robot can be guided by an external control device, or the control may be embedded within. Robots may be constructed to evoke human form, but most robots are task-performing machines, designed with an emphasis on stark functionality, rather than expressive aesthetics.
Robotics
Robotics is an interdisciplinary branch of electronics and communication, computer science and engineering. Robotics involves the design, construction, operation, and use of robots. The goal of robotics is to design machines that can help and assist humans. Robotics integrates fields of mechanical engineering, electrical engineering, information engineering, mechatronics engineering, electronics, biomedical engineering, computer engineering, control systems engineering, software engineering, mathematics, etc.
Autonomous robot
An autonomous robot is a robot that acts without recourse to human control. The first autonomous robots environment were known as Elmer and Elsie, which were constructed in the late 1940s by W. Grey Walter. They were the first robots in history that were programmed to "think" the way biological brains do and meant to have free will. Elmer and Elsie were often labeled as tortoises because of how they were shaped and the manner in which they moved. They were capable of phototaxis which is the movement that occurs in response to light stimulus.
Show more
Related publications (404)

Online Multicontact Receding Horizon Planning via Value Function Approximation

Sylvain Calinon, Teguh Santoso Lembono, Ke Wang, Jiayi Wang

Planning multicontact motions in a receding horizon fashion requires a value function to guide the planning with respect to the future, e.g., building momentum to traverse large obstacles. Traditionally, the value function is approximated by computing traj ...
Ieee-Inst Electrical Electronics Engineers Inc2024

Exact Obstacle Avoidance for Robots in Complex and Dynamic Environments Using Local Modulation

Lukas Huber

Robots outside of the fenced factories have to deal with continuously changing environment, this requires fast and flexible modes of control. Planning methods or complex learning models can find optimal paths in complex surroundings, but they are computati ...
EPFL2024

Hitting with Different Joints of a Robotic Manipulator

Aude Billard, Harshit Khurana

This paper builds up the skill of impact aware non prehensile manipulation through a hitting motion by allowing the robot arm to come in contact with the environment with parts other than its end effector. Hitting with other joints allows us to manipulate ...
2024
Show more
Related MOOCs (32)
Thymio: un robot pour se former à l'informatique
On propose dans ce MOOC de se former à et avec Thymio : apprendre à programmer le robot Thymio et ce faisant, s’initier à l'informatique et la robotique.
The Thymio robot as a tool for discovering digital science
This MOOC teaches basic understanding of robots’ mechanisms and Thymio’s programming languages, classroom use and pedagogical elements.
The Thymio robot as a tool for discovering digital science
This MOOC teaches basic understanding of robots’ mechanisms and Thymio’s programming languages, classroom use and pedagogical elements.
Show more

Graph Chatbot

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.