Publication

An ensemble inverse optimal control approach for robotic task learning and adaptation

Aude Billard, Hang Yin, Ana Paiva
2018
Journal paper
Abstract

This paper contributes a novel framework to efficiently learn cost-to-go function representations for robotic tasks with latent modes. The proposed approach relies on the principle behind ensemble methods, where improved performance is obtained by aggregating a group of simple models, each of which can be efficiently learnedq. The maximum-entropy approximation is adopted as an effective initialization and the quality of this surrogate is guaranteed by a theoretical bound. Our approach also provides an alternative perspective to view the popular mixture of Gaussians under the framework of inverse optimal control. We further propose to enforce a dynamics on the model ensemble, using Kalman estimation to infer and modulate model modes. This allows robots to exploit the demonstration redundancy and to adapt to human interventions, especially in tasks where sensory observations are non-Markovian. The framework is demonstrated with a synthetic inverted pendulum example and online adaptation tasks, which include robotic handwriting and mail delivery.

About this result
This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.
Related concepts (29)
Robotics
Robotics is an interdisciplinary branch of electronics and communication, computer science and engineering. Robotics involves the design, construction, operation, and use of robots. The goal of robotics is to design machines that can help and assist humans. Robotics integrates fields of mechanical engineering, electrical engineering, information engineering, mechatronics engineering, electronics, biomedical engineering, computer engineering, control systems engineering, software engineering, mathematics, etc.
Robotic arm
A robotic arm is a type of mechanical arm, usually programmable, with similar functions to a human arm; the arm may be the sum total of the mechanism or may be part of a more complex robot. The links of such a manipulator are connected by joints allowing either rotational motion (such as in an articulated robot) or translational (linear) displacement. The links of the manipulator can be considered to form a kinematic chain. The terminus of the kinematic chain of the manipulator is called the end effector and it is analogous to the human hand.
Autonomous robot
An autonomous robot is a robot that acts without recourse to human control. The first autonomous robots environment were known as Elmer and Elsie, which were constructed in the late 1940s by W. Grey Walter. They were the first robots in history that were programmed to "think" the way biological brains do and meant to have free will. Elmer and Elsie were often labeled as tortoises because of how they were shaped and the manner in which they moved. They were capable of phototaxis which is the movement that occurs in response to light stimulus.
Show more
Related publications (33)

Liquid Metal-Based Sensor Skin Enabling Haptic Perception of Softness

Stéphanie Lacour, Ivan Furfaro, Emilio Fernández Lavado, Haotian Chen

Haptic perception of softness is a unique feature of the human skin that relies on the concurrent measurements of the lateral deformation and compression of the skin during object manipulation. This is challenging to implement in robotics because of combin ...
2023

Learning and optimization of anticipatory feedback controllers for robot manipulation

Hakan Girgin

Programming intelligent robots requires robust controllers that can achieve desired tasks while adapting to the changes in the task and the environment. In this thesis, we address the challenges in designing such adaptive and anticipatory feedback controll ...
EPFL2023

Comprehensive Interactive Soft Interfaces for Wearable Tactile Feedback

Harshal Arun Sonar

As the field of robotics continues to grow outside the manufacturing environment into our daily lives, the interactions between humans and robots are increasingly becoming close and dynamic. This type of environment requires robots to be less rigid, multi- ...
EPFL2021
Show more
Related MOOCs (13)
Thymio: un robot pour se former à l'informatique
On propose dans ce MOOC de se former à et avec Thymio : apprendre à programmer le robot Thymio et ce faisant, s’initier à l'informatique et la robotique.
The Thymio robot as a tool for discovering digital science
This MOOC teaches basic understanding of robots’ mechanisms and Thymio’s programming languages, classroom use and pedagogical elements.
The Thymio robot as a tool for discovering digital science
This MOOC teaches basic understanding of robots’ mechanisms and Thymio’s programming languages, classroom use and pedagogical elements.
Show more

Graph Chatbot

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.