Interaction homme-robot

Les interactions humain-robot (Human-Robot Interactions en anglais, ) sont le sujet d'un champ de recherches ayant émergé du contact et de la rencontre entre l'humain et les systèmes robotiques. Il s'agit d'un champ de recherches interdisciplinaires à la frontière entre la robotique, l'ergonomie et la psychologie. Définition Formé par l’assemblage des deux mots « inter » et « action », le terme d’interaction, dans son étymologie même, suggère l’idée d’une action mutuelle, en réciprocité, de plusieurs éléments. Dans le champ des relations humaines, « interaction » intervient comme une contraction de l’expression « interaction sociale » définie comme une relation interpersonnelle, entre deux individus (ici humain/robot), dans laquelle des informations sont partagées. L'interaction humain-robot s'articule autour de plusieurs panneaux technologiques. En effet, afin de développer des robots ayant la capacité de collaborer mais également de « vivre » au contact des humains, l

Efficient Depth-based Deep Learning Methods for Multi-Party Pose Estimation

Angel Noe Martinez Gonzalez

Human detection and pose estimation are essential components for any artificial system responsive to the presence of humans and that react according to human-centered tasks. Robotic systems are typical examples, for which the body pose represents fine grained information useful to understand the behavior and activities of people, and interact with them. However, it is a challenging research topic with increasing difficulty given the unknown number of people in a usual scenario and factors like occlusions and sensing conditions. Current state-of-the-art methods have largely used deep Convolutional Neural Networks (CNN) to address the task. Traditionally, the selected CNNs are very deep and overparameterized, hence requiring large amounts of data to achieve good generalization and prevent overfitting. As a consequence, they are not straightforward to deploy in the low budget hardware typically available in practical applications such as HRI.This thesis studies methods for efficient and reliable 2D and 3D human pose estimation using deep learning approaches. It investigates novel lightweight convolutional network architectures that achieve real-time performance in multi-person scenarios and explores knowledge distillation methods to boost the performance of these models while keeping their efficiency. Moreover, this thesis addresses the high cost of data collection with annotations that arises with our deep learning-based approaches by relying on a large scale dataset of synthetic images with high variability. Domain adaptation methods and data augmentation strategies are proposed to exploit the synthetic corpus in order to achieve good generalization in sensor data. Additionally, this dissertation studies human 3D motion prediction framed as a sequence-to-sequence problem. Non-autoregressive transformer neural networks are proposed to predict elements in parallel to avoid error propagation from predicted elements, observed in autoregressive methods, while at the same time being efficient.Overall this thesis proposes different efficient and accurate deep learning solutions to design components of a human behaviour understanding system exploited in Human-Robot-Interaction (HRI) scenarios.

EPFL2021

Efficient Depth-based Deep Learning Methods for Multi-Party Pose Estimation

Angel Noe Martinez Gonzalez

EPFL2021

Efficient Depth-based Deep Learning Methods for Multi-Party Pose Estimation

Inferring Visual Attention and Addressee in Human Robot Interaction

Efficient Depth-based Deep Learning Methods for Multi-Party Pose Estimation

Inferring Visual Attention and Addressee in Human Robot Interaction