Publication

Geometric and Learning Methods for Robots to Navigate in Human Crowds with Application to Smart Mobility Devices

David Julian Gonon
2023
EPFL thesis
Abstract

The thesis at hand is concerned with robots' navigation in human crowds. Specifically, methods are developed for planning a mobile robot's local motion between pedestrians, and they are evaluated in experiments where a robot interacts with real pedestrians as well as in simulations of a crowd and a robot. The thesis is divided in three main contributions.The first contribution describes a novel method for non-holonomic robots of convex shape to avoid imminent collisions with moving obstacles. The method assists navigation by correcting steering from the robot's path planner or driver. Its performance is evaluated using a custom simulator, which replicates real crowd movements from a campus dataset, and corresponding metrics which quantify agents' efficiency, the robot's impact on the crowd, and the number of collisions. Further, the method is implemented and evaluated on the standing wheelchair Qolo. In the experiments performed, it drives in autonomous mode using on-board sensing (LiDAR, RGB-D camera and a system to track pedestrians). It avoids collisions with up to five pedestrians and passes through a door.The second contribution studies the Acceleration Obstacle (AO) for enabling a robot's navigation in human crowds. The AO's geometric properties are analyzed and a direct sampling-free algorithm is proposed to approximate its boundary by linear constraints. The resulting controller is formulated as a quadratic program and evaluated in interaction with simulated bi-directional crowd flow in a corridor. A comparison to alternative robotic controllers is carried out, considering the robot's and the crowd's performance and the robot's behavior with respect to emergent lanes. Results indicate that the robot can achieve higher efficiency outside lanes. In the third contribution, the problem for a mobile robot to navigate seamlessly in a human crowd is treated by an inverse reinforcement learning (IRL) approach. A novel feature is proposed to model costs of anticipated collisions between agents. The feature approximates agents' pairwise interaction energy, a function which prior work has derived empirically from crowd data as an interaction potential driving pedestrians' mutual avoidance. Using a recent framework to perform IRL from locally optimal examples in continuous space, cost functions which incorporate the novel feature are learned efficiently from high-dimensional examples of real crowd motion. Examples are obtained from two public datasets containing pedestrians' and wheelchair users' trajectories.The learned models are evaluated and compared in how accurately their local optima model the training examples and test examples. Furthermore, predictions based on test examples' initial states only are generated similarly by optimization, and their distance to recorded ground truth is measured. Both models' predictions compare favorably to a recent related approach from the literature.Finally, a control system which computes and executes in real-time an optimal trajectory according to the learned cost functions is implemented on a robotic wheelchair, to steer it between pedestrians perceived by an on-board tracking system. The robot is deployed on campus, where the controller's performance is evaluated qualitatively. Results show that the approach often generates apt motion plans, which complement pedestrians' motion in an efficient manner, albeit oscillations between locally optimal solutions may occur.

About this result
This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.
Related concepts (34)
Human–robot interaction
Human–robot interaction (HRI) is the study of interactions between humans and robots. Human–robot interaction is a multidisciplinary field with contributions from human–computer interaction, artificial intelligence, robotics, natural language processing, design, and psychology. A subfield known as physical human–robot interaction (pHRI) has tended to focus on device design to enable people to safely interact with robotic systems. Human–robot interaction has been a topic of both science fiction and academic speculation even before any robots existed.
Robotics
Robotics is an interdisciplinary branch of electronics and communication, computer science and engineering. Robotics involves the design, construction, operation, and use of robots. The goal of robotics is to design machines that can help and assist humans. Robotics integrates fields of mechanical engineering, electrical engineering, information engineering, mechatronics engineering, electronics, biomedical engineering, computer engineering, control systems engineering, software engineering, mathematics, etc.
Mobile robot
A mobile robot is an automatic machine that is capable of locomotion. Mobile robotics is usually considered to be a subfield of robotics and information engineering. Mobile robots have the capability to move around in their environment and are not fixed to one physical location. Mobile robots can be "autonomous" (AMR - autonomous mobile robot) which means they are capable of navigating an uncontrolled environment without the need for physical or electro-mechanical guidance devices.
Show more
Related publications (78)

Exact Obstacle Avoidance for Robots in Complex and Dynamic Environments Using Local Modulation

Lukas Huber

Robots outside of the fenced factories have to deal with continuously changing environment, this requires fast and flexible modes of control. Planning methods or complex learning models can find optimal paths in complex surroundings, but they are computati ...
EPFL2024

Dynamic Voxels Based on Ego-Conditioned Prediction: An Integrated Spatio-Temporal Framework for Motion Planning

Alexandre Massoud Alahi, Ting Zhang

Prediction is a vital component of motion planning for autonomous vehicles (AVs). By reasoning about the possible behavior of other target agents, the ego vehicle (EV) can navigate safely, efficiently, and politely. However, most of the existing work overl ...
Ieee-Inst Electrical Electronics Engineers Inc2024

Inverse Reinforcement Learning of Pedestrian-Robot Coordination

Aude Billard, David Julian Gonon

We apply inverse reinforcement learning (IRL) with a novel cost feature to the problem of robot navigation in human crowds. Consistent with prior empirical work on pedestrian behavior, the feature anticipates collisions between agents. We efficiently learn ...
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2023
Show more
Related MOOCs (32)
Thymio: un robot pour se former à l'informatique
On propose dans ce MOOC de se former à et avec Thymio : apprendre à programmer le robot Thymio et ce faisant, s’initier à l'informatique et la robotique.
The Thymio robot as a tool for discovering digital science
This MOOC teaches basic understanding of robots’ mechanisms and Thymio’s programming languages, classroom use and pedagogical elements.
The Thymio robot as a tool for discovering digital science
This MOOC teaches basic understanding of robots’ mechanisms and Thymio’s programming languages, classroom use and pedagogical elements.
Show more

Graph Chatbot

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.