Publications by Lorenzo Bertoni

Reshaping Perception for Autonomous Driving with Semantic Keypoints

The field of artificial intelligence is set to fuel the future of mobility by driving forward the transition from advanced driver-assist systems to fully autonomous vehicles (AV). Yet the current technology, backed by cutting-edge deep learning techniques, ...

EPFL2022

Simple Yet Effective Action Recognition for Autonomous Driving

Alexandre Massoud Alahi, Taylor Ferdinand Mordan, Lorenzo Bertoni

Self-driving cars and delivery robots are set to shape the future of transportation, but they still have to learn how to co-exist with humans in close proximity. Autonomous systems need to detect pedestrians and understand the meaning of their actions befo ...

2022

OpenPifPaf: Composite Fields for Semantic Keypoint Detection and Spatio-Temporal Association

Alexandre Massoud Alahi, Sven Kreiss, Lorenzo Bertoni

Many image-based perception tasks can be formulated as detecting, associating and tracking semantic keypoints, e.g., human body pose estimation and tracking. In this work, we present a general framework that jointly detects and forms spatio-temporal keypoi ...

IEEE Institute of Electrical and Electronics Engineers2022

Perceiving Humans: from Monocular 3D Localization to Social Distancing

Alexandre Massoud Alahi, Sven Kreiss, Lorenzo Bertoni

Perceiving humans in the context of Intelligent Transportation Systems (ITS) often relies on multiple cameras or expensive LiDAR sensors. In this work, we present a new cost-effective vision-based method that perceives humans' locations in 3D and their bod ...

IEEE Institute of Electrical and Electronics Engineers2022

MonStereo: When Monocular and Stereo Meet at the Tail of 3D Human Localization

Alexandre Massoud Alahi, Sven Kreiss, Taylor Ferdinand Mordan, Lorenzo Bertoni

Monocular and stereo visions are cost-effective solutions for 3D human localization in the context of self-driving cars or social robots. However, they are usually developed independently and have their respective strengths and limitations. We propose a no ...

IEEE2021

Joint Human Pose Estimation and Stereo 3D Localization

Alexandre Massoud Alahi, Sven Kreiss, Lorenzo Bertoni, Wenlong Deng

We present an end-to-end trainable Neural Network architecture for stereo imaging that jointly locates and estimates human body poses in 3D. Our method defines a 2D pose for each human in a stereo pair of images and uses a correlation layer with a composit ...

IEEE2020

MonoLoco: Monocular 3D Pedestrian Localization and Uncertainty Estimation

Alexandre Massoud Alahi, Sven Kreiss, Lorenzo Bertoni

We tackle the fundamentally ill-posed problem of 3D human localization from monocular RGB images. Driven by the limitation of neural networks outputting point estimates, we address the ambiguity in the task by predicting confidence intervals through a loss ...

2019

PifPaf: Composite Fields for Human Pose Estimation

Alexandre Massoud Alahi, Sven Kreiss, Lorenzo Bertoni

We propose a new bottom-up method for multi-person 2D human pose estimation that is particularly well suited for urban mobility such as self-driving cars and delivery robots. The new method, PifPaf, uses a Part Intensity Field (PIF) to localize body parts ...

IEEE2019