Publications related to Semantic parametric body shape estimation from noisy depth sequences

Test-time adaptation for 6D pose tracking

We propose a test -time adaptation for 6D object pose tracking that learns to adapt a pre -trained model to track the 6D pose of novel objects. We consider the problem of 6D object pose tracking as a 3D keypoint detection and matching task and present a mo ...

Elsevier Sci Ltd2024

From finger animation to full-body embodiment of avatars with different morphologies and proportions

Mathias Guy Delahaye

VR (Virtual Reality) is a real-time simulation that creates the subjective illusion of being in a virtual world. This thesis explores how integrating the user's body and fingers can be achieved and beneficial for the user to experience VR. At the advent of ...

EPFL2023

AN UNSUPERVISED METHOD FOR THE DETECTION OF AND TRACKING OF TARGETS IN SPOTLIGHT MODE SAR IMAGES

Lloyd Haydn Hughes

Taking advantage of Capella's ability to dwell on a target for an extended period of time (nominally 30s) in its spotlight (SP) mode, an unsupervised methodology for detecting moving targets in this data is presented in this paper. By colourizing short seg ...

IEEE2023

A Wearable Smart Glove and Its Application of Pose and Gesture Detection to Sign Language Classification

Josephine Anna Eleanor Hughes

Advances in soft sensors coupled with machine learning are enabling increasingly capable wearable systems. Since hand motion in particular can convey useful information for developing intuitive interfaces, glove-based systems can have a significant impact ...

Institute of Electrical and Electronics Engineers Inc.2022

Using Animal Motion Capture to Learn Neural Representations

Semih Günel

Understanding behavior from neural activity is a fundamental goal in neuroscience. It has practical applications in building robust brain-machine interfaces, human-computer interaction, and assisting patients with neurological disabilities. Despite the eve ...

EPFL2022

Temporal Representation Learning on Monocular Videos for 3D Human Pose Estimation

Pascal Fua, Mathieu Salzmann, Helge Jochen Rhodin, Victor Constantin, Sina Honari

In this paper we propose an unsupervised feature extraction method to capture temporal information on monocular videos, where we detect and encode subject of interest in each frame and leverage contrastive self-supervised (CSS) learning to extract rich lat ...

2022

Encoder-Decoder Models for Human Segmentation and Motion Analysis

Isinsu Katircioglu

Detecting people from 2D images and analyzing their motion in 3D have been long standing computer vision problems central to numerous applications such as autonomous driving and athletic training. Recently, with the availability of large amounts of trainin ...

EPFL2022

An analysis of the impacts of green mobility strategies and technologies on different European energy system

François Maréchal, Jonas Schnidrig, Tuong-Van Nguyen

A successful decarbonization of the European Union, coupled with a high integration of renewable energy and ambitious targets for energy efficiency, can only be reached with a significant contribution from transport. This sector currently represents a quar ...

2021

Preventing Breaks in Embodiment in Immersive Virtual Reality

Thibault Serge Mario Porssut

Virtual reality (VR) is immersive not only because of visual integration, but because we can act and perform in a virtual environment (VE). Beyond the mere fact that a VR system provides images computed directly from the users' viewpoint in stereoscopy, it ...

EPFL2021

Tracking and Relative Localization of Drone Swarms With a Vision-Based Headset

Dario Floreano, Maxim Pavliv, Fabrizio Schiano, Giuseppe Loianno

We address the detection, tracking, and relative localization of the agents of a drone swarm from a human perspective using a headset equipped with a single camera and an Inertial Measurement Unit (IMU). We train and deploy a deep neural network detector o ...

2021