Publications related to Real-Time Generative Hand Modeling and Tracking

Customizing the human-avatar mapping based on EEG error related potentials during avatar-based interaction

Olaf Blanke, José del Rocio Millán Ruiz, Ronan Boulic, Bruno Herbelin, Ricardo Andres Chavarriaga Lozano, Fumiaki Iwane, Thibault Serge Mario Porssut

Objective. A key challenge of virtual reality (VR) applications is to maintain a reliable human-avatar mapping. Users may lose the sense of controlling (sense of agency), owning (sense of body ownership), or being located (sense of self-location) inside th ...

2024

Test-time adaptation for 6D pose tracking

Andrea Cavallaro

We propose a test -time adaptation for 6D object pose tracking that learns to adapt a pre -trained model to track the 6D pose of novel objects. We consider the problem of 6D object pose tracking as a 3D keypoint detection and matching task and present a mo ...

Elsevier Sci Ltd2024

Aggregating Spatial and Photometric Context for Photometric Stereo

David Honzátko

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

EPFL2024

Immersive VR for upper-extremity rehabilitation in patients with neurological disorders: a scoping review

Silvestro Micera, Elena Losanno

Background Neurological disorders, such as stroke and chronic pain syndromes, profoundly impact independence and quality of life, especially when affecting upper extremity (UE) function. While conventional physical therapy has shown effectiveness in provid ...

BioMed Central2024

Generalization and Personalization of Machine Learning for Multimodal Mobile Sensing in Everyday Life

Lakmal Buddika Meegahapola

A range of behavioral and contextual factors, including eating and drinking behavior, mood, social context, and other daily activities, can significantly impact an individual's quality of life and overall well-being. Therefore, inferring everyday life aspe ...

EPFL2024

An immersive virtual reality tool for assessing left and right unilateral spatial neglect

Olaf Blanke, Andrea Serino, Roberta Ronchi

The reported rate of the occurrence of unilateral spatial neglect (USN) is highly variable likely due to the lack of validity and low sensitivity of classical tools used to assess it. Virtual reality (VR) assessments try to overcome these limitations by pr ...

Wiley2024

Modulation of Visually Induced Self-motion Illusions by α Transcranial Electric Stimulation over the Superior Parietal Cortex

Sylvain Jean-François Harquel

The growing popularity of virtual reality systems has led to a renewed interest in understanding the neurophysiological correlates of the illusion of self-motion (vection), a phenomenon that can be both intentionally induced or avoided in such systems, dep ...

Mit Press2024

Advancing Self-Supervised Deep Learning for 3D Scene Understanding

Seyed Mohammad Mahdi Johari

Recent advancements in deep learning have revolutionized 3D computer vision, enabling the extraction of intricate 3D information from 2D images and video sequences. This thesis explores the application of deep learning in three crucial challenges of 3D com ...

EPFL2024

TTool: A Supervised Artificial Intelligence-Assisted Visual Pose Detector for Tool Heads in Augmented Reality Woodworking

Yves Weinand, Andrea Settimi, Julien Gamerro, Florian Aymanns, Naravich Chutisilp

We present TimberTool (TTool v2.1.1), a software designed for woodworking tasks assisted by augmented reality (AR), emphasizing its essential function of the real-time localization of a tool head’s poses within camera frames. The localization process, a fu ...

2024

Investigating neural resource allocation in the sensorimotor control of extra limbs

Giulia Dominijanni

The rise of robotic body augmentation brings forth new developments that will transform robotics, human-machine interaction, and wearable electronics. Extra robotic limbs, although building upon restorative technologies, bring their own set of challenges i ...

EPFL2024