Publications associées à Oculométrie

SVGC-AVA: 360-Degree Video Saliency Prediction With Spherical Vector-Based Graph Convolution and Audio-Visual Attention

Pascal Frossard, Chenglin Li, Li Wei, Qin Yang, Yuelei Li

Viewers of 360-degree videos are provided with both visual modality to characterize their surrounding views and audio modality to indicate the sound direction. Though both modalities are important for saliency prediction, little work has been done by joint ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Effects of Head-Tracking Artefacts on Externalization and Localization in Azimuth With Binaural Wearable Devices

Hervé Lissek, Gilles André Courtois, Vincent Pierre Olivier Grimaldi

Head tracking combined with head movements have been shown to improve auditory externalization of a virtual sound source and contribute to the performance in localization. With certain technically constrained head-tracking algorithms, as can be found in we ...

Audio Engineering Soc2023

Discomfort glare from daylight: Influence of transmitted color and the eye's macular pigment

Sneha Jain

Designing architectural façades that allow sufficient daylight to create visually comfortable and pleasant environments is a challenging aspect of building design. It requires accounting for visual comfort and discomfort glare risks and understanding the f ...

EPFL2023

Saliency prediction in 360° architectural scenes: Performance and impact of daylight variations

Marilyne Andersen, Sabine Süsstrunk, Caroline Karmann, Kynthia Chamilothori, Seungryong Kim, Bahar Aydemir

Saliency models are image-based prediction models that estimate human visual attention. Such models, when applied to architectural spaces, could pave the way for design decisions where visual attention is taken into account. In this study, we tested the pe ...

2023

A multimodal measurement of the impact of deepfakes on the ethical reasoning and affective reactions of students

Touradj Ebrahimi, Patrick Jermann, Roland John Tormey, Cécile Hardebolle, Nihat Kotluk, Vivek Ramachandran

Deepfakes - synthetic videos generated by machine learning models - are becoming increasingly sophisticated. While they have several positive use cases, their potential for harm is also high. Deepfake production involves input from multiple engineers, maki ...

2023

Non-verbal Communication between Humans and Robots: Imitation, Mutual Understanding and Inferring Object Properties

Nuno Ricardo Ferreira Duarte

Humans can express their actions and intentions, resorting to verbal and/or non-verbal communication. In verbal communication, humans use language to express, in structured linguistic terms, the desired action they wish to perform. Non-verbal communication ...

EPFL2023

Assessing Experiences and Visual Perception in Train Station Environments with a Mobile Application and Eye Tracking

Andrea Regula Schneider

The Customer Experience Management at the Swiss Federal Railways (SBB) experiments with new technologies and methods to capture experiences and perceptions of passengers to design safe and customer friendly environments. First, a new methodological approac ...

2022

The Gaze Dialogue Model: Nonverbal Communication in HHI and HRI

Aude Billard, Nuno Ricardo Ferreira Duarte, José Santos-Victor

When humans interact with each other, eye gaze movements have to support motor control as well as communication. On the one hand, we need to fixate the task goal to retrieve visual information required for safe and precise action-execution. On the other ha ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

Multi-animal pose estimation, identification and tracking with DeepLabCut

Alexander Mathis, Mackenzie Mathis, Steffen Schneider, Shaokai Ye, Tanmay Nath, Jessy Lauer

Estimating the pose of multiple animals is a challenging computer vision problem: frequent interactions cause occlusions and complicate the association of detected keypoints to the correct individuals, as well as having highly similar looking animals that ...

NATURE PORTFOLIO2022

Robust Unsupervised Gaze Calibration Using Conversation and Manipulation Attention Priors

Jean-Marc Odobez, Rémy Alain Siegfried

Gaze estimation is a difficult task, even for humans. However, as humans, we are good at understanding a situation and exploiting it to guess the expected visual focus of attention of people, and we usually use this information to retrieve people's gaze. I ...

ASSOC COMPUTING MACHINERY2022