Publications related to Eye-tracking and artificial intelligence to enhance motivation and learning

Non-verbal Communication between Humans and Robots: Imitation, Mutual Understanding and Inferring Object Properties

Humans can express their actions and intentions, resorting to verbal and/or non-verbal communication. In verbal communication, humans use language to express, in structured linguistic terms, the desired action they wish to perform. Non-verbal communication ...

EPFL2023

Saliency prediction in 360° architectural scenes: Performance and impact of daylight variations

Marilyne Andersen, Sabine Süsstrunk, Caroline Karmann, Kynthia Chamilothori, Seungryong Kim, Bahar Aydemir

Saliency models are image-based prediction models that estimate human visual attention. Such models, when applied to architectural spaces, could pave the way for design decisions where visual attention is taken into account. In this study, we tested the pe ...

2023

Learning a QoE Metric from Social Media and Gaming Footage

Catalina Paz Alvarez Inostroza, Aikaterini Argyraki

Defining a universal metric for Quality of Experience (QoE) is notoriously hard due to the complex relationship between low-level performance metrics and user satisfaction. The most common metric, the Mean Opinion Score (MOS), has well-known biases and inc ...

2023

The Gaze Dialogue Model: Nonverbal Communication in HHI and HRI

Aude Billard, Nuno Ricardo Ferreira Duarte, José Santos-Victor

When humans interact with each other, eye gaze movements have to support motor control as well as communication. On the one hand, we need to fixate the task goal to retrieve visual information required for safe and precise action-execution. On the other ha ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

How Florist Apprentices Explore Bouquet Designs: Supporting Design Space Exploration for Vocational Students

Pierre Dillenbourg, Kevin Gonyop Kim, Catharine Regina Monika Maria Oertel Genannt Bierbach

Context: Exploring the design space is an important process in a design task. In this study, we considered design space exploration for the learners in vocational education and training (VET). The goal of the study was to investigate how they explore the d ...

2021

Modeling and Inferring Attention between Humans or for Human-Robot Interactions

Rémy Alain Siegfried

More and more intelligent systems have to interact with humans. In order to communicate efficiently, these systems need to perceive and understand us. A key factor of communication is the people's visual focus of attention (VFOA), which is useful to estima ...

EPFL2021

Exploring Spatial Perspective Taking in Human-Robot Interaction

Elmira Yadollahi

Humans often rely on their perspective taking skills to thrive within the world's complex relations and connections. An adequate understanding of others' spatial perspectives can increase the quality of the interaction, not only perceptually but also cogni ...

EPFL2021

Accurate Nod and 3D Gaze Estimation for Social Interaction Analysis

Yu Yu

Non-verbal behaviours play an important role in human communication since it can indicate human attention, serve as communication cue in interactions, or even reveal higher level personal constructs. For instance, head nod, a common non-verbal behaviour, c ...

EPFL2020

Towards everyday brain-computer interfacing through decoding visual cognition

Ruslan Aydarkhanov

Decoding visual cognition from non-invasive measurements of brain activity has shown valuable applications. Vision-based Brain-Computer Interfaces (BCI) systems extend from spellers to database search and spatial navigation. Despite the high performance of ...

EPFL2020

Stimuli-based Gaze Analytics to Enhance Motivation and Learning in MOOCs

Pierre Dillenbourg, Kshitij Sharma

The interaction with the various learners in a Massive Open Online Course (MOOC) is often complex. Contemporary MOOC learning analytics relate with click-streams, keystrokes and other user-input variables. Such variables however, do not always capture lear ...

IEEE2019