Publications associées à Modality (human–computer interaction)

SVGC-AVA: 360-Degree Video Saliency Prediction With Spherical Vector-Based Graph Convolution and Audio-Visual Attention

Pascal Frossard, Chenglin Li, Li Wei, Qin Yang, Yuelei Li

Viewers of 360-degree videos are provided with both visual modality to characterize their surrounding views and audio modality to indicate the sound direction. Though both modalities are important for saliency prediction, little work has been done by joint ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Keep Sensors in Check: Disentangling Country-Level Generalization Issues in Mobile Sensor-Based Models with Diversity Scores

Daniel Gatica-Perez, Lakmal Buddika Meegahapola

Machine learning models trained with passive sensor data from mobile devices can be used to perform various inferences pertaining to activity recognition, context awareness, and health and well-being. Prior work has improved inference performance through t ...

Assoc Computing Machinery2023

The Metaverse as a Virtual Model of Platform Urbanism: Its Converging AIoT, XReality, Neurotech, and Nanobiotech and Their Applications, Challenges, and Risks

Simon Elias Bibri

With their exponentially rising computational power, digital platforms are heralding a new era of hybrid intelligence. There has recently been much enthusiasm and hype that the Metaverse has the potential to unlock hybrid intelligence. This is premised on ...

MDPI2023

Dynamic pulse scheduling in ASDEX Upgrade: Disruption avoidance and investigation of the H-Mode density limit

Federico Alberto Alfredo Felici, Alessandro Pau, Bernhard Sieglin

Operation of a tokamak device requires the coordinated operation of a multitude of systems. The sequence of operations during a discharge is both too complex and fast for human interaction. A common way of operation is a predefined sequence of operations w ...

2023

Focus on People: Five Qestions from Human-Centered Computing

Daniel Gatica-Perez

A substantial body of research in multimodal interaction has studied how people naturally interact -face-to-face and through machinesand developed technology to analyze, support, and extend such forms of interaction. The talk will share personal experience ...

Assoc Computing Machinery2022

Introducing Alternative Value Proposition Canvases for Collaborative and Blended Design Thinking Activities in Science and Engineering Education

Denis Gillet, Isabelle Barbara Marie-Hélène Cardia

The value proposition canvas introduced in 2015 by Pigneur et al. is broadly used by entrepreneurs and intrapreneurs to create new services and products. We decided to apply it for collaborative and blended design thinking activities in a specialization in ...

IEEE2022

Do Children Adapt Their Perspective to a Robot When They Fail to Complete a Task?

Pierre Dillenbourg, Elmira Yadollahi, Ana Paiva

Spatial understanding and communication are essential skills in human interaction. An adequate understanding of others' spatial perspectives can increase the quality of the interaction, both perceptually and cognitively. In this paper, we take the first st ...

Assoc Computing Machinery2022

Conversational Multi-Hop Reasoning with Neural Commonsense Knowledge and Symbolic Logic Rules

Antoine Bosselut, Forough Arabshahi

One of the challenges faced by conversational agents is their inability to identify unstated presumptions of their users' commands, a task trivial for humans due to their common sense. In this paper, we propose a zeroshot commonsense reasoning system for c ...

ASSOC COMPUTATIONAL LINGUISTICS-ACL2021

Electronic Skins for Healthcare Monitoring and Smart Prostheses

Stéphanie Lacour, Laurent Mirko Dejace, Haotian Chen

The human skin is a unique organ that embeds multiple functions that no artificial systems can currently replicate. Advances in materials science and engineering are driving the design of electronic skins-large-area sensor arrays that mimic some sensory mo ...

ANNUAL REVIEWS2021

Exploring Spatial Perspective Taking in Human-Robot Interaction

Elmira Yadollahi

Humans often rely on their perspective taking skills to thrive within the world's complex relations and connections. An adequate understanding of others' spatial perspectives can increase the quality of the interaction, not only perceptually but also cogni ...

EPFL2021