Publications associées à Dynamic Visual Attention on the Sphere

SVGC-AVA: 360-Degree Video Saliency Prediction With Spherical Vector-Based Graph Convolution and Audio-Visual Attention

Pascal Frossard, Chenglin Li, Li Wei, Qin Yang, Yuelei Li

Viewers of 360-degree videos are provided with both visual modality to characterize their surrounding views and audio modality to indicate the sound direction. Though both modalities are important for saliency prediction, little work has been done by joint ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Saliency prediction in 360° architectural scenes: Performance and impact of daylight variations

Marilyne Andersen, Sabine Süsstrunk, Caroline Karmann, Kynthia Chamilothori, Seungryong Kim, Bahar Aydemir

Saliency models are image-based prediction models that estimate human visual attention. Such models, when applied to architectural spaces, could pave the way for design decisions where visual attention is taken into account. In this study, we tested the pe ...

2023

Towards Visual Saliency Explanations of Face Verification

Touradj Ebrahimi, Yuhang Lu, Zewei Xu

In the past years, deep convolutional neural networks have been pushing the frontier of face recognition (FR) techniques in both verification and identification scenarios. Despite the high accuracy, they are often criticized for lacking explainability. The ...

2024

The effects of visual distractors on serial dependence

David Pascucci

Attractive serial dependence occurs when perceptual decisions are attracted toward previous stimuli. This effect is mediated by spatial attention and is most likely to occur when similar stimuli are attended at nearby locations. Attention, however, also in ...

Assoc Research Vision Ophthalmology Inc2023

Generative power of a protein language model trained on multiple sequence alignments

Anne-Florence Raphaëlle Bitbol, Umberto Lupo, Damiano Sgarbossa

Computational models starting from large ensembles of evolutionarily related protein sequences capture a representation of protein families and learn constraints associated to protein structure and function. They thus open the possibility for generating no ...

eLIFE SCIENCES PUBL LTD2023

On the Maximum Power Density of Implanted Antennas within Simplified Body Phantoms

Anja Skrivervik, Mingxiang Gao, Zvonimir Sipus

With the application requirements of wireless technology in implantable bioelectronics, knowledge of the fundamental limits for implanted antennas becomes critical. In this work, we investigated the variation of maximum power density within simplified body ...

IEEE2022

Modeling Object Dissimilarity for Deep Saliency Prediction

Sabine Süsstrunk, Mathieu Salzmann, Tong Zhang, Seungryong Kim, Deblina Bhattacharjee, Bahar Aydemir

Saliency prediction has made great strides over the past two decades, with current techniques modeling low-level information, such as color, intensity and size contrasts, and high-level ones, such as attention and gaze direction for entire objects. Despite ...

2022

Clustering and Informative Path Planning for 3D Gas Distribution Mapping: Algorithms and Performance Evaluation

Alcherio Martinoli, Chiara Ercolani, Lixuan Tang, Ankita Arun Humne

Chemical gas dispersion can represent a severe threat to human and animal lives, as well as to the environment. Constructing a map of the distribution of gas in a fast and reliable manner is critical to ensure accurate monitoring of at-risk facilities and ...

2022

Mapping Active Site Geometry to Activity in Immobilized Frustrated Lewis Pair Catalysts

Rubén Laplaza Solanas, Anne-Clémence Corminboeuf, Shubhajit Das, Jacob Terence Blaskovits

The immobilization of molecular catalysts imposes spatial constraints on their active site. We reveal that in bifunctional catalysis such constraints can also be utilized as an appealing handle to boost intrinsic activity through judicious control of the a ...

Wiley-VCH Verlag GmbH2022

Unsupervised Visual Entity Abstraction towards 2D and 3D Compositional Models

Beril Besbinar

Object-centric learning has gained significant attention over the last years as it can serve as a powerful tool to analyze complex scenes as a composition of simpler entities. Well-established tasks in computer vision, such as object detection or instance ...

EPFL2022