Publications related to Better Generic Objects Counting When Asking Questions to Images: A Multitask approach for Remote Sensing Visual Question Answering

Multi-task prompt-RSVQA to explicitly count objects on aerial images

Devis Tuia, Sylvain Lobry, Christel Marie Tartini-Chappuis, Javiera Francisca Castillo Navarro, Nicola Antonio Santacroce

Introduced to enable a wider use of Earth Observation images using natural language, Remote Sensing Visual Question Answering (RSVQA) remains a challenging task, in particular for questions related to counting. To address this specific challenge, we propos ...

2023

Distributional Regression and Autoregression via Optimal Transport

Laya Ghodrati

We present a framework for performing regression when both covariate and response are probability distributions on a compact and convex subset of

\R^d

. Our regression model is based on the theory of optimal transport and links the conditional Fr'echet m ...

EPFL2023

Bayes-optimal Learning of Deep Random Networks of Extensive-width

Florent Gérard Krzakala, Lenka Zdeborová, Hugo Chao Cui

We consider the problem of learning a target function corresponding to a deep, extensive-width, non-linear neural network with random Gaussian weights. We consider the asymptotic limit where the number of samples, the input dimension and the network width ...

2023

Composite Relationship Fields with Transformers for Scene Graph Generation

Alexandre Massoud Alahi, David Mizrahi, George Adaimi

Scene graph generation (SGG) methods extract relationships between objects. While most methods focus on improving top-down approaches, which build a scene graph based on detected objects from an off-the-shelf object detector, there is a limited amount of w ...

2023

Prompt–RSVQA: Prompting visual context to a language model for Remote Sensing Visual Question Answering

Devis Tuia, Sylvain Lobry, Christel Marie Tartini-Chappuis, Valérie Zermatten

Remote sensing visual question answering (RQA) was recently proposed with the aim of interfacing natural language and vision to ease the access of information contained in Earth Observation data for a wide audience, which is granted by simple questions in ...

2022

RSVQA Meets Bigearthnet: A New, Large-Scale, Visual Question Answering Dataset for Remote Sensing

Devis Tuia, Sylvain Lobry

Visual Question Answering is a new task that can facilitate the extraction of information from images through textual queries: it aims at answering an open-ended question formulated in natural language about a given image. In this work, we introduce a new ...

IEEE2021

, ,

Modern methods for counting people in crowded scenes rely on deep networks to estimate people densities in individual images. As such, only very few take advantage of temporal consistency in video sequences, and those that do only impose weak smoothness co ...

2021

Physics-enhanced machine learning with symmetry-adapted and long-range representations

Andrea Grisafi

Theoretical and computational approaches to the study of materials and molecules have, over the last few decades, progressed at an exponential rate. Yet, the possibility of producing numerical predictions that are on par with experimental measurements is t ...

EPFL2021

Learning How to Walk: Warm-starting Optimal Control Solver with Memory of Motion

Sylvain Calinon, Teguh Santoso Lembono

In this paper, we propose a framework to build a memory of motion for warm-starting an optimal control solver for the locomotion task of a humanoid robot. We use HPP Loco3D, a versatile locomotion planner, to generate offline a set of dynamically consisten ...

2020

, ,

We tackle modelling and inference for variable selection in regression problems with many predictors and many responses. We focus on detecting hotspots, that is, predictors associated with several responses. Such a task is critical in statistical genetics, ...

INST MATHEMATICAL STATISTICS2020

Better Generic Objects Counting When Asking Questions to Images: A Multitask approach for Remote Sensing Visual Question Answering

Graph Chatbot

Chat with Graph Search

Multi-task prompt-RSVQA to explicitly count objects on aerial images

Distributional Regression and Autoregression via Optimal Transport

Bayes-optimal Learning of Deep Random Networks of Extensive-width

Composite Relationship Fields with Transformers for Scene Graph Generation

Prompt–RSVQA: Prompting visual context to a language model for Remote Sensing Visual Question Answering

RSVQA Meets Bigearthnet: A New, Large-Scale, Visual Question Answering Dataset for Remote Sensing

Physics-enhanced machine learning with symmetry-adapted and long-range representations

Learning How to Walk: Warm-starting Optimal Control Solver with Memory of Motion

Multi-task prompt-RSVQA to explicitly count objects on aerial images

Distributional Regression and Autoregression via Optimal Transport

Composite Relationship Fields with Transformers for Scene Graph Generation

Physics-enhanced machine learning with symmetry-adapted and long-range representations

Prompt–RSVQA: Prompting visual context to a language model for Remote Sensing Visual Question Answering

Bayes-optimal Learning of Deep Random Networks of Extensive-width

RSVQA Meets Bigearthnet: A New, Large-Scale, Visual Question Answering Dataset for Remote Sensing

Learning How to Walk: Warm-starting Optimal Control Solver with Memory of Motion