Publications related to Temporal difference learning

Unveiling the complexity of learning and decision-making

Reinforcement learning (RL) is crucial for learning to adapt to new environments. In RL, the prediction error is an important component that compares the expected and actual rewards. Dopamine plays a critical role in encoding these prediction errors. In my ...

EPFL2024

Computationally Efficient Reinforcement Learning: Targeted Exploration leveraging Simple Rules

Colin Neil Jones, Bratislav Svetozarevic, Loris Di Natale

Model-free Reinforcement Learning (RL) generally suffers from poor sample complexity, mostly due to the need to exhaustively explore the state-action space to find well-performing policies. On the other hand, we postulate that expert knowledge of the syste ...

2023

Beyond Spectral Gap: The Role of the Topology in Decentralized Learning

Martin Jaggi, Thijs Vogels, Hadrien Hendrikx

In data-parallel optimization of machine learning models, workers collaborate to improve their estimates of the model: more accurate gradients allow them to use larger learning rates and optimize faster. In the decentralized setting, in which workers commu ...

Brookline2023

Brain signals of a Surprise-Actor-Critic model: Evidence for multiple learning modules in human decision making

Wulfram Gerstner, Johanni Michael Brea, Alireza Modirshanechi, Kerstin Preuschoff, Marco Philipp Lehmann, Vasiliki Liakoni

Learning how to reach a reward over long series of actions is a remarkable capability of humans, and potentially guided by multiple parallel learning modules. Current brain imaging of learning modules is limited by (i) simple experimental paradigms, (ii) e ...

ACADEMIC PRESS INC ELSEVIER SCIENCE2022

Identifiability and Generalizability from Multiple Experts in Inverse Reinforcement Learning

Volkan Cevher, Paul Thierry Yves Rolland, Luca Viano, Boris Nikolov

While Reinforcement Learning (RL) aims to train an agent from a reward function in a given environment, Inverse Reinforcement Learning (IRL) seeks to recover the reward function from observing an expert’s behavior. It is well known that, in general, variou ...

2022

Temporal Pathways to Learning: How Learning Emerges in an Open-ended Collaborative Activity

Pierre Dillenbourg, Mortadha Abderrahim, Jauwairia Nasir, Aditi Kothiyal

The learning process depends on the nature of the learning environment, particularly in the case of open-ended learning environments, where the learning process is considered to be non-linear. In this paper, we report on the findings of employing a multimo ...

2022

Stochastic Second-Order Methods Improve Best-Known Sample Complexity of SGD for Gradient-Dominated Function

Patrick Thiran, Negar Kiyavash, Saber Salehkaleybar

We study the performance of Stochastic Cubic Regularized Newton (SCRN) on a class of functions satisfying gradient dominance property with

1\le\alpha\le2

which holds in a wide range of applications in machine learning and signal processing. This conditio ...

NeurIPS2022

Ageing and reinforcement learning

Michael Herzog, Wei-Hsiang Lin

Learning to achieve one’s goal in a complex environment is a complicated task. In reinforcement learning (RL) tasks, an agent interacts with the environment to learn optimal actions. In humans, striatal areas are strongly involved in these tasks. During ag ...

2021

CauseOccam: Learning Interpretable Abstract Representations in Reinforcement Learning Environments via Model Sparsity

Sergei Volodin

"I choose this restaurant because they have vegan sandwiches" could be a typical explanation we would expect from a human. However, current Reinforcement Learning (RL) techniques are not able to provide such explanations, when trained on raw pixels. RL alg ...

2021

Surprise-based model estimation in reinforcement learning: algorithms and brain signatures

Vasiliki Liakoni

Learning how to act and adapting to unexpected changes are remarkable capabilities of humans and other animals. In the absence of a direct recipe to follow in life, behaviour is often guided by rewarding and by surprising events. A positive or a negative o ...

EPFL2021

Temporal difference learning

Graph Chatbot

Chat with Graph Search

Unveiling the complexity of learning and decision-making

Computationally Efficient Reinforcement Learning: Targeted Exploration leveraging Simple Rules

Beyond Spectral Gap: The Role of the Topology in Decentralized Learning

Brain signals of a Surprise-Actor-Critic model: Evidence for multiple learning modules in human decision making

Identifiability and Generalizability from Multiple Experts in Inverse Reinforcement Learning

Temporal Pathways to Learning: How Learning Emerges in an Open-ended Collaborative Activity

Stochastic Second-Order Methods Improve Best-Known Sample Complexity of SGD for Gradient-Dominated Function

Ageing and reinforcement learning

CauseOccam: Learning Interpretable Abstract Representations in Reinforcement Learning Environments via Model Sparsity

Surprise-based model estimation in reinforcement learning: algorithms and brain signatures

Identifiability and Generalizability from Multiple Experts in Inverse Reinforcement Learning

Unveiling the complexity of learning and decision-making

Beyond Spectral Gap: The Role of the Topology in Decentralized Learning

Temporal Pathways to Learning: How Learning Emerges in an Open-ended Collaborative Activity

Computationally Efficient Reinforcement Learning: Targeted Exploration leveraging Simple Rules

Stochastic Second-Order Methods Improve Best-Known Sample Complexity of SGD for Gradient-Dominated Function

Ageing and reinforcement learning

Brain signals of a Surprise-Actor-Critic model: Evidence for multiple learning modules in human decision making

Surprise-based model estimation in reinforcement learning: algorithms and brain signatures

CauseOccam: Learning Interpretable Abstract Representations in Reinforcement Learning Environments via Model Sparsity