Publications by Marco Philipp Lehmann

Brain signals of a Surprise-Actor-Critic model: Evidence for multiple learning modules in human decision making

Wulfram Gerstner, Johanni Michael Brea, Alireza Modirshanechi, Kerstin Preuschoff, Marco Philipp Lehmann, Vasiliki Liakoni

Learning how to reach a reward over long series of actions is a remarkable capability of humans, and potentially guided by multiple parallel learning modules. Current brain imaging of learning modules is limited by (i) simple experimental paradigms, (ii) e ...

ACADEMIC PRESS INC ELSEVIER SCIENCE2022

Novelty is not surprise: Human exploratory and adaptive behavior in sequential decision-making

Michael Herzog, Wulfram Gerstner, Alireza Modirshanechi, Marco Philipp Lehmann, He Xu

Classic reinforcement learning (RL) theories cannot explain human behavior in the absence of external reward or when the environment changes. Here, we employ a deep sequential decision-making paradigm with sparse reward and abrupt environmental changes. To ...

2021

One-shot learning and behavioral eligibility traces in sequential decision making

Michael Herzog, Wulfram Gerstner, Marco Philipp Lehmann, Kerstin Preuschoff, He Xu, Vasiliki Liakoni

In many daily tasks, we make multiple decisions before reaching a goal. In order to learn such sequences of decisions, a mechanism to link earlier actions to later reward is necessary. Reinforcement learning (RL) theory suggests two classes of algorithms s ...

2019

One-shot learning and eligibility traces in sequential decision making

Marco Philipp Lehmann

When humans or animals perform an action that led to a desired outcome, they show a tendency to repeat it. The mechanisms underlying learning from past experience and adapting future behavior are still not fully understood. In this thesis, I study how huma ...

EPFL2018

Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of NeoHebbian Three-Factor Learning Rules

Wulfram Gerstner, Johanni Michael Brea, Marco Philipp Lehmann, Vasiliki Liakoni, Dane Sterling Corneil

2018

Exploring Bidirectional GPRS Capabilities in GNSS Positioning

Jan Skaloud, Hervé Gontran, Marco Philipp Lehmann

2005