Publications related to Reinforcement Learning Using a Continuous Time Actor-Critic Framework with Spiking Neurons

Unveiling the complexity of learning and decision-making

Reinforcement learning (RL) is crucial for learning to adapt to new environments. In RL, the prediction error is an important component that compares the expected and actual rewards. Dopamine plays a critical role in encoding these prediction errors. In my ...

EPFL2024

Non-invasive stimulation of the human striatum disrupts reinforcement learning of motor skills

Friedhelm Christoph Hummel, Takuya Morishita, Pierre Theopistos Vassiliadis, Elena Beanato, Esra Neufeld, Fabienne Windel, Maximilian Jonas Wessel, Traian Popa, Julie Duqué

Reinforcement feedback can improve motor learning, but the underlying brain mechanisms remain underexplored. In particular, the causal contribution of specific patterns of oscillatory activity within the human striatum is unknown. To address this question, ...

Nature Portfolio2024

Subcortical correlates of consciousness with human single neuron recordings

Olaf Blanke, Fosco Bernasconi, Nathan Quentin Faivre, Michael Eric Anthony Pereira

Subcortical brain structures such as the basal ganglia or the thalamus are involved in regulating motor and cognitive behavior. However, their contribution to perceptual consciousness is still unclear, due to the inherent difficulties of recording subcorti ...

2024

Fast adaptation to rule switching using neuronal surprise

Wulfram Gerstner

In humans and animals, surprise is a physiological reaction to an unexpected event, but how surprise can be linked to plausible models of neuronal activity is an open problem. We propose a self-supervised spiking neural network model where a surprise signa ...

2024

Seeking the new, learning from the unexpected: Computational models of surprise and novelty in the brain

Alireza Modirshanechi

Human babies have a natural desire to interact with new toys and objects, through which they learn how the world around them works, e.g., that glass shatters when dropped, but a rubber ball does not. When their predictions are proven incorrect, such as whe ...

EPFL2024

Fear learning induces synaptic potentiation between engram neurons in the rat lateral amygdala

Henry Markram, Rodrigo de Campos Perin

The lateral amygdala (LA) encodes fear memories by potentiating sensory inputs associated with threats and, in the process, recruits 10-30% of its neurons per fear memory engram. However, how the local network within the LA processes this information and w ...

Nature Portfolio2024

Predicting the long-term collective behaviour of fish pairs with deep learning

Francesco Mondada, Alexandre Massoud Alahi, Vaios Papaspyros

Modern computing has enhanced our understanding of how social interactions shape collective behaviour in animal societies. Although analytical models dominate in studying collective behaviour, this study introduces a deep learning model to assess social in ...

2024

Incorporating Projective Geometry into Deep Learning

Michal Jan Tyszkiewicz

In this thesis we explore the applications of projective geometry, a mathematical theory of the relation between 3D scenes and their 2D images, in modern learning-based computer vision systems. This is an interesting research question which contradicts the ...

EPFL2024

Deep Learning Theory Through the Lens of Diagonal Linear Networks

Scott William Pesme

In this PhD manuscript, we explore optimisation phenomena which occur in complex neural networks through the lens of

2

-layer diagonal linear networks. This rudimentary architecture, which consists of a two layer feedforward linear network with a diagonal ...

EPFL2024

Impact of Mitofusin 2 in the Nucleus Accumbens on motivated behavior and underlying neurobiological mechanisms

Alessandro Chioino

The nucleus accumbens (NAc) is part of the ventral striatum and plays a major role in motivation and goal-directed behaviour. Increasing evidence implicates impairments in accumbal function in anxiety and depression, two conditions that are commonly accomp ...

EPFL2024

Reinforcement Learning Using a Continuous Time Actor-Critic Framework with Spiking Neurons

Graph Chatbot

Chat with Graph Search

Unveiling the complexity of learning and decision-making

Non-invasive stimulation of the human striatum disrupts reinforcement learning of motor skills

Subcortical correlates of consciousness with human single neuron recordings

Fast adaptation to rule switching using neuronal surprise

Seeking the new, learning from the unexpected: Computational models of surprise and novelty in the brain

Fear learning induces synaptic potentiation between engram neurons in the rat lateral amygdala

Predicting the long-term collective behaviour of fish pairs with deep learning

Incorporating Projective Geometry into Deep Learning

Deep Learning Theory Through the Lens of Diagonal Linear Networks

Impact of Mitofusin 2 in the Nucleus Accumbens on motivated behavior and underlying neurobiological mechanisms

Unveiling the complexity of learning and decision-making

Fast adaptation to rule switching using neuronal surprise

Non-invasive stimulation of the human striatum disrupts reinforcement learning of motor skills

Fear learning induces synaptic potentiation between engram neurons in the rat lateral amygdala

Subcortical correlates of consciousness with human single neuron recordings

Deep Learning Theory Through the Lens of Diagonal Linear Networks

Seeking the new, learning from the unexpected: Computational models of surprise and novelty in the brain

Impact of Mitofusin 2 in the Nucleus Accumbens on motivated behavior and underlying neurobiological mechanisms

Predicting the long-term collective behaviour of fish pairs with deep learning

Incorporating Projective Geometry into Deep Learning