Publication
Neural Correlates of Reinforcement Learning: eligibility trace, reward prediction error, novelty and surprise
Publications associées (32)
Unveiling the complexity of learning and decision-making
Reinforcement learning (RL) is crucial for learning to adapt to new environments. In RL, the prediction error is an important component that compares the expected and actual rewards. Dopamine plays a critical role in encoding these prediction errors. In my ...
EPFL2024Seeking the new, learning from the unexpected: Computational models of surprise and novelty in the brain
Human babies have a natural desire to interact with new toys and objects, through which they learn how the world around them works, e.g., that glass shatters when dropped, but a rubber ball does not. When their predictions are proven incorrect, such as whe ...
EPFL2024Non-invasive stimulation of the human striatum disrupts reinforcement learning of motor skills
Friedhelm Christoph Hummel, Takuya Morishita, Pierre Theopistos Vassiliadis, Elena Beanato, Esra Neufeld, Fabienne Windel, Maximilian Jonas Wessel, Traian Popa, Julie Duqué
Reinforcement feedback can improve motor learning, but the underlying brain mechanisms remain underexplored. In particular, the causal contribution of specific patterns of oscillatory activity within the human striatum is unknown. To address this question, ...
Nature Portfolio2024Involvement of prelimbic cortex neurons and related circuits in the acquisition of a cooperative learning by pairs of rats
Maria del Carmen Sandi Perez, Elias Georges Gebara, Ana del Rocio Conde Moro
Social behaviors such as cooperation are crucial for mammals. A deeper knowledge of the neuronal mechanisms underlying cooperation can be beneficial for people suffering from pathologies with impaired social behavior. Our aim was to study the brain activit ...
Springer2024Resource-Efficient Continual Learning for Personalized Online Seizure Detection
David Atienza Alonso, Giovanni Ansaloni, José Angel Miranda Calero, Jonathan Dan, Amirhossein Shahbazinia, Flavio Ponzina
Epilepsy, a major neurological disease, requires careful diagnosis and treatment. However, the detection of epileptic seizures remains a significant challenge. Current clinical practice relies on expert analysis of EEG signals, a process that is time-consu ...
2024Social Opinion Formation and Decision Making Under Communication Trends
Ali H. Sayed, Virginia Bordignon, Mert Kayaalp
This work studies the learning process over social networks under partial and random information sharing. In traditional social learning models, agents exchange full belief information with each other while trying to infer the true state of nature. We stud ...
Piscataway2024Subcortical correlates of consciousness with human single neuron recordings
Olaf Blanke, Fosco Bernasconi, Nathan Quentin Faivre, Michael Eric Anthony Pereira
Subcortical brain structures such as the basal ganglia or the thalamus are involved in regulating motor and cognitive behavior. However, their contribution to perceptual consciousness is still unclear, due to the inherent difficulties of recording subcorti ...
2024Incorporating Projective Geometry into Deep Learning
In this thesis we explore the applications of projective geometry, a mathematical theory of the relation between 3D scenes and their 2D images, in modern learning-based computer vision systems. This is an interesting research question which contradicts the ...
EPFL2024Fast adaptation to rule switching using neuronal surprise
In humans and animals, surprise is a physiological reaction to an unexpected event, but how surprise can be linked to plausible models of neuronal activity is an open problem. We propose a self-supervised spiking neural network model where a surprise signa ...
2024Decoding electroencephalographic responses to visual stimuli compatible with electrical stimulation
Silvestro Micera, Simone Romeni, Laura Toni, Fiorenzo Artoni
Electrical stimulation of the visual nervous system could improve the quality of life of patients affected by acquired blindness by restoring some visual sensations, but requires careful optimization of stimulation parameters to produce useful perceptions. ...
Aip Publishing2024