Relationship to Neural Learning Rules

Description

This lecture delves into the relationship between neural learning rules and the derivative of the logarithm of a policy, exploring the post-synaptic and pre-synaptic contributions in weight updates. It explains how rewards modulate synaptic weights and how the activity of neurons influences learning.

In MOOCs (3)

Official source

https://mediaspace.epfl.ch/media/0_aa5o6ji2

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Related lectures (32)

Related concepts (19)

Synaptogenesis

Synaptogenesis is the formation of synapses between neurons in the nervous system. Although it occurs throughout a healthy person's lifespan, an explosion of synapse formation occurs during early brain development, known as exuberant synaptogenesis. Synaptogenesis is particularly important during an individual's critical period, during which there is a certain degree of synaptic pruning due to competition for neural growth factors by neurons and synapses.

Long-term depression

In neurophysiology, long-term depression (LTD) is an activity-dependent reduction in the efficacy of neuronal synapses lasting hours or longer following a long patterned stimulus. LTD occurs in many areas of the CNS with varying mechanisms depending upon brain region and developmental progress. As the opposing process to long-term potentiation (LTP), LTD is one of several processes that serves to selectively weaken specific synapses in order to make constructive use of synaptic strengthening caused by LTP.

Deep learning

Deep learning is part of a broader family of machine learning methods, which is based on artificial neural networks with representation learning. The adjective "deep" in deep learning refers to the use of multiple layers in the network. Methods used can be either supervised, semi-supervised or unsupervised.

Activity-dependent plasticity

Activity-dependent plasticity is a form of functional and structural neuroplasticity that arises from the use of cognitive functions and personal experience; hence, it is the biological basis for learning and the formation of new memories. Activity-dependent plasticity is a form of neuroplasticity that arises from intrinsic or endogenous activity, as opposed to forms of neuroplasticity that arise from extrinsic or exogenous factors, such as electrical brain stimulation- or drug-induced neuroplasticity.

Artificial neural network

Artificial neural networks (ANNs, also shortened to neural networks (NNs) or neural nets) are a branch of machine learning models that are built using principles of neuronal organization discovered by connectionism in the biological neural networks constituting animal brains. An ANN is based on a collection of connected units or nodes called artificial neurons, which loosely model the neurons in a biological brain. Each connection, like the synapses in a biological brain, can transmit a signal to other neurons.