Operant conditioning

Operant conditioning, also called instrumental conditioning, is a learning process where behaviors are modified through the association of stimuli with reinforcement or punishment. In it, operants—behaviors that affect one's environment—are conditioned to occur or not occur depending on the environmental consequences of the behavior. Operant conditioning originated in the work of Edward Thorndike, whose law of effect theorised that behaviors arise as a result of whether their consequences are satisfying or discomforting. In the 20th century, operant conditioning was studied by behaviorist psychologists, who believed that much, if not all, of mind and behaviour can be explained as a result of environmental conditioning. Reinforcements are environmental stimuli that increase behaviors, whereas punishments are stimuli that decrease behaviors. Both kinds of stimuli can be further categorised into positive and negative stimuli, which respectively involve the addition or removal of environm

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Related publications (28)

Related publications

Related people (2)

Related people

Related units (2)

Related units

Related concepts (38)

Related concepts

Related courses (7)

Related courses

Related lectures (11)

Related lectures

Concepts of Information Content and Likelihood in Parameter Calibration for Hydrological Simulation Models

There remains a great deal of uncertainty about uncertainty estimation in hydrological modeling. Given that hydrology is still a subject limited by the available measurement techniques, it does not appear that the issue of epistemic error in hydrological data will go away for the foreseeable future, and it may be necessary to find a way to allow for robust model conditioning and more subjective treatments of potential epistemic errors in prediction. In this paper an attempt is made to analyze how this is the result of the epistemic uncertainties inherent in the hydrological modeling process and their impact on model conditioning and hypothesis testing. Some ideas are proposed about how to deal with assessing the information in hydrological data and how it might influence model conditioning based on hydrological reasoning, with an application to rainfall-runoff modeling of a catchment in northern England, where inconsistent data for some events can introduce disinformation into the model conditioning process. A methodology is presented to make an assessment of the relative information content of calibration data before running a model that can then inform the evaluation of model runs and resulting prediction uncertainties.

Asce-Amer Soc Civil Engineers2015

Learning-induced biases in the ongoing dynamics of sensory representations predict stimulus generalization

Christoph Pokorny

Sensory stimuli have long been thought to be represented in the brain as activity patterns of specific neuronal assemblies. However, we still know relatively little about the long-term dynamics of sensory representations. Using chronic in vivo calcium imaging in the mouse auditory cortex, we find that sensory representations undergo continuous recombination, even under behaviorally stable conditions. Auditory cued fear conditioning introduces a bias into these ongoing dynamics, resulting in a long-lasting increase in the number of stimuli activating the same subset of neurons. This plasticity is specific for stimuli sharing representational similarity to the conditioned sound prior to conditioning and predicts behaviorally observed stimulus generalization. Our findings demonstrate that learning-induced plasticity leading to a representational linkage between the conditioned stimulus and non-conditioned stimuli weaves into ongoing dynamics of the brain rather than acting on an otherwise static substrate.

CELL PRESS2022

Novelty of Behaviour as a Basis for the Neuro-evolution of Operant Reward Learning

Andrea Soltoggio

An agent that deviates from a usual or previous course of action can be said to display novel or varying behaviour. Novelty of behaviour can be seen as the result of real or apparent randomness in decision making, which prevents an agent from repeating exactly past choices. In this paper, novelty of behaviour is considered as an evolutionary precursor of the exploring skill in reward learning, and conservative behaviour as the precursor of exploitation. Novelty of behaviour in neural control is hypothesised to be an important factor in the neuro-evolution of operant reward learning. Agents capable of varying behaviour, as opposed to conservative, when exposed to reward stimuli appear to acquire on a faster evolutionary scale the meaning and use of such reward information. The hypothesis is validated by comparing the performance during evolution in two environments that either favour or are neutral to novelty. Following these findings, we suggest that neuro-evolution of operant reward learning is fostered by environments where behavioural novelty is intrinsically beneficial, i.e. where varying or exploring behaviour is associated with low risk.

ACM2009

BIO-311: Neuroscience

The course starts with fundamentals of electrical - and chemical signaling in neurons. Students then learn how neurons in the brain receive and process sensory information, and how other neurons control the behavior of an animal. Furthermore, memory, learning, and brain disorders will be introduced.

CS-411: Digital education

This course addresses the relationship between specific technological features and the learners' cognitive processes. It also covers the methods and results of empirical studies on this topic: do student actually learn due to technologies?

CS-456: Artificial neural networks/reinforcement learning

Since 2010 approaches in deep learning have revolutionized fields as diverse as computer vision, machine learning, or artificial intelligence. This course gives a systematic introduction into influential models of deep artificial neural networks, with a focus on Reinforcement Learning.

Reinforcement

In reinforcement theory, it is argued that human behavior is a result of "contingent consequences" to human actions The publication pushes forward the idea that "you get what you reinforce" This m

Behaviorism

Behaviorism (also spelled behaviourism) is a systematic approach to understanding the behavior of humans and other animals. It assumes that behavior is either a reflex evoked by the pairing of certain

Psychology

Psychology is the study of mind and behavior in humans and non-humans. Psychology includes the study of conscious and unconscious phenomena, including feelings and thoughts. It is an academic discipl