Rectifier (neural networks)In the context of artificial neural networks, the rectifier or ReLU (rectified linear unit) activation function is an activation function defined as the positive part of its argument: where x is the input to a neuron. This is also known as a ramp function and is analogous to half-wave rectification in electrical engineering. This activation function was introduced by Kunihiko Fukushima in 1969 in the context of visual feature extraction in hierarchical neural networks.
Convolutional neural networkConvolutional neural network (CNN) is a regularized type of feed-forward neural network that learns feature engineering by itself via filters (or kernel) optimization. Vanishing gradients and exploding gradients, seen during backpropagation in earlier neural networks, are prevented by using regularized weights over fewer connections. For example, for each neuron in the fully-connected layer 10,000 weights would be required for processing an image sized 100 × 100 pixels.
Prefrontal cortexIn mammalian brain anatomy, the prefrontal cortex (PFC) covers the front part of the frontal lobe of the cerebral cortex. The PFC contains the Brodmann areas BA8, BA9, BA10, BA11, BA12, BA13, BA14, BA24, BA25, BA32, BA44, BA45, BA46, and BA47. The basic activity of this brain region is considered to be orchestration of thoughts and actions in accordance with internal goals. Many authors have indicated an integral link between a person's will to live, personality, and the functions of the prefrontal cortex.
Types of artificial neural networksThere are many types of artificial neural networks (ANN). Artificial neural networks are computational models inspired by biological neural networks, and are used to approximate functions that are generally unknown. Particularly, they are inspired by the behaviour of neurons and the electrical signals they convey between input (such as from the eyes or nerve endings in the hand), processing, and output from the brain (such as reacting to light, touch, or heat). The way neurons semantically communicate is an area of ongoing research.
Cortical stimulation mappingCortical stimulation mapping (CSM) is a type of electrocorticography that involves a physically invasive procedure and aims to localize the function of specific brain regions through direct electrical stimulation of the cerebral cortex. It remains one of the earliest methods of analyzing the brain and has allowed researchers to study the relationship between cortical structure and systemic function.
BrainA brain is an organ that serves as the center of the nervous system in all vertebrate and most invertebrate animals. It is located in the head, usually close to the sensory organs for senses such as vision. It is the most complex organ in a vertebrate's body. In a human, the cerebral cortex contains approximately 14–16 billion neurons, and the estimated number of neurons in the cerebellum is 55–70 billion. Each neuron is connected by synapses to several thousand other neurons.
Thalamocortical radiationsIn neuroanatomy, thalamocortical radiations also known as thalamocortical fibres, are the efferent fibres that project from the thalamus to distinct areas of the cerebral cortex. They form fibre bundles that emerge from the lateral surface of the thalamus. Thalamocortical fibers (TC fibres) have been referred to as one of the two constituents of the isothalamus, the other being microneurons. Thalamocortical fibers have a bush or tree-like appearance as they extend into the internal capsule and project to the layers of the cortex.
Cortical homunculusA cortical homunculus () is a distorted representation of the human body, based on a neurological "map" of the areas and proportions of the human brain dedicated to processing motor functions, or sensory functions, for different parts of the body. Nerve fibresconducting somatosensory information from all over the bodyterminate in various areas of the parietal lobe in the cerebral cortex, forming a representational map of the body. Findings from the 2010s and early 2020s began to call this interpretation into question, and research is ongoing in this field.
Reticular formationThe reticular formation is a set of interconnected nuclei that are located throughout the brainstem. It is not anatomically well defined, because it includes neurons located in different parts of the brain. The neurons of the reticular formation make up a complex set of networks in the core of the brainstem that extend from the upper part of the midbrain to the lower part of the medulla oblongata. The reticular formation includes ascending pathways to the cortex in the ascending reticular activating system (ARAS) and descending pathways to the spinal cord via the reticulospinal tracts.
Neural circuitA neural circuit (also known as a biological neural network BNNs) is a population of neurons interconnected by synapses to carry out a specific function when activated. Multiple neural circuits interconnect with one another to form large scale brain networks. Neural circuits have inspired the design of artificial neural networks, though there are significant differences. Early treatments of neural networks can be found in Herbert Spencer's Principles of Psychology, 3rd edition (1872), Theodor Meynert's Psychiatry (1884), William James' Principles of Psychology (1890), and Sigmund Freud's Project for a Scientific Psychology (composed 1895).
