Temporal integration in visual word recognition

When two displays are presented in close temporal succession at the same location, how does the brain assign them to one versus two conscious percepts? We investigate this issue using a novel reading paradigm in which the odd and even letters of a string are presented alternatively at a variable rate. The results reveal a window of temporal integration during reading, with a nonlinear boundary around approximately 80 msec of presentation duration. Below this limit, the oscillating stimulus is easily fused into a single percept, with all characteristics of normal reading. Above this limit, reading times are severely slowed and suffer from a word-length effect. ERPs indicate that, even at the fastest frequency, the oscillating stimulus elicits synchronous oscillations in posterior visual cortices, while late ERP components sensitive to lexical status vanish beyond the fusion threshold. Thus, the fusion/segregation dilemma is not resolved by retinal or subcortical filtering, but at cortical level by at most 300 msec. The results argue against theories of visual word recognition and letter binding that rely on temporal synchrony or other fine temporal codes.

Sensory memory in a model of a cortical column

Julien Mayor

Sensory memory is the first step of a complex memorization process. Sensory information is buffered in a "sensory store" for a short period. Then part of it is transferred to working memory, where information can be actively processed and, eventually, through its rehearsal, can be memorized and stored in long-term memory. Sensory memory is characterized by a high capacity and a short temporal extension. In this work we show that such a transient buffering of information is well captured in models of cortical microcircuits. Sensory information stays for a short time in the perturbations it induced to the neural activity. Two fundamental characteristics of cortical columns appear to be useful to this purpose. The first one is an approximate balance of neuronal excitation and inhibition. The second one is the sparseness of cells recurrent connections. Together, these two discriminants ensure a broad set of complex dynamical behaviours of the neural network along with the presence of a phase of sustained non-oscillatory activity with very irregular spike trains in individual neurons. We show that at the vicinity of a phase transition from a quiescent state to a phase of chaotic spiking activity, global stimuli can be buffered in the "macroscopic" neuronal activity. However if the sensory input only excites a subpart of the network, efficient information buffering is made using the detailed spiking activity of every neuron in the network. The "microscopic" structure of the network is therefore needed in order to buffer sensory information. In most situations, addition of noise enhances the buffering performance and the computational power of the network. This effect is known in the physical literature as "stochastic resonance". If the network has to achieve complex transformation of its inputs, stochastic resonance is shown to be an emergent property of the population of neurons. Both the very irregular spiking activity present in vivo and the balanced excitation and inhibition measured in cortical columns have a new functional relevance in being the neuronal substrate of an efficient sensory memory .

EPFL2005

Visuo-vestibular mechanisms of bodily self-consciousness

Joachim Jean-Marie Forget

Bodily self-consciousness is linked to multisensory integration and is particularly dependent on vestibular perception providing the brain with the main sensory cues about body motion and location in space. Vestibular and visual inputs are permanently balanced and integrated to encode the most optimal representation of the external world and of the observer in the central nervous system. Vection, an illusory self-motion experience induced only by visual stimuli, illustrates the fact that the visual and the vestibular systems share common neural underpinnings and a similar phenomenology. Optokinetic stimulation inducing vection and direct vestibular stimulation induce whole-body motion sensations that can be used to explore multisensory interactions. A failure in visuo-vestibular integration, artificially induced by the methods of cognitive psychology or in pathological conditions, has also been reported to altered own body perception and bodily self-consciousness. The respective contributions of the vestibular and visual systems to bodily self-consciousness amongst other polymodal sensory mechanisms, and the neural correlates of visuo-vestibular convergence, should be better understood. We first performed a neuroimaging study of brain regions where optokinetic and vestibular stimuli converge, using 7T functional magnetic resonance imaging in individual subjects. We identified three main regions of convergence: (1) the depth of supramarginal gyrus or retroinsular cortex, (2) the surface of supramarginal gyrus at the temporo-parietal junction, (3) and the posterior part of middle temporal gyrus and superior temporal sulcus. Then, we aimed to induce the embodiment of an external fake rubber hand through visuo-tactile conflict - the so-called rubber hand illusion paradigm, and studied how this integration is modulated by vection. Subjects experiencing vection in the direction of the rubber hand mislocalised the position of their real hand towards the rubber hand indicating that visuo-vestibular stimuli can enhance visuo-tactile integration. We also investigated if visuo-proprioceptive and tactile integration in peripersonal space could be dynamically updated based on the congruency of visual and proprioceptive feedback. A pair of rubber hands or feet provided visual feedback. Fake and real limbs were crossed or uncrossed. We showed that sensory cues were integrated in peripersonal space, dynamically reshaped but only for hands. Finally, we investigated a rare case of an illusory own body perception in an epileptic patient suffering from multiple daily disembodiments during seizures. Seizures were associated to a focal cortical microdysplasia juxtaposed to a developmental venous anomaly in the left angular gyrus, a brain region known to be important for visuo-vestibular integration and bodily self-consciousness. Our results characterize the inferior parietal lobule as a crucial structure in merging visual, vestibular, tactile and proprioceptive inputs, allowing the emergence of the global and unified experience of being âI.â Multisensory body representation can be reshaped transiently using visual and vestibular signals or in relation to a medical condition affecting the temporo-parietal junction. The integration of visual and vestibular signals, aims to adapt dynamically our internal representations to constant changes occurring in our environment.

EPFL2015

Self-grounded vision: hand ownership modulates visual location through cortical beta and gamma oscillations

Javier Bello Ruiz, Fosco Bernasconi, Olaf Blanke, Herberto Dhanis Pedro De Barros Camacho, Nathan Quentin Faivre, Roy Salomon, Michele Scandola

Vision is known to be shaped by context, defined by environmental and bodily signals. In the Taylor illusion, the size of an afterimage projected on one's hand changes according to proprioceptive signals conveying hand position. Here, we assessed whether the Taylor illusion does not just depend on the physical hand position, but also on bodily self-consciousness as quantified through illusory hand ownership. Relying on the somatic rubber hand illusion, we manipulated hand ownership, such that participants embodied a rubber hand placed next to their own hand. We found that an afterimage projected on the participant's hand drifted depending on illusory ownership between the participants' two hands, showing an implication of self-representation during the Taylor illusion. Oscillatory power analysis of electroencephalographic signals showed that illusory hand ownership was stronger in participants with stronger alpha suppression over left sensorimotor cortex, whereas the Taylor illusion correlated with higher beta/gamma power over frontotemporal regions. Higher gamma connectivity between left sensorimotor and inferior parietal cortex was also found during illusory hand ownership. These data show that afterimage drifts in the Taylor illusion do not only depend on the physical hand position but also on subjective ownership, which itself is based on the synchrony of somatosensory signals from the two hands. The effect of ownership on afterimage drifts is associated with beta/gamma power and gamma connectivity between frontoparietal regions and the visual cortex. Together, our results suggest that visual percepts are not only influenced by bodily context but are self-grounded, mapped on a self-referential frame.