Multisensory Origin of the Subjective First-Person Perspective: Visual, Tactile, and Vestibular Mechanisms

In three experiments we investigated the effects of visuo-tactile and visuo-vestibular conflict about the direction of gravity on three aspects of bodily self-consciousness: self-identification, self-location, and the experienced direction of the first-person perspective. Robotic visuo-tactile stimulation was administered to 78 participants in three experiments. Additionally, we presented participants with a virtual body as seen from an elevated and downward-directed perspective while they were lying supine and were therefore receiving vestibular and postural cues about an upward-directed perspective. Under these conditions, we studied the effects of different degrees of visuo-vestibular conflict, repeated measurements during illusion induction, and the relationship to a classical measure of visuo-vestibular integration. Extending earlier findings on experimentally induced changes in bodily self-consciousness, we show that self-identification does not depend on the experienced direction of the first-person perspective, whereas self-location does. Changes in bodily self-consciousness depend on visual gravitational signals. Individual differences in the experienced direction of first-person perspective correlated with individual differences in visuo-vestibular integration. Our data reveal important contributions of visuo-vestibular gravitational cues to bodily self-consciousness. In particular we show that the experienced direction of the first-person perspective depends on the integration of visual, vestibular, and tactile signals, as well as on individual differences in idiosyncratic visuo-vestibular strategies.

Visuospatial viewpoint manipulation during full-body illusion modulates subjective first-person perspective

Olaf Blanke, Christian Pfeiffer, Valentin Marc Schmutz

Self-consciousness is based on multisensory signals from the body. In full-body illusion (FBI) experiments, multisensory conflict was used to induce changes in three key aspects of bodily self-consciousness (BSC): self-identification (which body 'I' identify with), self-location (where 'I' am located), and first-person perspective (from where 'I' experience the world; 1PP). Here, we adapted a previous FBI protocol in which visuotactile stroking was administered by a robotic device (tactile stroking) and simultaneously rendered on the back of a virtual body (visual stroking) that participants viewed on a head-mounted display as if filmed from a posterior viewpoint of a camera. We compared the effects of two different visuospatial viewpoints on the FBI and thereby on these key aspects of BSC. During control manipulations, participants saw a no-body object instead of a virtual body (first experiment) or received asynchronous versus synchronous visuotactile stroking (second experiment). Results showed that within-subjects visuospatial viewpoint manipulations affected the subjective 1PP ratings if a virtual body was seen but had no effect for viewing a non-body object. However, visuospatial viewpoint had no effect on self-identification, but depended on the viewed object and visuotactile synchrony. Self-location depended on visuospatial viewpoint (first experiment) and visuotactile synchrony (second experiment). Our results show that the visuospatial viewpoint from which the virtual body is seen during FBIs modulates the subjective 1PP and that such viewpoint manipulations contribute to spatial aspects of BSC. We compare the present data with recent data revealing vestibular contributions to the subjective 1PP and discuss the multisensory nature of BSC and the subjective 1PP.

Springer Verlag2014

Neuroscience of Bodily Self-Consciousness

Olaf Blanke, Estelle Palluel, Christian Pfeiffer

We review recent research about human subjectivity and self-consciousness that has focused on cognitive psychology and neuroimaging of bodily self-consciousness. Multidisciplinary research on the fields of neurology, cognitive neuroscience and virtual reality opens new avenues to investigate brain mechanisms underlying a fundamental sense of the bodily self. Clinical evidence for the implication of right temporo-parietal junction for bodily self-consciousness has received support by studies in which virtual-reality based own body illusions are evoked in healthy participants to study the underlying processes. A series of experiments will be reviewed in which it was shown that the experiences of self-location, self-identification and the first-person perspective can be manipulated experimentally and rely on the integration of multisensory stimuli (touch, vision, proprioception, vestibular information). Specific protocols are available to predictably influence the different aspects of bodily self consciousness. We predict that the understanding of fundamental brain mechanisms of bodily self-consciousness will lead to unprecedented empirical insights that are of broad relevance for science, virtual reality, engineering, the humanities, as well as medicine and psychotherapy.

2011

Vestibular contribution to bodily self-consciousness and multisensory cortical processing

Christian Pfeiffer

How does the self relate to the body? Bodily self-consciousness, i.e. the sense of being a subject bound to a body, involves a first-person perspective (1PP), i.e. the sense of being directed at the world. Prior research suggests that bodily self-consciousness depends on brain mechanisms integrating multisensory bodily signals. However, the specific multisensory mechanisms of 1PP are poorly understood. Here, I defend the thesis that the vestibular system, i.e. the sensory system encoding rotational and linear accelerations of the head, contributes to 1PP and related multisensory processing in the brain. The first part of my thesis presents experimental evidence showing that 1PP was influenced by multisensory conflict about the direction of gravity and the location of the body. 1PP depended on integrated visual-vestibular signals and was functionally distinct from another aspect of bodily self-consciousness: self-identification, i.e. the feeling that a particular body is âmineâ. The second part of my thesis presents the electrical neural correlates by which vestibular stimulation affected somatosensory and visual cortical processing. Passive whole-body yaw rotation naturally and selectively stimulated the vestibular system while the evoked responses to somatosensory or visual stimuli were recorded by electroencephalography. Electrical neuroimaging analysis showed temporal-specific vestibular effects on somatosensory and visual evoked potentials, localized by source estimations to distinct regions of the somatosensory, visual, and vestibular cortical networks. Collectively, the results from my thesis suggest that the vestibular system contributes to 1PP and multisensory cortical processing and imply that the vestibular system should not be neglected when studying higher brain function and neurobiological mechanisms of consciousness.

EPFL2015