EEG correlates of active visual search during simulated driving: An exploratory study

Ricardo Andres Chavarriaga Lozano, Lucian Andrei Gheorghe, Hadrien Marc Renold
2014
Article de conférence

Résumé

Brain responses to visual stimuli can provide information about visual recognition processes. Several studies have shown stimulus-dependent modulation of the evoked neural responses after gaze shifts (i.e. eye fixation related potentials, EFRP) depending on the relevance of the fixated object. However these studies are typically performed on still images under constrained conditions. Here we extend this approach to study overt visual attention during a simulated driving task. Simultaneous analysis of eye-tracking and electroencephalography data revealed similar patterns than those previously reported. However, natural visual exploration yielded shorter fixations, which imposes constraints in the analysis of the elicited brain responses. Nevertheless, we found significant differences between EFRPs corresponding to target objects or non-object stimuli. These results suggest the possibility of decoding such information during driving, allowing better understanding of how drivers process the environmental information.

Official source

https://infoscience.epfl.ch/record/200116?ln=fr

À propos de ce résultat

Cette page est générée automatiquement et peut contenir des informations qui ne sont pas correctes, complètes, à jour ou pertinentes par rapport à votre recherche. Il en va de même pour toutes les autres pages de ce site. Veillez à vérifier les informations auprès des sources officielles de l'EPFL.

Concepts associés

Chargement

Publications associées

Chargement

Cognitive language engineering towards robust human-computer interaction

Vincenzo Pallotta

Intelligent information processing seems to be one of the most challenging task among those involved in human-computer interaction. A central issue is how to model the various types of interaction among artificial and natural entities at different levels of abstraction. On the one hand, models of interaction are required to better understand the communication phenomena. On the other, suitable languages and paradigms should provide powerful frameworks for developing computer-based applications. In this dissertation I focus on different aspects of the second problem, trying to develop a methodology for the design of interactive natural language applications (e.g. from question-answering to mixed-initiative dialogue). One of the main aspects I am concerned with in this work is the problem of their robustness. Several methods have been proposed for achieving robustness in natural language understanding, but these methods are sometimes hard to scale up or re-use in different applications. Moreover, they often concentrate on a single linguistic level of the processing rather than offering a global solution. I will set up a Language Engineering environment whose goal is to combine software engineering and cognitive aspects (e.g. aspects related to representation of a mental model of the speaker). Given its complexity, it is apparent that the problem can be solved only partially. I want to stress here that the main contribution of my work is a holistic perspective on the problem of natural language understanding. Rather than focusing on a particular aspect of natural language processing, I tried to benefit from the big amount of work that has been already done in Computational Linguistics and Computer Science merging different ideas and techniques. In the first part of the dissertation I explore the universe of Language Engineering in order to clarify how my contribution can be situated. After a survey on the state of the art on robust methods in analysis of natural language data, I focus on the role that Computational Logic plays in relating the syntactic and semantic analysis of natural language to its practical understanding within specific applications. Robustness is considered from two complementary perspectives, borrowing the terminology from modern software engineering: robustness "in the small" and robustness "in the large". The first perspective is discussed while presenting an application for the Interaction through Speech with Information Systems, where robust semantic parsing is used to extract queries from spoken natural language utterances.The second perspective is examplified by the re-engineering of an existing text analysis system using a new Language Engineering methodology: Agent-Oriented Language Engineering. In the second part of the thesis I discuss how cognitive aspects can be integrated into a Language Engineering environment leading to the notion of Cognitive Language Enginering. I tackle the difficult problem of robust dialogue management from both a cognitive and computational perspective. I propose two frameworks for the semantic representation and assimilation of information into the dialogue information state. The first framework allows us to represent and reason about the dynamic aspects of objects and events. The second framework is centered on the notion of mental space and it is used to build representations of the cognitive processing of information during communication.

EPFL2002

Chargement

Our comprehension of human brain functions and their dynamics has been dramatically improved by recent developments in non-invasive imaging techniques. These methods can be divided into two different categories, according to the nature of the measured signal: hemodynamic techniques, such as functional magnetic resonance imaging (fMRI) and positiron emission tomography (PET), and electromagnetic techniques, such as electroencephalography (EEG) and magnetoencephalography (MEG). These two categories are have complementary characteristics: hemodynamic techniques have a good spatial resolution (on a millimeter spatial scale) but have a poor temporal resolution, which is inherently limited by the rate changes in blood flow and oxygenation. Electromagnetic techniques have sub-millisecond temporal resolution but have a poor spatial resolution, since the analysis of intracranial generators requires the solution of an underdetermined inverse problem (i.e. there are infinite solutions that can explain equally well the same scalp-recorded distribution). The complementarity of the characteristics of these two families of methods allowed researchers to suppose that the understanding of spatio-temporal brain dynamics can be drastically improved by their combination (so-called multimodal imaging). Unfortunately some caveats hinder such combination. First, the nature of neurovascular coupling is still poorly understood. Second, analytical methods for multimodal imaging are largely in their infancy. The first part of this thesis focuses on the analysis of the temporal characteristics of the blood oxygenation level dependent (BOLD) signal and on how they are modulated by stimulus conditions. To analyze the BOLD dynamics, a novel method for synchronizing stimulus delivery and volume acquisition was developed. This method allows for estimating the BOLD signal with a high temporal resolution (in this thesis up to 125 ms) and for studying how the temporal characteristics (in this thesis mainly the BOLD peak latency and slope) are modulated by stimulus conditions (with an approach similar to that used in the analysis of the EEG evoked potentials). We applied this novel technique to a simple reaction time task to lateralized visual stimuli (the so-called Poffenberger paradigm) as well as to a multisensory auditory-visual reaction time task. In the first study (the Poffenberger paradigm) the analysis of BOLD dynamics supported the theory of a bilateral visuo-motor pathway even in the case of a visual stimulus ipsilateral to the responding hand. In the second study, (the auditory-visual multisensory reaction-time task), the analysis showed auditory-visual interactions within both primary auditory and visual cortices that could not be otherwise revealed by traditional fMRI analysis methods since it does not involve changes in signal amplitude. The second part of this thesis focuses on the comparison of the statistical results obtained by the analyses of fMRI and of the intracranial local field potentials (LFPs), estimated by the ELECTRA inverse solution. We first developed a new method for the analysis of EEG data. This method is based on the statistical comparison of the spectral characteristics of the estimated intracranial LFPs of the pre- and post- stimulus onset periods. Each single trial is analyzed independently, without including an averaging step, so that the information carried by high frequencies is preserved. We also propose a new metric, called resemblance, to investigate the relationship between fMRI and the estimated intracranial LFPs. Single-trial analysis and the resemblance metric were applied in an experiment involving separate EEG and fMRI acquisitions during the same passive visual stimulation protocol. This experiment revealed that only a limited set of LFP frequencies shows a spatial correlation with fMRI. This set of frequencies changes across brain areas, such that progression from lower to higher cortical levels of visual processing incorporates at each step new frequencies. In conclusion, in this thesis we show that the estimation and the analysis of the BOLD time course can give an important contribution to better understanding brain functions and brain organization. To fully understand the meaning of changes in BOLD dynamics, we need a better knowledge of the neuro-vascular coupling. To do that, we introduced a new method for evaluating the relationship between EEG and fMRI across frequencies and anatomical regions.

EPFL2006

Chargement

Much information is conveyed to animals by the diverse molecules propagated in their environment. This information is transmitted and treated within the olfactory system to be utilized by the rest of the brain. In this process, the sensory flow arriving from the nose first encounters the olfactory bulb. This thesis studies different aspects of the encoding and treatment of olfactory information in the bulb by a combination of experimental and theoretical approaches. The olfactory bulb consists of two functional stages: an input stage where the nerve terminals from the sensory neurons of the nose are spatially arranged in a precise manner, and an output stage corresponding to the neurons which propagate the processed information towards the more central brain areas. The first part of this thesis is focused on the development of an image processing technique to precisely map the input stage. In a second part, output neurons activity in responsive areas of the bulb was recorded in anaesthetized mice. The data obtained indicate complex dynamics in neural activity on several time scales. We show that the combination of mean firing rates from a large enough ensemble of neurons allows to accurately predict the odor presented to the animal. We also show that temporal variables related to the dynamics give very little information complementary to the ensemble rate code, suggesting that these variables are not read by brain structures downstream to the bulb. In a third part, we developed a numerical model of the olfactory bulb to understand its fast oscillatory dynamics. The model proposes a mechanism based on the negative feedback from the interneurons that regulate output neurons. Some predictions of the model are checked experimentally. An analytical interpretation of the model is also proposed and its generalization to the analysis of fast oscillation in other parts of the brain is discussed.

EPFL2007

Chargement

Cognitive language engineering towards robust human-computer interaction

Vincenzo Pallotta

EPFL2002

EPFL2006