Discriminative Channel Selection Method for the Recognition of Anticipation related Potentials from CCD estimated Cortical Activity

Recognition of brain states and subject's intention from electroencephalogram (EEG) is a challenging problem for brain-computer interaction. Signals recorded from each of EEG electrodes represent noisy spatio-temporal overlapping of activity arising from very diverse brain regions. However, un-mixing methods such as Cortical Current Density (CCD) can be used for estimating activity of different brain regions. These methods not only improve spatial resolution but also signal to noise ratio, hence the classifiers computed using this activity may ameliorate recognition performances. However, these methods lead to a multiplied number of channels, leading to the question -- ``How to choose relevant and discriminant channels from a large number of channels?''. In the current paper we present a channel selection method and discuss its application to the recognition of anticipation related potentials from surface EEG channels and CCD estimated cortical potentials. We compare the classification accuracies with previously reported performances obtained using Cz electrode potentials of 9 subjects (3 experienced + 6 naive). As hypothesised, we observed improvements for most subjects with channel selection method applied to CCD activity as compared to surface-EEG channels and baseline performances. This improvement is particularly significant for subjects who are naive and did not show a clear pattern on ERP grand averages.

Adaptation in Brain-Computer Interfaces

Anna Buttfield

One major challenge in Brain-Computer Interface (BCI) research is to cope with the inherent nonstationarity of the recorded brain signals caused by changes in the subjects brain processes during an experiment. Online adaptation of the classifier embedded into the BCI is a possible way of tackling this issue. In this chapter we investigate the effect of adaptation on the performance of the classifier embedded in three different BCI systems, all of them based on non-invasive electroencephalogram (EEG) signals. Through this adaptation we aim to keep the classifier constantly tuned to the EEG signals it is receiving in the current session. Although the experimental results reported here show the benefits of online adaptation, some questions need still to be addressed. The chapter ends discussing some of these open issues.

The MIT Press2007

Analysis of Anticipation Related Potentials for Brain Computer Interaction

Gangadhar Garipelli

Anticipation is a mental process during which a person actively engages in a phase required for the sensory perception and execution of the optimal actions at the arrival of the relevant future events. Since this process occurs before the execution of an intended action, it may be used as a control signal for Brain Computer Interface (BCI) applications. Recognition of neural correlates of this process can enhance the performance of a BCI and in turn reduce mental workload of its users. To this end, it is vital to understand the neural correlates involved in this process and to design robust methods for its recognition in single trials. The analysis of these correlates may also contribute to the basic knowledge of the mechanisms underlying this behavior. The thesis provides three major contributions: (i) it reports methods for the robust recognition of anticipation related Electroencephalogram (EEG) potentials (ii) it provides insights into the selection of appropriate preprocessing steps required for enhancing the Signal-to-Noise Ratio (SNR) of anticipatory slow cortical potentials (SCPs) and (iii) it identifies scalp area specific oscillatory activity related to different aspects of anticipatory behavior. First, we focus on methods for the single trial recognition of anticipatory SCPs using the widely known classical contingent negative variation (CNV) paradigm. Using this paradigm, we demonstrate the feasibility of recognizing the anticipatory SCPs (CNV potentials) using features thatmodel its temporal pattern. We propose a Bayesian approach that exploits temporal evolution and redundancy to quickly classify (e.g., within half of the anticipatory period), without compromising classification accuracy. We then improve upon these recognition rates by using a source localization technique based on the biophysical model of the human head. We further validate the feasibility of recognizing CNV potentials in an online experiment, and report for the first time that, under controlled conditions, these potentials can be reproduced and recognized in realistic interaction scenarios (assistive technology web-browsing) with high accuracies. Second, the thesis provides insights into the selection of appropriate preprocessing stages required for improving the SNR of SCPs. The CNV potentials are characterized by low frequencies that are usually recorded with full-DC, and hence suffer from task-irrelevant high amplitude fluctuations and spatial noise. To account for this, we identified appropriate spectral and spatial filters to improve the SNR. We demonstrate the potential of these preprocessing stages by using fusing multiple electrode specific linear classifiers, which achieve recognition performances of 90±2% (area under curve of receiver operating characteristic), where the classifiers are trained using recordings from one day and tested on the recordings from several days apart. Finally, the thesis identifies different facets of anticipatory behavior. Apart from the widely known CNV potentials, it is not clear which other spectral bands could be related to anticipatory behavior. Using recordings from an experiment (i.e., the assistive technology web browser) where multiple warning stimuli predicted an imperative stimulus, we explored the phase and amplitude response of various oscillatory sub-bands for the identification of markers that could be associated with different aspects of anticipation. From this study we report that: (i) there are duration (4-10 seconds) specific changes in Electroencephalography (EEG) activity in the range 0-1 Hz in the central electrodes correlate with reaction time, (ii) there exist slow oscillations (0.1-1 Hz) in the central electrodes that exhibit phase tuning up to 4 seconds before the onset of a target cue, (iii) there are delta oscillations (1.5-3 Hz), which are entrained to predictive rhythmic warning cues, (iv) there is a selective modulation (increase or decrease) in the amplitude of occipital alpha band (8-12 Hz) based on the relevance of forthcoming visual cue, and (v) there exist a reduction in the beta band (14-30 Hz) amplitude in the sensory motor and association areas lasting up to 10 seconds. The phase tuning and entrainment resulted in a low variance of phase values at the arrival of the imperative stimulus, which may be required for its optimal processing. The amplitude modulation of alpha band activity is likely to be a resultant of sensory suppression and attention. The reduction of beta-band activity over long periods of time suggests holding of sensory-motor association areas until the execution of a planned action. We believe that these observations are the consequence of the endogenous drive on the ongoing oscillations to enhance the processing of the forthcoming stimuli and preparation for an intended action. In summary, the thesis provides methods for the recognition of anticipatory SCPs by exploiting spectral and spatio-temporal characteristics with high performances. By exploring various other oscillatory sub-bands, the spectral characteristics of different aspects of anticipatory behavior are also identified. Further, methods modeling these characteristics can bring forth more robust and faster techniques for BCI systems.

EPFL2011

Bayesian machine learning applied in a brain-computer interface for disabled users

Ulrich Hoffmann

A brain-computer interface (BCI) is a system that enables control of devices or communication with other persons, only through cerebral activity, without using muscles. The main application for BCIs is assistive technology for disabled persons. Examples for devices that can be controlled by BCIs are artificial limbs, spelling devices, or environment control systems. BCI research has seen renewed interest in recent years, and it has been convincingly shown that communication via a BCI is in principle feasible. However, present day systems still have shortcomings that prevent their widespread application. In part, these shortcomings are caused by limitations in the functionality of the pattern recognition algorithms used for discriminating brain signals in BCIs. Moreover, BCIs are often tested exclusively with able-bodied persons instead of conducting tests with the target user group, namely disabled persons. The goal of this thesis is to extend the functionality of pattern recognition algorithms for BCI systems and to move towards systems that are helpful for disabled users. We discuss extensions of linear discriminant analysis (LDA), which is a simple but efficient method for pattern recognition. In particular, a framework from Bayesian machine learning, the so-called evidence framework, is applied to LDA. An algorithm is obtained that learns classifiers quickly, robustly, and fully automatically. An extension of this algorithm allows to automatically reduce the number of sensors needed for acquisition of brain signals. More specifically, the algorithm allows to perform electrode selection. The algorithm for electrode selection is based on a concept known as automatic relevance determination (ARD) in Bayesian machine learning. The last part of the algorithmic development in this thesis concerns methods for computing accurate estimates of class probabilities in LDA-like classifiers. These probabilities are used to build a BCI that dynamically adapts the amount of acquired data, so that a preset, approximate bound on the probability of misclassifications is not exceeded. To test the algorithms described in this thesis, a BCI specifically tailored for disabled persons is introduced. The system uses electroencephalogram (EEG) signals and is based on the P300 evoked potential. Datasets recorded from five disabled and four able-bodied subjects are used to show that the Bayesian version of LDA outperforms plain LDA in terms of classification accuracy. Also, the impact of different static electrode configurations on classification accuracy is tested. In addition, experiments with the same datasets demonstrate that the algorithm for electrode selection is computationally efficient, yields physiologically plausible results, and improves classification accuracy over static electrode configurations. The classification accuracy is further improved by dynamically adapting the amount of acquired data. Besides the datasets recorded from disabled and able-bodied subjects, benchmark datasets from BCI competitions are used to show that the algorithms discussed in this thesis are competitive with state-of-the-art electroencephalogram (EEG) classification algorithms. While the experiments in this thesis are uniquely performed with P300 datasets, the presented algorithms might also be useful for other types of BCI systems based on the EEG. This is the case because functionalities such as robust and automatic computation of classifiers, electrode selection, and estimation of class probabilities are useful in many BCI systems. Seen from a more general point of view, many applications that rely on the classification of cerebral activity could possibly benefit from the methods developed in this thesis. Among the potential applications are interrogative polygraphy ("lie detection") and clinical applications, for example coma outcome prognosis and depth of anesthesia monitoring.

EPFL2007