Fig. 17.1
MEG and EEG noninvasively record electromagnetic brain activity. (a) Electric currents in neurons (red arrow) produce a potential distribution on the scalp (red and blue regions) as well as a magnetic field (green lines) outside of the head. (b) The sensor array of modern MEG systems covers the whole scalp. The magnetic field map (red and blue contours for field out- and inward of the sensor helmet, respectively). (c) Postsynaptic currents (red arrows) in the apical dendrites of cortical pyramidal neurons are the main source of MEG and EEG. The parallel orientation of these dendrites enables spatial summation of the fields. (d) Action potentials are associated with antiparallel intracellular currents whereas postsynaptic currents are unidirectional. Parts of the figure adopted from Parkkonen [1]
This section sheds light on the neural origin of these signals, illustrates the instrumentation required to measure them, and outlines the typical computational approaches needed to infer neural activations from the neuromagnetic measurements. Throughout this introduction, attention is paid to aspects that are relevant for real-time MEG.
For further and more detailed information about MEG the reader is referred to reviews [2–5]. Textbooks on MEG have also become available; see, e.g., [6–8].
17.1.1 Origin of MEG Signals
Neurotransmitter vesicles released at the presynaptic axon terminal diffuse across the synaptic cleft and open specific ion channels on the membrane of the postsynaptic neuron. Ionic currents through these channels lead to a change in the membrane potential; excitatory synapses depolarize the cell (increase the membrane potential) while inhibitory synapses hyperpolarize the cell (decrease its membrane potential) or shunt the membrane potential to its resting value of about −70 mV (measured as the potential of the intracellular space with respect to the extracellular space). These postsynaptic potentials (PSPs) give rise to intracellular currents; see Fig. 17.1d. It is important to note that most inhibitory synapses are close to or even on the soma of the neuron where they can strongly influence the likelihood of the postsynaptic neuron to fire an action potential. In contrast, excitatory synapses are most abundant further away from the soma, on the branches of the dendritic tree. Therefore, both excitatory and inhibitory postsynaptic currents are typically towards the soma of the neuron. If the net potential change at the soma, taking into account the number and type of simultaneously active synapses and their distances from the soma, exceeds a threshold value of about −35 mV, the neuron fires an action potential (AP) that actively propagates along the axon towards presynaptic terminals of other synapses. Since the AP involves transient opening of local ion channels and thus a local change in the membrane potential, the intracellular current associated with an AP flows both forward and backward with respect to the propagation of the AP.
Although both postsynaptic currents and currents due to action potentials generate magnetic fields, the antiparallel arrangement of intracellular AP current components constitutes a quadrupole whose field diminishes rapidly with distance. When measuring the fields at a distance much larger than the length of significant AP current flow, the fields due to an AP are substantially weaker than those due to the largely unidirectional postsynaptic currents, which can be modeled as current dipoles.
The detectability of neural currents is also affected by their time course; the slower postsynaptic currents (tens of ms in duration) are more likely to co-occur than the faster APs (1–2 ms). Since the fields of single neural events are by far too weak to be measured by MEG or EEG, concerted action of tens or hundreds of thousands of neurons is needed for extracranial detection [2, 9]. Moreover, these simultaneously active neurons need to have their dendrites oriented roughly in parallel for the fields to sum up constructively. Fortunately, apical dendrites of pyramidal neurons are arranged in such a manner, and indeed the postsynaptic currents in these neurons produce the bulk of MEG and EEG signals.
In rare cases also axonal activity, i.e., APs, can be recorded with MEG. Bends in axons destroy the symmetry of the forward and backward currents and give rise to a dipolar component. However, the short duration of the AP still hampers its detection. Yet, sometimes, external stimulation can phase-lock the APs so well that massive averaging can make APs detectable; for example, responses from human auditory brain stem have been recorded with MEG [10]. These responses partly reflect axonal activity.
17.1.2 Instrumentation
Neuromagnetic fields within centimeters from the scalp are on the order of 100 femtoteslas (fT). For example, the Earth’s magnetic field (50–90 μT) is thus 9 orders of magnitude (billion times) stronger. Similarly, moving vehicles and many electric devices produce magnetic fields that are many orders of magnitude stronger than any neuromagnetic signal. Therefore, measuring these weak fields is extremely challenging, and a combination of ultrasensitive detectors and magnetic shielding is needed.
Currently all MEG systems in routine use are based on superconducting quantum interference devices (SQUIDs) which are magnetic field sensors that provide femtotesla-range sensitivity. As the name implies, these sensors exploit superconductivity and thus require cryogenic temperatures to operate. SQUIDs are typically made of low-critical-temperature superconductors that need to be cooled down to temperatures of liquid helium (boiling point 4.2 K or −269 °C). Despite the sufficient sensitivity of SQUIDs for MEG, alternative sensors are actively being sought since liquid helium is expensive and its supply is limited. For example, high-critical-temperature SQUIDs that operate at liquid-nitrogen (T = 77 K) temperatures [11] and atomic (optical) magnetometers [12] have been demonstrated to be capable of recording MEG, but further development is needed for these sensors to outperform helium-cooled SQUIDs in practical MEG devices.
To capture the neuromagnetic fields above the whole scalp and to enable localizing the neural sources generating the measured fields, large helmet-shaped arrays of SQUID sensors are used. State-of-the-art systems comprise over 300 sensors distributed across the scalp. Due to the low temperatures required, the sensor helmet is placed inside a cryogenic vessel, Dewar, which is designed to minimize the transfer of heat to the liquid-helium bath inside the vessel while allowing the neuromagnetic fields to pass undistorted to the sensors.
As mentioned earlier, magnetic shielding is typically needed to protect the neuromagnetic measurement from interfering ambient magnetic fields such as those from traffic, power lines, elevators, and laboratory equipment. The most common shielding method is a magnetically shielded room, which is made of mu-metal (an alloy with very high permeability) and aluminum. Such a passive shield can be augmented with active systems that measure the interfering field and apply currents to coils that produce fields that counteract the interference. The magnetically shielded room requires space and is a substantial expense. Attempts to measure MEG without such a room have been made, but unfortunately robust operation in urban environments is yet to be demonstrated.
As is evident from the above, compared to EEG, MEG is considerably more expensive and not portable. However, MEG offers superior spatial resolution and to some extent complementary sensitivity with respect to EEG. These features outweigh the higher cost of instrumentation when the goal is to localize brain activity with high accuracy. MEG may also facilitate the development of brain–computer interfaces even if the eventual application does not use MEG.
17.2 MEG Data Analysis
While the sensor signals are already indicative of brain activity, the full potential of MEG can only be exploited by subjecting the measured multichannel data to mathematical operations that (a) suppress external interference, (b) improve the signal-to-noise ratio (SNR) of the brain signals of interest, and (c) estimate the locations of the neural sources underlying the measured signals. These steps are discussed in the following. Special attention is paid to their real-time application.
First, let us define the concept of signal space as it becomes handy when discussing the following methods. A measurement with N channels can be described as a signal vector in an N-dimensional virtual space where each measurement channel spans one axis. The spatial distribution, or pattern on the sensors, corresponds to the direction of that vector whereas the strength of the signal is reflected as the length of this vector. Thus, a neural source with a fixed location and orientation corresponds to a signal vector to a fixed direction; variation of the strength of that source only affects the length of the vector. Conversely, a source whose location or orientation varies over time corresponds to a signal vector whose direction changes over time.
Often the signal of interest is confined to a specific part of the signal space, i.e., only a limited set of signal patterns is generated by the neural processes underlying the measured signal. This set is referred to as a signal subspace. For example, when measuring with a whole-scalp MEG system or a high-density EEG system, the sequence of responses evoked by a visual stimulus fall within a certain subspace which is likely to be separate from the subspace spanned by, e.g., auditory responses. Likewise, external magnetic interference is confined to a specific subspace which is separate from that of brain signals as will be discussed in the following.
For a more detailed and mathematical treatment of signal space in the context of MEG and EEG, see [13].
17.2.1 Interference Suppression
Despite the employed magnetic shielding, the measured data may still be contaminated by interference, which can originate in the subject and thus cannot be suppressed by shielding. These biological interference sources include active muscles, particularly the heart, and eyes (blinks and saccades). For suppressing interference, the multichannel nature of the data allows the use of statistical methods such as principal component analysis (PCA) [13, 14] and independent component analysis (ICA) [15, 16] but also physics-inspired methods that comprise a spatial signal model based on Maxwell’s equations; signal-space separation (SSS) is such a method [17]. When using PCA or ICA, interference is suppressed simply by omitting those components that correspond to interfering signals. For example, eye blinks and cardiac activity are typically represented in a low-dimensional (1–3 dimensions) signal subspace, which can be projected out of the data. In contrast, physics-based methods, such as SSS, do not require selecting specific components since the brain-signal subspace is determined by the model in a data-independent manner. However, SSS may not be able to suppress interference that spatially resembles brain activity while PCA or ICA could do it.
In real-time applications, the interference suppression system should require no or very little operator intervention such as determining which principal or independent components correspond to interference. Therefore, SSS lends itself well to real-time use, and a robust version of the algorithm has been devised particularly for applications where the data have to be processed in a single pass [18].
17.2.2 Filtering and Averaging in Time
Among all measurable brain activity, one often wants to target specific neural activations that reflect stimulus- or task-related processing. As raw MEG signals usually do not provide sufficient SNR to accurately pinpoint or separate the contributions of the underlying neural sources, responses to similar stimuli are averaged to improve the SNR. If we assume the noise—whether from the sensors, environment, or background brain activity—to be temporally uncorrelated with the signal of interest and that the responses are resilient to repetition, the SNR improves as the square root of the number of responses is averaged.
However, in real-time analysis, response averaging has only limited applicability since accumulating multiple responses naturally increases the latency of the feedback to the subject. Yet, with a rapidly changing stimulus, computing a moving average of the responses can be a powerful way of boosting the SNR. This is particularly true for steady-state responses (see Sect. 17.2.4.2), which have been employed extensively in EEG-based BCI applications; for example, steady-state visual evoked potentials (SSVEPs) can be collected with the stimulus changing even at several tens of hertz, and thus an averaging window of just one second can provide a good SNR.
The response of interest typically has a limited spectral width, i.e., the response is confined to a certain frequency band. Since the spectra of the measured signals are nonzero at all frequencies due to external interference, intrinsic sensor noise, and background brain activity, filtering the measurement to the band of the response improves the SNR.
In addition to conventional spectral filtering, time-domain templates (template filters) can be used if the response or series of responses have a stereotypical waveform. The measured data and the template are convolved and the resulting time series thresholded to detect moments when the responses of interest are likely present in the data.
17.2.3 Filtering and Averaging in Space
The SNR of multichannel measurements can be improved also by spatial filtering, i.e., by linearly combining the measurement channels such that the result shows the maximal SNR for the signal of interest. Several approaches exist for deriving these linear combinations, that is, weighted sums of the measurement channels:
1.
Combination of a set of neighboring channels with uniform weights. This method is used mostly to reduce the effect of intrinsic sensor noise, and it is often referred to as “spatial averaging.” No detailed knowledge of the source of interest is utilized. To remove the dependence on the source orientation and guarantee constructive spatial averaging, absolute values (or norms of planar-gradiometer pairs) are often taken. However, since both operations are nonlinear, the frequency content and phase of the signal are not preserved.
2.
Applying machine-learning algorithms to determine projections such that the resulting signal is optimized for providing the feedback; for example, it best discriminates between attended and unattended stimuli. Both unsupervised methods, such as ICA, and supervised methods, such as linear discriminant analysis (LDA), can be used. In either case, no explicit source modeling is done.
3.
Projecting the data to the signal-space direction corresponding to a known source, yielding an estimate of the source time course. The direction must be known in advance or determined adaptively from the data. Possible additional simultaneous sources are not explicitly taken into account and they can thus interfere with the estimate. To allow for any source orientation at a specific location, the source signal vectors of orthogonal dipolar sources can be computed and the norm of the projection onto this subspace taken as an estimate of the source strength.
4.
Using beamforming techniques to explicitly suppress signals generated outside of the source area of interest. In addition to the source signal vector, an estimate of the data covariance must be available.
17.2.3.1 Challenges in Real-Time Implementations
In real-time analysis, utilizing a priori information can be difficult as that information often depends on the position of the head with respect to the MEG sensor array. This is particularly true for source signal vectors and data covariance. There is no corresponding problem in EEG since the electrodes are attached to the scalp according to, e.g., the international 10–20 system and thus their location with respect to the brain does not vary considerably even between measurement sessions. In MEG, this problem can be addressed in two ways that we discuss below.
A short “source localizer” measurement can be performed just prior to switching to the actual experiment. If the head position can be assumed not to vary between the localizer measurement and the experiment, the localizer provides the source signal vector and the data covariance matrix in the space that is readily applicable also during the experiment; the head position does not need to be determined and no data transformations are needed. However, the assumption of an immobile head may not be valid, particularly if the localizer measurement is time-consuming. Additionally, the a priori information does not generalize well across subjects.
Alternatively, the signal vectors corresponding to the sources of interest can be determined in a separate measurement, and either these signal vectors or the measured data can be transformed to a common head position during the actual real-time experiment. Such a transformation can be accomplished via a source model (e.g., based on equivalent current dipoles or a minimum-norm estimate [19]) or via a multipolar expansion bound to the head position [17, 20]. Both approaches require that the head position with respect to the sensors can be determined accurately. All modern MEG systems include such functionality for off-line source modeling and integration of the source estimates with structural information; however, the availability of head localization for online use is still limited.
Machine-learning methods require training data which need to be obtained during the measurement unless the learned model generalizes across subjects with the aid of the transformations described earlier for differing head positions.
17.2.4 Signals for Neurofeedback
The previous section described how to transform the multichannel MEG measurement to a small set of time series that optimally reflects the brain activity of interest. Similarly to EEG, several features of MEG signals can be used for neurofeedback. Here we outline the most common signal characteristics that can be extracted from the raw time series and potentially used to drive or modulate stimulation.
17.2.4.1 Evoked Responses
Sensory input, particularly its abrupt changes, elicits electromagnetic responses at multiple levels of the nervous system, from peripheral nerves to high-order cortical areas. The characteristics of these responses, including their susceptibility to modulation by the current “brain state,” have been studied extensively and they have shed light on many aspects of cortical sensory processing.