Skip to main content
Download PDF

Multimodal characterization of the semantic N400 response within a rapid evaluation brain vital sign framework

Journal of Translational Medicine volume 16, Article number: 151 (2018) Cite this article

Abstract

Background

For nearly four decades, the N400 has been an important brainwave marker of semantic processing. It can be recorded non-invasively from the scalp using electrical and/or magnetic sensors, but largely within the restricted domain of research laboratories specialized to run specific N400 experiments. However, there is increasing evidence of significant clinical utility for the N400 in neurological evaluation, particularly at the individual level. To enable clinical applications, we recently reported a rapid evaluation framework known as “brain vital signs” that successfully incorporated the N400 response as one of the core components for cognitive function evaluation. The current study characterized the rapidly evoked N400 response to demonstrate that it shares consistent features with traditional N400 responses acquired in research laboratory settings—thereby enabling its translation into brain vital signs applications.

Methods

Data were collected from 17 healthy individuals using magnetoencephalography (MEG) and electroencephalography (EEG), with analysis of sensor-level effects as well as evaluation of brain sources. Individual-level N400 responses were classified using machine learning to determine the percentage of participants in whom the response was successfully detected.

Results

The N400 response was observed in both M/EEG modalities showing significant differences to incongruent versus congruent condition in the expected time range (p < 0.05). Also as expected, N400-related brain activity was observed in the temporal and inferior frontal cortical regions, with typical left-hemispheric asymmetry. Classification robustly confirmed the N400 effect at the individual level with high accuracy (89%), sensitivity (0.88) and specificity (0.90).

Conclusion

The brain vital sign N400 characteristics were highly consistent with features of the previously reported N400 responses acquired using traditional laboratory-based experiments. These results provide important evidence supporting clinical translation of the rapidly acquired N400 response as a potential tool for assessments of higher cognitive functions.

Background

Measurements of brainwave activity through event-related potentials (ERPs) are becoming increasingly useful in providing objective, physiology-based measures of brain function [1]. ERPs are derived from electroencephalography (EEG), and can provide information about cortical electrical activity corresponding to different aspects of neural processing [2, 3]. In particular, higher order cognitive functions like semantic processing indexed by the N400 ERP are among the most promising responses for emerging clinical applications [4,5,6,7]. The N400 response was first described when Kutas and Hillyard presented participants with visual sentences that either had a semantically related (i.e. congruent) or semantically unrelated (i.e. incongruent) ending [8]. It was observed as a negative deflection of the incongruent relative to congruent condition waveforms which peaked at approximately 400 ms latency following stimulus presentation, and the authors suggested that this differential was a neural marker of semantic language processing.

In the 38 years since its initial report, the N400 response has been studied extensively using a variety of stimulus paradigms in various healthy and clinical populations [9,10,11,12,13,14]. While the initial N400 work utilized sentence-based stimuli, subsequent studies showed that prime-target word pairs also successfully elicited this response [15, 16]. Additionally, non-language-based stimuli such as mental arithmetic and action sequences have also been shown to produce the N400 response [17], and the strength of this response has been found to be correlated with various stimulus properties [18]. Others have demonstrated overlapping features in the temporal and spatial characteristics of the N400 response when elicited using language- as well as non-language-based stimuli [17], with the spectral content in particular demonstrating potential in distinguishing between different neural processes [19]. In fact, one of the key spectral features of the N400 response has been shown to be a reduction in beta band oscillations when processing incongruent relative to congruent stimuli in semantic language paradigms [20].

The cortical generators of the N400 response have been investigated using numerous noninvasive imaging modalities, such as functional magnetic resonance imaging (fMRI), electroencephalography (EEG), as well as magnetoencephalography (MEG). Results have revealed widespread cortical activations across the left temporal lobe, along with smaller areas of activity in the right temporal as well as bilateral inferior frontal and parietal regions [11, 21,22,23]. Specifically, areas of the bilateral temporal cortices (Brodmann Areas [BA] 20/21/22) and left inferior frontal gyrus (BA 45/47) have been shown to be key cortical regions within the distributed language network likely responsible for N400 [24], and these results are also supported by findings from lesion studies [25].

Further to its functional relevance as an indicator of neural processing in healthy individuals, the N400 response has also shown significant potential as a diagnostic and prognostic tool in clinical populations [4, 17, 26,27,28,29,30,31,32,33]. Studies in brain-injured patients with disorders of consciousness showed that the N400 response was correlated with functional recovery [4]. Moreover, changes in N400 response also predicted cognitive decline in patients as they progressed from mild cognitive impairment (MCI) to dementia [5, 31]. Yet despite these promising findings, the use of the N400 ERP beyond the research setting has been hindered by two main challenges: First, given that ERPs are produced by averaging the neural response signals across a large number of trials, traditional N400 studies require prolonged testing paradigms [1, 34]. These paradigms are particularly problematic in clinical populations due to fluctuations in vigilance levels and lack of capability or motivation [30, 35]. In addition, rather than measuring only a single brain response in clinical populations (e.g. sensation, attention, or language), there are now calls for concurrent evaluations of a spectrum of brain responses which provide a more complete profile of brain function [34]. This is particularly crucial in longitudinal monitoring of brain function changes in clinical populations [36]. Under these circumstances, the traditional ERP testing paradigms may require hours to evaluate, which is impractical within most clinical settings.

To assess the N400 response within a short testing time while providing information about other brain function indicators, our group has been undertaking systematic development of rapid evaluation techniques in recent years. We previously demonstrated the successful evaluation of the N400 response in 100 healthy individuals using a point-of-care enabled device [34], then employed this device to track the progress of rehabilitation therapy in a brain-injured patient [6]. More recently, we demonstrated a rapid evaluation platform known as the ‘brain vital sign’ framework [37], which enables the rapid assessment of several brain function indicators including the N400 (semantic language), N100 (sensory processing) [38] and P300 (attention orienting) [39]. The brain vital sign framework employs a portable, low-density EEG system, with automated, user-friendly software for easy clinical applications. The testing paradigm utilizes a short, 5-min auditory stimulus sequence in which tone and word stimuli are interlaced to maximize the number of trials and signal-to-noise ratio. Results in healthy adults showed that, not only were the target responses successfully elicited at the individual level, but the platform also captured expected age-related changes in attention and cognition that were undetected using conventional clinical screening measures [37].

Although the rapid evaluation brain vital sign framework showed initial promise as a potential avenue for clinical application of the N400 ERP, the component characteristics of this rapidly elicited N400 (rN400) response have not yet been described. Given the short, complex stimulus paradigm, it is crucial to characterize this response with respect to its spatiotemporal, spectral, and neuroanatomical features, and compare them with known N400 characteristics reported in studies using more conventional approaches over the last few decades.

The current study utilized MEG with simultaneous EEG to investigate the temporal, spatial, spectral, and neuroanatomical characteristics of the rN400 response elicited within the brain vital sign framework. We hypothesized that the rN400 response will exhibit features consistent with known characteristics of the N400 response, including: (1) increased ERP negativity and MEG signal power for the incongruent relative to congruent condition during the 300–500 ms post-stimulus interval; (2) decreased beta- band power for the incongruent relative to congruent condition during the same interval; and (3) increased activation of temporal and frontal cortices (BA 20, 21, 22, 45 and 47) for processing of incongruent relative to congruent stimuli.

Methods

Participant details

Seventeen (17) right-handed healthy participants with no history of neurological problems or psychoactive medication were recruited (22.6 ± 2.4 years, 10 males). Participants were undergraduate or graduate students, had normal hearing, normal or corrected-to-normal vision, and were fluent in English. The study was approved by ethics boards at Fraser Health Authority and Simon Fraser University, and all participants provided written informed consent.

Auditory stimuli

As introduced elsewhere [37], the rapid assessment framework utilizes a compressed auditory stimulus sequence with interlaced tones and words to elicit brain responses across four different functional domains—auditory sensation (N100 ERP), attention (P300 ERP), and semantic language (N400 ERP)—in approximately 5 min (Fig. 1). The sequence comprised 60 blocks, with each block containing five tones and two words representing a prime-target pair. Semantic language processing responses were derived from conditionally averaging the trials corresponding to the target word in the pair. Semantically linked words (congruent condition, 50%, e.g. doctor-nurse) were contrasted with words not semantically linked (incongruent condition, 50%, e.g. doctor-egg) to generate the differential processing measures. Words in both groups were balanced for characteristics such as word frequency and length, and the words in the semantically linked group had a minimum Cloze probability of 0.8 [40]. The stimuli were recorded in a male voice and root-mean-square normalized using Audacity software. The stimulus sequence contained 30 trials each of the congruent and incongruent conditions.

Fig. 1
figure 1

Illustration of auditory stimulus sequence of the brain vital sign framework. Blocks of five tones and two words repeated 60 times for a total scan time of about 5 min. Words represent prime-target pairs, containing both semantic congruent (pink–orange) and incongruent (pink–blue) pairs. Tones (standard = green and deviant = black) elicit sensory (N100) and attention (P300) measures

Full size image

MEG and EEG data acquisition

A 151-channel CTF MEG (MEG International Services Limited, Canada) was used with concurrent 3-channel EEG, both recorded in a magnetically shielded room with the participants in the supine position. Data were sampled at 1200 Hz using axial gradiometers (5-cm baseline) with synthetic 3rd order gradients employed for noise cancellation. Continuous head position monitoring was undertaken by three head position indicator coils located at fiducial points (HPI, positioned at nasion, left and right pre-auricular points). EEG recordings utilized Ag/AgCl scalp electrodes placed at Fz, Cz and Pz locations, with impedances kept below 5 kOhms. Four additional electrodes were placed on the head corresponding to reference (left mastoid), ground (forehead), horizontal (outer canthus of left eye) and vertical (supra-orbital ridge of left eye) electro-occulogram (EOG). To facilitate the alignment of MEG scanner and head coordinate systems, the shape of the participants’ head and the 3-dimensional position of HPI coils and EEG/EOG electrodes were recorded using a Polhemus electromagnetic digitization system prior to data collection (Polhemus Incorporated, USA). Auditory stimulation was presented binaurally using insert earphones, and participants were instructed to maintain visual fixation on a crosshair displayed on the overhead screen (white cross on black background) throughout the session.

Data preprocessing

Raw data for both MEG and EEG were first visually inspected, and artifactual channels removed from further analysis. Data were then down-sampled to 300 Hz, notch filtered to remove frequencies corresponding to power line (60 Hz) with its harmonics as well as HPI coils, and low-pass filtered to 100 Hz. Data from 2 of the 17 participants were excluded from subsequent analysis due to poor quality.

MEG analysis

Following band-pass filtering (0.5–45 Hz), independent component analysis (ICA) was performed with runica algorithm in EEGLAB [41] in order to remove artifact from ocular, cardiac, and muscular sources.

Temporal effects

Since head position within the MEG helmet can vary across participants, global field power (GFP) was utilized to provide a measure of the overall activity across all channels [42]. Individual-level GFP was computed for the congruent and incongruent conditions using trial-averaged event-related fields. A bootstrapping approach was utilized to determine time intervals of significant difference between conditions, in which the GFP signals at each time point were permuted between the congruent and incongruent conditions across all subjects [43]. Using this approach, the interval of significance was identified to be 300–500 ms and used as the window of interest in subsequent analyses, consistent with prior literature [44, 45]. The mean GFP value in this time interval was then calculated for each condition (congruent and incongruent) and participant, and compared using paired t test at the group level.

Spectral effects

Sensor level time–frequency analysis was undertaken by convolution of the data with Morlet wavelets (6 cycles) using the continuous wavelet transform function in MATLAB (The Mathworks Inc., USA). The coefficients corresponding to 0.5–45 Hz frequency in the − 200 to 900 ms time window relative to stimulus onset were extracted, and log power was computed as the square of the absolute value of the coefficients. To better understand the event-related spectral changes, the mean log power in the baseline period (− 100 to 0 ms) was subtracted from the log power in the post-stimulus period for every trial within the frequency band. Significance was assessed using a bootstrapping approach by permuting the trial-averaged wavelet power in the congruent and incongruent conditions across participants in each frequency [43]. This entailed the calculation of T-statistic for each time point and frequency between the congruent and incongruent conditions in the 800 ms following stimulus presentation. Thereafter, 1000 permutations were undertaken and new T-statistic calculated for every permutation leading to a null distribution against which the significance of the true T-statistic was assessed (with p < 0.05 considered to be significant).

Neuroanatomical effects

Source level analysis was performed using SPM8 (Welcome Trust Centre for Neuroimaging, UK) with the forward and inverse modeling steps elaborated in previously published work [46]. Source analysis for localizing neural generators of the semantic language process was undertaken using minimum norm estimates (MNE) to maintain consistency with prior N400 studies in MEG [24, 44]. Group constraints were employed during inversion [47], and source reconstruction was based on trial-averaged data within the entire frequency range (0.5–45 Hz) and active epoch (0–900 ms relative to stimulus presentation). Source-level contrast images were derived using data in the 0.5–45 Hz frequency range and previously identified window of 300–500 ms. Statistical modeling employed a general linear model (GLM) with T-contrasts [48].

EEG analysis

To facilitate future translation into point-of-care enabled platforms, concurrently collected EEG data were also analyzed to extract ERPs. Contamination from ocular sources was removed from the EEG signal using an adaptive filtering approach [49]. For this process, the recorded EOG signals were used as reference inputs and processed using finite impulse response filters (m = 3), followed by recursive least squares-based removal from the EEG signal (λ = 0.9999). Subsequent to artifact removal, standard analysis steps including filtering (1–10 Hz), segmentation (− 200 to 900 ms) and conditional averaging were undertaken to generate ERPs [1, 2]. The mean value of the ERP waveform at the Cz electrode site in the 300–500 ms time interval was calculated for each condition and participant, and compared using paired t test at the group level.

Individual-level analysis

To evaluate reliability of the rN400 ERP at the individual level, a machine learning-based approach was undertaken using a two-category support vector machine (SVM) classifier following previously published methods [37, 50]. Briefly, an SVM classifier with a radial kernel was trained to distinguish between the congruent and incongruent condition waveforms using single-run, trial-averaged data from all three electrode sites. During each session, 90% of the available data were randomly selected to train the classifier, while the remaining 10% were used for testing classification accuracy. This procedure was repeated 10 times under tenfold cross-validation, such that the classifier was trained and tested on all available data. Results were averaged across all sessions, and measures were derived from the confusion matrix corresponding to accuracy, sensitivity, and specificity. To further assess the reliability of the analysis, results were verified using non-parametric permutation statistics [34, 51]. In short, this involved randomly redistributing the congruent and incongruent class labels among all datasets and performing the same classification procedures. This process was repeated 1000 times, and the resulting accuracies were used to create a null distribution against which the true classification accuracy was compared. Probabilities less than 0.05 were deemed to be significant for SVM classification outcome.

Results

Temporal and spectral effects in MEG

Sensor-level GFP demonstrated differential processing of the target word depending upon whether they were semantically related (congruent condition) or semantically unrelated (incongruent condition) to the first word. In particular, in the 300–500 ms post-stimulus interval, there was increased power for the incongruent relative to congruent condition (p < 0.05, Fig. 2a, b). In addition, the processing of incongruent words resulted in a significant reduction in beta band power relative to the processing of congruent words (p < 0.05, Fig. 2c). This decrease was observed in the 335–440 ms time interval, overlapping in time with the N400 response. Although there appeared to be some differences also present in other frequency bands, none of them were statistically significant.

Fig. 2
figure 2

Sensor-level MEG results showing differential processing in incongruent compared to congruent condition. a Grand-averaged GFP demonstrating increased power for incongruent relative to congruent condition. Shaded region denotes window of interest (300–500 ms). b Mean GFP averaged across the time window specified in part A, calculated for each subject and presented as mean ± SEM across subjects. *p < 0.05. c Time–frequency wavelet spectral power averaged over all MEG channels. Colour bar represents log power values

Full size image

Temporal effects in EEG

ERP waveforms exhibited greater negativity in the incongruent relative to congruent condition occurring within the 300–500 ms interval, which was maximal at the Pz electrode (p < 0.05, Fig. 3a–c). The trained SVM classifier successfully distinguished between the congruent and incongruent conditions with 88.89% accuracy, 88% sensitivity, and 90% specificity. All classification results were verified to be statistically significant through permutation analysis (p < 0.05).

Fig. 3
figure 3

ERP results demonstrating differential processing of semantic congruence and incongruence. a–c Grand-averaged ERP waveforms at the Fz, Cz, and Pz electrode sites, respectively. Shaded regions denote windows of interest (300–500 ms). d Mean ERP amplitudes averaged over the windows of interest, calculated for each subject and presented as Mean ± SEM across subjects. *p < 0.05

Full size image

Neuroanatomical effects in MEG

Differential processing of incongruent words was source-localized to the inferior frontal, inferior parietal, and temporal regions (incongruent > congruent contrast, p < 0.005, k = 20). Key areas included left inferior, middle and superior temporal gyri (BA 20, 21 and 22) and regions encompassing both the anterior and posterior portions of the left inferior frontal gyrus (BA 45, 47). Additionally, areas of the right temporal and inferior frontal gyri were also activated. In comparison, no suprathreshold clusters were observed for the reverse contrast of congruent > incongruent (Fig. 4 bottom panel).

Fig. 4
figure 4

Source localization results. Top: Incongruent word processing activates a left-lateralized distributed region of cortex including temporal, inferior frontal and inferior parietal areas (incongruent > congruent contrast, p < 0.005unc.). Bottom: No suprathreshold clusters were identified for the reverse contrast (congruent > incongruent). Color bar represents T-statistic values

Full size image

Discussion

Main findings

This study employed MEG with concurrent EEG to investigate the temporal, spectral, and neuroanatomical characteristics of the rapidly elicited N400 response (rN400) generated through the brain vital sign framework. Using a compressed auditory stimulus sequence comprising both tones and prime-target word pairs, we demonstrated that the resulting rN400 response exhibited features consistent with characteristics previously reported for the N400 response in semantic language paradigms [17, 18]. In particular, we found that: (1) the sensor-level temporal characteristics showed rN400 ERP in the incongruent relative to congruent condition, peaking approximately 300–500 ms after stimulus presentation and with concomitant changes in GFP (Hypothesis 1); (2) a significant decrease in beta-band spectral power was observed during the same interval in the incongruent relative to congruent condition (Hypothesis 2); and (3) source localization analysis showed that rN400 processes activated cortical regions spanning the temporal, inferior frontal, and parietal regions known to be associated with the N400 response (Hypothesis 3). These main findings are summarized in Table 1.

Table 1 Comparison of the features of interest between the N400 response elicited using traditional approaches and the rN400 response elicited under the rapid assessment brain vital sign framework
Full size table

Hypothesis 1: temporal effects

The sensor-level temporal effects showed a robust rN400 ERP for processing the incongruent relative to the congruent words (Fig. 3), consistent with previous findings based on sentences and semantic prime-target word pairs within auditory and visual modalities [17]. The response in the present study was observed to be maximal at the parietal (Pz) electrode location, also consistent with prior works suggesting a centro-parietal scalp distribution for the N400 ERP [9]. Importantly, these findings were also supported by our concurrent results using MEG which measures the magnetic counterpart of the rN400 ERP. Results showed that sensor-level GFP exhibited increased activity in the incongruent relative to congruent condition, peaking at similar latencies relative to rN400 ERP (Fig. 2a, b). It is important to note that polarity differences between the two modalities may be accounted for given that GFP is a power measure and is thus always non-negative, whereas ERP can be either positive or negative.

While the present study targeted the semantic processing effect indexed by the N400 and accordingly focused on the 300–500 ms window of interest to be concordant with previous literature [18, 44], other temporal differences between the two conditions were also present at earlier latencies within the ERP/ERF traces. These effects may be related to processes in support of semantic language comprehension such as phonological matching [52], letter-string processing [45] or detection of mismatch based on predicted input [53]. These earlier effects may be further explored in future studies.

Hypothesis 2: spectral effects

Time–frequency results demonstrated a significant decrease in beta band power in the incongruent condition relative to the congruent (Fig. 2c). These spectral changes occurred over the same time interval as the rN400 response, and provide further confirmatory evidence of the processing differences between the two conditions. A previous MEG study reported similar beta-band power reductions, and source-localized this effect to the left inferior frontal gyrus and temporal regions, with the authors postulating that the observed N400 effects may have represented a dynamic communication link between these regions [20]. Additionally, beta band power suppression has also previously been associated with increased level of cortical processing across a diverse range of experimental paradigms, such as motor movement [54], working memory [55] and information retrieval [56]. In light of these findings, the reduction in beta band power observed in the current study may be interpreted as a potential reflection of increased processing for the incongruent relative to congruent conditions within the relevant brain regions. It should also be noted that, although reduced power is visually observed for the theta frequency band in the current study, this effect was not statistically significant.

Hypothesis 3: neuroanatomical effects

Our results showed left-lateralized activations in the temporal cortices (BA 20, 21, 22) as well as inferior frontal gyri (BA 44, 45) (Fig. 4 upper panel). This is in agreement with prior works using fMRI and EEG, confirming the left temporal lobe as the largest source of the N400 effect, with a smaller contribution from the right temporal areas [21]. In addition, other EEG based works have identified contributions from the left perisylvian cortex [11], and bilateral inferior frontal gyri [22]. MEG based source localization has largely confirmed these findings, and suggested contributions from cortical areas including the left superior and middle temporal gyri as well as the inferior parietal and frontal areas [23, 44]. The converging neuroimaging results and theoretical models [9, 57, 58] have led to increasing consensus that semantic language processing is supported by a left lateralized network of brain regions [9, 24, 44]. Our results are consistent with these previous findings, as more left-lateralized activations were observed in both the temporal and inferior frontal regions. In addition to the left hemisphere activity, the right hemisphere activations observed in the current study were also in line with other studies using auditory stimuli [59].

The lack of suprathreshold clusters in the congruent > incongruent contrast (Fig. 4 lower panel) is also consistent with previous literature. MEG studies of N400 have shown largely overlapping areas of activation in both congruent and incongruent conditions, with greater extent of activations in the incongruent condition due to increased demands associated with incongruent stimulus [24]. Similarly, fMRI results showed increased hemodynamic activity for the incongruent condition compared to congruent [21]. Together, these hemodynamic and electromagnetic results support our findings regarding lack of suprathreshold clusters in the congruent > incongruent contrast.

Clinical implications

Beyond the extensive laboratory based evaluations of N400, clinical applications are increasingly utilizing the N400 response in a variety of patient populations. The N400 is being particularly studied in disorders of consciousness (DOC) as a potential marker of residual functional integrity as well as for tracking rehabilitation progress. Beukema and colleagues reported the importance of including N400 in assessments of DOC patients [7], while Steppacher et al. demonstrated the N400 as a crucial tool for assessing information processing abilities that are predictive of eventual recovery in DOC patients [4]. Similarly, the N400 response has also been utilized to track rehabilitation progress in traumatic brain injury [6] and for assessments of stroke patients [28]. Moreover, the N400 response has been found to be abnormal in Alzheimer’s disease [60], and was identified as a promising marker in differentially identifying MCI patients who may transition to dementia [5]. These demonstrations in clinical populations, combined with the excellent reliability and stability of N400 effects [61] provide an impetus for clinical integration of this promising response. The present study makes N400 assessments clinically accessible by balancing the need for rapid assessments in clinical settings with the inherent desire for high quality data while retaining the key known features of the N400 response. Our results demonstrated that the rapidly elicited N400 response through the brain vital sign framework exhibit many of the similar characteristics compared to traditional N400 paradigms [9, 17, 62].

Additionally, the robust identification of the N400 effect at the individual level using automated expert-independent machine learning approaches provides additional support for clinical application of this rapid assessment technique. The 89% hit rate in the present study is quite comparable to previous reports—with prior machine learning based analysis reporting results in the 86–92% range [34, 37] and other analytical techniques also reporting observable N400 effects in similar proportions of healthy participants [7, 30].

Caveats

Despite the promising findings in this study, two main limitations should also be noted. As this is the first study characterizing the rapidly elicited rN400 response within the brain vital sign framework, the focus was on examining its spatiotemporal and neuroanatomical effects and comparing them with known features of the traditional N400 response. However, given the myriad of language- and non-language-based experimental paradigms in which the N400 response has previously been described, it is not feasible to compare the rN400 response to every other traditional paradigm in one study. Rather, the current study focused on comparisons with language-based paradigms, and utilized response features and characteristics that have been identified as commonalities across different studies in order to account for variable modalities and experimental parameters (e.g. experimental condition, stimulus duration and type, inter-stimulus interval) [9, 17, 62]. Nonetheless, future studies may be conducted to examine more detailed comparisons between the brain vital sign rN400 response and traditional N400 responses. Additionally, as the first study of rN400 response, the current study utilized a distributed source modeling approach for source localization to be consistent with previous MEG studies of N400 [24, 44]. However, given the inherent limitations of this approach in biasing sources towards the cortical surface, future studies are needed to confirm these results using alternate source localization techniques such as spatial filtering using beamformer [63].

Conclusion

In this study, we investigated the spatiotemporal and neuroanatomical features of the N400 response as elicited by the rapid assessment brain vital signs framework. Using both MEG and EEG, our results showed that the rapidly elicited N400 response exhibits characteristics consistent with those reported in traditional semantic language-based N400 paradigms. These characteristics include temporal features showing maximal response within 300–500 ms latency; topographic scalp distribution demonstrating maximal response at the posterior Pz electrode; spectral effects showing reduction in beta band power; and source localization to left-lateralized temporal and inferior frontal areas. With the increasing use of the N400 response in patient assessments for neurological conditions such as dementia and traumatic brain injury, the convergent M/EEG results of the current study provide further support for the possibility of translating the N400 response from research to clinical settings through a rapid assessment framework for evaluating cognitive functions.

Abbreviations

ERP:

event related potential

MEG:

magnetoencephalography

BA:

brodmann area

rN400:

rapidly elicited N400

GFP:

global field power

GLM:

general linear model

IFG:

inferior frontal gyrus

TL:

temporal lobe

EEG:

electroencephalography

fMRI:

functional magnetic resonance imaging

MCI:

mild cognitive impairment

ICA:

independent component analysis

MNE:

minimum norm estimate

SVM:

support vector machine

IPL:

inferior parietal lobule

DOC:

disorders of consciousness

References

  1. Luck SJ. An introduction to the event-related potential technique. Cambridge: MIT Press; 2014.

    Google Scholar 

  2. Gawryluk JR, D’Arcy RCN. Electroencephalography: basic concepts and brain applications. In: Handbook of physics in medicine and biology. New York: CRC Press; 2010. pp. 24-1–14.

    Chapter  Google Scholar 

  3. Duncan CC, et al. Event-related potentials in clinical research: guidelines for eliciting, recording, and quantifying mismatch negativity, P300, and N400. Clin Neurophysiol. 2009;120(11):1883–908.

    Article  PubMed  Google Scholar 

  4. Steppacher I, Eickhoff S, Jordanov T, Kaps M, Witzke W, Kissler J. N400 predicts recovery from disorders of consciousness. Ann Neurol. 2013;73(5):594–602.

    Article  PubMed  Google Scholar 

  5. Olichney JM, Yang JC, Taylor J, Kutas M. Cognitive event-related potentials: biomarkers of synaptic dysfunction across the stages of Alzheimer’s disease. J Alzheimers Dis. 2011;26(Suppl 3):215–28.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Fleck-Prediger C et al. Clinical applications of the Halifax consciousness scanner: tracking recovery in a severely brain injured patient. ​International Brain Injury Association, International NeuroTrauma Letter, 2015. http://www.internationalbrain.org/articles/int-issue-37/

  7. Beukema S, et al. A hierarchy of event-related potential markers of auditory processing in disorders of consciousness. NeuroImage Clin. 2016;12:359–71.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Kutas M, Hillyard SA. Reading senseless sentences: brain potentials reflect semantic incongruity. Science. 1980;207(4427):203–5.

    Article  PubMed  CAS  Google Scholar 

  9. Lau EF, Phillips C, Poeppel D. A cortical network for semantics:(de) constructing the N400. Nat Rev Neurosci. 2008;9(12):920–33.

    Article  PubMed  CAS  Google Scholar 

  10. Connolly JF, Phillips NA, Stewart SH, Brake WG. Event-related potential sensitivity to acoustic and semantic properties of terminal words in sentences. Brain Lang. 1992;43(1):1–18.

    Article  PubMed  CAS  Google Scholar 

  11. D’Arcy RCN, Connolly JF, Service E, Hawco CS, Houlihan ME. Separating phonological and semantic processing in auditory sentence processing: a high-resolution event-related brain potential study. Hum Brain Mapp. 2004;22(1):40–51.

    Article  PubMed  Google Scholar 

  12. D’Arcy RCN, Service E, Connolly JF, Hawco CS. The influence of increased working memory load on semantic neural systems: a high-resolution event-related brain potential study. Cognit Brain Res. 2005;22(2):177–91.

    Article  Google Scholar 

  13. Holcomb PJ, Neville HJ. Auditory and visual semantic priming in lexical decision: a comparison using event-related brain potentials. Lang Cognit Process. 1990;5(4):281–312.

    Article  Google Scholar 

  14. Neville HJ, Mills DL, Lawson DS. Fractionating language: different neural subsystems with different sensitive periods. Cereb Cortex (New York, NY, 1991). 1992;2(3):244–58.

    Article  CAS  Google Scholar 

  15. Bentin S, McCarthy G, Wood CC. Event-related potentials, lexical decision and semantic priming. Electroencephalogr Clin Neurophysiol. 1985;60(4):343–55.

    Article  PubMed  CAS  Google Scholar 

  16. Rugg MD. The effects of semantic priming and word repetition on event-related potentials. Psychophysiology. 1985;22(6):642–7.

    Article  PubMed  CAS  Google Scholar 

  17. Kutas M, Federmeier KD. Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). Annu Rev Psychol. 2011;62:621–47.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Kutas M, Federmeier KD. Electrophysiology reveals semantic memory use in language comprehension. Trends Cognit Sci. 2000;4(12):463–70.

    Article  CAS  Google Scholar 

  19. Roehm D, Bornkessel-Schlesewsky I, Schlesewsky M. The internal structure of the N400: frequency characteristics of a language related ERP component. In: Chaos and complexity letters, vol. 2; 2007. pp. 365–95.

  20. Wang L, et al. Beta oscillations relate to the N400 m during language comprehension. Hum Brain Mapp. 2012;33(12):2898–912.

    Article  PubMed  Google Scholar 

  21. Van Petten C, Luka BJ. Neural localization of semantic context effects in electromagnetic and hemodynamic studies. Brain Lang. 2006;97(3):279–93.

    Article  PubMed  Google Scholar 

  22. Haan H, Streb J, Bien S, Rösler F. Individual cortical current density reconstructions of the semantic N400 effect: using a generalized minimum norm model with different constraints (L1 and L2 norm). Hum Brain Mapp. 2000;11(3):178–92.

    Article  PubMed  CAS  Google Scholar 

  23. Helenius P, Salmelin R, Service E, Connolly JF, Leinonen S, Lyytinen H. Cortical activation during spoken-word segmentation in nonreading-impaired and dyslexic adults. J. Neurosci. 2002;22(7):2936–44.

    Article  PubMed  CAS  Google Scholar 

  24. Maess B, Herrmann CS, Hahne A, Nakamura A, Friederici AD. Localizing the distributed language network responsible for the N400 measured by MEG during auditory sentence processing. Brain Res. 2006;1096(1):163–72.

    Article  PubMed  CAS  Google Scholar 

  25. Dronkers NF, Wilkins DP, Van Valin RD, Redfern BB, Jaeger JJ. Lesion analysis of the brain areas involved in language comprehension. Cognition. 2004;92(1):145–77.

    Article  PubMed  Google Scholar 

  26. Balconi MFAU, Arangio RFAU, Guarnerio C. Disorders of consciousness and N400 ERP measures in response to a semantic task. J Neuropsychiatry Clin Neurosci. 2013;25:237.

    Article  PubMed  Google Scholar 

  27. Connolly JF, D’Arcy RCN. Innovations in neuropsychological assessment using event-related brain potentials. Int J Psychophysiol. 2000;37(1):31–47.

    Article  PubMed  CAS  Google Scholar 

  28. D’Arcy RCN, et al. Electrophysiological assessment of language function following stroke. Clin Neurophysiol. 2003;114(4):662–72.

    Article  PubMed  Google Scholar 

  29. Marchand Y, D’Arcy RCN, Connolly JF. Linking neurophysiological and neuropsychological measures for aphasia assessment. Clin Neurophysiol. 2002;113(11):1715–22.

    Article  PubMed  Google Scholar 

  30. Neumann N, Kotchoubey B. Assessment of cognitive functions in severely paralysed and severely brain-damaged patients: neuropsychological and electrophysiological methods. Brain Res Protoc. 2004;14(1):25–36.

    Article  Google Scholar 

  31. Olichney JM, et al. Patients with MCI and N400 or P600 abnormalities are at very high risk for conversion to dementia. Neurology. 2008;70(19 Pt 2):1763–70.

    Article  PubMed  CAS  Google Scholar 

  32. Wang K, Cheung EFC, Gong Q, Chan RCK. Semantic processing disturbance in patients with schizophrenia: a meta-analysis of the N400 component. PLoS ONE. 2011;6(10):e25435.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  33. Wilson KR, O’Rourke H, Wozniak LA, Kostopoulos E, Marchand Y, Newman AJ. Changes in N400 topography following intensive speech language therapy for individuals with aphasia. Brain Lang. 2012;123(2):94–103.

    Article  PubMed  Google Scholar 

  34. Sculthorpe-Petley L, et al. A rapid event-related potential (ERP) method for point-of-care evaluation of brain function: development of the Halifax Consciousness Scanner. J Neurosci Methods. 2015;245:64–72.

    Article  PubMed  Google Scholar 

  35. Wang JT, Young GB, Connolly JF. Prognostic value of evoked responses and event-related brain potentials. Can J Neurol Sci. 2004;31(4):438–50.

    Article  PubMed  Google Scholar 

  36. Sergent C, et al. Multidimensional cognitive evaluation of patients with disorders of consciousness using EEG: a proof of concept study. NeuroImage Clin. 2016;13:455–69.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Ghosh Hajra S, et al. Developing brain vital signs: initial framework for monitoring brain function changes over time. Front Neurosci. 2016;10:211.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Davis PA. Effects of acoustic stimuli on the waking human brain. J Neurophysiol. 1939;2(6):494–9.

    Article  Google Scholar 

  39. Sutton S, Tueting P, Zubin J, John ER. Information delivery and the sensory evoked potential. Science. 1967;155(3768):1436–9.

    Article  PubMed  CAS  Google Scholar 

  40. Taylor WL. ‘Cloze procedure’: a new tool for measuring readability. J Bull. 1953;30(4):415–33.

    Google Scholar 

  41. Delorme A, Makeig S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J Neurosci Methods. 2004;134(1):9–21.

    Article  PubMed  Google Scholar 

  42. Skrandies W. Global field power and topographic similarity. Brain Topogr. 1990;3(1):137–41.

    Article  PubMed  CAS  Google Scholar 

  43. Maris E, Oostenveld R. Nonparametric statistical testing of EEG-and MEG-data. J Neurosci Methods. 2007;164(1):177–90.

    Article  PubMed  Google Scholar 

  44. Halgren E, et al. N400-like magnetoencephalography responses modulated by semantic context, word frequency, and lexical class in sentences. Neuroimage. 2002;17(3):1101–16.

    Article  PubMed  Google Scholar 

  45. Pylkkänen L, Marantz A. Tracking the time course of word recognition with MEG. Trends Cognit Sci. 2003;7(5):187–9.

    Article  Google Scholar 

  46. Liu CC, Ghosh Hajra S, Cheung TPL, Song X, D’Arcy RCN. Spontaneous blinks activate the precuneus: characterizing blink-related oscillations using magnetoencephalography. Front Hum Neurosci. 2017;11:489.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Litvak V, Friston K. Electromagnetic source reconstruction for group studies. Neuroimage. 2008;42(4):1490–8.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Friston KJ, Holmes AP, Worsley KJ, Poline J, Frith CD, Frackowiak RSJ. Statistical parametric maps in functional imaging: a general linear approach. Hum Brain Mapp. 1994;2(4):189–210.

    Article  Google Scholar 

  49. He P, Wilson G, Russell C. Removal of ocular artifacts from electro-encephalogram by adaptive filtering. Med Biol Eng Comput. 2004;42(3):407–12.

    Article  PubMed  CAS  Google Scholar 

  50. Parvar H, Sculthorpe-Petley L, Satel J, Boshra R, D’Arcy RCN, Trappenberg TP. Detection of event-related potentials in individual subjects using support vector machines. Brain Inform. 2014;2(1):1–12.

    Article  PubMed  PubMed Central  Google Scholar 

  51. P. Golland, B. Fischl. Permutation tests for classification: towards statistical significance in image-based studies. In: Biennial international conference on information processing in medical imaging. Berlin: Springer; 2003 pp. 330–341

  52. Connolly JF, Phillips NA. Event-related potential components reflect phonological and semantic processing of the terminal word of spoken sentences. J Cognit Neurosci. 1994;6(3):256–66.

    Article  CAS  Google Scholar 

  53. Dikker S, Rabagliati H, Farmer TA, Pylkkanen L. Early occipital sensitivity to syntactic category is based on form typicality. Psychol Sci. 2010;21(5):629–34.

    Article  PubMed  Google Scholar 

  54. Alegre M, Gurtubay IG, Labarga A, Iriarte J, Malanda A, Artieda J. Alpha and beta oscillatory changes during stimulus-induced movement paradigms: effect of stimulus predictability. NeuroReport. 2003;14(3):381–5.

    Article  PubMed  Google Scholar 

  55. Tallon-Baudry C. Oscillatory synchrony and human visual cognition. J Physiol. 2003;97(2):355–63.

    Google Scholar 

  56. Pesonen M, Björnberg CH, Hämäläinen H, Krause CM. Brain oscillatory 1–30 Hz EEG ERD/ERS responses during the different stages of an auditory memory search task. Neurosci Lett. 2006;399(1):45–50.

    Article  PubMed  CAS  Google Scholar 

  57. Friederici AD. Towards a neural basis of auditory sentence processing. Trends Cognit Sci. 2002;6(2):78–84.

    Article  Google Scholar 

  58. Hickok G, Poeppel D. Neural basis of speech perception. Hum Audit Syst Fundam Org Clin Disord. 2015;129:149–60.

    Google Scholar 

  59. Friederici AD, Ruschemeyer SA, Hahne A, Fiebach CJ. The role of left inferior frontal and superior temporal cortex in sentence comprehension: localizing syntactic and semantic processes. Cereb Cortex (New York, NY, 1991). 2003;13(2):170–7.

    Article  Google Scholar 

  60. Ford JM, et al. N400 evidence of abnormal responses to speech in Alzheimer’s disease. Electroencephalogr Clin Neurophysiol. 1996;99(3):235–46.

    Article  PubMed  CAS  Google Scholar 

  61. Kiang M, Patriciu I, Roy C, Christensen BK, Zipursky RB. Test–retest reliability and stability of N400 effects in a word-pair semantic priming paradigm. Clin Neurophysiol. 2013;124(4):667–74.

    Article  PubMed  Google Scholar 

  62. Lau EF, Weber K, Gramfort A, Hämäläinen MS, Kuperberg GR. Spatiotemporal signatures of lexical-semantic prediction. Cereb Cortex. 2016;26(4):1377–87.

    Article  PubMed  Google Scholar 

  63. Hillebrand A, Barnes GR. Beamformer analysis of MEG data. Int Rev Neurobiol. 2005;68:149–71.

    Article  PubMed  Google Scholar 

Download references

Author contributions

Conceptualization and study design: SGH, CL, and RD. Literature search: SGH, CL, and RD. Data collection: SGH, CL, SF, and TC. Analysis planning: SGH and CL. Data analysis: SGH and CL. Result presentation: SG, CL, and RD. Analysis outcome verification: SG, CL, XS, and RD. Result interpretation: All authors. Manuscript preparation: SG, CL, and RD. Critical editing and approval of submission: All authors. All authors read and approved the final manuscript.

Acknowledgements

The authors would like to acknowledge the volunteers for their participation in the study. We also thank Matt Courtemanche for assistance with data collection as well as Mary-Carmen Graham and Qun Gao for administrative and technical support.

Competing interests

Some authors are associated with HealthTech Connex Inc. This may qualify them to financially benefit from the commercialization of the NeuroCatch™ platform capable of measuring brain vital signs.

Availability of data and materials

The data that support the findings of this study are available from the corresponding author upon reasonable request.

Consent for publication

Not applicable.

Ethics approval and consent to participate

The study was approved by ethics boards at Fraser Health Authority and Simon Fraser University, and all participants provided written informed consent.

Funding

This work was partly supported by a grant from Mathematics of Information Technology And Complex Systems (MITACS, grant #IT03240). This study was also supported by a grant from the Surrey Memorial Hospital Foundation and a grant from Natural Sciences and Engineering Research Council (NSERC, grant # RGPIN-2015-04018), awarded to TC. SGH was supported by the Multi-Year Funding scholarship from Simon Fraser University and CL holds a Canadian Institutes of Health Research (CIHR) CGS Doctoral scholarship (grant # GSD-140381).

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Author information

Authors and Affiliations

  1. Faculty of Applied Science, Simon Fraser University, Burnaby, BC, Canada

    Sujoy Ghosh Hajra, Careesa C. Liu, Xiaowei Song, Shaun D. Fickling, Teresa P. L. Cheung & Ryan C. N. D’Arcy

  2. Health Science and Innovation, Surrey Memorial Hospital, Fraser Health Authority, Surrey, BC, Canada

    Xiaowei Song, Teresa P. L. Cheung & Ryan C. N. D’Arcy

  3. HealthTech Connex Inc, Surrey, BC, Canada

    Ryan C. N. D’Arcy

  4. Surrey NeuroTech Lab, Surrey Memorial Hospital, 13750 96 Avenue, Surrey, BC, V3V 1Z2, Canada

    Sujoy Ghosh Hajra, Careesa C. Liu, Shaun D. Fickling & Ryan C. N. D’Arcy

  5. ImageTech Lab, Surrey Memorial Hospital, 13750 96 Av, Surrey, BC, V3V 1Z2, Canada

    Xiaowei Song, Teresa P. L. Cheung & Ryan C. N. D’Arcy

Authors
  1. Sujoy Ghosh Hajra
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Careesa C. Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiaowei Song
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Shaun D. Fickling
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Teresa P. L. Cheung
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Ryan C. N. D’Arcy
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ryan C. N. D’Arcy.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ghosh Hajra, S., Liu, C.C., Song, X. et al. Multimodal characterization of the semantic N400 response within a rapid evaluation brain vital sign framework. J Transl Med 16, 151 (2018). https://doi.org/10.1186/s12967-018-1527-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12967-018-1527-2

Keywords

Journal of Translational Medicine

ISSN: 1479-5876

Contact us