As Chronic Fatigue Syndrome (CFS) has been known to follow Epstein-Bar virus (EBV) and other systemic infections; our objective was to describe differences in immune activation in post-infective CFS (PI-CFS) patients and recovered controls. We studied 301 adolescents prospectively over 24 months following the diagnosis of monospot-positive infectious mononucleosis (IM). We found an incidence of CFS at 6, 12 and 24 months of 13%, 7% and 4% respectively.
Methods
Using chemiluminescent imaging we measured the concentrations of IL-1a, 1b, 2, 4, 5, 6, 8, 10, 12 (p70), 13, 15, 17 and 23, IFN-γ, TNF-α and TNF-β in duplicate plasma samples available in bio-bank from 9 PI-CFS subjects and 12 recovered controls at 24 months post-infection.
Results
Standard comparative analysis indicated significant differences in IL-8 and 23 across subject groups. In constructing a linear classification model IL-6, 8 and 23 were selected by two different statistical approaches as discriminating features, with IL-1a, IL-2 and IFN-γ also selected in one model or the other. This supported an assignment accuracy of better than 80% at a confidence level of 0.95 into PI-CFS versus recovered controls.
Conclusion
These results suggest that co-expression patterns in as few as 5 cytokines associated with Th17 function may hold promise as a tool for the diagnosis of post-infectious CFS.
Keywords
CytokinesInfectious mononucleosisChronic fatigueClassification model
Background
Chronic Fatigue Syndrome (CFS) is a complex and poorly understood illness that affects between 1 and 4 million individuals [1, 2] and costs an estimated $35 billion per year in lost productivity and health care [3, 4]. Persistent and unexplained fatigue has been observed as a sequela of acute infection since the first half of the 20th century and the period’s notable outbreaks of infectious disease (e.g., polio epidemics, influenza pandemics). From 1934 to 1984, there were several reports of infectious disease outbreaks simulating poliomyelitis [5, 6] though no causal pathogen was isolated from the majority of the cases. Clinical investigation of individuals who did not recover several years after initial infection showed persistent symptoms of fatigue, sleep disturbance and cognitive impairment [7, 8]. Following an outbreak investigation in 1984 by the Centers for Disease Control and Prevention (CDC) in Incline Village, Nevada [9], an international group of medical experts defined this protracted post-infection illness as chronic fatigue syndrome (CFS) [10]. Since then, post-infection illness that lasts for more than six months is a central component of CFS, and studies have shown that the incidence of CFS following infection with a number of different pathogens is about 10% [11–14]. The pathogens that most commonly lead to CFS in prospective studies are those that cause infectious mononucleosis (IM)/glandular fever (mainly Epstein-Barr virus (EBV); occasionally cytomegalovirus (CMV), human herpesvirus 6, hepatitis A, and adenovirus [11], Q fever and Ross River virus (mainly in Australia [13]), enteroviruses [15] and parvovirus B19 [16, 17]. Indeed in recent work by Kerr and colleagues, antibody testing for EBV, enterovirus, Coxiella burnetii (causative agent of Q fever) and parvovirus B19 revealed evidence of subtype-specific relationships for EBV and enterovirus, two of the most common infectious triggers of CFS/ME [18].
There remains therefore an overwhelming body of evidence reinforcing the link to an infectious etiology in at least a subset of CFS patients, despite the fact that specific viral serology are not required for diagnosing CFS [19, 20]. Specifically, there is a notable and long-standing association of CFS with EBV infection. In our previously published analyses of the adolescent cohort presented here [14, 21–24], we reported a diagnosis of CFS at 6, 12 and 24 months following IM, in 13%, 7% and 4%, of the subjects respectively. Ninety percent of CFS subjects at 6 months were female as were all cases at 12 (n = 22) and 24 (n = 13) months following IM. This is consistent with the rates observed by Buchwald and colleagues (2000) [12] who found 12% of subjects had not recovered and were reporting symptoms of fatigue and impaired functioning 6 months following onset of IM, 76% of whom were female. Nearly identical results were also reported in an Australian cohort where 11% and 9% of subjects satisfied the case definition for CFS at 6 and 12 months following onset of IM, Q fever and Ross River fever (RRF) [13].
Investigators have sought to understand the underlying causes of these persistent symptoms by surveying immune signaling in the CFS patient population. Early measurements of cytokine concentrations in blood samples from this broader population produced widely discordant results due mainly to differences in case definition and laboratory protocols [25]. Limiting factors also include the focus on a varied and narrow selection of cytokines [26] as well as a conventional univariate analysis that does not account for the context-specific expression of cytokines [27]. Only one previous study has prospectively evaluated cytokine production in CFS patient populations where a uniform infectious trigger was supported by serology. Hickie et al. (2006) [13] measured the concentrations of 8 cytokines: IL-1b, IL-2, IL-4, IL-6, IL-10, IL-12, TNF-α, and IFN-γ in serum and culture supernatants of peripheral blood mononuclear cells collected 1, 2, 3, 6 and 12 months following the acute illness (IM, RRF or Q fever). The participants were 22 subjects with confirmed PI-CFS (11 EBV, 6 RRV, and 5 Q fever) and 42 control subjects (17 EBV, 14 RRV, and 11 Q fever) matched for age from the same cohort who had recovered within 6 weeks of symptom onset. The analyses were performed on all PI-CFS subjects as a single group, combining the 11 EBV patients with those infected by a virus uncommon outside Australia. They found no significant differences between PI-CFS cases and recovered controls in serum or culture supernatants [28]. However, serum cytokine levels were almost exclusively below the assay detection limit (8–15 pg/ml) and supernatants were cultured from cryopreserved PBMCs. As a result several unanswered questions remain. For example, do key CFS-specific cytokines remain unmeasured? Perhaps most importantly, could PI-CFS cytokine signatures reflect pathogen-specific (and gender-specific) variations in immune response? If so these may be lost when pooling subjects with different infectious triggers (and different genders).
In an attempt to address some of these questions, this secondary analysis has focused specifically on a group of female adolescents diagnosed PI-CFS as the result of a uniform and known pathogen, namely EBV. An extended survey of 16 cytokines was conducted in plasma using a modified chemiluminescent assay [27] and identified significant differences in IL-8 and IL-23 concentrations in the patient group at 24 months post-infection. Because cytokines are expressed in a coordinated fashion we also extended the analysis beyond the traditional univariate analysis to investigate combinatorial effects across multiple cytokines. Taken together, a classification of subjects based on levels of IL-2, 6, 8 and 23 supported assignment into the patient or control group with an accuracy exceeding 80% when applied relative to interferon gamma (IFN-γ) concentration. Interestingly the latter did not differ significantly in expression level across subject groups.
Methods
Cohort and clinical assessment
The cohort consisted of 301 adolescents recruited from the greater Chicago area upon diagnosis of monospot-positive acute IM, the presumption being that the vast majority of these cases were caused by EBV infection. Details of this cohort may be found in a recent report by Katz et al. (2009) [14]. In brief, adolescents were identified via school nurses (middle school, high school and college/university), pediatric practices, including the Pediatric Practice Research Group and the Virology Laboratory of Children’s Memorial Hospital. All prescribed treatments were recorded. Six months following their IM diagnosis, 286 (95%) subjects completed a telephone-based screening interview using the CFS Screening Questionnaire [29]. Based on the screening interview, 70 of these adolescents (24%) were assessed as not fully recovered. A clinical evaluation was completed on 53 (76%) of these 70 not fully recovered adolescents; 12 refused, 3 had exclusionary diagnoses and 2 did not meet study criteria. There was no significant difference in sex, family socioeconomic status or subject age between the group that completed the 6-month evaluation (n = 53), the group (n = 12) that refused and the group (n = 5) that was excluded (data not shown). Following the 6-month clinical evaluation, 39 of the 53 not fully recovered subjects who underwent clinical evaluation were classified as having CFS (13% of the original sample of 301 adolescents). Compared with the other 262 enrolled subjects in the cohort, 35 of the 39 subjects with CFS at 6 months were female (90%, vs 68%, p = 0.01 by Fisher’s exact test). There was no difference in race or socioeconomic status between the entire cohort and the subjects who went on to develop CFS (data not shown). Among the 14 other subjects completing the 6-month clinical evaluation, 1 had recovered between the time of the phone interview and the time he/she was seen in clinic and 13 were classified as CFS explained. There was no difference in family socioeconomic status or subject age between the group diagnosed with CFS (n = 39) and the group (n = 13) with CFS-explained (data not shown).
Thirty-six subjects diagnosed with CFS at the 6-month evaluation were re-evaluated at 12 months (3 were lost to follow-up): 11 recovered, 3 were now classified as CFS-explained, leaving 22 with a diagnosis of CFS (7% of the original sample; all females). At the 24-month evaluation, 3 more subjects with CFS were lost to follow-up since the 12-month evaluation. Of the 19 remaining subjects diagnosed with CFS at 12 months: 6 more recovered, 2 developed a reason for their CFS, 1 subject thought to have recovered at 12 months developed symptoms again and was reclassified as CFS, and 1 subject thought to have CFS-explained at 12 months now met criteria for CFS and had no predisposing reason, leaving 13 subjects (all females) who were classified as CFS 24 months following monospot-positive IM (4% of the original sample of 301 adolescents). Following the IM diagnosis, a telephone-screening interview also identified 50 recovered controls willing to come for a clinical evaluation. Adolescents who had not fully recovered and recovered controls underwent evaluation 6, 12 and 24 months post-IM. There was no difference in age, race or socioeconomic status between recovered adolescents who were and were not used as controls subjects (data not shown). At the 6-month evaluation recovered and non-recovered subjects were evaluated by 1 of 2 physicians experienced in diagnosing CFS (BZK or an adolescent specialist). At the 12 and 24-month visits, the subjects were evaluated in their home with the same blood and urine testing and the same history, interviews, and self-report measures used at six months, by a trained interviewer. All aspects of the study were approved by the Institutional Review Boards of Children’s Memorial Research Center and the College of Applied Sciences of the University of Illinois at Chicago. Secondary analysis of the biological samples and data was reviewed and approved by the Institutional Review Board of the University of Alberta. Diagnosis of CFS was based on the revision by Jason et al. (2006) [30] of the international CFS case definition [20], itself a revision of the of the Fukuda criteria [19], although all patients also met the international case definition of CFS [20]. When a well-recognized underlying condition such as primary depression could explain a subject’s symptoms then that subject was classified as having “CFS-explained”, and these subjects were not included in the analysis. Primary depression was defined based on the Structured Clinical Interview for the DSM-IV Child Version.
The clinical evaluation included laboratory tests to rule out medical causes of CFS (e.g., chemistry panel, complete blood count, erythrocyte sedimentation rate, liver chemistries, urine toxicology, urinalysis and thyroid function tests). The examining physician at 6 months made a diagnosis of CFS, CFS-explained, or recovered on each subject. These diagnoses were then blindly reviewed by an expert panel using the Jason revision for pediatrics [30] of the Fukuda criteria [19] before being permanently assigned to a subject. Each subject also completed the Chalder Fatigue Scale at 6, 12 and 24 months [31], along with the Youth Medical Questionnaire, Modifiable Activity Questionnaire, Sleep Assessment Questionnaire, and the Structured Clinical Interview for the DSM-IV Child Version, Child/Young Adult Behavior Checklist, Child/Young Adult Self-Report, and Life Events and Difficulty Questionnaire [30]. At 24-months post-IM onset, 13 subjects satisfied the criteria for CFS, all of whom were young women. Plasma samples were available for n = 9 of these 13 CFS patients 24-months after diagnosis with IM and 12 recovered controls, matched as closely as possible to the subjects with CFS by gender, age (+/- 1 year) and Tanner stage (4 or 5).
Laboratory measurements
Morning fasting blood samples were collected into ethylene diamine tetra acetic acid (EDTA) anticoagulant tubes. Plasma was separated within 2 hours of collection and stored at -80oC until assayed. We measured 16 cytokines in plasma using Quansys reagents and instrument (Quansys Biosciences, Logan, Utah) in the same way as reported previously in a larger cohort of CFS subjects with unknown etiology and illness trigger [26]. The Quansys Imager, driven by an 8.4 megapixel Canon 20D digital SLR camera, supports 96 well plate based chemiluminescent imaging. The Q-Plex™ Human Cytokine - Screen (16-plex) is a quantitative enzyme-linked immunoabsorbent assay (ELISA)-based test where sixteen distinct capture antibodies have been absorbed to each well of a 96-well plate in a defined array. The range of the cytokine concentrations used in the standard calibration samples were adjusted for each cytokine along with sample exposure time to provide the most reliable comparison possible between CFS patients and controls across the range of cytokine concentrations known and expected in plasma. For the standard curves, we used the second order (k = 2) polynomial regression model (parabolic curve): Yp = b0 + b1X1 + b2X2.. + bkXk, where Yp is the predicted outcome value for the polynomial model with regression coefficients b1 to bk for each degree and y intercept b0. The standard sample concentrations used to establish the calibration curves for each cytokine are listed in Additional file 1: Table S1; these confirm that the concentrations reported in study subjects are within the calibrated range for this assay.
Statistical analyses
Comparative statistics
Each plasma sample was run in duplicate. To compare subject-to-subject variation with replicate error both the parametric n-way ANOVA and the nonparametric Kruskall-Wallis tests were used. Results presented in Additional file 1: Table S2 indicate that variations separating individuals was statistically greater than replicate error for most cytokines in at least one subject group or the other. The parametric n-way ANOVA applied to log-transformed values was generally more sensitive to these differences than the Kruskall-Wallis test. Replicate error in the measurement of IL-1a, IL-10 and IL-17 did not support subject-to-subject resolution within either group regardless of the statistical test used. These were nonetheless adequate for use in comparisons across patient groups as a whole.
To assess the significance of differences in the mean expression of individual cytokines separating subject groups we used a standard parametric t test after performing a logarithmic transformation. In conjunction with this a nonparametric Wilcoxon rank-sum test was used to compare the difference in group-wise median expression for each cytokine. Values below detection limit were replaced with the lowest concentration recorded for each specific cytokine within each subject group.
Classification analysis
As an extension of this group-wide analysis of expression levels, cytokines were ranked according to their classification of individual subjects based on their associated receiver operating characteristic (ROC) curves and on the U-statistic of a two-sample unpaired Wilcoxon ranksum test. In addition to an unadjusted ranking, a relative ranking was also computed that accounted for the cross-correlation (CC) existing between individual cytokines. In this adjustment correlation information was used to reweight the Z value of a candidate cytokine using Zi (1-α ‾r ij), where ‾rij is the average of the absolute values of the cross-correlation coefficient between the candidate i and all previously selected cytokines j = 1 through i. The weighting factor α (alpha) is a scalar value between 0 and 1. According to this adjustment a large value of ‾rij outweighs the significance statistic Z making new candidates that are highly correlated with previously ranked cytokines less likely to be selected next.
The use of cytokines in combination with one another was also considered. For this, linear discriminant classification models were constructed iteratively using randomly selected subsets of cytokines and their performance evaluated. All cytokines were normalized to have a mean value of 0 and a variance of 1.0. Classifiers were evaluated based on their overall error rate (incorrectly classified samples / total classified samples) in assigning subjects to their proper diagnostic group. Only classifiers with overall error rate of less than 20% were accepted into the pool of candidates. In addition the posterior probability of the discriminant analysis was used to invalidate candidate class assignments with low confidence (< 0.90) and label any such instance as an inconclusive classification. Furthermore a strict linear classification model was selected to favor subsets of cytokines that were minimally redundant. Traditional ordinary least squares models will perform poorly when correlated or collinear terms are used together due to variance inflation [32]. Final correction of the linear classifier for collinearity in the selected cytokine subsets was performed using a diagonal covariance matrix estimate. According to this model an observed row x from the sample array is classified into group I rather than group J if 0 < B0 + x*B, where the coefficient vector B and intercept vector B0 are estimated from the data.
In order to assess the robustness of models constructed using the all-possible-subsets approach described above, an analysis of this data using a sequential stepwise variable selection [33] was also conducted. Using this algorithm, a linear classification model was constructed by selecting cytokines sequentially based on their respective partial-F test values. Cytokines with a p(partial F) < 0.05 were selected for recruitment into the regression model while those currently in the model but showing a p(partial F) > 0.10 were pruned. All calculations described above were performed using the classify, classperf, rankfeatures, randfeatures and stepwisefit functions available in the MatLab Statistics Toolbox and the MatLab Bioinformatics Toolbox (The MathWorks, Inc., Natick, MA).
Results
Cytokine expression in PI-CFS patients
Summary statistics for group-wise expression of cytokines in PI-CFS patients and subjects who recovered normally from IM are presented graphically in Figure 1 (see also Additional file 1: Table S3). Briefly these show that IL-8 was significantly elevated in median expression (p ≤ 0.05) in PI-CFS while IL-23 was significantly decreased. We also found IL-2 expression to be elevated in PI-CFS though this reached statistical significance for the t-test only. Similarly reduced expression of IL-5 in PI-CFS was significant based on the Wilcoxon rank sum test only. A trend towards increased IL-13 expression was also observed (p ~ 0.07).
Figure 1
Cytokine Expression in Post-mononucleosis Chronic Fatigue. Cytokine Expression Median concentration (with median absolute deviation from median) of 16 cytokines measured in peripheral blood plasma from n = 12 adolescents recovering normally at 24 months from infectious mononucleosis (IM) and n = 9 patients suffering from post-infectious chronic fatigue syndrome (PI-CFS).
Ranking individual cytokine markers
Univariate analysis indicated that cytokines IL-2, IL-5, IL-8 and IL-23 were significantly different, in either mean or median expression, in PI-CFS patients compared to subjects that had recovered. To investigate these differences we estimated how individual cytokines might rank on the basis of their performance in assigning subjects to the correct diagnostic class, namely PI-CFS or recovered controls. As expected, the results presented in Table 1 indicate that as individual biomarkers IL-5, IL-8 and IL-23 ranked consistently in the top 3 positions based on both the area under the receiver operating characteristic curve (AUC) and the Wilcoxon U statistic. In terms of AUC, IL-8 was the single best discriminator between groups (0.34 above 0.50). In comparison IL-5 and IL-23, the next best markers represented a 40% decrease in AUC (0.20 above 0.50). With respect to the U statistic IL-8 and 23 were virtually equivalent with the next best marker leading to a 20% decrease in reliability. The next 3 positions were occupied by a combination of IL-2, IL-13, and IL-15 as well as IFN-γ, TNF-α and TNF-β depending on the criterion used. However, these corresponded to a greater than 50% reduction in the AUC and a 40% decrease in the U statistic when compared to IL-8 and IL-5 respectively. This ranking was slightly different when we corrected for cross-correlation between cytokines by reweighting the Z statistic using an alpha value of α=1 as described above (2.3.2 of the Methods section). Once again IL-5, 8 and 23 were selected as the top ranking cytokines. The next 3 positions were occupied by a combination of the same cytokines as before with the exception that IL-15 was replaced by IL-6. Once again these corresponded to a loss in performance of greater than 50% in both AUC and U metrics when compared to IL-5 or IL-8.
Table 1
Individual Cytokines as Illness Markers
Ranked Features PI-CFS vs Ctrl**
CC weight alpha=0
ROC
AUC-0.50
Wilcoxon
U statistic
IL-8
(pg/ml)
0.34
IL-5
0.31
IL-5
(pg/ml)
0.20
IL-23
0.30
IL-23
(pg/ml)
0.20
IL-8
0.24
IL-13
(pg/ml)
0.16
IFN-g
0.18
IL-2
(pg/ml)
0.16
TNFa
0.13
IL-15
(pg/ml)
0.14
TNFb
0.13
IL-17
(pg/ml)
0.13
IL-12p70
0.10
IL-6
(pg/ml)
0.10
IL-1b
0.07
IL-10
(pg/ml)
0.08
IL-1a
0.06
IFN-g
(pg/ml)
0.07
IL-13
0.06
IL-4
(pg/ml)
0.07
IL-2
0.06
TNFb
(pg/ml)
0.04
IL-15
0.04
IL-1a
(pg/ml)
0.04
IL-17
0.04
IL-1b
(pg/ml)
0.04
IL-4
0.03
TNFa
(pg/ml)
0.03
IL-10
0.03
IL-12p70
(pg/ml)
0.01
IL-6
0.00
Ranked Features PI-CFS vs Ctrl**
CC weight alpha=1.0
ROC
AUC-0.50
Wilcoxon
U statistic
IL-8
(pg/ml)
0.34
IL-5
0.31
IL-23
(pg/ml)
0.20
IL-8
0.24
IL-5
(pg/ml)
0.20
IL-23
0.30
IL-2
(pg/ml)
0.16
TNFb
0.13
IL-13
(pg/ml)
0.16
IFN-g
0.18
IL-6
(pg/ml)
0.10
TNFa
0.13
IL-17
(pg/ml)
0.13
IL-1a
0.06
IL-15
(pg/ml)
0.14
IL-12p70
0.10
IFN-g
(pg/ml)
0.07
IL-2
0.06
IL-10
(pg/ml)
0.08
IL-1b
0.07
IL-4
(pg/ml)
0.07
IL-13
0.06
IL-1a
(pg/ml)
0.04
IL-17
0.04
TNFb
(pg/ml)
0.04
IL-15
0.04
IL-1b
(pg/ml)
0.04
IL-10
0.03
TNFa
(pg/ml)
0.03
IL-4
0.03
IL-12p70
(pg/ml)
0.01
IL-6
0.00
Relative rank of individual cytokines based on their classification performance as evaluated by the area (AUC) under the receiver operating characteristic (ROC) curve and the Wilcoxon U statistic. Values without cross-correlation adjustment (CC Weight α=0) and with full cross-correlation adjustment are shown (CC weight α=1).
** Note: values were not log transformed since ROC rank is non-parametric.
A candidate cytokine-based signature for IM-induced chronic fatigue
For all their merit individual cytokines are not without their limitations as biomarkers. Their use in combination has the potential to improve classification performance by introducing immune context. Cytokines are not expressed independently but instead their patterns arise as a result of one or several basic immune processes acting in concert. This limits the expression of cytokines to specific patterns and deviation from these patterns may be indicative of illness even though the cytokines in question may still be within expected ranges when considered individually. Not only is analysis of co-expression more representative of the underlying biology but from a purely statistical perspective, these measurements are subject to various levels of noise and the use of a weighted average score across several cytokines promises to be much more reliable. Indeed, in our analysis a minimal set of 5 cytokines was necessary to satisfy the criterion of better than 80% accuracy at a confidence level of 0.95 (Figure 2). The subset of 5 cytokines that maximized the performance of a simple linear classification model with minimal redundancy consisted of IL-2, IL-6, IL-8, IL-23 and IFN-γ. As shown in Table 2 this classification model supported a specificity of 88% at a sensitivity of 94% (PPV = 0.85, NPV = 0.95) when applied to the training data of adolescent PI-CFS patients and recovered controls. Only 7 of the 42 individual samples received an inconclusive assignment when a minimal confidence level of 0.95 was applied. In comparison classifiers constructed with cytokines best ranked on the basis of their individual performance produced much higher levels of uncertainty. For example the 5 cytokines ranked best in terms of contribution to the AUC, namely IL-8, IL-5, IL-2, IL-23 and IL-13, produced over 26 out of 42 inconclusive class assignments at a confidence threshold of 0.95. Adjusting further for the partial correlation between these cytokines (collinearity) only reduced this to 22 inconclusive class assignments. Similarly a classification based on IL-5, IL-23, IL-8, IFN-γ and TNF-β, ranked best on the basis of the U statistic, produced 29 inconclusive assignments in the set of 42 individual samples. Once again 24 of these remained after correction for correlation between cytokines (collinearity). The general performance characteristics for these alternate models are summarized in Table 2.
Figure 2
A Cytokine-based Subject Classification. Linear classification scores for the assignment of subjects to the overall PI-CFS group obtained using the simple linear classifier 0 > B0 + B*X where X is the normalized concentration of cytokines IL-2, 6, 8 23 and IFN-γ.
Table 2
Performance Characteristics1of Subject Classification using Cytokine Combinations
Optimal Linear model subset
Top ranking AUC with CC correction
Top ranking U statistic with CC correction
Classification based on IL-2, 6, 8, 23, IFNg
Classification based on IL-2, 5, 8, 13, 23
Classification based on IL-5, 23, 8, IFNg, TNFb
Linear cw 90% Conf
Linear uncorrected
Linear cw 90% Conf
Linear uncorrected
Linear cw 90% Conf
Linear uncorrected
Correct Rate
0.97
0.90
0.94
0.86
0.92
0.79
Error Rate
0.03
0.10
0.06
0.14
0.08
0.21
Inconclusive Rate
0.17
0.00
0.62
0.00
0.69
0.00
Classified Rate
0.83
1.00
0.38
1.00
0.31
1.00
Sensitivity
0.72
0.94
0.33
0.83
0.33
0.67
Specificity
0.88
0.88
0.38
0.88
0.25
0.88
Positive Predictive Value
0.81
0.85
0.29
0.83
0.25
0.80
Negative Predictive Value
0.81
0.95
0.43
0.88
0.33
0.78
Positive Likelihood
5.78
7.56
0.53
6.67
0.44
5.33
Negative Likelihood
0.32
0.06
1.78
0.19
2.67
0.38
Classification models based on random all-possible-subset selection of 5 cytokines as well as the top 5 ranking cytokines based on individual contribution to the AUC and the U statistic.
1 Correct Rate is defined as (correctly classified samples)/ (all classified samples); Error rate as (incorrectly classified samples)/ (all classified samples); Inconclusive Rate is defined as (non-classified samples) / (total number of samples); Classified rate is (classified samples) / (total number of samples); Sensitivity is defined as (correctly classified positives) / (true positives); Specificity is (correctly classified negatives) / (true negatives); Positive Predictive Value is (correctly classified positives) / (positive classified); Negative Predictive Value is (correctly classified negatives) / (negative classified); Positive Likelihood is Sensitivity / (1 – Specificity); Negative Likelihood is (1 – Sensitivity) / Specificity.
Even though IL-5 ranked highly in terms of individual performance it was not selected as a contributor to the classification model. To explore this further we examined the correlation of IL-5 with other cytokines. The cross-correlation patterns existing between cytokines in the PI-CFS patient set as well as in the recovered control group are presented in Additional file 1: Table S4. These indicate strong and significant (p < 0.05) correlations between IL-5 and IL-23 as well as with IFN-γ in the PI-CFS patient set (r = 0.65, 0.77; p < 0.01). Truncation of these terms and substitution with IL-5 into the random subset model was explored as a strategy for alleviating these redundancies. In all cases classification performance was significantly reduced (Additional file 1: Table S5). This suggests that IL-23 and IFN-γ are better suited than IL-5 to support class assignment based on IL-2, 8 and 6.
In order to test the robustness of this combination of cytokines, a stepwise selection algorithm was also applied to the same data. Stepwise selection produced a linear classification model that was once again based on a subset of 5 cytokines. In this sequential model-building scheme, IL-6, 8 and 23 were again chosen as significant markers of PI-CFS. Also selected were IL-1a and IL-13. Together theses 5 cytokines supported the assignment of samples to their correct diagnostic class with a specificity of 94% at a sensitivity of 91% (PPV = 0.95, NPV = 0.89) (Table 3). Using the consensus terms shared by both the all-possible-subsets (Table 2) and stepwise models leads to a classification model based on IL-6, 8 and 23 alone. This reduced consensus model supported a specificity of 88% at a sensitivity of 83% (PPV = 0.91, NPV = 0.80) (Table 3). Because samples from 4 PI-CFS patients were unavailable for analysis a set of simulations was used to test the stability of the above-mentioned models to inclusion of these subjects. In a worst-case scenario these patients were included in the analysis and assigned cytokine profiles selected randomly from the set of healthy normal profiles. With each random assignment a stepwise regression model was constructed. In 50 repeated assignments, IL-8 was unanimously selected in all regression models, while IL-6 ranked second with recruitment into 41 of 50 models (Additional file 1: Table S6). Of the initial classification model IL-6, 8 and 23 were selected by two different regression algorithms with simulations showing IL-6 and 8 to be particularly robust choices for this data.
Table 3
Stepwise and Consensus Classification Models
Classification based on
Stepwise model of IL-1a, 6, 8,13, 23
Consensus model of IL-6, 8, and 23
Minimal model of IL-6 and 8
Correct Rate
0.93
0.86
0.79
Error Rate
0.07
0.14
0.21
Inconclusive Rate
0.00
0.00
0.00
Classified Rate
1.00
1.00
1.00
Sensitivity
0.92
0.83
0.79
Specificity
0.94
0.89
0.78
Positive Predictive Value
0.96
0.91
0.83
Negative Predictive Value
0.89
0.80
0.74
Positive Likelihood
16.50
7.50
3.56
Negative Likelihood
0.09
0.19
0.27
Performance of linear classification models based on (i) a stepwise selection of IL-1a, 6, 8, 13 and 23, (ii) the intersecting subset of IL-6, 8 and 23 found in both stepwise and all-possible-subsets models and (iii) a core selection of IL-6 and 8, the two most robust choices based on simulations with random data substitutions.
Discussion
In this work we studied a population of adolescents that developed CFS as a sequela of monospot-positive IM and compared them to control subjects who recovered normally from the same infection. Approximately 4% of subjects (or 13 individuals) diagnosed with IM fit the case definition for CFS at 24 months, a number consistent with other prospective studies of infectious onset CFS [12, 13]. In comparing the concentrations of 16 cytokines between cases and recovered controls we found significantly different levels of IL-8, IL-23 and possibly IL-2 and IL-5 in plasma samples from CFS patients. Increased IL-8 and decreased IL-5 is a pattern also seen asthma [34] and in B cell chronic lymphocytic leukemia (B-CLL) [35]. Most striking were differences in IL-23, a cytokine expressed by dendritic cells and macrophages. Though not required for the generation of Th17 cells from naïve CD4+ T cells, IL-23 is nonetheless essential for the full and sustained differentiation of the Th17 cell subset [36]. Median concentration of this cytokine was significantly lower in patients with CFS than in recovered controls. IL-23 expression is highly inducible in PHA-stimulated CD4+ cells, in particular when primed with IFN-γ, suggesting a potential role for IL-23 in Th1 response [37]. We found decreased expression of IL-23 in CFS patients despite comparable levels of IFN-γ. In addition we found levels of IL-17 to be similar despite elevated levels of known antagonist IL-2 [38]. Consistent with this, our previous analysis of cytokine expression in a population of adult subjects with CFS of unknown etiology [27] indicated an abnormally subdued IL-23/Th17/IL-17 response to elevated levels of known inducers IL-1b and IL-6 [39].
The above-mentioned discrepancies emphasize the importance of immune context. Indeed it was necessary to use the combined expression of 5 cytokines to support a robust separation of patients from recovered controls. Ultimately the context linking the expression of these cytokines arises from one or several basic immune processes acting in concert. Here the choice of cytokines in both the all-possible-subsets and stepwise regression models is interesting in that the majority of these are either directly or indirectly related to Th17 response [39]. In this analysis IL-6, 8 and 23 were selected by two different statistical approaches, with IL-1a, IL-2 and IFN-γ also selected in one model or the other. It is interesting to note that neither IL-1a, nor IL-6 or IFN-γ were differentially expressed across groups even though they contributed significantly to the classification of these subjects. IL-1, 6 and 23 are known inducers of Th17 response, which in turn is a producer of IFN-γ [39]. Conversely IL-2 is generally known as a Th17 antagonist [38]. Liu et al. (2007) [40] describe a mechanism by which IL-1 induces the production of IL-23 via NF-kappa B activation, which in turn promotes the production of IL-6 and 8 in human fibroblast-like synoviocytes from rheumatoid arthritis patients. Though this is still poorly understood, recent evidence in animal models supports a role for EBV and EBV-inducible genes in the pathogenic modulation of Th17 response [41, 42]. This may involve TLR9 which has been shown recently to play a significant role in the recognition of EBV by primary dendritic cells (DC), as indicated by a marked inhibitory effect on their synthesis of IFN-α, IL-6, and IL-8 [43]. Collectively the current analysis, as well as results from our previous work [27], suggests that illness-specific differences in the regulation of Th17 response may be a shared component in a significant subset of CFS cases.
When comparing this work with results from other studies it is important to remember the type of sample and the specific patient population studied. For example, recent work by Brenu et al. (2011) [44] demonstrated higher levels of IL-10, IFN-γ and TNF-α in CFS. However this was measured in mitogen-stimulated CD4+ cell cultures not in plasma. Similar in vitro protocols were used in earlier work by Amel Kashipaz et al. (2003) [45] and Skowera et al. (2004) [46]. Using the same sample type and laboratory protocol applied here, we recently reported higher levels of IL-5 and lower levels of IL-8 in CFS subjects compared to healthy controls, while levels of IL-23 showed little difference [27]. However both the work of Broderick et al. (2010) [27] and Brenu et al. (2011) [44] were conducted in a much broader CFS patient population where the illness trigger was not uniform. In addition the control population consisted of otherwise healthy individuals not individuals recovering from acute infection. Estimates of the number of patients with CFS who can date their illness to a specific (presumably infectious) acute illness range from 20- 90%, with the highest percentages being recorded in adolescent populations [8, 47–53]. Accordingly our current results align closely with those of another study conducted specifically in a post-infectious patient population by Vollmer-Conna et al. (2007) [28]. The authors found no differences in the concentrations of IL-1b, IL-2, IL-4, IL-6, IL-10, IL-12, TNF-α, and IFN-γ analyzed in serum. With the possible exception of elevated IL-2, we also did not find differences in the levels of these cytokines. Levels of IL-5, 8 and 23 were not measured in this earlier study.
Limitations of our current study include the fact that it reports on a small cohort. This is important when considering the general applicability of our statistical classification model in particular. The hope is that this subset of subjects is somewhat representative of a larger PI-CFS patient population. CFS is well known for its heterogeneous presentation; however it can be argued that much of this is the result of varied etiology and unknown triggers. Our results are derived from a prospective study and constitute an important first look at the molecular phenotyping of persistent fatigue in a cohort with a uniform and known infectious trigger; namely infectious mononucleosis. While this trigger does not explain all presentations of CFS, it does represent a significant subset of patients, in particular in the pediatric population. Moreover though specific to the EBV pathogen, elements presented here may also be of relevance to other forms of CFS with an infectious etiology. Constraints such as these further emphasize the importance of prospective studies and the need for much larger initiatives of this type in this and related patient populations.
Conclusion
In conclusion, the co-expression profile of 5 of 16 cytokines measured in the plasma of subjects recruited in a 2-year prospective study of mononucleosis-induced chronic fatigue syndrome readily discriminates cases from recovered control subjects and describes an atypical immune response in these individuals. In particular, irregular patterns of co-expression in IL-6, 8 and 23 were identified using two distinct statistical methodologies. These differences were especially evident when cast in the context of IL-1a, IL-2 and IFN-γ. This evidence points to a possible dysregulation of the innate system’s priming of the appropriate adaptive Th17 response in these subjects.
Declarations
Acknowledgments
This analysis was funded by the CFIDS Association of America grants to G Broderick, BZ Katz and NG Klimas; cohort recruitment and assessment was supported by grants from the US National Institute of Health, including R01 HD043301-05 (PI R Taylor), R21AA016635 (PI M.A. Fletcher) and R01AI065723 (PI MA Fletcher); and R01AI065723 (PI MA Fletcher); the US Department of Veterans Affairs, Merit Award to NG Klimas.
Authors’ Affiliations
(1)
Division of Pulmonary Medicine, Department of Medicine, University of Alberta, WMC 2E4.41 WC Mackenzie Health Sciences Centre
(2)
Division of Infectious Diseases, Anne and Robert H. Lurie Children’s Hospital of Chicago
(3)
Department of Medicine, University of Miami
(4)
Miami Veterans Affairs Medical Center
(5)
Department of Pathology, Feinberg School of Medicine, Northwestern
(6)
CFIDS Association of America
(7)
Department of Occupational Therapy, University of Illinois at Chicago
References
Chandler HK, Ciccone D, MacBride RJ, Natelson B: Medically unexplained illness in short- and long-term disability applicants: prevalence and cost of salary reimbursement. Disabil Rehabil. 2008, 30 (16): 1185-1191. 10.1080/09638280701500109.View ArticlePubMedGoogle Scholar
Reeves WC, Jones JF, Maloney E, Heim C, Hoaglin DC, Boneva RS, Morrissey M, Devlin R: Prevalence of chronic fatigue syndrome in metropolitan, urban, and rural Georgia. Popul. Health Metr. 2007, 5: 5-10.1186/1478-7954-5-5.View ArticlePubMedPubMed CentralGoogle Scholar
Reynolds KJ, Vernon SD, Bouchery E, Reeves WC: The economic impact of chronic fatigue syndrome. Cost Eff. Resour. Alloc. 2004, 2 (1): 4-10.1186/1478-7547-2-4.View ArticlePubMedPubMed CentralGoogle Scholar
Jason LA, Benton MC, Valentine L, Johnson A, Torres-Harding S: The economic impact of ME/CFS: Individual and societal costs. Dyn. Med. 2008, 7: 6-10.1186/1476-5918-7-6.View ArticlePubMedPubMed CentralGoogle Scholar
Leake JP, Cedar ET, Dearing WP, Gilliam AG, Chope HD: Epidemiology of Poliomyelitis in California, 1934. Am J Public Health Nations Health. 1934, 24 (12): 1204-1206. 10.2105/AJPH.24.12.1204.View ArticlePubMedPubMed CentralGoogle Scholar
Sigurdsson B, Sigurjonsson J, Sigurdsson JH, Thorkelsson J, Gudmundsson KR: A disease epidemic in Iceland simulating poliomyelitis. Am J Hyg. 1950, 52 (2): 222-238.PubMedGoogle Scholar
Sigurdsson B: Clinical findings six years after outbreak of Akureyri disease. Lancet. 1956, 270 (6926): 766-767.View ArticlePubMedGoogle Scholar
Bell DS, Jordan K, Robinson M: Thirteen-year follow-up of children and adolescents with chronic fatigue syndrome. Pediatrics. 2001, 107 (5): 994-998. 10.1542/peds.107.5.994.View ArticlePubMedGoogle Scholar
Holmes GP, Kaplan JE, Stewart JA, Hunt B, Pinsky PF, Schonberger LB: A cluster of patients with a chronic mononucleosis-like syndrome. Is Epstein-Barr virus the cause?. J.A.M.A. 1987, 257 (17): 2297-2302. 10.1001/jama.1987.03390170053027.View ArticlePubMedGoogle Scholar
Holmes GP, Kaplan JE, Gantz NM, Komaroff AL, Schonberger LB, Straus SE, Jones JF, Dubois RE, Cunningham-Rundles C, Pahwa S, Tosato G, Zegans LS, Purtilo DT, Brown N, Schooley RT, Brus I: Chronic fatigue syndrome: a working case definition. Ann Intern Med. 1988, 108 (3): 387-389.View ArticlePubMedGoogle Scholar
White PD, Thomas JM, Amess J, Crawford DH, Grover SA, Kangro HO, Clare AW: Incidence, risk and prognosis of acute and chronic fatigue syndromes and psychiatric disorders after glandular fever. Br J Psychiatry. 1998, 173: 475-481. 10.1192/bjp.173.6.475.View ArticlePubMedGoogle Scholar
Buchwald DS, Rea TD, Katon WJ, Russo JE, Ashley RL: Acute infectious mononucleosis: characteristics of patients who report failure to recover. Am J Med. 2000, 109: 531-537. 10.1016/S0002-9343(00)00560-X.View ArticlePubMedGoogle Scholar
Hickie I, Davenport T, Wakefield D, Vollmer-Conna U, Cameron B, Vernon SD, Reeves WC, Lloyd A, Dubbo Infection Outcomes Study Group: Post-infective and chronic fatigue syndromes precipitated by viral and non-viral pathogens: prospective cohort study. B.M.J. 2006, 333 (7568): 575-10.1136/bmj.38933.585764.AE.View ArticleGoogle Scholar
Katz BZ, Shiraishi Y, Mears CJ, Binns HJ, Taylor R: Chronic fatigue syndrome after infectious mononucleosis in adolescents. Pediatrics. 2009, 124 (1): 189-193. 10.1542/peds.2008-1879.View ArticlePubMedPubMed CentralGoogle Scholar
Chia J, Chia A, Voeller M, Lee T, Chang R: Acute enterovirus infection followed by myalgic encephalomyelitis/chronic fatigue syndrome (ME/CFS) and viral persistence. J Clin Pathol. 2010, 63 (2): 165-168. 10.1136/jcp.2009.070466.View ArticlePubMedGoogle Scholar
Seishima M, Mizutani Y, Shibuya Y, Arakawa C: Chronic fatigue syndrome after human parvovirus B19 infection without persistent viremia. Dermatology. 2008, 216 (4): 341-346. 10.1159/000116723.View ArticlePubMedGoogle Scholar
Kerr JR, Bracewell J, Laing I, Mattey DL, Bernstein RM, Bruce IN, Tyrrell DA: Chronic fatigue syndrome and arthralgia following parvovirus B19 infection. J Rheumatol. 2002, 29 (3): 595-602.PubMedGoogle Scholar
Fukuda K, Straus SE, Hickie I, Sharpe MC, Dobbins JG, Komaroff A: The Chronic Fatigue Syndrome: A comprehensive approach to its definition and study. Ann Intern Med. 1994, 121: 953-959.View ArticlePubMedGoogle Scholar
Reeves WC, Lloyd A, Vernon SD, Klimas NG, Jason LA, Bleijenberg G, Evengard B, White PD, Nisenbaum R, Unger ER, International Chronic Fatigue Syndrome Study Group: Identification of ambiguities in the 1994 chronic fatigue syndrome research case definition and recommendations for resolution. BMC Health Serv Res. 2003, 3 (1): 25-10.1186/1472-6963-3-25.View ArticlePubMedPubMed CentralGoogle Scholar
Huang Y, Katz BZ, Mears C, Kielhofner GW, Taylor R: Postinfectious fatigue in adolescents and physical activity. Arch Pediatr Adolesc Med. 2010, 164 (9): 803-809. 10.1001/archpediatrics.2010.144.PubMedPubMed CentralGoogle Scholar
Katz BZ, Boas S, Shiraishi Y, Mears CJ, Taylor R: Exercise tolerance testing in a prospective cohort of adolescents with chronic fatigue syndrome and recovered controls following infectious mononucleosis. J Pediatr. 2010, 157 (3): 468-472. 10.1016/j.jpeds.2010.03.025.View ArticlePubMedPubMed CentralGoogle Scholar
Taylor R, O’Brien J, Kielhofner GW, Lee S-W, Katz BZ, Mears CJ: The occupational and quality of life consequences of chronic fatigue syndrome/myalgic encephalomyelitis in young people. Brit. J. Occ. Therapy. 2010, 73: 524-530. 10.4276/030802210X12892992239233.View ArticleGoogle Scholar
Katz BZ, Stewart JM, Shiraishi Y, Mears CJ, Taylor R: Autonomic symptoms at baseline and following infectious mononucleosis in a prospective cohort of adolescents. Arch. Pediatr. Adol. Med. 2011, 165: 765-766. 10.1001/archpediatrics.2011.124.View ArticleGoogle Scholar
Maher K, Klimas NG, Fletcher MA: Immunology. Handbook of Chronic Fatigues. Edited by: Jason LA, Fennell PA, Taylor RR. 2003, John Wiley & Sons, Hoboken, 124-151.Google Scholar
Fletcher MA, Zeng XR, Barnes Z, Levis S, Klimas NG: Plasma cytokines in women with chronic fatigue syndrome. J Transl Med. 2009, 7: 96-10.1186/1479-5876-7-96.View ArticlePubMedPubMed CentralGoogle Scholar
Broderick G, Fuite J, Kreitz A, Vernon SD, Klimas N, Fletcher MA: A formal analysis of cytokine networks in chronic fatigue syndrome. Brain Behav Immun. 2010, 24 (7): 1209-1217. 10.1016/j.bbi.2010.04.012.View ArticlePubMedPubMed CentralGoogle Scholar
Vollmer-Conna U, Cameron B, Hadzi-Pavlovic D, Singletary K, Davenport T, Vernon SD, Reeves WC, Hickie I, Wakefield D, Lloyd AR, Dubbo Infective Outcomes Study Group: Postinfective fatigue syndrome is not associated with altered cytokine production. Clin Infect Dis. 2007, 45 (6): 732-735. 10.1086/520990.View ArticlePubMedGoogle Scholar
Jason LA, Richman JA, Rademaker AW, Jordan KM, Plioplys AV, Taylor RR, McCready W, Huang CF, Plioplys S: A community-based study of chronic fatigue syndrome. Arch Intern Med. 1999, 159 (18): 2129-2137. 10.1001/archinte.159.18.2129.View ArticlePubMedGoogle Scholar
Jason LA, Jordan K, Miike T, Bell DS, Lapp C, Torres-Harding S, Rowe K, Gurwitt A, DeMerlier K, Van Hoof E: A pediatric case definition for myalgic encephalomyelitis and chronic fatigue syndrome. J. Chronic Fatigue Syndrome. 2006, 13: 1-44.View ArticleGoogle Scholar
Chalder T, Berelowitz C, Pawlikowska T: Development of a fatigue scale. J Psychosom Res. 1993, 37: 147-154. 10.1016/0022-3999(93)90081-P.View ArticlePubMedGoogle Scholar
Pizzichini MM, Pizzichini E, Efthimiadis A, Chauhan AJ, Johnston SL, Hussack P, Mahony J, Dolovich J, Hargreave FE: Asthma and natural colds. Inflammatory indices in induced sputum: a feasibility study. Am J Respir Crit Care Med. 1998, 158 (4): 1178-1184.View ArticlePubMedGoogle Scholar
Chanan-Khan AA, Chitta K, Ersing N, Paulus A, Masood A, Sher T, Swaika A, Wallace PK, Mashtare TL, Wilding G, Lee K, Czuczman MS, Borrello I, Bangia N: Biological effects and clinical significance of lenalidomide-induced tumour flare reaction in patients with chronic lymphocytic leukaemia: in vivo evidence of immune activation and antitumour response. Br J Haematol. 2011, 155 (4): 457-467. 10.1111/j.1365-2141.2011.08882.x.View ArticlePubMedPubMed CentralGoogle Scholar
Torchinsky MB, Blander JM: T helper 17 cells: discovery, function, and physiological trigger. Cell Mol Life Sci. 2010, 67 (9): 1407-1421. 10.1007/s00018-009-0248-3.View ArticlePubMedGoogle Scholar
Ma XT, Zhang XJ, Zhang B, Geng YQ, Lin YM, Li G, Wu KF: Expression and regulation of interleukin-23 subunits in human peripheral blood mononuclear cells and hematopoietic cell lines in response to various inducers. Cell Biol Int. 2004, 28 (10): 689-697. 10.1016/j.cellbi.2004.07.002.View ArticlePubMedGoogle Scholar
Laurence A, Tato CM, Davidson TS, Kanno Y, Chen Z, Yao Z, Blank RB, Meylan F, Siegel R, Hennighausen L, Shevach EM, O’shea JJ: Interleukin-2 signaling via STAT5 constrains T helper 17 cell generation. Immunity. 2007, 26 (3): 371-381. 10.1016/j.immuni.2007.02.009.View ArticlePubMedGoogle Scholar
Liu FL, Chen CH, Chu SJ, Chen JH, Lai JH, Sytwu HK, Chang DM: Interleukin (IL)-23 p19 expression induced by IL-1beta in human fibroblast-like synoviocytes with rheumatoid arthritis via active nuclear factor-kappaB and AP-1 dependent pathway. Rheumatology (Oxford). 2007, 46 (8): 1266-1273. 10.1093/rheumatology/kem055.View ArticleGoogle Scholar
Casiraghi C, Shanina I, Cho S, Freeman ML, Blackman MA, Horwitz M: Gammaherpesvirus latency accentuates EAE pathogenesis: relevance to Epstein-Barr virus and multiple sclerosis. PLoS Pathog. 2012, 8 (5): e1002715-10.1371/journal.ppat.1002715.View ArticlePubMedPubMed CentralGoogle Scholar
Liu JQ, Liu Z, Zhang X, Shi Y, Talebian F, Carl JW, Yu C, Shi FD, Whitacre CC, Trgovcich J, Bai XF: Increased Th17 and regulatory T cell responses in EBV-induced gene 3-deficient mice lead to marginally enhanced development of autoimmune encephalomyelitis. J Immunol. 2012, 188 (7): 3099-3106. 10.4049/jimmunol.1100106.View ArticlePubMedPubMed CentralGoogle Scholar
Fiola S, Gosselin D, Takada K, Gosselin J: TLR9 contributes to the recognition of EBV by primary monocytes and plasmacytoid dendritic cells. J Immunol. 2010, 185 (6): 3620-3631. 10.4049/jimmunol.0903736.View ArticlePubMedGoogle Scholar
Feder HM, Dworkin PH, Orkin C: Outcome of 48 pediatric patients with chronic fatigue. A clinical experience. Arch Fam Med. 1994, 3 (12): 1049-1055. 10.1001/archfami.3.12.1049.View ArticlePubMedGoogle Scholar
Carter BD, Edwards JF, Kronenberger WG, Michalczyk L, Marshall GS: Case control study of chronic fatigue in pediatric patients. Pediatrics. 1995, 95 (2): 179-186.PubMedGoogle Scholar
Krilov LR, Fisher M, Friedman SB, Reitman D, Mandel FS: Course and outcome of chronic fatigue in children and adolescents. Pediatrics. 1998, 102 (2 Pt 1): 360-366.View ArticlePubMedGoogle Scholar
Sankey A, Hill CM, Brown J, Quinn L, Fletcher MA: A follow-up study of chronic fatigue syndrome in children and adolescents: symptom persistence and school absenteeism. Clin Child Psychol Psychiatry. 2006, 11 (1): 126-138. 10.1177/1359104506059133.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
