- Open Access
Nomogram for short-term outcome assessment in AChR subtype generalized myasthenia gravis
Journal of Translational Medicine volume 19, Article number: 285 (2021)
An accurate prediction for prognosis can help in guiding the therapeutic options and optimizing the trial design for generalized myasthenia gravis (gMG). We aimed to develop and validate a predictive nomogram to assess the short-term outcome in patients with the anti-acetylcholine receptor (AChR) subtype gMG.
We retrospectively reviewed 165 patients with AChR subtype gMG who were immunotherapy naïve at the first visit from five tertiary centers in China. The short-term clinical outcome is defined as the achievement of minimal symptom expression (MSE) at 12 months. Of them, 120 gMG patients from Huashan Hospital were enrolled to form a derivation cohort (n = 96) and a temporal validation cohort (n = 24) for the nomogram. Then, this nomogram was externally validated using 45 immunotherapy naïve AChR subtype gMG from the other four hospitals. Multivariate logistic regression was used to screen independent factors and construct the nomogram.
MSE was achieved in 70 (72.9%), 20 (83.3%), and 33 (73.3%) patients in the training, temporal validation, and external validation cohort, respectively. The duration ≤ 12 months (p = 0.021), ocular score ≤ 2 (p = 0.006), QMG score > 13 (p = 0.008), and gross motor score ≤ 9 (p = 0.006) were statistically associated with MSE in AChR subtype gMG. The nomogram has good performance in predicting MSE as the concordance indexes are 0.81 (95% CI, 0.72–0.90) in the development cohort, 0.944 (95% CI, 0.83–1.00) in the temporal validation cohort, and 0.773 (95% CI, 0.63–0.92) in the external validation cohort.
The nomogram achieved an optimal prediction of MSE in AChR subtype gMG patients using the baseline clinical characters.
Myasthenia gravis (MG) is an autoimmune disorder characterized by pathological autoantibody-mediated transmission defect in neuromuscular junctions (NMJ) of ocular, bulbar, limb, respiratory, and axial muscles. It can be further divided into different subgroups according to the presentations, antibody specificity, and onset age due to the clinical heterogeneity . Based on the involved muscle, there are approximately 80% of patients develop generalized weakness . Of these generalized myasthenia gravis (gMG) patients, 85% are seropositive for anti-acetylcholine receptor (AChR) antibodies . Therefore, anti-AChR antibody-positive gMG patients account for the majority of MG and also are the main participants in the clinical trials for new immunotherapies.
Therapeutic response and the outcome for gMG patients are critical concerns in clinical practice. Conventional immunotherapies for gMG include corticosteroids and immunomodulatory agents (e.g., azathioprine, mycophenolate mofetil, methotrexate, cyclosporine, and tacrolimus) . A predictive model has been developed for evaluating the corticosteroid-induced initial worsening in a prospective cohort . However, there is still an unmet need for developing a model to predict the clinical outcome for gMG patients , especially in the era with emerging therapies development such as eculizumab and neonatal Fc receptor inhibitors [7,8,9]. For the MG patients who are likely to achieve remission, the benefit from the excessive treatment maybe not be cost-effective . Longitudinal studies provided evidence that approximately 75% of MG patients had an optimal outcome with remission, confined ocular involvement, or mild weakness, while only 7% achieved complete stable remission within a decade . Recently, minimal symptom expression (MSE) that is defined as the patient-reported MG activity of daily living (MG-ADL) scale 0–1 has been used to evaluate the clinical efficacy of efgartigimod in gMG . In comparison to other measures, MSE may provide a more representative outcome measurement for the majority of gMG patients.
In this study, we aim to develop and validate a nomogram for predicting the clinical short-term outcome for gMG patients using the baseline clinical characteristics.
Study design and patient recruitment
There are 1193 MG patients registered in a tertiary referral diagnostic center in Huashan Hospital from August 8, 2012, through December 18, 2020. The inclusion criteria were (1) onset symptoms and signs compatible with gMG; (2) immunotherapy naive at baseline; (3) seropositive for anti-AChR antibody; (4) MG-ADL score > 1 at baseline; (5) follow-up period longer than half a year from baseline; (6) exclusion of other MG mimicking diseases including Lambert–Eaton myasthenic syndrome, peripheral neuropathy, myopathies, and motor neuron diseases. Eligible patients with the integrated baseline data recruited from February 13, 2017, through August 2, 2019, were included in the training cohort for the development of the nomogram, and those recruited from August 2, 2019, through March 13, 2020, were included into the temporal validation cohort. Then, the nomogram was externally validated using 45 anti-AChR antibody-positive gMG patients who have not received immunotherapy from May 2015 to May 2021 at 4 tertiary centers in China (Xiangya Hospital, Xuanwu Hospital, Tangdu Hospital, and Wuhan No.1 Hospital).
The clinical baseline variables include gender, age at onset, the comorbidities of autoimmune disease, and disease duration. The age at onset of MG is classified into three subgroups including early-onset (10–49 years), late-onset (50–64 years), and elderly-onset (65 years or older) . The concurrent autoimmune diseases identified in our cohort include Graves' disease, Hashimoto's autoimmune thyroiditis, type 1 diabetes mellitus, immune thrombocytopenic purpura, autoimmune hemolytic anemia, and vitiligo . The disease duration is defined as the period from the onset of weakness symptoms of MG to the first visit to our hospital. The MG associated clinical features include Myasthenia Gravis Foundation of America (MGFA) classification, thymoma concurrence, history of thymectomy, MG worsening, anti-AChR antibodies titers, pyridostigmine dosage, manual muscle test (MMT) score, MG-ADL score, and the related subscores (bulbar, respiratory, ocular, and limb score), and quantitative myasthenia gravis (QMG) score and the related subscores (extraocular muscle, bulbar muscle, gross motor, and axial motor score). The presence of thymoma is determined by a computed tomography scan. MG worsening is defined as a substantial exacerbation in muscle weakness and fatigability, or increased medication . The anti-AChR antibodies titer was measured by enzyme-linked immunosorbent assay (ELISA, Euroimmun, Lübeck, Germany) and the cut-off value was 0.50 nmol/L.
We divided the total MG-ADL score into four subscores: (1) Ocular score: double vision and eyelid droop; (2) Bulbar score: talking, chewing, and swallowing activities; (3) Respiratory score: the activity of breathing; (4) Limb score: the ability to brush teeth or comb hair, and arise from a chair. For QMG score, it was divided into 5 subscores: (1) Extraocular muscle score: first three items (double vision on lateral gaze, ptosis, and facial muscles); (2) Bulbar muscle: score fourth and fifth items (swallowing 4 oz. water, and the onset of dysarthria); (3) Gross motor score: sixth, seventh, ninth, and tenth, twelfth, and thirteenth items (arms outstretched, hands grip, and legs outstretched); (4) Axial motor score: eleventh item (head lifted); (5) Respiratory score: eighth item (Vital capacity, % predicted).
Our analysis showed that the continuous demographic characteristics data in this study were not normally distributed. The missing data of thymoma, thymectomy, anti-AChR Abs titer, and pyridostigmine dosage account for less than 10%. These missing data were missed at random and replaced by the average of the observed values. Continuous variables were expressed as medians (quartiles) and compared between groups using the Mann–Whitney U test. Categorical variables were expressed as frequencies (percentages) and were tested using the χ2 test or Fisher exact test. To determine the cut-off values of the continuous variable, we created receiver operating characteristic curves for “MSE” and defined them as the points on the ROC curve where Youden's index reached the highest. The significance of each variable in the training cohort was analyzed using univariate and multivariate logistic regression analyses. Variables showing statistical (P < 0.1) and clinical significance of the univariate analysis were included in the multivariate logistic regression analysis to develop the nomogram to predict whether a patient would achieve MSE.
The variance inflation factors (VIFs) were generated to examine individual predictors for potentially strong contributions to multicollinearity. The discrimination performance of this nomogram was measured by the concordance index (C-index) in the training and validation cohorts. The Hosmer–Lemeshow test was applied to assess the agreement between nomogram predicted and observed probabilities. All analyses were performed using IBM SPSS version 20.0 (SPSS Company, Chicago, IL, USA) and R software (R version 4.0.3, USA).
Patient demographic characteristics
A total of 1193 MG patients have been initially registered in our referral center-based database. According to the inclusion flowchart, we finally enrolled 120 AChR subtype gMG patients with no immunotherapies at the baseline registry (Fig. 1). Of these gMG patients, 96 and 24 patients were then included in the training and temporal validation cohort splitting by time. Besides, 45 AChR subtype gMG patients from the other 4 centers were enrolled for external validation.
The baseline clinical characteristics and the outcome of MG patients in the training and temporal validation cohort were comparable, except for the differences in the respiratory score (p = 0.035), and respiratory muscle score (p = 0.002) (Table 1). In the development set, 70 patients (72.9%) achieved MSE and the median disease duration was 7 (3.0–30.5) months. At baseline, 34% of patients were diagnosed to have concurrent thymoma and 24% had undergone thymectomy in the development set. The ADL and QMG scores of the development cohort were 5 (4.0–8.0) and 11 (9.0–14.0), respectively.
The clinical characteristics of the external validation and development groups are summarized in Table 2. The frequency of MSE was similar for the development (72.9%) and external validation groups (73.3%), whereas there were some differences between these groups regarding the frequency of thymectomy, disease duration, anti-AChR Abs titer, MMT score, bulbar score, bulbar muscle score, and gross motor score.
Short-term clinical outcome assessment
MSE status was achieved in 70 (72.9%), 20 (83.3%), and 33 (73.3%) patients in the training, temporal validation, and external validation cohorts at 12 months after baseline recruitment. For the patients who did not achieve MSE, the median ADL scores were 3 (range 3–6), 4.5 (range 3.25–5), and 2.5 (range 2–7) in the training, temporal validation, and external validation cohorts, respectively.
In the training and temporal validation groups in Huashan Hospital, the initial dose and dose-escalating manner of prednisone depended on the physician's decision. The final oral prednisone dose for each patient was at 0.8 mg to 1 mg/kg and azathioprine, tacrolimus, or mycophenolate mofetil as immunosuppressants concurrent with oral prednisone. Three patients had received rescue therapies including immunoglobulin and plasma exchange.
Nomogram development and validation
We identified three risk factors significantly associated with MSE including duration, ocular score, and gross motor score (p < 0.1) (Table 3). Considering the clinical significance, we also included the QMG score (p = 0.155) along with these statistically significant variables into the multivariate logistic regression. All these above variables were independently associated with MSE (p < 0.05), with results reported as odds ratio (95% CI), duration ≤ 12 months (3.45 [1.23–10.24]), ocular score ≤ 2 (6.00 [1.82 to 24.58]), QMG score > 13 (11.95 [2.31 to 95.82]), and gross motor score ≤ 9 (10.82 [2.22–69.13]). The VIFs of them were 1.01, 1.25, 1.78, and 1.84 respectively, suggesting that there was no multiple collinearity among the four independent risk factors. We then used these four factors to establish an individualized prediction nomogram, which can calculate the total point for each gMG patient with anti-AChR antibodies and converted it to predicted probabilities of MSE (Fig. 2). This nomogram was then validated in both the temporal validation cohort derived from Huashan Hospital and the external validation cohort.
The ability of this nomogram to differentiate between patients who do or do not achieve MSE is excellent as the C-indexes are 0.810 (95% CI, 0.72–0.90), 0.944 (95% CI 0.83–1.00), and 0.773 (95% CI, 0.63–0.92) in the development, temporal validation, and external validation cohorts, respectively (Fig. 3). Besides, the p-values of the Hosmer–Lemeshow test are 0.98, 0.99, and 0.61 for the development, temporal validation, and external validation sets, which indicates good agreement between nomogram predicted and observed probabilities.
To optimize the clinical management, the need to identify the patients with good prognoses using the baseline characteristics is unmet. In this multicenter study, we suggest that disease duration ≤ 12 months, ocular score ≤ 2, QMG score > 13, and gross motor score ≤ 9 before immunosuppressants administration are significant predictors for reaching the status of MSE in AChR subtype gMG patients.
For patients with anti-AChR antibodies, these antibodies bind and activate the complement cascade at the NMJ, resulting in the postsynaptic folds degeneration of skeletal muscle . It has been shown that chronic anticholinesterase treatment in rats could destroy the postsynaptic membrane . Around 80 patients (83.3%) included in the training cohort have only administered pyridostigmine before the first visit. From our study, we indicated that the patients who had a duration from onset to immunosuppressive therapies shorter than 12 months had a better outcome, which may be due to an alleviate NMJ destruction. A systematic review also identified the duration between onset and diagnosis (< 1 year) was a strong predictor of remission for MG patients .
We also found that MG patients whose baseline QMG score more than 13 were more likely to achieve MSE. Previous logistic regression analysis had also confirmed that the high baseline QMG score serves as an independent predictor of response to immunotherapy . As a result, these patients with more severe weakness symptoms measured by the QMG appear to respond better to treatments and have good prognoses.
QMG is a valid subject scale to assess the severity of the weakness. However, the items are linearly scored and not weighted. Based on the clinical practicability, though the signs of poor vital capacity and spontaneous ptosis gain the same QMG score, the degree of disability experienced by the former is more severe. As a result, MGFA also recommended “weighting” specific sub-scores of the QMG . In this study, QMG has been divided into five functional subscores and the gross motor score ≤ 9 was a significant risk factor for MSE in MG. In an observational study of 2000 MG patients over sixty years, David et al. have found some MG patients who experienced remission also had mild weakness of legs or orbicularis oculi . It was consistent with our study that gross motor score and ocular score were associated with MSE.
Our database documented the doses of corticosteroid or immunosuppressive drugs in gMG patients. The combination of immunosuppressive drugs was analyzed using univariate and multivariate logistic regression. However, there were 26 (27%) missing values in the training cohort that were replaced by fifty multiple imputations (MIs) counterparts. The multivariable model of MIs data showed that the combination of immunosuppressive drugs (p = 0.034, OR 0.22 [0.06–0.87]) with the above four risk factors was associated with MSE(Additional file 1: Table S1). Therefore, the baseline clinical characteristics other than advanced immunotherapy were vital predictors for MSE of gMG patients with anti-AChR antibodies. A recent study also revealed that the higher prednisolone dosage and the more frequent plasmapheresis were associated with the treatment-resistant outcome for MG patients . The MIs model had good agreement with the nonimputed model and there was little difference between the ORs for the original and the MIs models. Given the high percentage of missing data, the final analyses were performed on the original model.
With the development of novel therapy for MG, MSE has severed as a patient-reported primary outcome measure in clinical trials. Tough minimal manifestation status (MMS) is the goal for the treatment of MG, MSE is more available in the clinical trials for a long follow-up due to its unique advantages. MSE is not only able to reflect the patient’s experienced disease fluctuations symptom during a long period, but easy to acquire in an online follow-up study with no need of specialized equipment or training [20, 21]. This study showed that the baseline characteristics before starting immunotherapy are determinants for MSE. As a result, we suggest clinical trials that use MSE as an endpoint should pay more attention to the distribution of duration, ocular score, QMG score, and gross motor score in the different groups to decrease selection bias.
There are several limitations of our study. Firstly, the records of therapy were insufficient. However, we used the statistic method including internal temporal validation and MIs to minimize these shortcomings. Secondly, patients who did not have sufficient clinical records were excluded, which may result in selection bias. Finally, the nomogram was based only on Chinese gMG patients. This nomogram may have some restrictions to predict the outcome for gMG patients from others areas due to the different treatment methods. The prospective and large-scale analysis is required to test and verify this nomogram.
In conclusion, we develop and validate a nomogram to predict the probability to achieve MSE using the baseline clinical characteristics. The prediction would help in clinical decision-making and prognosis monitoring. Simultaneously, we suggest that these baseline clinical characteristics should be evaluated before the selection of participants in MG trials to avoid potential bias.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Generalized myasthenia gravis
Minimal symptom expression
Myasthenia gravis activities of daily living
Myasthenia Gravis Foundation of America
Manual muscle test
Quantitative myasthenia gravis
Variance inflation factors
Minimal manifestation status
Gilhus NE, Tzartos S, Evoli A, Palace J, Burns TM, Verschuuren J. Myasthenia gravis. Nat Rev Dis Primers. 2019;5:30.
Hehir MK, Silvestri NJ. Generalized myasthenia gravis: classification, clinical presentation, natural history, and epidemiology. Neurol Clin. 2018;36:253–60.
Lindstrom JM, Seybold ME, Lennon VA, Whittingham S, Duane DD. Antibody to acetylcholine receptor in myasthenia gravis. Prevalence, clinical correlates, and diagnostic value. Neurology. 1976;26:1054–9.
Wang L, Huan X, Xi J-Y, Wu H, Zhou L, Lu J-H, Zhang T-S, Zhao C-B. Immunosuppressive and monoclonal antibody treatment for myasthenia gravis: a network meta-analysis. CNS Neurosci Ther. 2019;25:647–58.
Kanai T, Uzawa A, Kawaguchi N, Oda F, Ozawa Y, Himuro K, Kuwabara S. Predictive score for oral corticosteroid-induced initial worsening of seropositive generalized myasthenia gravis. J Neurol Sci. 2019;396:8–11.
Mao ZF, Mo XA, Qin C, Lai YR, Olde Hartman TC. Course and prognosis of myasthenia gravis: a systematic review. Eur J Neurol. 2010;17:913–21.
Vissing J, Jacob S, Fujita KP, O’Brien F, Howard JF. “Minimal symptom expression” in patients with acetylcholine receptor antibody-positive refractory generalized myasthenia gravis treated with eculizumab. J Neurol. 2020;267:1991–2001.
Howard JF Jr, Bril V, Burns TM, Mantegazza R, Bilinska M, Szczudlik A, Beydoun S, Garrido F, Piehl F, Rottoli M, et al. Randomized phase 2 study of FcRn antagonist efgartigimod in generalized myasthenia gravis. Neurology. 2019;92:e2661–73.
Nguyen-Cao TM, Gelinas D, Griffin R, Mondou E. Myasthenia gravis: historical achievements and the “golden age” of clinical trials. J Neurol Sci. 2019;406:116428.
Bacci ED, Coyne KS, Poon JL, Harris L, Boscoe AN. Understanding side effects of therapy for myasthenia gravis and their impact on daily life. BMC Neurol. 2019;19:335.
2020 Virtual AANEM Annual Meeting Abstract Guide. Muscle Nerve 2020, 62 Suppl 1:S1-S131.
Murai H, Yamashita N, Watanabe M, Nomura Y, Motomura M, Yoshikawa H, Nakamura Y, Kawaguchi N, Onodera H, Araga S, et al. Characteristics of myasthenia gravis according to onset-age: Japanese nationwide survey. J Neurol Sci. 2011;305:97–102.
Hayter SM, Cook MC. Updated assessment of the prevalence, spectrum and case definition of autoimmune disease. Autoimmun Rev. 2012;11:754–65.
Khadilkar SV, Chaudhari CR, Patil TR, Desai ND, Jagiasi KA, Bhutada AG. Once myasthenic, always myasthenic? observations on the behavior and prognosis of myasthenia gravis in a cohort of 100 patients. Neurol India. 2014;62:492–7.
Engel AG, Tsujihata M, Lindstrom JM, Lennon VA. The motor end plate in myasthenia gravis and in experimental autoimmune myasthenia gravis. A quantitative ultrastructural study. Ann N Y Acad Sci. 1976;274:60–79.
Katzberg HD, Barnett C, Bril V. Predictors of response to immunomodulation in patients with myasthenia gravis. Muscle Nerve. 2012;45:648–52.
Jaretzki A 3rd, Barohn RJ, Ernstoff RM, Kaminski HJ, Keesey JC, Penn AS, Sanders DB. Myasthenia gravis: recommendations for clinical research standards. Task Force of the Medical Scientific Advisory Board of the Myasthenia Gravis Foundation of America. Neurology. 2000;55:16–23.
Grob D, Brunner N, Namba T, Pagala M. Lifetime course of myasthenia gravis. Muscle Nerve. 2008;37:141–9.
Ozawa Y, Uzawa A, Yasuda M, Kojima Y, Onishi Y, Oda F, Kanai T, Himuro K, Kawaguchi N, Kuwabara S. Long-term outcomes and prognostic factors in generalized myasthenia gravis. J Neurol. 2021. https://doi.org/10.1007/s00415-021-10520-x.
Muppidi S, Wolfe GI, Conaway M, Burns TM. MG-ADL: still a relevant outcome measure. Muscle Nerve. 2011;44:727–31.
Muppidi S. The myasthenia gravis–specific activities of daily living profile. Ann N Y Acad Sci. 2012;1274:114–9.
We would like to thank Jie Song, Lei Zhou, and Jun Lu for their assistance in data collection.
This work was supported by financial grants from the National Natural Science Foundation of China (No. 81870988 and 82071410), and Shanghai Municipal Science and Technology Major Project (No.2018SHZDZX01), and ZJLab.
Ethics approval and consent to participate
This study was approved by the ethics committee of each hospital. Written informed consent was obtained from each study participant before sample collection. All study procedures were performed by the principles of Good Clinical Practice and the Declaration of Helsinki.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file 1. Table S1.
Univariate and multivariate Logistic regression models for minimal symptom expression in the development group.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Zhao, R., Wang, Y., Huan, X. et al. Nomogram for short-term outcome assessment in AChR subtype generalized myasthenia gravis. J Transl Med 19, 285 (2021). https://doi.org/10.1186/s12967-021-02961-9
- Generalized myasthenia gravis
- Anti-acetylcholine receptor antibody
- Minimal symptom expression