Skip to main content
Download PDF

Comparison and development of machine learning tools for the prediction of chronic obstructive pulmonary disease in the Chinese population

Journal of Translational Medicine volume 18, Article number: 146 (2020) Cite this article

Abstract

Background

Chronic obstructive pulmonary disease (COPD) is a major public health problem and cause of mortality worldwide. However, COPD in the early stage is usually not recognized and diagnosed. It is necessary to establish a risk model to predict COPD development.

Methods

A total of 441 COPD patients and 192 control subjects were recruited, and 101 single-nucleotide polymorphisms (SNPs) were determined using the MassArray assay. With 5 clinical features as well as SNPs, 6 predictive models were established and evaluated in the training set and test set by the confusion matrix AU-ROC, AU-PRC, sensitivity (recall), specificity, accuracy, F1 score, MCC, PPV (precision) and NPV. The selected features were ranked.

Results

Nine SNPs were significantly associated with COPD. Among them, 6 SNPs (rs1007052, OR = 1.671, P = 0.010; rs2910164, OR = 1.416, P < 0.037; rs473892, OR = 1.473, P < 0.044; rs161976, OR = 1.594, P < 0.044; rs159497, OR = 1.445, P < 0.045; and rs9296092, OR = 1.832, P < 0.045) were risk factors for COPD, while 3 SNPs (rs8192288, OR = 0.593, P < 0.015; rs20541, OR = 0.669, P < 0.018; and rs12922394, OR = 0.651, P < 0.022) were protective factors for COPD development. In the training set, KNN, LR, SVM, DT and XGboost obtained AU-ROC values above 0.82 and AU-PRC values above 0.92. Among these models, XGboost obtained the highest AU-ROC (0.94), AU-PRC (0.97), accuracy (0.91), precision (0.95), F1 score (0.94), MCC (0.77) and specificity (0.85), while MLP obtained the highest sensitivity (recall) (0.99) and NPV (0.87). In the validation set, KNN, LR and XGboost obtained AU-ROC and AU-PRC values above 0.80 and 0.85, respectively. KNN had the highest precision (0.82), both KNN and LR obtained the same highest accuracy (0.81), and KNN and LR had the same highest F1 score (0.86). Both DT and MLP obtained sensitivity (recall) and NPV values above 0.94 and 0.84, respectively. In the feature importance analyses, we identified that AQCI, age, and BMI had the greatest impact on the predictive abilities of the models, while SNPs, sex and smoking were less important.

Conclusions

The KNN, LR and XGboost models showed excellent overall predictive power, and the use of machine learning tools combining both clinical and SNP features was suitable for predicting the risk of COPD development.

Background

It has been reported that chronic obstructive pulmonary disease (COPD) is a public health challenge due to its high prevalence and related disability, mortality and socioeconomic burden worldwide [1,2,3]. Approximately 90% of deaths related to COPD occur in Asia and Africa [4]. In 2013, more than 0.9 million deaths related to COPD occurred, and COPD was reported to be the third leading cause of death in China [5].

The typical symptoms of COPD include dyspnea, chronic cough, and sputum production, and spirometry is considered the gold-standard method for the diagnosis of COPD [6]. Spirometry is essential for diagnosis and provides a useful description of the severity of pathologic changes in COPD. The forced expiratory volume in one second (FEV1), forced vital capacity (FVC), and the ratio of FEV1 to FVC are used to evaluate pulmonary function [7]. COPD is now clinically defined as a post-bronchodilator FEV1/FVC less than 70% of the predicted value and FEV1 less than 80% of the predicted value [8].

Rehman et al. [3] reported that in Europe and the USA, the prevalence of COPD ranges from 3.4 to 13.4%, whereas in Asia, the prevalence ranges from 3.5 to 19.1% [9] due to urbanization, industrial pollution, tanneries and the sue of biomass fuel inside homes [10].

Smoking is a well-known risk factor for COPD development; however, fewer than 20% of smokers develop COPD, and more than 15% of non-smokers have COPD [11]. Recent studies have shown that many people develop COPD without ever smoking. Therefore, other factors besides personal smoking, other environmental triggers, such as second-hand smoke during pregnancy or early childhood, various genetic factors, occupational exposure to dust, noxious fumes and vapors, indoor air pollution from the use of biomass fuels, and outdoor air pollution, may interact in an additive manner with risk factors within individual and lifestyle issues (diet and exercise) [12]. Zhong reported that COPD was more common among rural residents than among urban residents in China, probably because of a number of environmental and individual risk factors, such as old age, smoking, coal use, infection, and low body mass index (BMI) [13]. In addition, it has been reported that infections could promote the progression of COPD, such as in patients with emphysema and adenoviral infections or patients with asthma and intracellular infections [14,15,16]. Beyer et al. reported that COPD may originate in childhood or even in utero. Lung function can be compromised during lung development in utero—e.g., low birthweight babies or children whose mothers smoked during pregnancy have reduced lung function soon after birth [17].

Wang et al. reported a national cross-sectional study in China that indicated that COPD was highly prevalent in the Chinese adult population. Cigarette smoking, ambient air pollution, underweight, childhood chronic cough, parental history of respiratory diseases, and low education are major risk factors for COPD in the Chinese population. Among these factors, cigarette smoking and air pollution are major preventable risk factors for this disease [18]. With rapid industrialization and urbanization, ambient air pollution has become a major public health crisis in China [19]. The air quality composite index (AQCI) was obtained from the Chinese Official website, which included the pollution degree of the six pollutants SO2, NO2, PM10, PM2.5, CO and O3 and other pollutants. The higher the AQCI is, the more serious the pollution. In the present study, we used a combination of AQCI and other risk factors, such as age, sex, BMI and smoking, to predict COPD development.

In addition, COPD susceptibility- or disease progression-related genes have been reported [20], and genome-wide association studies (GWASs) have revealed single nucleotide polymorphism (SNP) sites related to COPD occurrence and development, such as HHIP [21], IL13 [22], MMP9 [23], SFTPB [24], SOD3 [25], CHRNA3 [26], RNF150 [27], BICD1 [28], COL4A3 [29], AQP5 [30], AGPHD1 [31], IREB2 [32], etc. Many studies have indicated that some candidate genes are associated with COPD over the past few years. However, there have been few studies on the susceptible loci of COPD in the Chinese population in recent years (Additional file 1: Table S1).

Lung function is the gold standard for the clinical diagnosis of COPD; however, when the FEV1/FVC or FEV1% value is abnormal, lung function is a defective indicator in approximately 30% of patients [33]. COPD in the early stages is usually not recognized, diagnosed, or treated and therefore may not be included as a diagnosis in patient medical records. Therefore, the applicability of the lung function index for the early diagnosis of COPD is limited. With the rapid aging of the Chinese population, COPD has become one of the leading causes of disability and a large economic burden [34]. Therefore, it is necessary to develop a reliable early warning method for COPD that could lead to early intervention and treatment for COPD.

In the present study, we performed a case–control study including 441 patients with COPD and 192 healthy controls. Then, the odds ratios (ORs) of the genotypes of 101 SNPs and clinical features for COPD development were calculated. We established and compared six prediction models that included susceptible SNPs and clinical features using statistical, machine learning and neural network approaches.

Methods and materials

Study population

A total of 441 COPD patients and 192 control subjects were randomly recruited from seven subcenters in China from January to December 2017, including Linfen People’s Hospital (Linfen city, Shanxi Province), Jincheng People’s Hospital (Jincheng city, Shanxi Province), Heji Hospital Affiliated with Changzhi Medical College (Changzhi city, Shanxi Province), General Hospital of Tisco (Sixth Hospital of Shanxi Medical University) (Taiyuan city, Shanxi Province), Hebei General Hospital (Shijiazhuang city, Hebei Province), General Hospital of Datong Coal Mine Group Co., Ltd. (Datong city, Shanxi Province), and Shanghai Zhangjiang Institute of Medical Innovation (Shanghai). COPD was diagnosed according to the Global Initiative for Chronic Obstructive Lung Disease (GOLD) criteria [6], and patients with other medical histories were excluded. All procedures were performed in accordance with the ethical standards of the Clinical Research Ethics Committee of the above hospitals, and informed consent was obtained from all individuals included in the study.

The basic characteristics of all participants are listed in Additional file 2: Tables S2 and Additional file 3: Table S3. Smoking status was defined as follows: nonsmokers had never smoked, and smokers included ex-smokers and current smokers. BMI was measured in kg/m2(underweight < 19, normal = 19–25, overweight = 25–30, obese ≥ 30). AQCI values were derived from the following seven regions according to official government website statistics in China: five cities from Shanxi Province (http://sthjt.shanxi.gov.cn/html/tndt/20180119/58694.html), Shijiazhuang from Hebei Province (http://hbepb.hebei.gov.cn/hjzlzkgb/) and Shanghai (http://www.mee.gov.cn/hjzl/zghjzkgb/lnzghjzkgb/).

DNA extraction and genotyping

We selected 101 SNPs from 76 genes and 9 intergenic regions that were previously reported to be associated with COPD [20, 23,24,25,26,27,28,29, 32, 35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60]. A 4-mL peripheral blood sample was obtained from each participant for DNA analysis. Genomic DNA was extracted from whole blood using the GoldMag-Mini Whole Blood Genomic DNA Purification Kit (GoldMag Co. Ltd., Xi’an City, China). The DNA concentration was measured using a NanoDrop 2000 (Thermo Scientific, Fitchburg, WI, USA).

MassArray assay

We used the https://agenacx.com website to design multiplex primers for each SNP: 1st PCR primer, 2nd PCR primer, and UEP primer. The primers for the 101 SNPs are shown in Additional file 4: Table S4. The SNPs were genotyped with an Agena BioscienceTMMassARRAY® Analyzer 384-well Configuration (Agena, CA, USA) according to the standard protocol recommended by the manufacturer.

PCR amplification was performed in a reaction system with a total volume of 5 μl containing 10 ng genomic DNA, 1 U PCR enzyme (Agena), 0.5 μl 10× PCR buffer, 0.1 μl dNTPs mix and 0.5 μl of each primer under the following program: 2 min denaturation at 95 °C, 45 cycles of 30 s at 95 °C, 30 s at 56 °C and 60 s at 72 °C and a final extension at 72 °C for 5 min. Then, the PCR products were cleaned by 2 μl SAP (Agena) including 1.53 μl nanopure water, 0.17 μl SAP buffer and 0.5 U SAP enzyme with the following steps: 40 min at 37 °C and 5 min at 85 °C. Finally, the single-base extension used 2 μl iPLEX EXTEND mix (Agena) containing 0.619 μl nanopure water, 0.94 μl Extend primer mix, 0.041 μl iPLEX enzyme, 0.2 μl iPLEX buffer and 0.2 μl iPLEX termination mix and was performed with the following steps: initial denaturation at 94 °C for 30 s, followed by 40 cycles of a 3-step amplification profile of 5 s at 94 °C, an additional 5 cycles of 5 s at 52 °C and 5 s at 80 °C and a final extension at 72 °C for 3 min. Data management and analysis were performed using Typer Analyzer 4.0 software (Agena). Several SNP samples were finally excluded because ≥ 10% of the genotyping data were missing.

Model construction in the training set

First, 290 COPD patients and 103 control subjects were enrolled as the training set, and the OR values of all genotypes of SNPs were calculated using the PLINK software package (version 1.07) [61]. The genotypes with missing OR values were assigned the average OR value. Nine SNPs were identified to be significantly associated with COPD risk in the Chinese population. Then, 6 models were established to predict COPD development, including a logistic regression (LR) model, an artificial neural network of the multilayer perceptron (MLP), a decision tree model (DT), a XGboost model, a support vector machine (SVM) and a k-nearest neighbors classifier (KNN) model, and included 5 clinical features and 9 SNPs. K-folder cross validation (k = 5) was used to train, construct and compare the 6 predictive models. The confusion matrix, area under the receiver operating characteristic (ROC) curve (AU-ROC), the area under the precision-recall (PR) curve (AU-PRC), specificity, sensitivity (recall), positive predictive value (PPV (precision)), negative predictive value (NPV), accuracy, F1 score and MCC were used to evaluate and compare the comprehensive performance of feature selection. AU-ROC is one of the most used metrics in evaluating binary classifiers and shows the true positive rate against the false positive rate. Compared with AU-ROC, AU-PRC is useful for unbalanced data, such as our study, and shows precision against recall. The F1 score takes the harmonic mean of precision and recall [62]. The MCC result ranges between -1 and 1, where a value of 1 indicates a perfect positive correlation, a value of -1 indicates a perfect negative correlation, and a value of 0 indicates no correlation [63].

Model selection was based on several currently and frequently adopted predictive model types. For example, the linear LR model [64] and SVM model have been widely adopted in many clinical applications, such as for CKD disease prediction [65]. The DT model [66] is based on a radial basis function neural network and support vector machine coupled with firefly algorithm techniques; the XGboost and MLP models have also been used in clinical research [65, 67]. KNN was chosen due to its simplicity and ability to perform multiclass classification, and this algorithm could run with default parameters [68]. When tuning the parameters in the KNN, SVM and DT models, the overall effect did not perform as well as choosing default parameters, so tuning parameters were not chosen in the three models, while tuning parameters were used in the LR, MLP and XGboost models. All the corresponding parameters are listed in Additional file 5: Table S5.

Assessment of the six models in the test set

In the validation set, we no longer calculated the OR values from PLINK software and directly mapped the OR value of each genotype from the training set. However, the genotypes with missing OR values were assigned the average OR value independently in the test set. To validate the training set, we recruited 151 COPD patients and 89 controls in the test set. Six models were selected for validation in the test set. The entire process is shown in Fig. 1. All the input data and sample output folders were uploaded to GitHub (https://github.com/weilan-yuan/COPD_machine-learning).

Fig. 1
figure 1

Flow chart display. Flow chart showing the SNP selection, model training, and performance evaluation processes. A total of 633 subjects were recruited for the current study. The data were preprocessed and randomly divided into a training set (393 participants) and a test set (240 participants). k-fold cross-validation was used in the training set, and performance evaluation indexes such as AU-ROC and AU-PRC were adopted to judge the average predictive performance of each model

Full size image

Statistical analysis

For all SNPs, the ORs and 95% confidence intervals (CIs) of the minor alleles were assessed without adjusting for age, sex, BMI, smoking status and AQCI by Chi squared tests using the PLINK package between COPD patients and healthy controls. Furthermore, six predictive models (KNN, LR, DT, SVM, XGboost and MLP) for COPD risk were used and evaluated by Python (version 3.7.0) and included 9 SNPs with 5 clinical features. The diagnostic values of the 6 models were assessed by ROC and PRC analysis. Parametric statistics (t-test) were used for normally distributed data, and nonparametric statistics (Mann–Whitney) were used for non-normally distributed data. The t-test and nonparametric Mann–Whitney U test or Chi squared test was used to compare parametric and categorical variables, respectively. Statistical calculations were performed in R studio (R.3.51). P ≤ 0.05 was the threshold for statistical significance.

Results

Clinical characteristics of the participants

The clinical characteristics of the cases and controls are shown in Additional file 2: Tables S2 and Additional file 3: Table S3. There were significant differences in age, sex, smoking status, AQCI, FEV1/FVC (%) and FEV1 (%) between COPD patients and healthy controls (P < 0.0001) in both the training and test sets. Only the BMI levels were similar between the two groups. The results indicated that COPD patients were more likely to be older, male, and smokers, and the FEV1/FVC (%) and FEV1 (%) values were lower in the COPD group than in the healthy controls.

Allele frequency comparisons between the two groups

In the training set, 6 SNPs (rs3025030, rs28929474, rs7326277, rs7326277, rs16969968, and rs59569785) were excluded because ≥ 10% of the sample data were missing. Finally, 95 of the 101 SNPs were included in the following analysis. We assumed that the minor allele (A1) of each SNP was a risk factor compared to the main allele (A2) and obtained the OR values. All results are shown in Additional file 6: Table S6. The results showed that 9 SNPs tended to be significantly associated with COPD: 6 SNPs (rs1007052, rs2910164, rs159497, rs473892, rs9296092 and rs161976) were risk factors for COPD development, while 3 SNPs (rs8192288, rs12922394 and rs20541) were protective factors against developing COPD, as shown in the forest plots in Fig. 2.

Fig. 2
figure 2

Nine SNPs associated with COPD. Forest plots show 9 SNPs associated with COPD (odds ratios (ORs) and 95% confidence intervals (CIs)). ORs are denoted by black boxes, and 95% CIs are denoted by the corresponding black lines

Full size image

The role of six risk SNPs in COPD

Among the 6 risk SNPs, the SNP rs10007052 is located in the first intron of the RNF150 gene. Ding et al. first reported that polymorphisms of RNF150 were significantly associated with COPD risk in the Chinese Han and Li populations [27]. In our present case–control study, we also found that the SNP rs10007052 affected the pathogenesis of COPD in a Chinese population (rs1007052, OR = 1.671, 95% CI 1.128–2.477, P = 0.010). rs2910164 was reported as a C/G polymorphism in the precursor stem region of pre-miR146a on chromosome 5q33 and was first associated with genetic predisposition towards papillary thyroid cancer [69]. In the current study, we found that the G allele of the rs2910164 SNP (OR = 1.416, 95% CI 1.020–1.967, p < 0.037) is a risk factor for COPD development. Regarding rs473892, which is located in intergenic regions at chromosome 6 near the gene OLIG3, the T allele of rs473892 was associated with a higher FEV1 level in subjects with high exposure to mineral dust than in those without exposure in the LifeLines and Vlagtwedde-Vlaardingen samples [70]. In the present study, we found that the C allele of rs473892 (OR = 1.473, 95% CI 1.008–2.152, P < 0.045) was a risk factor for COPD development. These findings indicated that the T allele of rs473892 may be a protective locus for COPD, while the C allele is a risk locus for COPD. It has been reported that BICD1 (rs161976) is a potential susceptibility gene in COPD patients. rs161976 was previously demonstrated in a GWAS to be associated with emphysema in patients with COPD with an FEV1 < 80% of the predicted value [71]. In the present study, we found that rs161976 (OR = 1.594, 95% CI 1.010–2.515, P < 0.044) is also a risk locus in COPD. rs159497 is located in intergenic regions near the PDE4D gene. It was reported that PDE4D was not only a susceptibility gene for asthma [72] but also for ever-smokers who were associated with a reduced FEV1 level [73]. In the current study, we also showed that rs159497 (OR = 1.445, 95% CI 1.007–2.073, P < 0.045) was a risk factor for COPD development. rs9296092 is located in intergenic regions that lie in the gene region between the zinc finger and BTB domain containing 9 and BCL2-antagonist/killer1 (ZBTB9-BAK1) at chromosome 6 p21.32. Ding et al. also reported that in a case–control study, rs9296092 was associated with the greatest increase in the risk of COPD in the Hainan Province of China [74]. In our current study, we found that the A allele of rs9296092 (OR = 1.832, 95% CI 1.005–3.34, P < 0.045) is also a risk factor for COPD development.

The roles of rs8192288, rs20541 and rs12922394 in COPD

In addition, 3 SNPs were protective against COPD; among them, the SNP rs8192288 is located in the first intron of the SOD3 gene [25]. In our present results, we found that the T allele of rs8192288 (OR = 0.593, 95% CI 0.388–0.906, P < 0.015) was associated with a reduced risk of COPD. The SNP rs20541 is in the fourth exon of the IL-13 gene [75]. In the present study, we found that the A allele of rs20541 (OR = 0.669, 95% CI 0.480–0.942, P < 0.018) is a protective factor against COPD. The SNP rs12922394 is in the first intron of the CDH13 gene and is usually removed during the gene-splicing process. Yuan et al. reported that the T allele of rs12922394 was associated with a significantly reduced risk of COPD [44]. In the current study, we found that the T allele of rs12922394 (R = 0.651, 95% CI 0.449–0.942, P < 0.022) was also associated with a reduced risk of COPD, indicating that this variant may protect against COPD development.

Comparison of 6 prediction models in the training set

In the training set, k-fold cross-validation (k = 5) was used, and various parameter combinations were exhausted by grid search. Six models were established in this study. For each model, the evaluation indicators used were the confusion matrix, AU-ROC, AU-PRC, specificity, sensitivity (recall), PPV (precision), NPV, accuracy, F1 and MCC score. The average AU-ROC, AU-PRC and 95% CI are shown in Fig. 3a, b. Five models had AU-ROC values above 0.82, and only the MLP model had a lower value (0.80). The AU-PRC values were above 0.91 for all models. Otherwise, the six models presented varying performances, as shown in Table 1. Five models, namely, KNN, LR, SVM, DT and XGboost, had excellent performance, and the accuracy, PPV (precision), sensitivity (recall), and F1 score were above 0.81, 0.85, 0.87 and 0.87, respectively. Among the five models, the MCC, specificity and NPV were above 0.69, 0.78 and 0.80, respectively, for both the DT and XGboost models; the MLP model obtained the highest sensitivity (recall) (0.99) and NPV (0.87) but had the lowest specificity rate (0.10). XGboost obtained the highest AU-ROC value of 0.94 (95% CI 0.89–0.98) and AU-PRC value of 0.97 (95% CI 0.93–0.99), with the highest accuracy (0.91), PPV (precision) (0.95), F1 score (0.94), MCC (0.77) and specificity (0.85). The results indicated that XGboost was the best-performing model in the training set. Therefore, we used the XGboost model to analyze the importance of features including 9 SNPs and 5 clinical features, and the feature score (F. score) rankings were measured by the total_gain metric in XGboost (Fig. 4). The results showed that location (AQCI), age and BMI played important roles in the model, while 9 SNPs, smoking status and sex were less important.

Fig. 3
figure 3

Evaluation of the predictive models. a, b The picture shows the AU-ROC and AU-PRC curves of the 6 models in the training set. Mean AUC values and 95% CIs of different prediction models are shown in the box

Full size image
Table 1 The efficacy of KNN, LR, SVM, DT, MLP and XGboost in the training set
Full size table
Fig. 4
figure 4

Analysis of the importance of each feature. The histogram describes the relative importance of 9 SNPs and 5 clinical features in the XGboost model. The relative importance is quantified by assigning a weight between 0 and 1000 for each variable

Full size image

To verify the importance of clinical features or SNPs for predicting COPD in all models, we used only 9 SNPs and 5 clinical features and selected the top 5 ranked features, which included 3 clinical features (AQCI, age and BMI) and 2 SNPs (rs12922394 and rs10007052), to be included in the six models. The results indicated that with only the input of 9 SNPs, the AU-ROC values were only 0.51–0.66, but the AU-PRC values of all models were 0.80–0.86 (Additional file 7: Fig. S1). The PPV (precision), sensitivity (recall) and F1 score of all models were above 0.70, and the accuracy rate was above 0.61. However, the other evaluation indexes, such as MCC, specificity and NPV, were poor for all six models (Additional file 8: Table S7). The AU-PRC is an alternative approach for assessing the performance of a biomarker and is a summary statistic that reflects the ability of a biomarker to identify the diseased group [76]. In the present study, we found that with only the input of the 9 SNPs, all models had reduced AU-ROCs, but the AU-PRC showed a satisfactory performance (0.80–0.86). The results indicated that AU-PRC may be a good biomarker for predicting COPD.

In addition, the 5 clinical features showed better performance than the SNPs. The AU-ROC and AU-PRC values were above 0.82 and 0.92, respectively (Additional file 9: Fig. S2), with the, PPV (precision), sensitivity (recall) and F1 score exceeding 0.80 for all models; the MCC and specificity for DT and XGboost were above 0.70. KNN had the highest sensitivity (recall) (0.94). Both DT and XGboost had the same highest F1 score (0.93) and the same highest NPV (0.82) (Additional file 10: Table S8). Among all models, the XGboost model also obtained the highest AU-ROC (0.93, 95% CI 0.91–0.95) and AU-PRC (0.97, 95% CI 0.92–0.98), similar to the results shown in Fig. 3, as well as the highest accuracy (0.91), PPV (precision) (0.95), MCC (0.77) and specificity (0.86).

When inputting the top 5 ranked features, the AU-ROC and AU-PRC values were above 0.80 and 0.91, respectively (Additional file 11: Fig. S3), with PPV (precision), sensitivity (recall) and F1 score exceeding 0.82, 0.88 and 0.85 in all models, respectively; among these values, the accuracy values of KNN, LR, DT and XGboost were above 0.81. The MCC, specificity and NPV were above 0.71, 0.77 and 0.80 for both the DT and XGboost models, respectively; the MLP model had the lowest MCC rate (0.43), and the SVM had the lowest specificity rate (0.47) (Additional file 12: Table S9). Moreover, the XGboost model still obtained the highest AU-ROC (0.93, 95% CI 0.88–0.98) and AU-PRC (0.97, 95% CI 0.89–0.99) as well as the highest accuracy (0.91), PPV (precision) (0.94), sensitivity (recall) (0.94), F1 score (0.94), MCC (0.78), specificity (0.84) and NPV (0.84). These results indicated that clinical features played more important roles than SNPs in predicting COPD development.

Validation of the six models in the test set

According to the training results, we validated all models in the test set. The AU-PRC values were above 0.80 for all models. Among the models, the KNN, LR, and XGboost models had excellent overall predictive power, the AU-ROC values were above 0.80 (Fig. 5), and the accuracy, PPV (precision), sensitivity (recall), F1 score and NPV were above 0.79, 0.78, 0.90, 0.84, and 0.80, respectively. The DT obtained the lowest AU-ROC value (0.73); the MLP model obtained the highest sensitivity (recall) (1.00) and NPV (1.00) but had the lowest specificity rate (0.38) (Table 2).

Fig. 5
figure 5

Validation of the training set. a, b The picture shows the AU-ROC and AU-PRC curves of all models in the test set

Full size image
Table 2 The efficacy of KNN, LR, SVM, DT, MLP and XGboost in the test set
Full size table

In addition, we validated only 9 SNPs, 5 clinical features and the top 5 ranked features in six models. The results indicated that with the 9 SNPs, all models performed poorly, as in the training set (Additional file 13: Table S10), while the recall and F1 score were above 0.89 and 0.73, respectively, for four models (KNN, LR, SVM and MLP). However, the AU-PRC values (0.63–0.81) were higher than the AU-ROC values (0.47–0.50) (Additional file 14: Fig. S4). When only considering 5 clinical features, the AU-PRC values of all models were above 0.79; three models, KNN, LR, and XGboost, had AU-ROC values above 0.81 (Additional file 15: Fig. S5), and the accuracy, PPV (precision), sensitivity (recall), F1 score and NPV were above 0.79, 0.78, 0.92, 0.85 and 0.82, respectively (Additional file 16: Table S11). The SVM had the lowest MCC (0.27) and specificity (0.33) and DT had the lowest AU-ROC (0.73). The MLP obtained the highest sensitivity (recall) (0.99) and NPV (0.98). When inputting the top 5 ranked features, all models had AU-PRC values above 0.80; among these models, KNN, LR, MLP and XGboost all had AU-PRC values above 0.77 (Additional file 17: Fig. S6) as well as an accuracy, PPV (precision), sensitivity (recall), F1 score and NPV above 0.78, 0.77, 0.88, 0.83 and 0.76, respectively. The SVM had the lowest MCC (0.26) and specificity (0.33). DT had the highest recall (0.97) and NPV (0.90), but the lowest AU-ROC (0.73), KNN, LR and XGboost had specificity rates above 0.60 (Additional file 18: Table S12).

Discussion

COPD is an irreversible and progressive disease, so there is an urgent need to diagnose COPD in the early stage. COPD development is affected by various factors, including genetic susceptibility, air quality, smoking status, age and BMI [12, 13]. However, the combination of genetic polymorphisms and the above factors has not yet been reported to predict early-stage COPD in the Chinese population.

With the development of artificial intelligence, such as machine learning, deep learning, and neural networks, these methods have been successfully used for disease diagnosis and prediction [77,78,79]. In the present study, we used machine learning to establish risk models (LR, KNN, SVM, MLP, DT and XGboost models) that combined various factors to predict COPD.

In the present study, we employed a dataset with 441 patients with COPD and 192 healthy controls, which satisfied the power analysis. A total of 101 SNPs were identified, and 9 SNPs were significantly associated with COPD development based on PLINK software. Our results showed that 6 SNPs (rs1007052, rs2910164, rs473892, rs161976, rs159497, and rs9296092) were risk factors for COPD, while 3 SNPs (rs8192288, rs20541, and rs12922394) were protective factors for COPD development. These results were roughly shown by previous studies. However, there is controversy regarding the role of individual SNPs in COPD. For example, a GWAS found no significant relationship between rs10007052 and COPD in Europeans [80]. However, rs10007052 was a risk factor for COPD in China [27]. In this study, we also found that rs10007052 was a risk locus for COPD, which provided more evidence for its role in COPD among the Chinese population. The inconsistent results from these studies may result from racial and ethnic differences. A meta-analysis that included 11 studies with 3077 participants (1896 cases and 1181 controls) indicated that the A allele of rs20541 was associated with an elevated risk of COPD in Caucasians but not in Asians [81]. However, in the present study, we found that the A allele of rs20541 (OR = 0.669, P < 0.018) was a protective factor for COPD in the Chinese population. More data are needed to validate this finding in the Chinese population.

Apart from SNPs, we also considered 5 clinical features that may be associated with COPD development, such as smoking history, ambient air quality, BMI, age and sex. In the training set, 6 models (LR, KNN, SVM, MLP, DT and XGboost models) were established to predict COPD risk and included 9 SNPs and 5 clinical features. We evaluated the predictive performance of these 6 models for COPD and found that the XGboost model presented the best AU-ROC and AU-PRC values in both the training and test sets in all features. The XGboost algorithm is a highly effective and widely used machine learning method that can build complex models and make accurate decisions when given adequate data [65]. We used the XGboost model to predict feature importance, and the results indicated that the AQCI was the most important factor, while SNPs were less important. This finding was consistent with our knowledge that although COPD development is affected by genetic susceptibility, ambient air pollution and physiological factors may contribute more to the process. In order to verify the importance of clinical features or SNPs for predicting COPD in all models, when only the 9 SNPs were used in all models, we found that the AU-ROC values were very low, but the AU-PRC values were above 0.79. AU-PRC has been reported to provide better agreement with the PPVs of biomarkers and should be preferred over the AU-ROC for evaluating uncommon or rare disease biomarkers [76]. Using unbalanced data, we found that the AU-PRC was a better metric than the AU-ROC, and the fluctuations were also relatively stable. When the models considered only 5 clinical features or the top 5 ranked features combined 3 clinical features and 2 SNPs, both AU-ROC and AU-PRC performed well, similar to all features combining both 5 clinical features and 9 SNPs in the models in the training set. However, in the test set, when inputting the top 5 ranked features, both the AU-ROC and AU-PRC values of the KNN, LR and XGboost models were slightly lower than those of the models that considered only 5 clinical features or combined all features. In addition, when only considering clinical features in the validation set, the accuracy, precision, MCC, specificity and NPV were 0.68, 0.69, 0.27, 0.33 and 0.64 for the SVM model, respectively (Additional file 16: Table S11). When inputting the top 5 ranked features, the accuracy, precision, MCC, specificity and NPV were 0.68, 0.69, 0.26, 0.33 and 0.63 for the SVM model, respectively (Additional file 18: Table S12). When all features, the 5 clinical features and 9 SNPs, were inputted, the accuracy, precision, MMC, specificity and NPV were 0.78, 0.77, 0.52, 0.53 and 0.82 for the SVM model, respectively (Table 2). These results indicated that clinical features played more important role than SNPs in predicting COPD development, while combined all features make various parameters more stable in the models.

There were some limitations in this study. First, the sample size used was relatively small, and the total sample of patients with COPD and healthy controls was unbalanced. Second, the samples from the seven centers were severely unbalanced; in the training set, only control subjects and no COPD patients were collected from the Shanghai area; no control subjects were recruited from Jincheng, and only one COPD patient came from Datong. In the validation set, control subjects and COPD patients from only 5 centers, excluding Jincheng and Shijiazhuang, were enrolled in the test set. Third, we only obtained 9 SNPs for the prediction models, and these SNPs performed worse than the clinical features; there may be other genetic susceptibility SNPs to be discovered. Fourth, we only collected five clinical features for the prediction models, while other risk factors were not collected, such as occupational exposure, childhood chronic cough, parental history of respiratory diseases, and low education in the Chinese population. More work is required before these models can be applied in the clinic for COPD prediction, and these findings should be validated in a larger cohort.

Conclusions

In conclusion, we identified 9 genetically susceptible loci for COPD and constructed COPD prediction models that comprised SNPs and clinical factors, including ambient air pollution. The KNN, LR and XGboost models showed excellent overall predictive power. We also identified that clinical features were more important than SNPs in predicting COPD development. Our study also revealed that these machine learning tools showed good performance for COPD risk prediction and could potentially be beneficial for the early diagnosis and treatment of patients with COPD in the Chinese population in the near feature.

Availability of data and materials

Data sharing is applicable to this article.

Abbreviations

COPD:

Chronic obstructive pulmonary disease

SNP:

Single-nucleotide polymorphism

AQCI:

Air Quality Composite Index

FEV1:

Forced expiratory volume in one second

FVC:

Forced vital capacity

BMI:

Body mass index

GWAS:

Genome-wide association studies

OR:

Odds ratio

LR:

Logistic regression

MLP:

Multilayer perceptron

DT:

Decision tree model

SVM:

Support vector machine

KNN:

k-Nearest neighbors classifier

AUC:

Area under the receiver operating characteristic curve

CI:

Confidence interval

PRC:

Precision-recall curve

MCC:

Matthews correlation coefficient

References

  1. Disease GBD, Injury I, Prevalence C. Global, regional, and national incidence, prevalence, and years lived with disability for 310 diseases and injuries, 1990–2015: a systematic analysis for the Global Burden of Disease Study 2015. Lancet. 2016;388:1545–602.

    Article  Google Scholar 

  2. Adeloye D, Chua S, Lee C, Basquill C, Papana A, Theodoratou E, Nair H, Gasevic D, Sridhar D, Campbell H, et al. Global and regional estimates of COPD prevalence: systematic review and meta-analysis. J Glob Health. 2015;5:020415.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Anees Ur R, Ahmad Hassali MA, Muhammad SA, Shah S, Abbas S, Hyder Ali IAB, Salman A. The economic burden of chronic obstructive pulmonary disease (COPD) in the USA, Europe, and Asia: results from a systematic review of the literature. Expert Rev Pharmacoecon Outcomes Res. 2019;4:1–12.

    Article  Google Scholar 

  4. May SM, Li JT. Burden of chronic obstructive pulmonary disease: healthcare costs and beyond. Allergy Asthma Proc. 2015;36:4–10.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Zhou M, Wang H, Zhu J, Chen W, Wang L, Liu S, Li Y, Wang L, Liu Y, Yin P, et al. Cause-specific mortality for 240 causes in China during 1990-2013: a systematic subnational analysis for the Global Burden of Disease Study 2013. Lancet. 2016;387:251–72.

    Article  PubMed  Google Scholar 

  6. Rabe KF, Hurd S, Anzueto A, Barnes PJ, Buist SA, Calverley P, Fukuchi Y, Jenkins C, Rodriguez-Roisin R, van Weel C, et al. Global strategy for the diagnosis, management, and prevention of chronic obstructive pulmonary disease: GOLD executive summary. Am J Respir Crit Care Med. 2007;176:532–55.

    Article  PubMed  Google Scholar 

  7. Schunemann HJ, Dorn J, Grant BJ, Winkelstein W Jr, Trevisan M. Pulmonary function is a long-term predictor of mortality in the general population: 29-year follow-up of the Buffalo Health Study. Chest. 2000;118:656–64.

    Article  CAS  PubMed  Google Scholar 

  8. Kheirallah AK, Miller S, Hall IP, Sayers I. Translating lung function genome-wide association study (GWAS) findings: new insights for lung biology. Adv Genet. 2016;93:57–145.

    Article  CAS  PubMed  Google Scholar 

  9. Buist AS, McBurnie MA, Vollmer WM, Gillespie S, Burney P, Mannino DM, Menezes AM, Sullivan SD, Lee TA, Weiss KB, et al. International variation in the prevalence of COPD (the BOLD Study): a population-based prevalence study. Lancet. 2007;370:741–50.

    Article  PubMed  Google Scholar 

  10. Mannino DM, Buist AS. Global burden of COPD: risk factors, prevalence, and future trends. Lancet. 2007;370:765–73.

    Article  PubMed  Google Scholar 

  11. Eisner MD, Anthonisen N, Coultas D, Kuenzli N, Perez-Padilla R, Postma D, Romieu I, Silverman EK, Balmes JR. Committee on Nonsmoking Copd E, Occupational Health A: an official American Thoracic Society public policy statement: Novel risk factors and the global burden of chronic obstructive pulmonary disease. Am J Respir Crit Care Med. 2010;182:693–718.

    Article  PubMed  Google Scholar 

  12. Postma DS, Bush A, van den Berge M. Risk factors and early origins of chronic obstructive pulmonary disease. Lancet. 2015;385:899–909.

    Article  PubMed  Google Scholar 

  13. Zhong N, Wang C, Yao W, Chen P, Kang J, Huang S, Chen B, Wang C, Ni D, Zhou Y, et al. Prevalence of chronic obstructive pulmonary disease in China: a large, population-based survey. Am J Respir Crit Care Med. 2007;176:753–60.

    Article  PubMed  Google Scholar 

  14. Hogg JC. Chronic bronchitis: the role of viruses. Semin Respir Infect. 2000;15:32–40.

    Article  CAS  PubMed  Google Scholar 

  15. Kraft M, Cassell GH, Henson JE, Watson H, Williamson J, Marmion BP, Gaydos CA, Martin RJ. Detection of Mycoplasma pneumoniae in the airways of adults with chronic asthma. Am J Respir Crit Care Med. 1998;158:998–1001.

    Article  CAS  PubMed  Google Scholar 

  16. Hegele RG, Hayashi S, Hogg JC, Pare PD. Mechanisms of airway narrowing and hyperresponsiveness in viral respiratory tract infections. Am J Respir Crit Care Med. 1995;151:1659–64 (discussion 1664-1655).

    Article  CAS  PubMed  Google Scholar 

  17. Beyer D, Mitfessel H, Gillissen A. Maternal smoking promotes chronic obstructive lung disease in the offspring as adults. Eur J Med Res. 2009;14(Suppl 4):27–31.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Wang C, Xu J, Yang L, Xu Y, Zhang X, Bai C, Kang J, Ran P, Shen H, Wen F, et al. Prevalence and risk factors of chronic obstructive pulmonary disease in China (the China Pulmonary Health [CPH] study): a national cross-sectional study. Lancet. 2018;391:1706–17.

    Article  PubMed  Google Scholar 

  19. Guan WJ, Zheng XY, Chung KF, Zhong NS. Impact of air pollution on the burden of chronic respiratory diseases in China: time for urgent action. Lancet. 2016;388:1939–51.

    Article  PubMed  Google Scholar 

  20. Yuan C, Lu G, Deng X. Genetic polymorphism and chronic obstructive pulmonary disease. Int J Chron Obstruct Pulmon Dis. 2017;12:1385–93.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  21. Wang B, Zhou H, Yang J, Xiao J, Liang B, Li D, Zhou H, Zeng Q, Fang C, Rao Z, et al. Association of HHIP polymorphisms with COPD and COPD-related phenotypes in a Chinese Han population. Gene. 2013;531:101–5.

    Article  CAS  PubMed  Google Scholar 

  22. Gong Y, Shi GC, Wan HY, Yang K, Pan CM, Cheng QJ, Dai RR, Li QY, Li M, Zhou M, Guo Y. Association between the interleukin-13 gene and development of chronic obstructive pulmonary disease in southern Chinese Han population: a case–control study. Chin Med J (Engl). 2013;126:4403–8.

    CAS  Google Scholar 

  23. Hirose Y, Chiba K, Karasugi T, Nakajima M, Kawaguchi Y, Mikami Y, Furuichi T, Mio F, Miyake A, Miyamoto T, et al. A functional polymorphism in THBS2 that affects alternative splicing and MMP binding is associated with lumbar-disc herniation. Am J Hum Genet. 2008;82:1122–9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  24. Foreman MG, DeMeo DL, Hersh CP, Carey VJ, Fan VS, Reilly JJ, Shapiro SD, Silverman EK. Polymorphic variation in surfactant protein B is associated with COPD exacerbations. Eur Respir J. 2008;32:938–44.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  25. Dahl M, Bowler RP, Juul K, Crapo JD, Levy S, Nordestgaard BG. Superoxide dismutase 3 polymorphism associated with reduced lung function in two large populations. Am J Respir Crit Care Med. 2008;178:906–12.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  26. Siedlinski M, Tingley D, Lipman PJ, Cho MH, Litonjua AA, Sparrow D, Bakke P, Gulsvik A, Lomas DA, Anderson W, et al. Dissecting direct and indirect genetic effects on chronic obstructive pulmonary disease (COPD) susceptibility. Hum Genet. 2013;132:431–41.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Ding Y, Niu H, Yang H, Sun P, Chen Y, Duan M, Xu D, Xu J, Jin T. EGLN2 and RNF150 genetic variants are associated with chronic obstructive pulmonary disease risk in the Chinese population. Int J Chron Obstruct Pulmon Dis. 2015;10:145–51.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  28. Lee JH, Cho MH, McDonald ML, Hersh CP, Castaldi PJ, Crapo JD, Wan ES, Dy JG, Chang Y, Regan EA, et al. Phenotypic and genetic heterogeneity among subjects with mild airflow obstruction in COPDGene. Respir Med. 2014;108:1469–80.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Kim KM, Park SH, Kim JS, Lee WK, Cha SI, Kim CH, Kang YM, Jung TH, Kim IS, Park JY. Polymorphisms in the type IV collagen alpha3 gene and the risk of COPD. Eur Respir J. 2008;32:35–41.

    Article  CAS  PubMed  Google Scholar 

  30. Hansel NN, Sidhaye V, Rafaels NM, Gao L, Gao P, Williams R, Connett JE, Beaty TH, Mathias RA, Wise RA, et al. Aquaporin 5 polymorphisms and rate of lung function decline in chronic obstructive pulmonary disease. PLoS ONE. 2010;5:e14226.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  31. Kim DK, Hersh CP, Washko GR, Hokanson JE, Lynch DA, Newell JD, Murphy JR, Crapo JD, Silverman EK, Investigators CG. Epidemiology, radiology, and genetics of nicotine dependence in COPD. Respir Res. 2011;12:9.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Castaldi PJ, Dy J, Ross J, Chang Y, Washko GR, Curran-Everett D, Williams A, Lynch DA, Make BJ, Crapo JD, et al. Cluster analysis in the COPDGene study identifies subtypes of smokers with distinct patterns of airway disease and emphysema. Thorax. 2014;69:415–22.

    Article  PubMed  Google Scholar 

  33. Isah MD, Makusidi MA, Abbas A, Okpapi JU, Njoku CH, Abba AA. Spirometric evaluation of ventilatory function in adult male cigarette smokers in Sokoto metropolis. Niger Postgrad Med J. 2017;24:1–7.

    Article  PubMed  Google Scholar 

  34. Chan KY, Li X, Chen W, Song P, Wong NWK, Poon AN, Jian W, Soyiri IN, Cousens S, Adeloye D, et al. Prevalence of chronic obstructive pulmonary disease (COPD) in China in 1990 and 2010. J Glob Health. 2017;7:020704.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Zhou DC, Zhou CF, Toloo S, Shen T, Tong SL, Zhu QX. Association of a disintegrin and metalloprotease 33 (ADAM33) gene polymorphisms with the risk of COPD: an updated meta-analysis of 2,644 cases and 4,804 controls. Mol Biol Rep. 2015;42:409–22.

    Article  CAS  PubMed  Google Scholar 

  36. Guo Y, Gong Y, Pan C, Qian Y, Shi G, Cheng Q, Li Q, Ren L, Weng Q, Chen Y, et al. Association of genetic polymorphisms with chronic obstructive pulmonary disease in the Chinese Han population: a case–control study. BMC Med Genomics. 2012;5:64.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  37. Hardin M, Zielinski J, Wan ES, Hersh CP, Castaldi PJ, Schwinder E, Hawrylkiewicz I, Sliwinski P, Cho MH, Silverman EK. CHRNA3/5, IREB2, and ADCY2 are associated with severe chronic obstructive pulmonary disease in Poland. Am J Respir Cell Mol Biol. 2012;47:203–8.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  38. Kaur-Knudsen D, Nordestgaard BG, Bojesen SE. CHRNA3 genotype, nicotine dependence, lung function and disease in the general population. Eur Respir J. 2012;40:1538–44.

    Article  PubMed  Google Scholar 

  39. Cho MH, Castaldi PJ, Wan ES, Siedlinski M, Hersh CP, Demeo DL, Himes BE, Sylvia JS, Klanderman BJ, Ziniti JP, et al. A genome-wide association study of COPD identifies a susceptibility locus on chromosome 19q13. Hum Mol Genet. 2012;21:947–57.

    Article  CAS  PubMed  Google Scholar 

  40. Hu G, Shi Z, Hu J, Zou G, Peng G, Ran P. Association between polymorphisms of microsomal epoxide hydrolase and COPD: results from meta-analyses. Respirology. 2008;13:837–50.

    Article  PubMed  Google Scholar 

  41. An L, Xia H, Zhou P, Hua L. Exploration of association between EPHX1 and chronic obstructive pulmonary disease on the basis of combined data mining. Genet Mol Res. 2016;15:2.

    Google Scholar 

  42. Zhang YF, Zhao AD. Common polymorphisms in IL-27 genes may contribute to risk of various human diseases in asian populations: a meta-analysis. Med Sci Monit. 2016;22:766–75.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  43. Wang EY, Liang WB, Zhang L. Association between single-nucleotide polymorphisms in interleukin-12A and risk of chronic obstructive pulmonary disease. DNA Cell Biol. 2012;31:1475–9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  44. Yuan YM, Zhang JL, Xu SC, Ye RS, Xu D, Zhang Y, Zhang YJ, Chen YL, Liu YL, Su ZG. Genetic variants of CDH13 determine the susceptibility to chronic obstructive pulmonary disease in a Chinese population. Acta Pharmacol Sin. 2016;37:390–7.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  45. Wang R, Li M, Zhou S, Zeng D, Xu X, Xu R, Sun G. Effect of a single nucleotide polymorphism in miR-146a on COX-2 protein expression and lung function in smokers with chronic obstructive pulmonary disease. Int J Chron Obstruct Pulmon Dis. 2015;10:463–73.

    CAS  PubMed  PubMed Central  Google Scholar 

  46. Ding Y, Niu H, Li Y, He P, Li Q, Ouyang Y, Li M, Hu Z, Zhong Y, Sun P, Jin T. Polymorphisms in VEGF-A are associated with COPD risk in the Chinese population from Hainan province. J Genet. 2016;95:151–6.

    Article  CAS  PubMed  Google Scholar 

  47. Budulac SE, Postma DS, Hiemstra PS, Kunz LI, Siedlinski M, Smit HA, Vonk JM, Rutgers B, Timens W, Boezen HM. Groningen leiden universities corticosteroids in obstructive lung disease study G: multidrug resistance-associated protein-1 (MRP1) genetic variants, MRP1 protein levels and severity of COPD. Respir Res. 2010;11:60.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  48. Zhou X, Baron RM, Hardin M, Cho MH, Zielinski J, Hawrylkiewicz I, Sliwinski P, Hersh CP, Mancini JD, Lu K, et al. Identification of a chronic obstructive pulmonary disease genetic determinant that regulates HHIP. Hum Mol Genet. 2012;21:1325–35.

    Article  CAS  PubMed  Google Scholar 

  49. Dijkstra AE, Postma DS, van Ginneken B, Wielputz MO, Schmidt M, Becker N, Owsijewitsch M, Kauczor HU, de Koning HJ, Lammers JW, et al. Novel genes for airway wall thickness identified with combined genome-wide association and expression analyses. Am J Respir Crit Care Med. 2015;191:547–56.

    Article  CAS  PubMed  Google Scholar 

  50. Hobbs BD, de Jong K, Lamontagne M, Bosse Y, Shrine N, Artigas MS, Wain LV, Hall IP, Jackson VE, Wyss AB, et al. Genetic loci associated with chronic obstructive pulmonary disease overlap with loci for lung function and pulmonary fibrosis. Nat Genet. 2017;49:426–32.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  51. van Diemen CC, Postma DS, Aulchenko YS, Snijders PJ, Oostra BA, van Duijn CM, Boezen HM. Novel strategy to identify genetic risk factors for COPD severity: a genetic isolate. Eur Respir J. 2010;35:768–75.

    Article  PubMed  CAS  Google Scholar 

  52. Hoonhorst SJ, Lo Tam Loi AT, Pouwels SD, Faiz A, Telenga ED, van den Berge M, Koenderman L, Lammers JW, Boezen HM, van Oosterhout AJ, et al. Advanced glycation end products and their receptor in different body compartments in COPD. Respir Res. 2016;17:46.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  53. Ren JT, Feng K, Wang P, Peng WH, Jia HY, Liu K, Lu HJ. Relationship between the gene polymorphism in fibroblast growth factor-10 and susceptibility to chronic obstructive pulmonary disease 220 cases. Zhonghua Jie He He Hu Xi Za Zhi. 2013;36:935–9.

    PubMed  Google Scholar 

  54. Wang B, Yang J, Xiao J, Liang B, Zhou HX, Su Z, Xu S, Chen H, Ma C, Deng J, et al. Association of XRCC5 polymorphisms with COPD and COPD-related phenotypes in the Han Chinese population: a case-control cohort study. Genet Mol Res. 2014;13:7070–8.

    Article  CAS  PubMed  Google Scholar 

  55. Ding Y, Yang D, Zhou L, Xu J, Chen Y, He P, Yao J, Chen J, Niu H, Sun P, Jin T. Variants in multiple genes polymorphism association analysis of COPD in the Chinese Li population. Int J Chron Obstruct Pulmon Dis. 2015;10:1455–63.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  56. Deng L, Zhou H, Yang J, Xiao J, Wang B, Wang L, Ou X, Feng Y. CTLA-4 gene polymorphisms and susceptibility to chronic obstructive pulmonary disease. Int J Clin Exp Pathol. 2013;6:2548–53.

    PubMed  PubMed Central  Google Scholar 

  57. Xu SC, Kuang JY, Liu J, Ma CL, Feng YL, Su ZG. Association between fibroblast growth factor 7 and the risk of chronic obstructive pulmonary disease. Acta Pharmacol Sin. 2012;33:998–1003.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  58. Hosgood HD 3rd, Menashe I, He X, Chanock S, Lan Q. PTEN identified as important risk factor of chronic obstructive pulmonary disease. Respir Med. 2009;103:1866–70.

    Article  PubMed  PubMed Central  Google Scholar 

  59. Wang J, Zhang C, Zhang Z, Zheng Z, Sun D, Yang Q, Hadadi C, Li D, Xu X, Xiong M, et al. A functional variant rs6435156C > T in BMPR2 is associated with increased risk of chronic obstructive pulmonary disease (COPD) in Southern Chinese Population. EBioMedicine. 2016;5:167–74.

    Article  PubMed  PubMed Central  Google Scholar 

  60. Yuan Y, Jiang H, Kuang J, Hou X, Feng Y, Su Z. Genetic variations in ADIPOQ gene are associated with chronic obstructive pulmonary disease. PLoS ONE. 2012;7:e50848.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  61. Purcell S, Neale B, Todd-Brown K, Thomas L, Ferreira MA, Bender D, Maller J, Sklar P, de Bakker PI, Daly MJ, Sham PC. PLINK: a tool set for whole-genome association and population-based linkage analyses. Am J Hum Genet. 2007;81:559–75.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  62. Wang Z, Hu M, Zhai G. Application of deep learning architectures for accurate and rapid detection of internal mechanical damage of blueberry using hyperspectral transmittance data. Sensors (Basel). 2018;18:1126.

    Article  Google Scholar 

  63. Elbashir MK, Sheng Y, Wang J, Wu F, Li M. Predicting beta-turns in protein using kernel logistic regression. Biomed Res Int. 2013;2013:870372.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  64. Meadows K, Gibbens R, Gerrard C, Vuylsteke A. Prediction of patient length of stay on the intensive care unit following cardiac surgery: a logistic regression analysis based on the cardiac operative mortality risk calculator, EuroSCORE. J Cardiothorac Vasc Anesth. 2018;32:2676–82.

    Article  PubMed  Google Scholar 

  65. Xiao J, Ding R, Xu X, Guan H, Feng X, Sun T, Zhu S, Ye Z. Comparison and development of machine learning tools in the prediction of chronic kidney disease progression. J Transl Med. 2019;17:119.

    Article  PubMed  PubMed Central  Google Scholar 

  66. Safari MJS. Decision tree (DT), generalized regression neural network (GR) and multivariate adaptive regression splines (MARS) models for sediment transport in sewer pipes. Water Sci Technol. 2019;79:1113–22.

    Article  PubMed  Google Scholar 

  67. Yun J, Park JE, Lee H, Ham S, Kim N, Kim HS. Radiomic features and multilayer perceptron network classifier: a robust MRI classification strategy for distinguishing glioblastoma from primary central nervous system lymphoma. Sci Rep. 2019;9:5746.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  68. Szlosek DA, Ferrett J. Using machine learning and natural language processing algorithms to automate the evaluation of clinical decision support in electronic medical record systems. EGEMS (Wash DC). 2016;4:1222.

    Google Scholar 

  69. Jazdzewski K, Murray EL, Franssila K, Jarzab B, Schoenberg DR, de la Chapelle A. Common SNP in pre-miR-146a decreases mature miR expression and predisposes to papillary thyroid carcinoma. Proc Natl Acad Sci USA. 2008;105:7269–74.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  70. de Jong K, Vonk JM, Timens W, Bosse Y, Sin DD, Hao K, Kromhout H, Vermeulen R, Postma DS, Boezen HM. Genome-wide interaction study of gene-by-occupational exposure and effects on FEV1 levels. J Allergy Clin Immunol. 2015;136(1664–1672):e1614.

    Google Scholar 

  71. Kong X, Cho MH, Anderson W, Coxson HO, Muller N, Washko G, Hoffman EA, Bakke P, Gulsvik A, Lomas DA, et al. Genome-wide association study identifies BICD1 as a susceptibility gene for emphysema. Am J Respir Crit Care Med. 2011;183:43–9.

    Article  CAS  PubMed  Google Scholar 

  72. Himes BE, Hunninghake GM, Baurley JW, Rafaels NM, Sleiman P, Strachan DP, Wilk JB, Willis-Owen SA, Klanderman B, Lasky-Su J, et al. Genome-wide association analysis identifies PDE4D as an asthma-susceptibility gene. Am J Hum Genet. 2009;84:581–93.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  73. Obeidat M, Wain LV, Shrine N, Kalsheker N, Soler Artigas M, Repapi E, Burton PR, Johnson T, Ramasamy A, Zhao JH, et al. A comprehensive evaluation of potential lung function associated genes in the SpiroMeta general population sample. PLoS ONE. 2011;6:e19382.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  74. Ding Y, Niu H, Zhou L, Zhou W, Chen J, Xie S, Geng T, Ouyang Y, He P, Sun P, et al. Association of multiple genetic variants with chronic obstructive pulmonary disease susceptibility in Hainan region. Clin Respir J. 2017;11:727–32.

    Article  PubMed  Google Scholar 

  75. Zheng T, Zhu Z, Wang Z, Homer RJ, Ma B, Riese RJ Jr, Chapman HA Jr, Shapiro SD, Elias JA. Inducible targeting of IL-13 to the adult lung causes matrix metalloproteinase- and cathepsin-dependent emphysema. J Clin Invest. 2000;106:1081–93.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  76. Ozenne B, Subtil F, Maucort-Boulch D. The precision–recall curve overcame the optimism of the receiver operating characteristic curve in rare diseases. J Clin Epidemiol. 2015;68:855–9.

    Article  PubMed  Google Scholar 

  77. Chen J, Remulla D, Nguyen JH, Dua A, Liu Y, Dasgupta P, Hung AJ. Current status of artificial intelligence applications in Urology and its potential to influence clinical practice. BJU Int. 2019;124:567–77.

    Article  Google Scholar 

  78. Alam M, Le D, Lim JI, Chan RVP, Yao X. Supervised machine learning based multi-task artificial intelligence classification of retinopathies. J Clin Med. 2019;8:E872.

    Article  PubMed  Google Scholar 

  79. Liang H, Tsui BY, Ni H, Valentim CCS, Baxter SL, Liu G, Cai W, Kermany DS, Sun X, Chen J, et al. Evaluation and accurate diagnoses of pediatric diseases using artificial intelligence. Nat Med. 2019;25:433–8.

    Article  CAS  PubMed  Google Scholar 

  80. Kim DK, Cho MH, Hersh CP, Lomas DA, Miller BE, Kong X, Bakke P, Gulsvik A, Agusti A, Wouters E, et al. Genome-wide association analysis of blood biomarkers in chronic obstructive pulmonary disease. Am J Respir Crit Care Med. 2012;186:1238–47.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  81. Liao N, Zhao H, Chen ML, Xie ZF. Association of the IL-13 polymorphisms rs1800925 and rs20541 with chronic obstructive pulmonary disease risk: an updated meta-analysis. Medicine (Baltimore). 2017;96:e8556.

    Article  CAS  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This work was supported by Major Projects of Special Development Funds in Zhangjiang National Independent Innovation Demonstration Zone, Shanghai (ZJ2017-ZD-012).

Author information

Author notes

  1. Xia Ma, Yanping Wu and Ling Zhang contributed equally to this work

Authors and Affiliations

  1. Department of Pulmonary and Critical Care Medicine, General Hospital of Datong Coal Mine Group Co., Ltd., Datong, 037000, China

    Xia Ma

  2. Department of Respiratory, General Hospital of Tisco (Sixth Hospital of Shanxi Medical University), 2 Yingxin Street, Jiancaoping District, Taiyuan, 030008, Shanxi Province, China

    Yanping Wu, Xia Zhu & Weihua Jia

  3. Department of Respiratory, Linfen People’s Hospital, Linfen, 041000, China

    Ling Zhang

  4. Shanghai Biotecan Pharmaceuticals Co., Ltd., 180 Zhangheng Road, Shanghai, 201204, China

    Weilan Yuan, Junhui Gao, Jiangman Zhao & Hui Tang

  5. Shanghai Zhangjiang Institute of Medical Innovation, Shanghai, 201204, China

    Weilan Yuan, Junhui Gao, Jiangman Zhao & Hui Tang

  6. Department of Respiratory Medicine, Hebei General Hospital, Shijiazhuang, 050000, China

    Li Yan

  7. Department of Respiratory Medicine, Heji Hospital Affiliated with Changzhi Medical College, Changzhi, 046011, China

    Sha Fan

  8. Department of Clinical Laboratory, JinCheng People’s Hospital, Jincheng, 048000, China

    Yunzhi Lian

  9. Department of Clinical Laboratory, Linfen People’s Hospital, West of Rainbow Bridge, West Binhe Road, Yaodu District, Linfen, 041000, Shanxi Province, China

    Ping Zhang

  10. Department of Pulmonary and Critical Care Medicine, The First Hospital of Shanxi Medical University, Taiyuan, 030001, China

    Xia Ma

Authors
  1. Xia Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yanping Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ling Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Weilan Yuan
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Li Yan
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Sha Fan
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Yunzhi Lian
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Xia Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Junhui Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Jiangman Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Ping Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Hui Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Weihua Jia
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

XM, YPW, and LZ conceived the study and collected samples. LY, SF, YZL, and XZ performed laboratory experiments. WLY and JHG analyzed the data, established the risk models and updated the input data in GitHub. HT wrote the first draft of the paper and was in charge of clinical database curation and oversight, and JMZ, PZ, and WHJ edited the manuscript and revised the manuscript. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Ping Zhang, Hui Tang or Weihua Jia.

Ethics declarations

Ethical approval and consent to participate

This study was approved by the Ethics Committee of Linfen People’s Hospital, Jincheng People’s Hospital, Peace Hospital Affiliated with Changzhi Medical College, The General Hospital of Tisco Affiliated with Shanxi Medical University, Hebei General Hospital, and General Hospital of Datong Coal Mine Group Co., Ltd. Informed consent was obtained from each individual for the study.

Consent for publication

Informed consent was obtained from all participants for publication.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1: Table S1.

The Chinese COPD studies with basic information in international journals.

Additional file 2: Table S2.

Demographics of COPD patients and control subjectsin the training set.

Additional file 3: Table S3.

Demographics of COPD patients and control subjectsin the test set.

Additional file 4: Table S4.

The sequence of 101 SNPs and their primers in multiplex PCR.

Additional file 5: Table S5.

The parameters selection in the predictive models.

Additional file 6: Table S6.

Allele frequencies in COPD and control subjects for SNPs.

Additional file 7: Fig. S1.

Evaluation of the predictive models with only the 9 SNPs as inputs. a, b The picture shows the AU-ROC and AU-PRC curves of the 6 models in the training set. Mean AUC values and 95% CIs of different prediction models are shown in the box.

Additional file 8: Table S7.

The efficacy of KNN, LR, SVM, DT, MLP and XGboost in the training set of 9 SNPs features.

Additional file 9: Fig. S2.

Evaluation of the predictive models with only the 5 clinical features as inputs. a, b The picture shows the AU-ROC and AU-PRC curves of the 6 models in the training set. Mean AUC values and 95% CIs of different prediction models are shown in the box.

Additional file 10: Table S8.

The efficacy of KNN, LR, SVM, DT, MLP and XGboost in the training set of 5 Clinical features.

Additional file 11: Fig. S3.

Evaluation of the predictive models with the top 5 ranked features as inputs. a, b The picture shows the AU-ROC and AU-PRC curves of the 6 models in the training set. Mean AUC values and 95% CIs of different prediction models are shown in the box.

Additional file 12: Table S9.

The efficacy of KNN, LR, SVM, DT, MLP and XGboost in the training set of top 5 ranked features.

Additional file 13: Table S10.

The efficacy of KNN, LR, SVM, DT, MLP and XGboost in the test set of 9 SNPs features.

Additional file 14: Fig. S4.

Validation of the models in the training set with only the 9 SNPs as inputs. a, b The picture shows the AU-ROC and AU-PRC curves of all models in the test set.

Additional file 15: Fig. S5.

Validation of the models in the training set with only the 5 clinical features as inputs. a, b The picture shows the AU-ROC and AU-PRC curves of all models in the test set.

Additional file 16: Table S11.

The efficacy of KNN, LR, SVM, DT, MLP and XGboost in the test set of 5 clinical features.

Additional file 17: Fig. S6.

Validation of the models in the training set with the top 5 ranked features as inputs. a, b The picture shows the AU-ROC and AU-PRC curves of all models in the test set.

Additional file 18: Table S12.

The efficacy of KNN, LR, SVM, DT, MLP and XGboost in the test set of top 5 ranked features.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ma, X., Wu, Y., Zhang, L. et al. Comparison and development of machine learning tools for the prediction of chronic obstructive pulmonary disease in the Chinese population. J Transl Med 18, 146 (2020). https://doi.org/10.1186/s12967-020-02312-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12967-020-02312-0

Keywords

Journal of Translational Medicine

ISSN: 1479-5876

Contact us