Skip to main content
Download PDF

Radiomic analysis for predicting prognosis of colorectal cancer from preoperative 18F-FDG PET/CT

Journal of Translational Medicine volume 20, Article number: 66 (2022) Cite this article

Abstract

Background

To develop and validate a survival model with clinico-biological features and 18F- FDG PET/CT radiomic features via machine learning, and for predicting the prognosis from the primary tumor of colorectal cancer.

Methods

A total of 196 pathologically confirmed patients with colorectal cancer (stage I to stage IV) were included. Preoperative clinical factors, serum tumor markers, and PET/CT radiomic features were included for the recurrence-free survival analysis. For the modeling and validation, patients were randomly divided into the training (n = 137) and validation (n = 59) set, while the 78 stage III patients [training (n = 55), and validation (n = 23)] was divided for the further experiment. After selecting features by the log-rank test and variable-hunting methods, random survival forest (RSF) models were built on the training set to analyze the prognostic value of selected features. The performance of models was measured by C-index and was tested on the validation set with bootstrapping. Feature importance and the Pearson correlation were also analyzed.

Results

Radiomics signature (containing four PET/CT features and four clinical factors) achieved the best result for prognostic prediction of 196 patients (C-index 0.780, 95% CI 0.634–0.877). Moreover, four features (including two clinical features and two radiomics features) were selected for prognostic prediction of the 78 stage III patients (C-index was 0.820, 95% CI 0.676–0.900). K–M curves of both models significantly stratified low-risk and high-risk groups (P < 0.0001). Pearson correlation analysis demonstrated that selected radiomics features were correlated with tumor metabolic factors, such as SUVmean, SUVmax.

Conclusion

This study presents integrated clinico-biological-radiological models that can accurately predict the prognosis in colorectal cancer using the preoperative 18F-FDG PET/CT radiomics in colorectal cancer. It is of potential value in assisting the management and decision making for precision treatment in colorectal cancer.

Trial registration The retrospectively registered study was approved by the Ethics Committee of Fudan University Shanghai Cancer Center (No. 1909207-14-1910) and the data were analyzed anonymously.

Introduction

Colorectal cancer (CRC) is one of the most commonly diagnosed cancers all over the world, though its epidemiology is different in various regions [1]. It is also one of the leading causes of cancer-related mortality despite the advancement in treatment strategies [2, 3]. The prognosis of CRC is one of the essential factors in patient management and selection of treatment strategies [4]. Tumor Node Metastasis (TNM) staging classification system plays an important role in colorectal cancer prognostication [4,5,6]. But TNM staging system cannot accurately differentiate the prognosis of colon cancer with stage II and III. A series of disease characteristics known to affect the survival of colorectal cancer were not directly included in the TNM staging system, such as age, gender, location of primary disease, tumor grade, lymphatic vessel and peripheral nerve infiltration, intestinal obstruction or perforation and BRAF and KRAS Mutations [7,8,9,10]. Blood and stool protein markers have also been investigated to identify patients with favorable and poor prognosis [11, 12]. Several studies were dedicated to other prognostic factors in patients with MSI status and chromosome 18q loss of heterozygosity in the coding place [13, 14]. Several studies have attempted to provide clinical assistance in the management strategies of colorectal cancer by utilizing important imaging prognostic features, such as depth of tumor spread, presence of malignant lymph nodes, tumor deposits, extramural vascular invasion, and differentiation of mucinous from nonmucinous tumors [15].

For staging primary colon cancer, contrast-enhanced computed tomography (CT) scans achieved accuracies ranging from 60 to 80% [16,17,18,19]. MRI features are useful in diagnosing locally advanced rectal tumors and also are helpful to assess regional nodal involvement and treatment response [20, 21]. However, the above anatomical imaging is based on morphology, cannot provide the metabolic characteristics of the tumor lesion. 18F-fluoro-2-deoxy-d-glucose Positron emission tomography/computed tomography (18F-FDG PET/CT) can sensitively provide the molecular and functional information of not only the primary tumor, but also distant metastasis lesion and the recurrent disease by one-time imaging [22]. 18F-FDG, like glucose, is transported into cells by glucose transporters, where it is transformed into 18F-FDG-6-phosphate (18F-FDG-6-P). Because 18F-FDG-6-P cannot be metabolized further, it becomes trapped inside cells. Compared with normal tissue, tumor cells are highly proliferative and have a high glucose metabolic rate. Therefore, tumor cells accumulate more 18F-FDG-6-P than normal cells [23]. The degree of metabolic activities or tissue uptake of FDG was expressed as a standardized uptake value (SUV). In colorectal cancer, cells showed increased glycolysis metabolism. PET can be quantitatively evaluated and compared in studies (e.g., pre- and post-treatment)[24] using SUV, thus assisting to obtain insights into tumor biology. The correlation between FDG metabolism in PET and tumor proliferation rates that may in turn help determine the prognosis of CRC. It is known that the scan highly depends on the patient's physical condition due to a 6-h fast.

Radiomics is a promising translational research field that can provide quantified tumor heterogeneity information from medical images in a non-invasive manner. Studies have shown that radiomic features based on CT or MRI were related to the prognosis of colorectal cancers [25,26,27]. PET/CT radiomics has achieved success in wide range of cancers [28,29,30,31]. For example, PET/CT radiomics has successfully predicted the prognosis of various malignancies including gastric cancer [32], nasopharyngeal carcinoma [33]. lung cancer, breast cancer and other tumors [34,35,36]. There have been several studies of PET/CT radiomics in rectal cancer, however, not in colon cancer [37,38,39,40]. Other PET/CT radiomics studies focused on colorectal cancer patients with metastasis [41, 42]. In addition, studies used texture analysis instead of complete radiomics to study the prognosis of colorectal cancer with a relatively small number of cases[37, 43]. Some studies reported the metabolic phenotype could predict genetic alterations of colorectal cancer by 18F-FDG PET/CT radiomics [44]. Therefore, we conclude that the prognostic value of PET/CT radiomics based on primary colorectal cancer has not been deeply explored, especially in stage III patients who accounts for a high proportion of colorectal cancer patients. In this study, we investigated the prognostic value of 18F-FDG PET/CT-based radiomics features using machine learning for CRC patients of all stages and then applied the same method on CRC patients with stage III to analyze the differences.

Materials and methods

Patients collection

The study was approved by Ethics Committee of Fudan University Shanghai Cancer Centre and Institutional Review Board for clinical investigation. In our study, 196 patients diagnosed with colorectal cancer between January 2010 and July 2018 were retrospectively collected from an electronic database in Fudan University Shanghai Cancer Centre. Patients were followed up until July 2020. All patients who met the following criteria were enrolled: (1) Patients received surgery at the primary colorectal lesion and the final pathology was colorectal adenocarcinoma or mucinous adenocarcinoma; (2) Immunohistochemical results also was received; (3) Patients received no preoperative treatment and underwent preoperative 18F-FDG PET/CT. Thus, the difference in tumor metabolism after adjuvant therapy was avoided; (4) Patients did not receive any chemotherapy, radiation therapy, or molecular targeted therapy before 18F-FDG PET/CT scans yet; (5) Patients were not lost to follow-up. We reviewed 243 patients diagnosed with colorectal cancer in total and finally enrolled 196 patients for this study.

18F-FDG PET/CT protocol and imaging interpretation

18F-FDG PET/CT scans were performed using a PET/CT scanner (Siemens Medical Systems, Biograph 16 HR). All patients fasted for at least 6 h before 18F-FDG administration and glucose levels in the peripheral blood were confirmed to be 10 mmol/L or less before the 18F-FDG injection (7.4 MBq/kg (0.2 mCi/kg) of body weight) in this study. The scanning included the area from the upper thigh to the skull. Data acquisition started approximately 1 h after the injection. The low-dose CT scans were obtained with the following parameters: 40–60 mA, 120 kV, 0.6-s tube rotation, and 3.75-mm section thickness. The spatial resolution of PET images was 168 × 168 × 172 with voxel size 4.06 × 4.06 × 5 \({mm}^{3}\), while the resolution of CT images was 512 × 512 × 172 with voxel size 1.37 × 1.37 × 5 \({mm}^{3}\). For quantitative analysis, 18F-FDG accumulation on a workstation was assessed by two experienced nuclear medicine physicians through calculating the standardized uptake value (SUV), metabolic tumor volume (MTV) and total lesion glycolysis (TLG) in the regions of interest placed over the suspected lesions and the normal liver. SUV was calculated in a pixel as (radioactivity) / (injected dose/body weight). TLG was calculated as (mean SUV) × (MTV), in which MTV was measured with setting a margin threshold as SUV of 2.5. All values of SUVmax, MTV, and mean SUV were automatically measured by analysis software for each lesion. For evaluating metastatic CRC, the highest SUV in a metastatic tumor was taken as SUVmax and the mean SUV was taken as SUVmean.

Medical image delineation

The Volume of Interest (VOIs) in the tumor was segmented slice by slice by two attending nuclear medicine physicians respectively. The open-source software ITK-Snap [45] was used for segmentation. If the two opinions were different, they discussed and made the final decision together. The physicians segmented tumors only on the basis of imaging findings and did not consider pathological findings. Since the PET/CT images were co-registered, only the VOIs of PET images were manually segmented, and then resampled to CT images through coordinate transformation and interpolation. The resulting VOIs for CT images were validated by a radiologist.

Radiomics feature extraction

Radiomics Workflow was illustrated in Fig. 1 including three main modules: Feature Engineering, Random Survival Forest (RSF) Models, Statistical analysis.

Fig. 1
figure 1

Radiomics workflow. Input PET/CT was collected from patients with colorectal cancer (Stage I–IV). Feature engineering was used to extract radiomics features from region of interests in PET/CT images and to select important features via log-rank test and variable hunting. Two random survival forest (RSF) models M1 and M2 were constructed followed by statistical analysis including survival prediction, correlation analysis and individualized interpretation

Full size image

In feature extraction, we applied different settings for PET and CT images to adapt to different image characteristics of these two modalities, as illustrated in Additional file 1: Fig. S1. For PET images, we firstly applied SUV normalization based on patients’ body weight and injection doze. Then, we used a fixed bin-size of 0.25 SUV in intensity discretization to reduce the effect of the image noise [46]. The common parameter for bin size [47, 48] was used to ensure the reproducibility of our model. On the other hand, for CT images, we firstly shifted + 1000 HU on image values to prevent the pixel value from being negative when squared, as the minimum value of HU was -1000. For CT image discretization, we used a fixed bin size of 25 HU, as suggested in previous reports [49,50,51].

1246 radiomic features were extracted from ROIs delineated by clinicians on PET and CT images respectively, resulting in 2492 radiomic features per patient. Radiomic features include three major types: first-order features, shape features and texture features. First-order features describe the intensity distribution of voxels. Shape features describe the tumor shape characteristics such as volumes and surface areas. Texture features describe the second-order intensity distribution of voxels via Gray Level Co-occurrence Matrix (GLCM), Gray Level Size Zone Matrix (GLSZM), Gray Level Run Length Matrix (GLRLM), and Gray Level Dependence Matrix (GLDM). Wavelet features and Laplacian of Gaussian (LoG) features are texture features extracted from filtered images using wavelet filters and LoG filters. The radiomic feature extraction was implemented with open-source PyRadiomics library [52] (https://github.com/Radiomics/pyradiomics), which is in compliant with Imaging Biomarker Standardization Initiative [53].

Feature selection

Before implementing feature selection, 24 clinico-biological features and 2492 radiomic features were fused to form a feature pool. The feature selection strategy was designed to be outcome-driven, aiming to mine features that capture the prognostic patterns. As illustrated in Fig. 2A, we applied a sequential combination of univariate and multivariate selection on the PET, CT radiomic features and clinico-biological features extracted from training data.

Fig. 2
figure 2

Methodology and results of feature selection. A Methodology of feature selection: univariate log-rank test was applied to select features with p < 0.05 to form feature set a. Multivariate variable hunting was used to select discriminative feature combination (final feature set b) via five-fold cross validation. B Results of feature selection: the number of selected features in feature selection pipeline

Full size image

In univariate selection, the log-rank test was used to select statistically significant features with high prognostic values (p < 0.05). Based on the selected features, multivariate selection was deployed to select the final discriminative feature set using RSF-based variable hunting algorithm [54]. To prevent the risk of overfitting, we applied 50 times of five-fold cross-validation in multivariate feature selection to boost the generalizability of selected feature subsets. As the selected features were based on the performance of rotating training sets instead of a single fixed training set, the selected feature subset was more generalizable, thus properly avoiding the risk of overfitting.

Modeling and validation

The patients were split into training and validation sets (7:3 ratio) using the stratified method. A random survival forest (RSF) model, which captures non-linear effects, was fitted to predict the recurrence-free survival (RFS) on the training set. To select the best performing RSF model with optimized hyperparameters, we used the grid search strategy based on the average C-index on the training set with 1000 times of bootstrap. The model performance was evaluated by C-index on the validation set with 1000 times bootstrap to reduce model overfitting. Furthermore, the predicted risks of the validation set yielded by the fitted RSF model were dichotomized into low-risk and high-risk groups. Then two groups were compared using the log-rank test to examine whether the model could stratify patients with different RFS.

Statistical analysis

Statistical analysis was implemented using R package version 3.6.3 (R Foundation for Statistical Computing) and p-value < 0.05 was considered statistically significant. The optimal cutoff point for the log-rank test was performed by ‘surv_cutpoint’ function in the ‘survminer’ R package. The random survival forest and variable-hunting algorithm were implemented using the “randomForestSRC” R package.

Results

Demographics of patients

There were 196 patients with colorectal cancer involved in the dataset. Table 1 summarized the detailed demographics of patients. Of a total of 196 patients with colorectal cancer, stage I, II, III, and IV were 32 (16.3%), 44 (22.4%), 78 (39.8%), and 42 (21.4%), respectively. In the original experiment, 196 patients (ranging from stage I to stage IV) were randomly split into 138 training samples and 58 validation samples with a ratio of 7:3. The dataset used in the primary experiment is denoted as D-1 ~ 4. There were 29.6% of patients from D-1 ~ 4 who experienced recurrence. In the further experiment, we conducted the prognostic analysis on patients with stage III only, which was split into training and testing sets with a ratio of 7:3. The dataset containing only stage III patients is denoted as D-3. There were 33.3% of patients from D-3 who experienced recurrence. Compared with other studies, the patient characteristics in Table 1 listed four clinical factors including CEA, CA199, and Lymph nodes, which are automatically screened as prognostic factors by the machine program (feature selection). Our radiomics modelling combined the power of these clinical factors with imaging-based features, thus may be more valuable than clinical studies using merely clinical factors in predicting prognosis.

Table 1 Patients characteristics of the training and validation sets
Full size table

Result of feature selection

As illustrated in Fig. 2B, feature selection was applied on 2492 radiomics features extracted from PET and CT images and 24 clinico-biological features. For patients with stage I-IV, 12 CT and 48 PET radiomics features and nine clinico-biological features, were selected during univariate selection, while the final feature set composed of two CT, two PET and four clinical features was selected in multivariate selection for model building. For patients with stage III, 27 CT and 22 PET radiomics features and five clinico-biological features were selected during univariate selection, while one CT, one PET and two clinical features were selected in multivariate selection.

Performance of radiomics signature

The performance of selected radiomic signatures was illustrated in Fig. 3A and B for primary experiment D-1 ~ 4 and secondary experiment D3, respectively. Figure 3A and B showed RSF models built with clinical, CT and PET features outperforms models with solely clinical, PET or CT features, peaking at C-index 0.780 [95% CI 0.634–0.877] and 0.820 [95% CI 0.676–0.900] respectively. The detailed performance of signatures was attached in the Additional file 1: Table S2. K–M curves of radiomics signatures for D-1 ~ 4 and D3 were demonstrated in Fig. 3C and D respectively (P < 0.0001). To evaluate the risk of overfitting, we summarized training and testing C-index during the independent validation in Additional file 1: Table S1. The table showed the differences between training and testing C-index were less than 0.03 in both experiments, which suggested the risk of overfitting was properly alleviated.

Fig. 3
figure 3

The performance of prognostic models. Figure A and B showed the comparison of the prognostic performance of different modalities on D-1 ~ 4 and D-3 respectively. Figure C and D were K–M Curves for different modalities on D-1 ~ 4 and D-3 respectively. Log-rank test was used for statistical tests used in K–M curve. P-value < 0.05 indicated survival distributions of high-risk and low-risk groups were significantly different. P-value was marked in each sub-figure of Figure C and D

Full size image

Feature analysis and interpretation

There were eight features identified by the feature selection process from D-1 ~ 4 including four clinical features (CA199, lymph nodes, stage, and Carcinoembryonic antigen (CEA)), two PET features (PET-wavelet-LLH-gldm-DV and PET-wavelet-LLL-glcm-imc2) and two CT features (CT-Log-sigma-5.0-3D-glszm-SAE, CT-Log-sigma-4.0-3D-glszm-SALGLE). The RSF model built on these eight features is denoted as M1. There were four features identified for the secondary experiment D-3 including two clinical features (CA199 and lymph nodes) and one PET feature (PET-Wavelet-LLH-glszm-ZV) and one CT feature (CT-Log-sigma-5.0-3D-glszm-SAE). The RSF model built on these four features for the secondary experiment is denoted as M2. Detailed feature explanation was attached in the Additional file 1: Table S3.

We further revealed the contribution of each feature for model M1 and M2 in Fig. 4A and B. Bar graphs in Fig. 4A and B showed the normalized importance of each feature, in which CA199 contributed most in M1 and PET-Wavelet-LLH-glszm-ZV contributed most in M2. Pie graphs in Fig. 4A and B illustrated the percentage of contribution of PET, CT and clinical features. PET and CT features contributed 13.3% in M1 while contributed 83.5% in M2. In addition to feature contribution, we compared the features in M1 and M2 then found two common clinical features (CA199 and lymph nodes) and one common CT feature (CT-Log-sigma-5.0-3D-glszm-SAE).

Fig. 4
figure 4

Feature importance and Pearson correlation of M1 and M2. Figure A was the univariate importance of features in models M1 and M2. Clinical, PET, and CT features were represented by using blue, gray, and red bar, respectively. Figure B showed the overlapping between features selected for models M1 and M2. In Figure C, Pearson test was used for correlational statistical analysis. P-value < 0.05 indicated significant correlation identified between two variables (indicated with colored cells)

Full size image

Figure 4C summarized Pearson correlation between selected radiomic features and clinical features. It shows that radiomic features were significantly correlated to metabolic tumor activity features such as SUVmean, SUVmax, TLG, and 40%MTV.

Case study

We chose two stage IIIA samples from the validation set of the Data-3 to showcase the predictive performance of M2 model built on the radiomics signature. Our prognostic endpoint was recurrence-free survival (RFS), which focuses on the length of time before the disease recurs. As shown in Fig. 5A, our radiomics model predicted an overall lower curve in patient 1 compared patient 2. It indicated the higher chance that the disease recurred in patient 1 in a shorter time. This prediction was in accordance with the fact that real recurrence time for patient 1 (8 months) was shorter compared with patient 2 (13 months). After 15 months, both patients had low recurrence-free probability (< 50%), while patient 1 showed a trend of lower recurrence-free probability. This was also in accordance with the fact that the disease of both patients recurred, while the recurrence in patient 1 was earlier.

Fig. 5
figure 5

Case study for individualized result interpretation. Figure A showed the predicted survival curves of individual patients yielded by the model M2. Figure B showed the values of radiomic features of patients in the case study. Figure C visualized the tumor region in 3D body imaging, in PET/CT imaging and PET/CT radiomics features

Full size image

Values of radiomic features for these two patients were shown in Fig. 5B. The Zone variance (ZV) of PET-Wavelet-LLH image measures the variance in gray level zone size. The larger ZV, the greater heterogeneity. The SAE (Small Area Emphasis) of CT-Log-5.0-3D image measures the distribution of small size gray level zones and the larger value indicated finer textures. Detailed clinical information of two patients was included in the Additional file 1: Table S4. The visualization of radiomic features was demonstrated in Fig. 5C.

In clinic routine, patients with high CA199 tend to have worse prognosis than patients with normal CA199. In our case study, we intentionally chose two unconventional cases where patient 2 (with high CA199) had better prognosis than patient 1 (with normal CA199). For these two special cases, our PET/CT radiomics model M2, which was specifically designed to predict RFS of stage III colorectal cancer, achieved correct prediction. This is mainly because M2 combined the predictive power of both clinical and PET/CT imaging features. More specifically, as shown in Fig. 4A, among these compound features, a majority of the contribution (83.5%) from the collective PET/CT radiomics features was towards the correct prognostic decision (shorter recurrence time), while the importance of CA199 in the prediction only accounted for 14%, and thereby, the machine learning model M2 made the correct prognostic prediction.

Discussion

Radiomics is a high-throughput mining of quantitative image features from standard medical imaging that can extract data and apply it to clinical decision support systems to improve the accuracy of diagnosis, prognosis and prediction. Radiomics is increasingly important in cancer research. Radiomics analysis leverages sophisticated image analysis tools and the rapid development and validation of medical imaging data that use image-based signatures for accurate diagnosis and treatment, providing a powerful tool for modern medicine [28,29,30,31]. Previous studies have shown that 18F-FDG PET/CT radiomics performed well in predicting the prognosis of various malignancies. The newly developed PET/CT radiomic signature was a powerful predictor of gastric cancer survival [32]. Radiomics features of baseline PET/CT images provide complementary prognostic information for nasopharyngeal carcinoma compared with the use of clinical parameters alone [33]. This method was also advantageous to predict the prognosis of lung cancer, breast cancer and other tumors [34,35,36]. As for colorectal cancer, a few studies demonstrated that FDG PET radiomic held potential towards the improved prediction of clinical outcome in stage IV patients of colorectal cancer and locally-advanced rectal cancer [42, 55]. The explosive researches on the prognostic value of PET/CT-based radiomics methods for the total colorectal cancer were rare, especially for stage III. A study on the National Cancer Data Base (NCDB) showed that CRC patients with stage III accounted for approximately one-third of all stages [56]. Moreover, the 5-year survival rate of this largest proportion of patients was subjected to a large difference in the survival outcomes [57, 58]. Therefore, it is necessary to evaluate the prognosis of stage III colorectal cancer separately, and to intervene as early as possible according to different individual patients to reduce the risk of recurrence and metastasis. In this study, we developed an original model to predict the prognosis of CRC patients and further experimented on stage III patients by 18F-FDG PET/CT radiomics.

We unprecedentedly investigated prognosis models for patients ranging from stage I to IV in the primary experiment. The model M1 trained by a combination of features of all three modalities outperformed other models with a C-index of 0.780 [95% CI 0.634–0.877]. The K–M curves indicated that our model effectively separated high-risk and low-risk patient groups (P < 0.0001). For model M1, CA199 was the most important feature. It means that this cancer antigen marker CA199 contributed most to the outcome of the prognostic prediction in model M1. The result is consistent with previous studies [43] that CA199 is a key prognostic biomarker. Notably, the contribution of imaging features was irreplaceable, although they only accounted for 13.3% of the contribution. Both PET and CT features were important and irreplicable in radiomics analysis because they both had positive importance scores, which suggests these features positively contributed to the model accuracy. Experimental results in Manuscript Fig. 3A verified that the model constructed with multimodalities (C-index 0.780) outperformed the models built with PET (C-index 0.592) or CT (C-index 0.755) alone on D-1 ~ 4. Similar trend can be identified on D-3 with Fig. 3B.

We also focused on analyzing models for patients with stage III, because the 5-year survival rate was unsatisfactory, though radical surgery and adjuvant chemotherapy were routinely performed. The prediction of prognosis is valuable for supporting individualized treatment. The C-index of M2 was 0.820 [95% CI 0.676–0.900], which means it holds a great potential value of prognostic prediction in colorectal cancer. Its performance was also superior to that of single-modality or double-modality models. K–M curves of M2 illustrated that the model could significantly separate high-risk and low-risk patient group. For model M2, PET-Wavelet-LLH-glszm-ZV was the most important feature in the predictive model, which means the texture information quantified by this PET feature successfully captured the heterogeneity of colorectal tumour towards accurate prognostic prediction. This was because PET images could provide information not only about the metabolism of the tumor, but also about the total load of the tumor. For further interpretation of this PET feature, we conducted correlation analysis, and found that this PET features positively correlated with 40% MTV and TLG (p < 0.05). CA199, which contributed most in M1, only made up 14% of all feature contributions.

Moreover, CA199, lymph nodes and CT-Log-sigma-5.0-3D-glszm-SAE were three features identified both in M1 and M2. The feature importance analysis showed that clinical features played the most vital roles in the prognosis of CRC patients of all stages, while radiomics features contributed more when predicting the prognosis of CRC patients with stage III. The case study also demonstrated that features with greater contribution could help the model to overcome the negative impact caused by single features, and then rectify the prediction. Thereby, it is reasonable to believe that the combination of clinical characteristics and imaging characteristics of 18F-FDG metabolism is more predictive than any single modality model.

We reduced the risk of overfitting through reducing the number of features and employed cross-validation in feature selection. Firstly, we reduced the risk of overfitting by strictly controlling the number of features, as the reduced number of features leaded to the decrease of the number of required parameters inside machine learning models, thus minimizing the risk of overfitting [59]. According to the guideline for radiomics studies [60], we reduced the number of features to less than 1/10 of sample sizes. Secondly, 50 times five-fold cross-validation was deployed during the feature selection on the training dataset to reduce the risk of overfitting [59]. By selecting features on the rotating training instead of a fixed training set, we effectively minimize the risk of overfitting on a fixed proportion of data. Thirdly, we evaluated the risk of overfitting by comparing the performance of the model on training and testing datasets in independent validation. Additional file 1: Table S1 showed that the difference between training and testing C-index was less than 0.03 in both experiments, which suggests that the risk of overfitting was properly handled.

This study was partly limited by its retrospective design and relatively modest sample sizes. We will continue to collect more patients who meet the criteria, and will attempt to conduct prospective studies to further validate our models and investigate the prognosis of patients with sub-stages (e.g., IIIA, IIIB, IIIC). We look forward to conducting further randomized controlled trials in the future on the significance and importance of 18F-FDG PET/CT imaging omics in the diagnosis and treatment of colorectal cancer. We will investigate the effect of spatial resolution of PET/CT images on the parameters of radiomic feature extraction.

Conclusion

Radiomics-based decision supporting system is a powerful tool in modern medicine to identify new imaging biomarkers for more effective, accurate, and efficient diagnosis and prognostic prediction. Our developed recurrence-free survival model demonstrates that 18F-FDG PET/CT radiomics combined with clinical features in the study may fuel the identification of new imaging biomarkers, and could be instructive in the predictive prognosis of colorectal cancer, especially in stage III. The power of combining 18F-FDG PET/CT radiomics and modeling could potentially optimize the individual treatment strategies by avoiding ineffective or excessive management.

Availability of data and materials

The datasets generated and/or analysed during the current study are not publicly available due patient privacy and copyright issues but are available from the corresponding author on reasonable request.

Abbreviations

CEA:

Carcinoembryonic antigen

CRC:

Colorectal Cancer

18F-FDG:

18F-fluoro-2-deoxy-d-glucose

PET/CT:

Positron emission tomography/computed tomography

SUV:

Standardized uptake value

MTV:

Metabolic tumor volume

TLG:

Total lesion glycolysis

VOI:

The volume of interest

RSF:

Random survival forest

References

  1. Siegel RL, Miller KD, Jemal A. Cancer statistics, 2019. CA Cancer J Clin. 2019;69:7–34.

    Article  PubMed  Google Scholar 

  2. Chen W, Zheng R, Baade PD, et al. Cancer statistics in China, 2015. CA Cancer J Clin. 2016;66:115–32.

    Article  PubMed  Google Scholar 

  3. Siegel RL, Miller KD, Jemal A. Cancer statistics, 2016. CA Cancer J Clin. 2016;66:7–30.

    Article  PubMed  Google Scholar 

  4. Gunderson LL, Jessup JM, Sargent DJ, et al. Revised tumor and node categorization for rectal cancer based on surveillance, epidemiology, and end results and rectal pooled analysis outcomes. J Clin Oncol. 2010;28:256–63.

    Article  PubMed  Google Scholar 

  5. Gunderson LL, Sargent DJ, Tepper JE, et al. Impact of T and N stage and treatment on survival and relapse in adjuvant rectal cancer: a pooled analysis. J Clin Oncol. 2004;22:1785–96.

    Article  PubMed  Google Scholar 

  6. Gunderson LL, Jessup JM, Sargent DJ, et al. Revised TN categorization for colon cancer based on national survival outcomes data. J Clin Oncol. 2010;28:264–71.

    Article  PubMed  Google Scholar 

  7. Dekker E, Tanis PJ, Vleugels JLA, et al. Colorectal cancer. Lancet. 2019;394:1467–80.

    Article  PubMed  Google Scholar 

  8. Bailey CE, Hu CY, You YN, et al. Increasing disparities in the age-related incidences of colon and rectal cancers in the United States, 1975–2010. JAMA Surg. 2015;150:17–22.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Venook AP, Niedzwiecki D, Innocenti F, et al. Impact of primary (1º) tumor location on overall survival (OS) and progression-free survival (PFS) in patients (pts) with metastatic colorectal cancer (mCRC): Analysis of CALGB/SWOG 80405 (Alliance). J Clin Oncol. 2016;34:3504–3504.

    Article  Google Scholar 

  10. Taieb J, Le Malicot K, Shi Q, et al. J Natl Cancer Inst. 2017;109:1.

    Article  CAS  Google Scholar 

  11. Mala T, Bøhler G, Mathisen Ø, et al. Hepatic resection for colorectal metastases: can preoperative scoring predict patient outcome? World J Surg. 2002;26:1348–53.

    Article  PubMed  Google Scholar 

  12. Lech G, Słotwiński R, Słodkowski M, et al. Colorectal cancer tumour markers and biomarkers: recent therapeutic advances. World J Gastroenterol. 2016;22:1745–55.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  13. Sinicrope FA, Sargent DJ. Clinical implications of microsatellite instability in sporadic colon cancers. Curr Opin Oncol. 2009;21:369–73.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  14. Sarli L, Bottarelli L, Bader G, et al. Association between recurrence of sporadic colorectal cancer, high level of microsatellite instability, and loss of heterozygosity at chromosome 18q. Dis Colon Rectum. 2004;47:1467–82.

    Article  PubMed  Google Scholar 

  15. García-Figueiras R, Baleato-González S, Padhani AR, et al. Advanced imaging techniques in evaluation of colorectal cancer. Radiographics. 2018;38:740–65.

    Article  PubMed  Google Scholar 

  16. Smith NJ, Bees N, Barbachano Y, et al. Preoperative computed tomography staging of nonmetastatic colon cancer predicts outcome: implications for clinical trials. Br J Cancer. 2007;96:1030–6.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  17. Hundt W, Braunschweig R, Reiser M. Evaluation of spiral CT in staging of colon and rectum carcinoma. Eur Radiol. 1999;9:78–84.

    Article  CAS  PubMed  Google Scholar 

  18. Engelmann BE, Loft A, Kjær A, et al. Positron emission tomography/computed tomography for optimized colon cancer staging and follow up. Scand J Gastroenterol. 2014;49:191–201.

    Article  PubMed  Google Scholar 

  19. Nerad E, Lahaye MJ, Maas M, et al. Diagnostic accuracy of CT for local staging of colon cancer: a systematic review and meta-analysis. AJR Am J Roentgenol. 2016;207:984–95.

    Article  PubMed  Google Scholar 

  20. Horvat N, Rocha C, Oliveira B, et al. MRI of rectal cancer: tumor staging, imaging techniques, and management. Radiographics. 2019;39:367–87.

    Article  PubMed  Google Scholar 

  21. Liu LH, Lv H, Wang ZC, et al. Performance comparison between MRI and CT for local staging of sigmoid and descending colon cancer. Eur J Radiol. 2019;121:108741.

    Article  PubMed  Google Scholar 

  22. Evans J, Patel U, Brown G. Rectal cancer: primary staging and assessment after chemoradiotherapy. Semin Radiat Oncol. 2011;21:169–77.

    Article  PubMed  Google Scholar 

  23. Shan L: [(18)F]-Fluoro-2-deoxy-d-glucose-folate. In Molecular Imaging and Contrast Agent Database (MICAD). Bethesda (MD): National Center for Biotechnology Information (US); 2004

  24. Lin M, Wong K, Ng WL, et al. Positron emission tomography and colorectal cancer. Crit Rev Oncol Hematol. 2011;77:30–47.

    Article  PubMed  Google Scholar 

  25. Badic B, Desseroit MC, Hatt M, et al. Potential complementary value of noncontrast and contrast enhanced CT radiomics in colorectal cancers. Acad Radiol. 2019;26:469–79.

    Article  PubMed  Google Scholar 

  26. Dai W, Mo S, Han L, et al. Prognostic and predictive value of radiomics signatures in stage I-III colon cancer. Clin Transl Med. 2020;10:288–93.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Li Y, Liu W, Pei Q, et al. Predicting pathological complete response by comparing MRI-based radiomics pre- and postneoadjuvant radiotherapy for locally advanced rectal cancer. Cancer Med. 2019;8:7244–52.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Lambin P, Leijenaar RTH, Deist TM, et al. Radiomics: the bridge between medical imaging and personalized medicine. Nat Rev Clin Oncol. 2017;14:749–62.

    Article  PubMed  Google Scholar 

  29. Reginelli A, Nardone V, Giacobbe G, et al. Radiomics as a new frontier of imaging for cancer prognosis: a narrative review. Diagnostics (Basel, Switzerland). 2021;11:1796.

    CAS  PubMed Central  Google Scholar 

  30. Stanzione A, Verde F, Romeo V, et al. Radiomics and machine learning applications in rectal cancer: current update and future perspectives. World J Gastroenterol. 2021;27:5306–21.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Hou M, Sun JH. Emerging applications of radiomics in rectal cancer: state of the art and future perspectives. World J Gastroenterol. 2021;27:3802–14.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Jiang Y, Yuan Q, Lv W, et al. Radiomic signature of (18)F fluorodeoxyglucose PET/CT for prediction of gastric cancer survival and chemotherapeutic benefits. Theranostics. 2018;8:5915–28.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Lv W, Yuan Q, Wang Q, et al. Radiomics analysis of PET and CT components of PET/CT imaging integrated with clinical parameters: application to prognosis for nasopharyngeal carcinoma. Mol Imaging Biol. 2019;21:954–64.

    Article  CAS  PubMed  Google Scholar 

  34. Oikonomou A, Khalvati F, Tyrrell PN, et al. Radiomics analysis at PET/CT contributes to prognosis of recurrence and survival in lung cancer treated with stereotactic body radiotherapy. Sci Rep. 2018;8:4003.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  35. Huang SY, Franc BL, Harnish RJ, et al. Exploration of PET and MRI radiomic features for decoding breast cancer phenotypes and prognosis. NPJ Breast Cancer. 2018;4:24.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  36. Wang H, Zhao S, Li L, et al. Development and validation of an (18)F-FDG PET radiomic model for prognosis prediction in patients with nasal-type extranodal natural killer/T cell lymphoma. Eur Radiol. 2020;30:5578–87.

    Article  CAS  PubMed  Google Scholar 

  37. Staal FCR, van der Reijd DJ, Taghavi M, et al. Radiomics for the prediction of treatment outcome and survival in patients with colorectal cancer: a systematic review. Clin Colorectal Cancer. 2021;20:52–71.

    Article  PubMed  Google Scholar 

  38. Bang JI, Ha S, Kang SB, et al. Prediction of neoadjuvant radiation chemotherapy response and survival using pretreatment [(18)F]FDG PET/CT scans in locally advanced rectal cancer. Eur J Nucl Med Mol Imaging. 2016;43:422–31.

    Article  CAS  PubMed  Google Scholar 

  39. Giannini V, Mazzetti S, Bertotto I, et al. Predicting locally advanced rectal cancer response to neoadjuvant therapy with (18)F-FDG PET and MRI radiomics features. Eur J Nucl Med Mol Imaging. 2019;46:878–88.

    Article  CAS  PubMed  Google Scholar 

  40. Li H, Boimel P, Janopaul-Naylor J, et al. Deep convolutional neural networks for imaging data based survival analysis of rectal cancer. Proc IEEE Int Symp Biomed Imaging. 2019;2019:846–9.

    PubMed  PubMed Central  Google Scholar 

  41. van Helden EJ, Vacher YJL, van Wieringen WN, et al. Radiomics analysis of pre-treatment [(18)F]FDG PET/CT for patients with metastatic colorectal cancer undergoing palliative systemic treatment. Eur J Nucl Med Mol Imaging. 2018;45:2307–17.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Rahmim A, Bak-Fredslund KP, Ashrafinia S, et al. Prognostic modeling for patients with colorectal liver metastases incorporating FDG PET radiomic features. Eur J Radiol. 2019;113:101–9.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Nakajo M, Kajiya Y, Tani A, et al. A pilot study for texture analysis of (18)F-FDG and (18)F-FLT-PET/CT to predict tumor recurrence of patients with colorectal cancer who received surgery. Eur J Nucl Med Mol Imaging. 2017;44:2158–68.

    Article  PubMed  Google Scholar 

  44. Chen SW, Shen WC, Chen WT, et al. Metabolic imaging phenotype using radiomics of [(18)F]FDG PET/CT associated with genetic alterations of colorectal cancer. Mol Imaging Biol. 2019;21:183–90.

    Article  CAS  PubMed  Google Scholar 

  45. Yushkevich PA, Piven J, Hazlett HC, et al. User-guided 3D active contour segmentation of anatomical structures: significantly improved efficiency and reliability. NeuroImage (Orlando, Fla). 2006;31:1116–28.

    Google Scholar 

  46. Ha S, Choi H, Paeng JC, et al. Radiomics in oncological PET/CT: a methodological overview. Nucl Med Mol Imaging. 2019;53:14–29.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Tixier F, Le Rest CC, Hatt M, et al. Intratumor heterogeneity characterized by textural features on baseline 18F-FDG PET images predicts response to concomitant radiochemotherapy in esophageal cancer. J Nucl Med. 2011;52:369–78.

    Article  PubMed  Google Scholar 

  48. Pfaehler E, van Sluis J, Merema BBJ, et al. Experimental multicenter and multivendor evaluation of the performance of PET radiomic features using 3-dimensionally printed phantom inserts. J Nucl Med. 2020;61:469–76.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  49. Welch ML, McIntosh C, Haibe-Kains B, et al. Vulnerabilities of radiomic signature development: the need for safeguards. Radiother Oncol. 2019;130:2–9.

    Article  PubMed  Google Scholar 

  50. Dou TH, Coroller TP, van Griethuysen JJM, et al. Peritumoral radiomics features predict distant metastasis in locally advanced NSCLC. PLoS ONE. 2018;13:e0206108.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  51. Yuan R, Shi S, Chen J, et al. Radiomics in RayPlus: a web-based tool for texture analysis in medical images. J Digit Imaging. 2019;32:269–75.

    Article  PubMed  Google Scholar 

  52. van Griethuysen JJM, Fedorov A, Parmar C, et al. Computational radiomics system to decode the radiographic phenotype. Cancer Res. 2017;77:e104–7.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  53. Zwanenburg A, Vallieres M, Abdalah MA, et al. The image biomarker standardization initiative: standardized quantitative radiomics for high-throughput image-based phenotyping. Radiology. 2020;295:328–38.

    Article  PubMed  Google Scholar 

  54. Ishwaran H, Kogalur UB, Chen X, et al. Random survival forests for high-dimensional data. 2011;4:115–32.

    Google Scholar 

  55. Lovinfosse P, Polus M, Van Daele D, et al. FDG PET/CT radiomics for predicting the outcome of locally advanced rectal cancer. Eur J Nucl Med Mol Imaging. 2018;45:365–75.

    Article  PubMed  Google Scholar 

  56. Chagpar R, Xing Y, Chiang YJ, et al. Adherence to stage-specific treatment guidelines for patients with colon cancer. J Clin Oncol. 2012;30:972–9.

    Article  PubMed  PubMed Central  Google Scholar 

  57. Hari DM, Leung AM, Lee JH, et al. AJCC Cancer Staging Manual 7th edition criteria for colon cancer: do the complex modifications improve prognostic assessment?. J Am Coll Surg. 2013; 217:181–190.

  58. Webber C, Gospodarowicz M, Sobin LH, et al. Improving the TNM classification: findings from a 10-year continuous literature review. Int J Cancer. 2014;135:371–8.

    Article  CAS  PubMed  Google Scholar 

  59. Mayerhoefer ME, Materka A, Langs G, et al. Introduction to Radiomics. J Nucl Med. 2020;61:488–95.

    Article  CAS  PubMed  Google Scholar 

  60. Sollini M, Antunovic L, Chiti A, et al. Towards clinical application of image mining: a systematic review on artificial intelligence and radiomics. Eur J Nucl Med Mol Imaging. 2019;46:2656–72.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

This work was funded by National Natural Science Foundation of China (Grant Numbers 81771861 and 81971648), Shanghai Scientific and Technological Innovation Program (Grant Numbers 18410711200 and 19142202100).

Funding

This work was funded by National Natural Science Foundation of China (Grant Numbers 81971648), Shanghai Scientific and Technological Innovation Program (Grant Numbers 19142202100).

Author information

Author notes

  1. Lilang Lv, Bowen Xin and Yichao Hao contributed equally to this work and share first authorship

Authors and Affiliations

  1. Department of Radiotherapy, Fudan University Shanghai Cancer Center, No.270 Dong’an Road, Xuhui district, Shanghai, 200032, China

    Lilang Lv & Xiaomao Guo

  2. School of Computer Science, The University of Sydney, Sydney, NSW, Australia

    Bowen Xin, Yichao Hao & Xiuying Wang

  3. Department of Nuclear Medicine, Fudan University Shanghai Cancer Center, No.270 Dong’an Road, Xuhui district, Shanghai, 200032, China

    Ziyi Yang, Junyan Xu & Shaoli Song

  4. Department of Automation, Shanghai Jiao Tong University, Shanghai, 200240, China

    Lisheng Wang

  5. Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China

    Lilang Lv, Ziyi Yang, Junyan Xu, Shaoli Song & Xiaomao Guo

  6. Center for Biomedical Imaging, Fudan University, Shanghai, China

    Ziyi Yang, Junyan Xu & Shaoli Song

  7. Shanghai Engineering Research Center of Molecular Imaging Probes, Shanghai, China

    Ziyi Yang, Junyan Xu & Shaoli Song

Authors
  1. Lilang Lv
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bowen Xin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yichao Hao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ziyi Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Junyan Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Lisheng Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Xiuying Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Shaoli Song
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Xiaomao Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Conceptualization, LL, SS and XG; methodology, LL, BX and YH; software, ZY and JX; validation, LL, BX and YH; formal analysis, BX and YH; investigation, ZY and JX; resources, LW and XW; data curation, LL, BX and YH; writing-original draft preparation, LL, BX and YH; writing-review and editing, all authors; visualization, all authors; project administration, SS and XG. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Shaoli Song or Xiaomao Guo.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the Ethics Committee of Fudan University Shanghai Cancer Center (No. 1909207-14-1910) and the data were analyzed anonymously. The requirement of written informed consent was waived.

Consent for publication

Written informed consent for the analysis of anonymized clinical and imaging data was obtained from all patients.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Additional figures and tables.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lv, L., Xin, B., Hao, Y. et al. Radiomic analysis for predicting prognosis of colorectal cancer from preoperative 18F-FDG PET/CT. J Transl Med 20, 66 (2022). https://doi.org/10.1186/s12967-022-03262-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12967-022-03262-5

Keywords

Journal of Translational Medicine

ISSN: 1479-5876

Contact us