- Open Access
Development of a radiomics model to diagnose pheochromocytoma preoperatively: a multicenter study with prospective validation
Journal of Translational Medicine volume 20, Article number: 31 (2022)
Preoperative diagnosis of pheochromocytoma (PHEO) accurately impacts preoperative preparation and surgical outcome in PHEO patients. Highly reliable model to diagnose PHEO is lacking. We aimed to develop a magnetic resonance imaging (MRI)-based radiomic-clinical model to distinguish PHEO from adrenal lesions.
In total, 305 patients with 309 adrenal lesions were included and divided into different sets. The least absolute shrinkage and selection operator (LASSO) regression model was used for data dimension reduction, feature selection, and radiomics signature building. In addition, a nomogram incorporating the obtained radiomics signature and selected clinical predictors was developed by using multivariable logistic regression analysis. The performance of the radiomic-clinical model was assessed with respect to its discrimination, calibration, and clinical usefulness.
Seven radiomics features were selected among the 1301 features obtained as they could differentiate PHEOs from other adrenal lesions in the training (area under the curve [AUC], 0.887), internal validation (AUC, 0.880), and external validation cohorts (AUC, 0.807). Predictors contained in the individualized prediction nomogram included the radiomics signature and symptom number (symptoms include headache, palpitation, and diaphoresis). The training set yielded an AUC of 0.893 for the nomogram, which was confirmed in the internal and external validation sets with AUCs of 0.906 and 0.844, respectively. Decision curve analyses indicated the nomogram was clinically useful. In addition, 25 patients with 25 lesions were recruited for prospective validation, which yielded an AUC of 0.917 for the nomogram.
We propose a radiomic-based nomogram incorporating clinically useful signatures as an easy-to-use, predictive and individualized tool for PHEO diagnosis.
Pheochromocytoma (PHEO) is a rare neuroendocrine catecholamine-secreting tumor originating from the chromaffin cells, with an annual incidence of approximately 1–2/100,000 person-years [1, 2]. Predicting PHEO prior to surgery can alleviate perioperative mobility and mortality as they can produce excessive catecholamine if perioperatively improperly handled; leading to consequential life-threatening hypertension, arrhythmia, and stroke . Therefore, preoperatively discriminating PHEOs from other adrenal tumors is crucial for appropriate treatment planning.
Abdominal/pelvic multiphasic computed tomography (CT) or magnetic resonance imaging (MRI) is commonly used in cancer diagnosis  and has been recommended as the most common non-invasive modality to diagnose PHEO . MRI is a morphologic imaging procedure that can differentiate PHEOs from other adrenal tumors such as adenomas and metastases [6, 7] since PHEOs are generally hyperintense on T2-weighted images . However, due to atypical signs on T2-weighted MR images, about 35% of PHEOs can be misclassified [9, 10]. In addition, lesions of PHEOs with hemorrhage and necrosis can be heterogeneous . PHEOs may also mimic other adrenal masses on the traditional radiological analysis due to the overlap in imaging features and non-specific clinical findings [11,12,13]; encapsulating the notion of “imaging chameleon” . Therefore, diagnosing PHEO accurately and timely remains a challenge [14,15,16]. As a result, developing a more accurate preoperative imaging tool to diagnose PHEO is in urgent need.
Computational medical imaging, also called radiomics, involves the analysis and translation of medical images into quantitative data [17, 18]. Based on high-throughput imaging features, the minable data from radiomics can improve the diagnostic, prognostic, and predictive accuracy, bridging the gap between clinical imaging and personalized medicine [19, 20]. Furthermore, radiomics features have the advantages to evaluate a tumor and its microenvironment, characterization of spatial heterogeneity, and longitudinal evaluation of cancer evolution. There have been many applications of radiomics in cancer diagnosis and prediction such as rectal cancer, breast cancer, and bladder cancer [21,22,23,24]. In addition, Yi et al. developed a CT-based radiomics signature to differentiate subclinical pheochromocytoma from lipid-poor adenoma. Nevertheless, as a single-center study, the patient population in the study was relatively small and homogeneous. And the study only used a region of interest (ROI) of the adrenal lesions for radiomics analysis, making it unable to effectively reveal the heterogeneity of the entire lesion. Further studies are warranted due to limitations. However, to the best of our knowledge, there is no publication evaluating whether an MRI-based radiomics signature would facilitate the preoperative diagnosis of PHEO.
Thence, the purpose of this study was to investigate whether an MRI-based radiomics analytics was capable of preoperative differentiation of PHEOs and non-PHEOs (e.g. benign adrenocortical adenomas, adrenocortical carcinomas, other pathologies). In addition, a radiomic-clinical model was developed and then validated in an internal validation set, an external validation set, and a prospective validation set.
Methods and materials
This study was approved by the institutional review board at the Sun Yat-sen Memorial Hospital of Sun Yat-sen University and the Third Affiliated Hospital of Sun Yat-sen University (Guangzhou, China). Written informed consent was obtained from each patient. The retrospective cohort of this study comprised of an evaluation of the institutional database for medical records from September 2010 to May 2019 to identify patients with adrenal mass who underwent surgical resection with curative intent. Patients for the prospective validation were treated at our institute between June 2019 and June 2020 (ClinicalTrials.gov identifier: ChiCTR1900028520).
A total of 305 patients were included in this cohort study based on the following criteria. The inclusion criteria for patient selection were: (i) underwent adrenalectomy; (ii) pathologically confirmed as adrenal tumor; (iii) had preoperative MRI examination. The exclusion criteria were: (i) poor imaging quality or imaging artifacts; (ii) pathologically confirmed diagnosis of adrenal hyperplasia, adrenal cyst, or adrenal angiolipoma. The non-PHEO was defined as adrenal tumors other than pheochromocytoma, adrenal hyperplasia, adrenal cyst, and adrenal angiolipoma. Then, 239 patients treated in the Sun Yat-sen Memorial Hospital were divided into a training cohort (N = 166 patients with n = 170 lesions diagnosed between September 2010 and October 2013) and an internal validation cohort (N = 73 patients with n = 73 lesions diagnosed between November 2013 and May 2019) in a ratio of 7:3. Patients treated in the Third Affiliated Hospital of Sun Yat-sen University were used as the external validation set (N = 66 patients with n = 66 lesions diagnosed between August 2010 and May 2019). Finally, 25 patients with 25 adrenal lesions were recruited to prospectively validate the model.
The clinical and pathological data retrieved from the medical records included sex, age, tumor location, smoking history, presence of hypertension, and symptom number (symptoms include headache, palpitation, and diaphoresis). Pathological examination of adrenal lesions was reviewed by two pathologists with more than 10 years of experience. Any disagreement was resolved by consensus. Since some patients had bilateral lesions, each lesion was considered as a subject to be measured in this study. The entire study flowchart is presented in Fig. 1A and the recruitment pathway is shown in Additional file 1: Fig. S1.
MRI image acquisition, segmentation, and feature extraction
Figure 1B presents the radiomics procedure. Axial T2-weighted images were used for radiomics analyses, performed using a 3D Slicer (version 4.9.0, https://www.slicer.org), an open-source software program widely used for image visualization and segmentation . The Additional file 1: Supplementary Methods describes in detail the MRI image acquisition, segmentation, and the algorithms for radiomics feature extraction along with their reproducibility.
Radiomics signature construction and performance assessment
The least absolute shrinkage and selection operator (LASSO) logistic regression algorithm, which is suitable for the regression of high-dimensional data , was used to select the most impactful predictive features in the training set. Then, a radiomics signature was constructed and the radiomics score was calculated for each patient via a linear combination of the selected features that were weighted by their respective LASSO coefficients.
The potential use of the radiomics signature to diagnose PHEO was first assessed in the training set and validated in the internal and external validation sets by using a Mann–Whitney U test. Then, stratified analyses were performed (Additional file 1: Data Supplement). Furthermore, discrimination of the radiomics signature was assessed using the receiver operating characteristic (ROC) curve and the area under the ROC curve (AUC). An optimism-corrected AUC was also calculated by bootstrapping method (2000 bootstrap resamples) to obtain stable optimism-corrected estimates .
Development of a radiomic-clinical nomogram and performance assessment
Multivariable logistic regression analysis began with the radiomics signature and the clinical candidate predictors in the training set. The backward stepwise selection was applied using the Akaike’s Information Criterion (AIC) as the stopping rule . Based on the result of the multivariable logistic analyses, a radiomic-clinical nomogram was built. Meanwhile, variance inflation factors (VIFs) were calculated for evaluating the multicollinearity among variables in the regression model. The logistic regression formula for calculating the risk score was also presented.
The discrimination and calibration of the radiomic-clinical nomogram were evaluated in the training set. AUC and optimism-corrected AUC were employed to evaluate the discrimination of the radiomic-clinical nomogram, and calibration curve was used to assess the calibration, accompanied by the Hosmer–Lemeshow test.
Internal and external validation of the radiomic-clinical nomogram
The logistic regression formula formed in the training set was applied to all patients of the internal and external validation sets. Meanwhile, the performances of the nomogram were evaluated in the internal or external validation set using the AUC calculation and calibration analysis.
Models comparison and clinical usefulness evaluation
To further evaluate the radiomic-clinical nomogram applicability, we compared the radiomic-clinical model to a clinical model incorporating clinical independent predictors alone, which was identified by a multivariate logistic regression analysis. The ROC curves were plotted and AUCs were calculated to quantify the discriminative ability of each model.
Decision curve analysis (DCA) was conducted to determine the clinical usefulness of the radiomic-clinical nomogram by quantifying the net benefits at different threshold probabilities , and the clinical model was also compared.
Prospective validation of the radiomics model
Following the construction of the radiomic-clinical model, 25 patients with adrenal tumors were enrolled and used as prospective validation. In the prospective validation set, ROC analyses were used to evaluate the performance. In addition, the associated classification measures, including sensitivity, specificity, positive predictive value, and negative predictive value were also calculated for the radiomic-clinical nomogram.
All statistical analyses were performed using the R software, version 3.5.3 (https://www.r-project.org/). The LASSO logistic regression was performed using the “glmnet” package. The nomogram and calibration curve were plotted using the “rms” package. Hosmer–Lemeshow test was performed using the “vcdExtra” package, and VIF was calculated using the “car” package. DCA was performed using the “dca.r” function. Statistical significance was two-sided, with significance level at P < 0.05.
The detailed clinicopathological characteristics of the patients in the training (N = 166), internal validation (N = 73) and external validation (N = 66) sets are summarized in Table 1. Of the total 305 retrospective patients included in the study, 133 (43.6%) were men, and the median (interquartile range, IQR) age was 49.0 (39.0–57.0) years. Among them, 23.9% (74/309) of the lesions were diagnosed as PHEOs. The clinical data of the prospective validation set (N = 25) is provided in Additional file 1: Table S1.
Radiomics signature construction and performance assessment
In total, 1301 radiomics features were extracted from each lesion. Among them, 7 features were selected as potential predictors using the LASSO logistic regression algorithm in the training set (Fig. 2A and B). The selected features and their corresponding coefficients are shown in the Supplementary Methods.
The radiomics scores between the PHEO and non-PHEO patients demonstrated significant difference among the training set (median [interquartile range], − 0.608 [− 1.073 to − 0.102] vs. − 1.977 [− 2.394 to − 1.274], respectively, P < 0.001, Fig. 2C), the internal validation set (median [interquartile range], − 0.829 [− 1.099 to − 0.572] vs. − 2.103 [− 2.440 to − 1.283], respectively, P < 0.001, Fig. 2C) and the external validation set (median [interquartile range], − 0.439 [− 1.097 to − 0.058] vs. − 1.616 [− 2.249 to − 0.854], respectively, P < 0.001, Fig. 2C). Furthermore, significant association of the radiomics score between the PHEO and non-PHEO patients was also found in the stratified analysis (Additional file 1: Table S2). Further, the radiomics signature yielded an AUC of 0.887 (95% CI 0.834–0.940) and an optimism-corrected AUC of 0.886 in the training set, which was validated in the internal and external validation sets with AUCs of 0.880 (95% CI 0.805–0.995) and 0.807 (95% CI 0.695–0.918), respectively (Fig. 2D).
Radiomic-clinical nomogram construction and performance assessment
The radiomics signature and symptom number were identified as independent predictors to distinguish PHEO from other adrenal lesions. For the collinearity diagnosis, all VIFs were less than 4 (ranging from 1.072 to 1.451), which indicated that there was no collinearity. To ensure easy use of the predictive model, we presented it as a nomogram (Fig. 3A). The logistic regression formula for calculating the risk score was as follows: (2.035 × radiomics score) + (0.602 × symptom number) + 0.781.
The radiomic-clinical nomogram achieved good discrimination with an AUC of 0.893 (95% CI 0.840–0.946) in the training set (Fig. 3B). The optimism-corrected AUC of the nomogram was 0.892. In addition, an optimal risk score cutoff value of − 0.985 was defined according to the maximum Youden index. The calibration curve demonstrated good agreement between predicted and observed probabilities in the training set (Fig. 3C). The Hosmer–Lemeshow test yielded a nonsignificant statistic (P = 0.602), indicating that there was no departure from a perfect fit.
Internal and external validation of the radiomic-clinical nomogram
The radiomic-clinical nomogram yielded a favorable AUC of 0.906 (95% CI 0.841–0.971, Fig. 3B) in the internal validations set and yielded an AUC of 0.844 (95% CI 0.740–0.949, Fig. 3B) in the external validation set. Good calibration was also observed both in the internal and external validation sets along with nonsignificant statistics (P = 0.893 and P = 0.267, respectively) in the Hosmer–Lemeshow tests (Fig. 3C).
The waterfall plot showed the distribution of risk scores and pathologic diagnosis for all lesions (Fig. 3D). The specificity, sensitivity, and accuracy of the radiomic-clinical model detection of PHEO were 0.750, 0.857, and 0.840 in the internal validations set.
Model comparison and clinical usefulness evaluation
In the training set, we further analyzed the eight clinical candidate variables using multivariate logistic regression to construct the clinical model. As a result, the clinical model incorporates two predictors, i.e., symptom number and MRI-determined tumor size (Table 2). In the combined training, internal and external validation sets, the radiomic-clinical nomogram achieved significantly higher AUC than the clinical model (AUC [95% CI], 0.881 [0.842 to 0.919] vs. 0.765 [0.708 to 0.823], respectively, P < 0.001, Fig. 4A). The DCA showed that using the radiomic-clinical nomogram to predict PHEO added more net benefit than the clinical model (Fig. 4B). Similar findings were found in both the training and the validation sets (Additional file 1: Fig. S2).
Prospective validation of the radiomics model
Conspicuously, the radiomics signature predicted PHEO in the prospective validation set yielded an AUC of 0.881 (95% CI 0.726 to 1.000, Additional file 1: Fig. S3A), and the radiomics scores showed a significant difference between the PHEO and non-PHEO patients (median [interquartile range], − 0.246 [− 1.061 to 1.006] vs. − 2.466 [− 3.061 to − 1.433], respectively, P = 0.020, Additional file 1: Fig. S3B). In addition, the radiomic-clinical model performed well in the prospective validation for prediction of the PHEO, with an AUC of 0.917 (95% CI 0.801 to 1.000, Additional file 1: Fig. S3A). These findings suggest the ability of the model to identify the PHEO.
In this study, we used high-throughput extraction of data-characterization algorithms to extract radiomics features and constructed a nomogram with combined radiomics features and clinical risk factors to distinguish PHEOs from other adrenal lesions [30, 31]. The nomogram was validated using different validation sets and demonstrated promising reproducibility and reliability of the prediction model for potential clinical usage in the pre-operative diagnosis of PHEOs.
As we have known, PHEO was notoriously difficult to diagnose as a rare neuroendocrine tumor causing a myriad of clinical symptoms. PHEOs are heterogeneous at imaging, including cystic change, hemorrhage, calcification, intracellular lipid, and malignancy . Most show high morbidity and mortality due to excessive catecholamine production, leading to hypertension, arrhythmia, and stroke . It would be lethal in uncontrolled and unrecognized cases. The ESE/ENSAT guideline has suggested that determination of metanephrines might be eliminated in case of adrenal mass with an unenhanced CT attenuation value ≤ 10 HU . However, this recommendation was based on a small sample size of patients with an unenhanced attenuation value > 10 HU [35, 36]. The specificity of the biochemical tests for PHEOs depends quite mainly on preanalytical criteria which maintains the use of some affected drugs (e.g. dopamine D2 receptor antagonists) and the need of a correctly collected 24 h urine and blood sampling [37, 38]. And Edward’s study showed that the probability of pheochromocytoma in adrenal incidental tumors with unenhanced CT attenuation ≤ 10HU was low, which did not support the widespread clinical practice to determine metanephrines in every patient with adrenal lesions . Furthermore, the determination of metanephrines is rather expensive. The rate of false-positive results might be increased because the optimal preanalytical conditions were difficult to create, which makes it do more diagnostic tests to rule out PHEO at higher costs .
Although previous studies have been reported that the overall diagnostic performance was good for diagnosing PHEOs, it should be noted that the sensitivity was relatively low (51.7–58.0%) with traditional imaging technology [39, 41, 42]. With Gallium-Dotatate PET CT pheochromocytomas and paragangliomas can be visualized with high sensitivity and in case of malignant pheochromocytomas metastases can be demonstrated . Nonetheless, its application is limited due to the expensive inspection and the difficulty of popularization in primary hospitals. Apart from adrenal incidentoma, it is possible that the method might be useful in applications where MRI is specifically indicated for imaging of PHEO. This includes clinical contexts in which radiation exposure should be minimized (e.g., children, young women of child bearing age). Use of MRI might also be considered to minimize radiation exposure during periodic repeated imaging studies in patients with mutations of tumor-susceptibility genes.
Application of radiomics analysis has been recognized as an important technology [18, 44, 45]. The high-dimensional imaging features can acquire more detailed information about the tumor which cannot be detected easily by the naked eye. And different pathological types of tumors exhibit different values of radiomics features, which might be an underlying mechanism of applying radiomics in tumor classification . Our study analyzed the images with 3D-VOI method, extracted a total of 1301 radiomic features and built a radiomic signature using seven selected radiomics features after reduction of redundant features. Some selected features describe the distribution of voxel intensity of the VOI region, such as ‘Mean’ and ‘Skewness’, while some selected texture features like ‘Entropy’ hold information about the spatial heterogeneity of the lesion. However, the interpretation of features remains a challenge in radiomic research, and further studies are warranted to explore the potential biological significance underlying the selected radiomics features. In our study, we did establish an MRI-based radiomics signature which demonstrated strong potential as promising indicators for the diagnosis of PHEOs to aid physicians to more accurately diagnose the PHEOs.
Furthermore, by incorporating clinical predictors, we developed and validated a radiomics nomogram in our study, which has the ability to diagnose the PHEOs. Odds ratio of symptom number is 1.826 in the multivariable logistic regression analysis, suggesting that the greater the symptom number is, the greater the probability of PHEO diagnosis (Table 2). Indeed, symptoms like palpitations, headache, and diaphoresis are significant when considering a possibility of PHEO diagnosis . The model demonstrated high discriminatory power, with AUCs greater than 84.4%. As such, it could stratify patients with PHEOs and non-PHEOs. Patients with PHEO could receive preoperative medication for further surgical treatment or even targeted therapy including germline mutations in SDHB or fusions involving MAML3 . That is, it could be helpful for clinicians to determine personalized treatment strategies preoperatively. Thus, the radiomic-clinical model may further increase the accuracy of the PHEOs diagnosis and minimize the cases of misdiagnosis and missed diagnosis.
Intriguingly, when compared with the clinical model, the radiomic-clinical model was superior in both the training and validation sets. This suggests that the MRI imaging radiomics features are more representative of the tumors and the radiomic-clinical model is not only a simple combination of radiomics features but also a synergy between intratumor heterogeneity and clinical variables. The underlying explanation for the good performance of our radiomic model may be that the internal structure of lesion heterogeneity reflected by radiomic characteristics is related to the biological behavior and microstructure of adrenal tumor , which were critical factors influencing the efficacy in predicting PHEOs preoperatively.
To our knowledge, this is the first study to show that MRI-based radiomics can be used to distinguish PHEOs from other adrenal lesions. The pros of the findings of this study include: first, we used an open-sourced software for the radiomics procedure instead of custom-developed software, which makes it possible to further validate the model even conducted by other institutions ; second, the model developed using the retrospective data was not only validated using an internal validation set but was also further validated in the prospective set; third, the predictors, radiomics signature and symptom number, in the nomogram were feasibly obtained from routine MRI scans and medical history taking, thereby enhancing their clinical availability and usability.
However, there were several limitations to be acknowledged. First, it was mainly designed using two institutional retrospective studies with a modest number of patients that may not be representative in other institutions. Accordingly, multicenter prospective trials with larger patient samples are needed in order to improve clinical efficacy . Second, semi-automatic tumor segmentation contained complex operation and possibly man-made interference. A more stable and time-saving method such as automatic segmentation could be applied to the radiomics analysis . Third, our study did not involve nuclear imaging, which limits our further clinical outreach and application. Fourth, the data of biochemical tests for PHEOs were not included in our presented model due to the lack of these data in our retrospective study. Further studies are warranted to investigate whether the biochemical tests can improve the performance of the radiomics model. Future work should involve analyses of the dependencies between radiomics features and clinical variables or genetic changes, which may further improve the diagnostic model.
In conclusion, we developed a novel radiomics model combining the radiomics signature and symptom number for predicting the presence of PHEOs, against other adrenal lesions, before initial treatment. It can be used as a noninvasive, safe, simple-to-implement, and accurate method in the daily setting, after wider prospective validation.
Availability of data and materials
The datasets used during the current study are available from the corresponding author on reasonable request.
Prejbisz A, Lenders JW, Eisenhofer G, Januszewicz A. Cardiovascular manifestations of phaeochromocytoma. J Hypertens. 2011;29:2049–60.
Bravo EL, Tagle R. Pheochromocytoma: state-of-the-art and future prospects. Endocr Rev. 2003;24:539–53.
Young WF Jr. Clinical practice. The incidentally discovered adrenal mass. N Engl J Med. 2007;356:601–10.
Lam TBL. Optimizing the diagnosis of pelvic lymph node metastasis in bladder cancer using computed tomography and magnetic resonance imaging. Cancer Commun. 2018;38:2.
Caoili EM, Korobkin M, Francis IR, Cohan RH, Dunnick NR. Delayed enhanced CT of lipid-poor adrenal adenomas. AJR Am J Roentgenol. 2000;175:1411–5.
Boland GW, Blake MA, Hahn PF, Mayo-Smith WW. Incidental adrenal lesions: principles, techniques, and algorithms for imaging characterization. Radiology. 2008;249:756–75.
Sahdev A, Reznek RH. The indeterminate adrenal mass in patients. Cancer Imaging. 2007;7:S100-109.
Wang F, Liu J, Zhang R, Bai Y, Li C, Li B, Liu H, Zhang T. CT and MRI of adrenal gland pathologies. Quant Imaging Med Surg. 2018;8:853–75.
Varghese JC, Hahn PF, Papanicolaou N, Mayo-Smith WW, Gaa JA, Lee MJ. MR differentiation of phaeochromocytoma from other adrenal lesions based on qualitative analysis of T2 relaxation times. Clin Radiol. 1997;52:603–6.
Lattin GE Jr, Sturgill ED, Tujo CA, Marko J, Sanchez-Maldonado KW, Craig WD, Lack EE. From the radiologic pathology archives: adrenal tumors and tumor-like conditions in the adult: radiologic-pathologic correlation. Radiographics. 2014;34:805–29.
McDermott S, McCarthy CJ, Blake MA. Images of pheochromocytoma in adrenal glands. Gland Surg. 2015;4:350–8.
Umanodan T, Fukukura Y, Kumagae Y, Shindo T, Nakajo M, Takumi K, Nakajo M, Hakamada H, Umanodan A, Yoshiura T. ADC histogram analysis for adrenal tumor histogram analysis of apparent diffusion coefficient in differentiating adrenal adenoma from pheochromocytoma. J Magn Reson Imaging. 2017;45:1195–203.
Park BK, Kim B, Ko K, Jeong SY, Kwon GY. Adrenal masses falsely diagnosed as adenomas on unenhanced and delayed contrast-enhanced computed tomography: pathological correlation. Eur Radiol. 2006;16:642–7.
Blake MA, Kalra MK, Maher MM, Sahani DV, Sweeney AT, Mueller PR, Hahn PF, Boland GW. Pheochromocytoma: an imaging chameleon. Radiographics. 2004;24(Suppl 1):S87-99.
Mannelli M, Lenders JW, Pacak K, Parenti G, Eisenhofer G. Subclinical phaeochromocytoma. Best Pract Res Clin Endocrinol Metab. 2012;26:507–15.
Low G, Sahi K. Clinical and imaging overview of functional adrenal neoplasms. Int J Urol. 2012;19:697–708.
Limkin EJ, Sun R, Dercle L, Zacharaki EI, Robert C, Reuze S, Schernberg A, Paragios N, Deutsch E, Ferte C. Promises and challenges for the implementation of computational medical imaging (radiomics) in oncology. Ann Oncol. 2017;28:1191–206.
Aerts HJ, Velazquez ER, Leijenaar RT, Parmar C, Grossmann P, Carvalho S, Bussink J, Monshouwer R, Haibe-Kains B, Rietveld D, et al. Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun. 2014;5:4006.
Lambin P, Leijenaar RTH, Deist TM, Peerlings J, de Jong EEC, van Timmeren J, Sanduleanu S, Larue R, Even AJG, Jochems A, et al. Radiomics: the bridge between medical imaging and personalized medicine. Nat Rev Clin Oncol. 2017;14:749–62.
Khorrami M, Bera K, Thawani R, Rajiah P, Gupta A, Fu P, Linden P, Pennell N, Jacono F, Gilkeson R, et al. Distinguishing granulomas from adenocarcinomas by integrating stable and discriminating radiomic features on non-contrast computed tomography scans. Eur J Cancer. 2021;148:146–58.
Liu Z, Zhang XY, Shi YJ, Wang L, Zhu HT, Tang Z, Wang S, Li XT, Tian J, Sun YS. Radiomics analysis for evaluation of pathological complete response to neoadjuvant chemoradiotherapy in locally advanced rectal cancer. Clin Cancer Res. 2017;23:7253–62.
Min X, Li M, Dong D, Feng Z, Zhang P, Ke Z, You H, Han F, Ma H, Tian J, Wang L. Multi-parametric MRI-based radiomics signature for discriminating between clinically significant and insignificant prostate cancer: cross-validation of a machine learning method. Eur J Radiol. 2019;115:16–21.
Liu Z, Li Z, Qu J, Zhang R, Zhou X, Li L, Sun K, Tang Z, Jiang H, Li H, et al. Radiomics of multiparametric MRI for pretreatment prediction of pathologic complete response to neoadjuvant chemotherapy in breast cancer: a multicenter study. Clin Cancer Res. 2019;25:3538–47.
Wu S, Zheng J, Li Y, Yu H, Shi S, Xie W, Liu H, Su Y, Huang J, Lin T. A radiomics nomogram for the preoperative prediction of lymph node metastasis in bladder cancer. Clin Cancer Res. 2017;23:6904–11.
Fedorov A, Beichel R, Kalpathy-Cramer J, Finet J, Fillion-Robin JC, Pujol S, Bauer C, Jennings D, Fennessy F, Sonka M, et al. 3D Slicer as an image computing platform for the Quantitative Imaging Network. Magn Reson Imaging. 2012;30:1323–41.
Sauerbrei W, Royston P, Binder H. Selection of important variables and determination of functional form for continuous predictors in multivariable model building. Stat Med. 2007;26:5512–28.
Han K, Song K, Choi B. How to develop, validate, and compare clinical prediction models involving radiological parameters: study design and statistical methods. Korean J Radiol. 2016;17:339–50.
Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMJ. 2015;350:7594.
Vickers AJ, Cronin AM, Elkin EB, Gonen M. Extensions to decision curve analysis, a novel method for evaluating diagnostic tests, prediction models and molecular markers. BMC Med Inform Decis Mak. 2008;8:53.
Lafata K, Wang Y, Konkel B, Yin F, Bashir M. Radiomics: a primer on high-throughput image phenotyping. Abdom Radiol. 2021. https://doi.org/10.1007/s00261-021-03254-x.
Aerts H. The potential of radiomic-based phenotyping in precision medicine: a review. JAMA Oncol. 2016;2:1636–42.
Raja A, Leung K, Stamm M, Girgis S, Low G. Multimodality imaging findings of pheochromocytoma with associated clinical and biochemical features in 53 patients with histologically confirmed tumors. AJR Am J Roentgenol. 2013;201:825–33.
Fishbein L, Leshchiner I, Walter V, Danilova L, Robertson AG, Johnson AR, Lichtenberg TM, Murray BA, Ghayee HK, Else T, et al. Comprehensive molecular characterization of pheochromocytoma and paraganglioma. Cancer Cell. 2017;31:181–93.
Fassnacht M, Arlt W, Bancos I, Dralle H, Newell-Price J, Sahdev A, Tabarin A, Terzolo M, Tsagarakis S, Dekkers OM. Management of adrenal incidentalomas: European Society of Endocrinology Clinical Practice Guideline in collaboration with the European Network for the Study of Adrenal Tumors. Eur J Endocrinol. 2016;175:G1–34.
Kannan S, Purysko A, Faiman C, Remer EM, Shah L, Bena J, Siperstein A, Berber E, Fergany A, Bravo E, Hamrahian AH. Biochemical and radiological relationships in patients with pheochromocytoma: lessons from a case control study. Clin Endocrinol. 2014;80:790–6.
Motta-Ramirez GA, Remer EM, Herts BR, Gill IS, Hamrahian AH. Comparison of CT findings in symptomatic and incidentally discovered pheochromocytomas. AJR Am J Roentgenol. 2005;185:684–8.
Darr R, Kuhn M, Bode C, Bornstein SR, Pacak K, Lenders JWM, Eisenhofer G. Accuracy of recommended sampling and assay methods for the determination of plasma-free and urinary fractionated metanephrines in the diagnosis of pheochromocytoma and paraganglioma: a systematic review. Endocrine. 2017;56:495–503.
Lenders JW, Duh QY, Eisenhofer G, Gimenez-Roqueplo AP, Grebe SK, Murad MH, Naruse M, Pacak K, Young WF Jr, Endocrine S. Pheochromocytoma and paraganglioma: an endocrine society clinical practice guideline. J Clin Endocrinol Metab. 2014;99:1915–42.
Buitenwerf E, Korteweg T, Visser A, Haag C, Feelders RA, Timmers H, Canu L, Haak HR, Bisschop P, Eekhoff EMW, et al. Unenhanced CT imaging is highly sensitive to exclude pheochromocytoma: a multicenter study. Eur J Endocrinol. 2018;178:431–7.
Lenders JW, Willemsen JJ, Eisenhofer G, Ross HA, Pacak K, Timmers HJ, Sweep CG. Is supine rest necessary before blood sampling for plasma metanephrines? Clin Chem. 2007;53:352–4.
Schieda N, Alrashed A, Flood TA, Samji K, Shabana W, McInnes MD. Comparison of quantitative MRI and CT washout analysis for differentiation of adrenal pheochromocytoma from adrenal adenoma. AJR Am J Roentgenol. 2016;206:1141–8.
Northcutt BG, Raman SP, Long C, Oshmyansky AR, Siegelman SS, Fishman EK, Johnson PT. MDCT of adrenal masses: can dual-phase enhancement patterns be used to differentiate adenoma and pheochromocytoma? AJR Am J Roentgenol. 2013;201:834–9.
Sadowski S, Millo C, Cottle-Delisle C, Merkel R, Yang L, Herscovitch P, Pacak K, Simonds W, Marx S, Kebebew E. Results of (68)Gallium-DOTATATE PET/CT scanning in patients with multiple endocrine neoplasia type 1. J Am Coll Surg. 2015;221:509–17.
Bi WL, Hosny A, Schabath MB, Giger ML, Birkbak NJ, Mehrtash A, Allison T, Arnaout O, Abbosh C, Dunn IF, et al. Artificial intelligence in cancer imaging: clinical challenges and applications. CA Cancer J Clin. 2019;69:127–57.
Gillies RJ, Kinahan PE, Hricak H. Radiomics: images are more than pictures, they are data. Radiology. 2016;278:563–77.
Xie T, Wang X, Zhang Z, Zhou Z. CT-based radiomics analysis for preoperative diagnosis of pancreatic mucinous cystic neoplasm and atypical serous cystadenomas. Front Oncol. 2021;11:621520.
O’Connor J, Aboagye E, Adams J, Aerts H, Barrington S, Beer A, Boellaard R, Bohndiek S, Brady M, Brown G, et al. Imaging biomarker roadmap for cancer studies. Nat Rev Clin Oncol. 2017;14:169–86.
Gao Y, Kikinis R, Bouix S, Shenton M, Tannenbaum A. A 3D interactive multi-object segmentation tool using local robust statistics driven active contours. Med Image Anal. 2012;16:1216–27.
Land S, Ritter M, Costantino J, Julian T, Cronin W, Haile S, Wolmark N, Ganz P. Compliance with patient-reported outcomes in multicenter clinical trials: methodologic and practical approaches. J Clin Oncol. 2007;25:5113–20.
Wang S, Li C, Wang R, Liu Z, Wang M, Tan H, Wu Y, Liu X, Sun H, Yang R, et al. Annotation-efficient deep learning for automatic medical image segmentation. Nat Commun. 2021;12:5915.
This study was supported by the National Key Research and Development Program of China (Grant No. 2018YFA0902803), the Science and Technology Planning Project of Guangdong Province (Grant Nos. 2017B020227007, 2020A1515111119, 2015A030310090, 2016A030313291).
Ethics approval and consent to participate
This study was approved by the Institutional Review Board of the Sun Yat-sen Memorial Hospital of Sun Yat-sen University and the Third Affiliated Hospital of Sun Yat-sen University (Guangzhou, China) with informed consent from subjects.
Consent for publication
All authors have read and approved the content and agree to submit for consideration for publication in the journal.
The authors declare no potential conflicts of interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file 1: Fig. S1.
Recruitment pathways. Fig. S2. Receiver operating characteristic analysis (A–C) and decision curve analysis (D–F) of radiomic-clinical nomogram model and clinical model in the training set, internal validation set, and external validation set, respectively. Fig. S3. Performance of the radiomics signature and radiomic-clinical model in the prospective validation set. (A) ROC curve of the radiomics signature in the prospective validation set. (B) Boxplots of the radiomics score in the prospective validation set. (C) ROC curve of the radiomic-clinical nomogram in the prospective validation set. Table S1. The clinical data of the prospective validation set. Table S2. Stratified analysis of the association between the radiomics signature and the pathological characteristics of adrenal lesions in the combined training, internal validation and external validation sets. Table S3. Stratified analysis of the association between the radiomics signature and MRI parameters in all enrolled patients.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Kong, J., Zheng, J., Wu, J. et al. Development of a radiomics model to diagnose pheochromocytoma preoperatively: a multicenter study with prospective validation. J Transl Med 20, 31 (2022). https://doi.org/10.1186/s12967-022-03233-w
- Magnetic resonance imaging