Bringing radiomics into a multi-omics framework for a comprehensive genotype–phenotype characterization of oncological diseases
Journal of Translational Medicine volume 17, Article number: 337 (2019)
Genomic and radiomic data integration, namely radiogenomics, can provide meaningful knowledge in cancer diagnosis, prognosis and treatment. Despite several data structures based on multi-layer architecture proposed to combine multi-omic biological information, none of these has been designed and assessed to include radiomic data as well. To meet this need, we propose to use the MultiAssayExperiment (MAE), an R package that provides data structures and methods for manipulating and integrating multi-assay experiments, as a suitable tool to manage radiogenomic experiment data. To this aim, we first examine the role of radiogenomics in cancer phenotype definition, then the current state of radiogenomics data integration in public repository and, finally, challenges and limitations of including radiomics in MAE, designing an extended framework and showing its application on a case study from the TCGA-TCIA archives. Radiomic and genomic data from 91 patients have been successfully integrated in a single MAE object, demonstrating the suitability of the MAE data structure as container of radiogenomic data.
Diseases are governed by complex biological mechanisms requiring different levels of analyses for a comprehensive interpretation of the underlying pathology. Today, the progress in genomics, transcriptomics, epigenomics and their combination, enables the incorporation of different biological layers of information to predict phenotypic conditions (tumor/normal, early/late stage, survival, etc.). Multi-omics data integration is, therefore, one of the major challenges in the era of precision medicine, particulary in oncology. With the huge increase in genomic data production, the need for specific models and methods for storing and analyzing those data has arisen; an example is MultiAssayExperiment (MAE) . MAE handles multiple and heterogeneous data types for a set of samples of multi-assay genomic experiments (transcript counts, DNA variants or methylation status of genes or regions, etc.). However, these structures consider only data produced by molecular biology experiments and neglect the impact of other ‘omics which also deserve consideration. The progress that has been made in medical imaging techniques and the development of high-throughput algorithms to extract quantitative features from medical images has led to the development of radiomics. In clinical research, radiomics is becoming a meaningful tool and might be considered as an additional and complementary source of ‘omic information, not achievable in a multi-omics biological environment. In this scenario, the growing impact of non-invasive imaging techniques for disease definition, in parallel with the evolution of next-generation sequencing (NGS) tools, provides powerful methods for investigating the phenotype through the combination of imaging characteristics (radiomic features) into a multi-omics biological framework. Indeed, in recent years, correlation of radiomic features with genomic features, rise to a new field of study defined “radiogenomics” . The increasing scale and availability of a high volume of health data requires new and efficient strategies for data management, data linkage and data integration. These types of datasets are defined “multimodal”  since multimodal signals are managed together. In this context, there are many challenges to overcome: identifying relationships between data from different modalities, joining multimodal information to execute prediction, learning information to help understand limited data of another modality and, crucial in our case, representing, integrating and summarizing multimodal data. Thus, in order to optimize data management and analysis, it is necessary to reshape the existing information systems into innovative multi-layer data systems by combining statistical and computational methods. So far, no tools integrating genomic and radiomic data have been designed; therefore, consolidating single-omic datasets from different domains in a meaningful manner is an ambitious undertaking. Here, we investigated the role of the MAE structure as a possible bridge for integrating radiomics into a multi-omics framework. To this end, we evaluated the potential of MAE as a structure for storing and managing both imaging and biological ‘omic data derived from different type of experiments, while keeping the coordinated representation of data and ensuring consistency between a single assay and clinical patient data during data subsetting and analysis intact. The extended multi-omics framework proposed here allows researchers to simplify the management of radiogenomic data. In this article, (i) we will first introduce the state of the art of both radiomics and biological ‘omics in the field of cancer research; (ii) we will then summarize the role of radiogenomics in cancer phenotype definition; (iii) we will discuss the current state of radiogenomic public repositories, their limits, challenges and limitations of including radiomics in a multi-omics framework; (iv) finally, we will demonstrate the feasibility of our approach with a case study using The Cancer Genome Atlas (TCGA), for biological data, and The Cancer Imaging Archive (TCIA), for public medical images.
Radiomics and biological ‘omics in the field of cancer research: state of the art
Radiomics arises from the increasing interest in the development of non-invasive diagnostic tools for disease characterization and monitoring, especially in cancer research [4, 5]. Diagnostic images are able to provide information on the entire tumor volume, reducing inaccuracy due to sampling errors in histopathological analyses. In this scenario, radiomics, i.e. the extraction of a large number of quantitative features from medical images , has proved to be a key way to study the cancer imaging phenotypes, reflecting underlying gene expression patterns [7, 8] and revealing heterogeneous tumor metabolism and anatomy [9, 10]. This high-throughput feature extraction is typically preparatory to a data mining process  in order to associate or predict different clinical outcomes , giving important prognostic information about the disease. Radiomics has the potential to extensively characterize the intratumoral heterogeneity, and it has shown promise in predicting treatment response and outcome, differentiating benign and malignant tumors and assessing the relationship with genetics in many cancer types [13,14,15,16,17,18,19]. The radiomic approach can be applied to any imaging modality, even on more modalities acquired at the same time point, providing multi-parametric features. Once the images are collected, the radiomic approach involves two main steps: the segmentation of Region Of Interest (ROI) and the estimation of descriptive features. ROI segmentation consists of the identification of target regions of prognostic value, which can be performed according to different strategies. After ROI segmentation, an automated process extracts quantitative features (descriptors) from each ROI. The descriptors are designed to provide information, related to the tumor phenotype and the microenvironment. Radiomic features can be divided into four groups: shape-based (geometric characteristics), first-order and second-order statistics features (texture characteristics) and higher-order features (impose filter grids on an image to extract repetitive or non-repetitive patterns to compute first- or second-order statistic features from). As a result, up to hundreds of features are obtained from a single image (Fig. 1). Finally, the extracted features, together with clinical or pathologic outcomes, are fed into machine-learning procedures to construct classification, predictive, or prognostic models .
Biological multi-omics integration tools
In the past several years, various methods, data structures and tools, related to multi-omics data integration have been developed. For an exhaustive review of multi-omics data integration methods and a list of packages using these methods see Huang et al. . In order to ensure structured relations between different layers of biological data, data containers are a necessary requirement. Some existing data structures for multi-omic assays have been utilized to meet this demand. Two of the most recent are MultiDataSet  and MultiAssayExperiment (MAE)  (R/Bioconductor packages). These packages manage several sets of biological experiments and facilitate the coordination of different types of operations, such as data visualization, data manipulation, subsetting, data integration and reshaping. Moreover, these data containers enable subsetting of data by different items, such as clinical or pathologic variables, genes, genomic ranges and assays. Additionally, data warehouses that enable users to dynamically interrogate clinico-pathologic data in a multidimensional manner are developed in this context. One such example is the Data Warehouse for Translational Research (DW4TR) .
We have chosen to test MAE as radiogenomic data container because of the extensive documentation, very frequent updating, integration of several R and Bioconductor data classes, ample set of data manipulation methods and a simplified graphical interface including many R/Bioconductor packages. Moreover, many of the available datasets, which include both radiomic and genomic data, are provided by TCGA and TCIA databases and the whole genomic part is already available as an MAE object. The structure of the MAE object makes possible coordinated operations through three main functions: i) reporting the property of sample units, such as clinical, pathological, and biospecimen data; ii) containing the experimental data for the samples forming part of the study; iii) containing the representation of the relationship between sample units and experimental data. Another class of fundamental tools are visualization and analysis tools. Table 1 summarizes the main characteristics of these resources. For a deeper list of tools, see Kannan L [34, 35].
Challenges of radiomics in multi-omics framework
A crucial aspect in radiogenomic data analysis is the very large dimensionality of the feature space; therefore the analyses of these data are often unreliable and have a high overfitting and curse of dimensionality . For these reasons, radiogenomic studies need a robust data structure in order to reduce difficulty and make the analyses efficient, scalable and reproducible. In this context, some data integration and data processing challenges need to be addressed . One challenge regards data acquisition of ‘omic experiments, since biological processes may be assessed in different spatial and/or temporal scales. Indeed there is a greater complexity in some type of ‘omics, such as transcriptomics (alteration of gene expression over time), compared to, for example, genomic experiments (executed on a temporal/spatial static substrate) . Obviously, in radiogenomic data integration, the different and specific spatial/temporal multi-dimensionality introduces an additional level of complexity. For instance, in patient with cancer, imaging is usually performed multiple times during the course of disease and therapy whereas only one time and at one location genomics or transcriptomics profiling is not performed systematically . Another crucial aspect in radiogenomic data analysis is the management of multi-sample and multi-parameters storage from different lesions or sub-regions of a lesion, for each patient. Spatial multi-dimensionality is a common event for both radiomic and biological ‘omics but, here too, there are cases of uniqueness. For example, in a proteomic experiment, which analyzes the abundance of proteins, their post-translational modifications and subcellular compartments location, does not have a corresponding dimensionality in radiomic experiments. Another intrinsic problem of multi-omics analyses is missing data, which may occur due to reasons such as data filtering (for example, low coverage of a detected variant) or non-execution of a specific analysis on a subset of samples deriving from different laboratory. Different machine learning approaches are used to handling missing data  but a preliminary overview and quantification of these data is crucial to set a multi-omics analysis. Therefore, from a data structure point of view, the challenge is to ensure structured relations between patient data and experiments/assays features. One way to ensure the alignment of data is to take into account: the different scales of dimensionality of heterogenous data, missing data and data storage. Despite the challenges and the limitations described above, one of the biggest advantages of radiogenomic studies is the opportunity to assess the relationships between genotype features (such as genomic variants), intermediate phenotype features (such as transcriptomics and epigenetic variables), radiomic features (image phenotype) and phenotypic clinical outcome. Adding radiomic features means adding phenotypic descriptors, which differ from phenotypic outcome, but in relation with them and with the multi-omic biological features.
Role of radiogenomics in cancer phenotype definition
Radiogenomic analyses are generally used for two main purposes: identifying features that might be related to genetic or molecular outcomes and correlating imaging and genomic data to identify suitable markers or predictors of a particular disease. Tipically, a radiogenomic dataset contains genomic (for example, gene expression) and imaging data, without outcomes data. A well-known correlation between specific imaging features and an outcome could enable the discovery of relationship between those features and specific tumor molecular characteristics. Similarly, investigating a well-known correlation of tumor molecular characteristics related to an outcome may allow the detection of imaging features related with that outcome. Several studies, based on these approaches, have been published. Gevaert et al.  tested how well the imaging features, based on specific genomic characteristics, predicted patient survival in non–small-cell lung cancer using sets of imaging and genomic (gene expression) data without outcomes. Other examples are radiogenomic studies in which correlations have been detected between imaging features and tumor subtypes, especially in breast cancer and in glioblastoma multiforme. Mazurowski et al.  demonstrated that imaging features describing tumor enhancement dynamics can differentiate breast cancer luminal B molecular subtype from other subtypes. Therefore, an imaging feature might be predictive of outcomes and might not necessitate a genomic analysis. However, in another study, Guo et al.  describe that a combination of imaging and genomic features could be useful for better breast tumor characterization. Indeed, they demonstrated that imaging features such as tumor size outperformed genomic features in predicting tumor pathological stage, whereas genomic features outperformed imaging features in predicting breast cancer estrogen receptor (ER) and progesterone receptor (PR) status such as tumor molecular characteristics. Another approach was used in Karlo et al. , where correlations between imaging features and mutation of genes (related with stage and diminished survival prognosis) were identified. Through this evidence, imaging features, potentially predictive of outcomes, have been identified. Furthermore, in Glioblastoma Multiforme, 1p/19q co-deletion, a widely used prognostic biomarker for brain tumors, and epidermal growth factor receptor (EGFR) mutations, have been correlated with a wide array of MRI features [44, 45]. Finally, radiogenomics could potentially have an important role in targeted therapies and in improving the performance in cancer outcomes prediction. In order to identify complex phenotypes from a radiogenomics approach, a number of challenges need to be addressed. The introduction of more complex models combining multiple heterogeneous data sources could overcome many of these challenges. For further insights on state of the art of radiogenomics studies see [6, 46, 47].
Radiomics in multi-omics framework: limits, challenges and limitations
Existing integrated databases
Integrated databases share data across multiple data types ranging from clinical to ‘omics and medical imaging relative to specific research area. In Table 2, we provide a list of discipline-specific databases covering oncological, neurological, neurodegenerative and cardiovascular field or multiple-diseases. So far, multi-omic profiles are primarily available in the oncological field. Indeed, Genomic Data Commons (GDC) portal, which includes the TCGA database, and TCIA are an unprecedented source of biomedical data for a broad range of cancer diseases. Although each database possesses its own organization, overall, they store data sets with multiple data types available at different levels. In addition to multi-omic and imaging data, supporting data related to the images such as patient outcomes, treatment details, genomics, pathology, and expert analyses are also provided when available. Clinical, multi-omic and pathological data stored on the GDC can be associated to the imaging data, stored on TCIA. Although both data portals allow an interactive navigation through different projects and their multiple data types, using matched TCGA patient identifiers, it is possible to explore the TCGA/TCIA databases without the ability to automatically correlate tissue genotype, radiological phenotype and patient outcomes. For example, many TCGA/TCIA studies [70,71,72] have published their radiomic data (radiomic features, radiologist features or also segmentations) on the TCIA website. These data are in a simple table format, such as xls format, and at present there is no way to automatically explore the radiomic data together with the genome data available on TCGA portal. The current workflow consists of downloading imaging and genomic features separately, integrating the data through a non standard way and finally performing a cleaning and subsetting operation. The results of this process are likely to result in a situation in which there is either little or no suitable omic data. Thus, there is an urgent need to link radiomic and genomic data globally such that data integration in achieved, facilitating scientists to uncover genotype–phenotype associations/correlations. In the following section, we provide a case study based on breast cancer data from TCGA/TCIA database to illustrate an example of data integration and utilization of MAE data structure for multi-omics data management.
The increasing interest in the development of statistical methodologies for multi-layers integration is due to the complexity of biological systems and data heterogeneity. In particular, to integrate heterogeneous data several methodological challenges must be addressed must:
different technical platforms;
different modalities and techniques used to acquire and measure data;
different numerical data types and scales;
large differences in the number of measured features for each data type.
In a multi-assay context, these factors make it difficult to choose the appropriate statistical approaches for data processing and the integration method. Each technical platform has its own noise level and sensitivity and, generally, it is associated with ad-hoc protocols for normalization and batch effects, depending on ‘omics/radiomics data type. Heterogeneous data integration includes the following statistical issues: dimension reduction, data integration or data fusion and causal inference:
In multi-assays integration context, heterogeneous data usually increase the dimensionality and, consequently, increase the chance to produce false positive hypothesis testing results. To solve this problem, the first step is to identify and combine relevant features from each data modality, keeping known the biological dependencies. Dimension reduction approaches decompose data into a few new variables (called components) that explain most of the differences in observations. Dimension reduction approaches, widely used in exploratory analysis of single omics datasets, are emerging also to simultaneous exploratory analyses of multiple datasets. These methods extract the linear relationships that better explain the correlated structure across datasets, the variability both within and between variables (or observations) and may highlight data issues such as batch effects or outliers. In the literature for integrated ‘omics, dimension reduction methods have presented several variations from Principal Component Analysis (PCA) and Factor Analysis. These variations include Multiple Factor Analysis (MFA), consensus PCA (CPCA), multiple-block PCA (MBPCA) and non-negative matrix factorization (NMF). As ‘omics datasets tend to have high dimensionality it is often useful to reduce the number of variables. In fact, several recent extensions of PCA include variable selection, often via a regularization step or L1 penalization (e.g. Least Absolute Shrinkage and Selection Operator, LASSO).
Data integration or data fusion
Two main approaches to multi-omics data integration can be considered: linear or simultaneous integration. The linear approach to multi-omics data leads to an oversimplified view of biology, basing on already known biological processes. This is possible, in particular, when only two data types are considered. The complexity of the phenotypes suggests that they can be better explored by the combination of simultaneous changes across all ‘omics data. The linear multi-omics integration does not consider unknown inter-omics relationships. Instead, simultaneous approach provides a complete and realistic characterization of phenotype from exploring the inter-omics interactions. Statistical methodologies for simultaneous integration can be classified into supervised and unsupervised approaches. Unsupervised methods explore biological profiles from input datasets and assign objects into different subgroups (clusters) without labeled response variables. Conversely, supervised methods consider the available known phenotype information from samples (for example disease-normal, treatment–control) and use this information to discover genotype–phenotype interactions and investigate biological processes. In multi-omics data integration field, there are different statistical approaches that can be classified as multivariate, concatenation-based and transformation-based methods. Multivariate methods are usually based on Partial Least Square Regression (PLS) or Canonical Correspondence Analysis (CCA). Many of them were developed and integrated in multi-omics bioinformatics tools (Table 1). Concatenation-based integration methods are performed by combining multiple data matrices of different multi-omics data types into a single combined matrix, used as input for constructing a predictive model. Finally, the transformation-based methods, such as Similarity Network Fusion, before constructing a model, convert multi-omics data types into intermediate and common form and integrate them into a large input matrix. The main advantage of a transformation step is to preserve individual ‘omics characteristics that can be lost otherwise.
A vital piece in understanding of the disease mechanisms. In genomic data analysis, we can consider different types of associations, such as association of discrete variables (DNA variations) with continuous variables (phenotypes, gene expression), association of discrete variables (DNA variations) with binary trait (disease status). In the integrated ‘omics literature, the regression strategies are used for explaining inter- or intra-system relations and interactions. One of the approaches is the parallel regression, used to explain intersystem responses simultaneously. Another possible approach is represented by Bayesian networks (BNs), belonging to the family of graphical models. BNs maintain high interpretability via graphical outputs and represent a way to identify possible causal relationships between measured variables depending on their conditional dependencies and independence. BNs explicitly model conditional statistical dependencies among random variables. In the biological context, each random variable represents one molecular feature. Integration of different ‘omics data modalities can be performed by using a primary data source, for example gene expression and employing further data (i.e., histone modifications or combinations of several sources) to construct informative network priors, which facilitate the identification of the true biological network from data. Networks represent a powerful tool in the context of multi-omics data integration, since they are able to contain heterogeneous and high-dimensional information. Networks can characterize complex interactions, thus identifying the mechanism linked to different types of information and associated to the phenotype of interest. In radiogenomics, a weighted network fusion that takes into account the importance of each layer could be considered. This approach can be applied to multi-omic genome-scale models where layers represent transcriptomic and phenotypic information. The weight measures the relative importance of each layer. Then each condition is associated with a point in a multi-dimensional phenotypic space. In order to address knowledge from the dynamic nature of molecular networks under various disease conditions, an unsupervised method, called DIABLO , was developed. DIABLO is an integrative classification method building predictive multi-omics models that can be applied to multi-omics data from new samples to determine their phenotype. This approach includes sparse generalized canonical correlation analysis (sGCCA) , multi-omics factor analysis (MOFA) , and Joint and Individual Variation Explained (JIVE) . The latter is a component-based method: it transforms each ‘omic dataset into latent components and maximizes the sum of pairwise correlations between latent components and a phenotype of interest.
MAE framework design: a case study
As described in the previous sections, we propose the use of MultiAssayExperiment (MAE) object as data structure to integrate genomic, radiomic and clinical data, providing coordinated representation, operations on multiple and heterogeneous data and focusing on two fundamental aspects of data at stake: multisampling and data longitudinality. We tested this solution at first studying existing MAE objects of TCGA unrestricted data of different cancer tissue obtained through curatedTCGA R package  and then creating a new MAE based on the TCGA breast cancer data and the respective radiomic features, extracted from T1 weighted Dynamic Contrast Enhanced (DCE) MRI images of TCIA .
Objects from curated TCGA contain data from different ‘omic experiments carried out on the same patient. Each experiment may contain different sample types for the same patient (for example, primary solid tumor and metastatic samples). To manage these data, in the TCGA project, a barcode is used as primary identifier. The TCGA barcode consists of a sequence of values associated to labels, each of which specifically identifies a TCGA data element. For example, the “Sample” label describes the sample type of a particular collection of data related to a patient and may take different value corresponding to a sample type according to Sample Type Codes table . The barcode TCGA-A1-A0SB-01A example indicates Primary Solid Tumor data (Sample Type Code: 01) of the patient A0SB belonging to TCGA project on breast invasive carcinoma (Tissue Source Site Codes: A1) (Fig. 2). This nomenclature was also used by curated TCGA in the construction of the TCGA data MAE object. In more detail, the barcode is used as value of colname column of MAE sampleMap (a DataFrame that relates the “primary” data - that describes the biological unit, which can refer to specimens, patients, etc.—to the experimental assays—for example, RNAseqGene). This DataFrame allows an unambiguous map from every experimental observation to one and only one biological unit, such as a patient, and allows different technical and biological replication for each assay. Moreover, identifiers allow consistency between data during subsetting and re-ordering. We propose to use both MAE data structure and a TCGA-barcodes-like structure to manage radiomic experiment data, together with biological omic data, in a single data structure. Typically, in a radiomic workflow, each single ROI, and the respective features, may represent a different lesion, or a region of a lesion, and, therefore, may exist in multiple samples for each patient of a radiomic experiment. According to our proposal, this multi-sampling feature can be managed by using MAE data structure and a specific barcode, in the same way as genomic data. In this scenario, a key role is played by the ExperimentList component of MAE, which contains all experimental data. This component can contain different type of elements, two of which are Matrix (a base element used for ID-Based dataset) and SummarizedExperiment . The latter may contain one or more assays (a matrix-like element that store the data). For each assay, rows represent features of interest and columns represent samples. For example in a genomic experiment, the rows of an assay represent genes or transcript, the columns represent the patients and each different assay in a Copy Number Alterations experiment may represent the values of segment mean and number of probes (Fig. 3). A radiomic experiment differs substantially from a genomic experiment in that it consists of one level of data complexity less than a genomic experiment. The latter is performed on a set of samples (the columns of the assay) and the analysis is performed on a set of genes, transcripts or protein (the rows of the assay). Finally, the experiment produces different results from the various assays. A radiomic experiment, instead, is performed on a set of samples without analysing of the molecular sub-level and therefore, from data structure point of view, we have two options:
Use assays of a summarizedExperiment to store the matrix-like data of each time-point. In this case, multiple time-point data are associated to a single experiment, for example BRCA_T1_weighted_DCE_MRI, with as many assays as time-points (BRCA indicates breast cancer data) (Fig. 3).
Use different summarizedExperiment to store different time-point data. In this case two experiments may be, for example, BRCA_T1_weighted_DCE_MRI_TP1 and BRCA_T1_weighted_DCE_MRI_TP2 (TP indicates Time Point) (Fig. 4).
In both cases, the rows of each assay stored radiomic features.
As shown in our case study, this data organization enables the use of MAE to collect, manage and then analyze radiomic data together with genomic and clinical data. In our case study the TCIA data consist of 36 quantitative radiomic features extracted from primary tumor images of 91 patients of the BRCA study, each acquired at a single time point. TCGA data consist of a MAE object composed of several experiments. We selected RNA-seq (expression quantification of 20,502 genes from 878 samples) and miRNA-seq (expression quantification of 1046 miRNA from 849 samples) experiments and integrated it together with TCIA data in a single MAE object. To do this, we first downloaded TCGA experiments, using curated TCGA, and TCIA features released. Subsequently, we created two R objects: one for TCGA and one for TCIA data. In the case of TCGA data we have directly obtained a MAE object through curated TCGA while in the case of TCIA, we first converted an xls file in an R dataframe and then in a summarizedExperiment object. This experiment contains two assays that represent two time point data, one of which is simulated. The radiomic experiment was subsequently integrated with the two pre-existing summarizedExperiment (RNA-seq and miRNA-seq experiment extracted from the downloaded MAE) using the workflow described in MAE vignettes on Bioconductor . Figure 5 shows a generalized Venn diagram for sample membership in multiple assays. The visualization of set intersections was performed using the UpSet matrix design using UpSetR package . The script code to reproduce above described procedure is available at https://gitlab.com/Zanfardino/radiogenomics-mae-case-study. We also propose an architecture, shown in Fig. 6, for a modular integration platform. Through a graphic interface, the users are able to (i) create or upload a MAE object, (ii) summarize MAE data through basic statistics and plots, (iii) manage and subset the uploaded data and (iv) execute different type of analyses (through independent modules). All the functions allow to work with highly complex data in an intuitive and simplified way. One way to manage and understand the meaning of large dimensional data is to place it in a visual context such as we have done here (Fig. 7).
The high-throughput production of ‘omics data has led to an increase of data sets of different types that need to be integrated in order to better understand disease mechanisms and how these multiple molecular data generate the observed phenotypes in complex diseases. Merging imaging phenotypes with multi-omic biological data may lead to new prognostic cancer models, new support for patient treatment strategy and development of improved survival predictors. Accordingly, increased attention is paid to statistical methods and algorithms to analyze and correlate multivariate imaging, clinical and molecular data for disease diagnosis and prognosis. Bringing these datasets together in a meaningful manner is the main goal of this study. Here, we identified three main challenges to overcome: the management of missing data caused by data filtering or non-execution of a specific analysis on a subset of samples, different spatial and temporal scales of imaging data and the need to manage radiomic features related to multiple lesions or sub-regions of a lesion. Our proposal to use MAE as data structure to combine radiogenomic data aims to integrate and facilitate the use and the exploration of heterogeneous and complex data derived from these deeply distant domains. Our integrated design enables regular operations of MAE on all experiments of a radiogenomic dataset, including radiomic data. With our MAE design, operations like: (i) selecting complete cases or subsettings, (ii) selecting samples with information in all dataset and/or in all ‘omics of a set of experiments (crucial to set a multi-omics analysis when more samples with missing data exist) and (iii) selecting subjects with specific phenotypes and clinical outcomes, may be carried out in order to ensure correct alignment of assays and patients, making radiogenomic integrative analysis more attainable. Moreover, the MAE structure, and the ability to organize data of different experiments in different interlinked data objects, has facilitated the handling of the additional spatial and temporal scales added by radiomic data. All of these operations and, therefore, our selection of the MultiAssayExperiment as the radiogenomic data container have been successfully tested with the integration of TCGA-BRCA data of 91 patients with radiomic features available on TCIA for the same patients. Despite the existence of specific software that make some of these functions available, such as TCGAbiolinks, RTCGA Toolbox and mixOmics (Table 1), none of these tools was designed to work on radiogenomic data. Conversely, our proposal facilitates radiogenomic studies since it allows user exploration across genomic as well as imaging datasets in data type independent manner. For example, the use of the TCGA barcode is clearly suitable for biological ‘omics data description but not for radiomic data, except for “Patient ID”, “Sample” and “Center” labels. The latter represents an open challenge and, therefore, a possible future direction might be the development of a unique nomenclature for a new type of barcode to specifically describe radiogenomic data. Moreover, for data different from TCGA, also a custom id can be used as colName in SampleMap. In conclusion, understanding the relationships among genomic profiles, imaging phenotypes and outcomes has great potential to improve cancer treatment and management. In this context, genomic features are closely related to genetic and molecular profile of a cancer and, consequently, to outcomes like receptor status, while, radiomic features characterize tumor phenotypes and, consequently, outcomes like tumor stage. Bringing radiomics and genomic data together into a single data structure is the first step to achieve effective radiogenomic analysis, integrating information arising from different aspects of the tumor. The use of the current version of MAE by an interdisciplinary research community can pave the way to further development of extended MAE object for implementing new functionalities specific to radiogenomic domain in order to correlate phenotype and genotype features.
Availability of data and materials
Data supporting the findings of this study are available from GDC data portal https://www.cancer.gov/about-nci/organization/ccg/research/structural-genomics/tcga and from TCIA web site http://doi.org/10.7937/K9/TCIA.2014.8SIPIY6G.
next generation sequencing
The Cancer Genome Atlas
The Cancer Imaging Archive
region of interest
Data Warehouse for Translational Research
epidermal growth factor receptor
genomic data commons
principal component analysis
multiple factor analysis
non-negative matrix factorization
Least Absolute Shrinkage and Selection Operator
partial least square
Canonical Correspondence Analysis
sparse generalized canonical correlation analysis
multi-omics factor analysis
Joint and Individual Variation Explained
dynamic contrast enhanced
breast related cancer antigens
magnetic resonance imaging
ribonucleic acid sequencing
Ramos M, Schiffer L, Re A, et al. Software for the integration of multiomics experiments in Bioconductor. Cancer Res. 2017;77:e39–42.
Hariri AR, Weinberger DR. Imaging genomics. Br Med Bull. 2003;65:259–70.
Baltrušaitis T, Ahuja C, Morency LP. Multimodal machine learning: a survey and taxonomy. IEEE Trans Pattern Anal Mach Intell. 2018. https://doi.org/10.1109/TPAMI.2018.2798607.
Aiello M, Cavaliere C, D'Albore A, et al. The Challenges of Diagnostic Imaging in the Era of Big Data. J Clin Med. 2019;8(3):316.
Gatenby RA, Grove O, Gillies RJ. Quantitative imaging in cancer evolution and ecology. Radiology. 2013;1:8–15.
Incoronato M, Aiello M, Infante T, et al. Radiogenomic analysis of oncological data: a technical survey. Int J Mol Sci. 2017;18(4):805.
Gillies RJ, Anderson AR, Gatenby RA, et al. The biology underlying molecular imaging in oncology: from genome to anatome and back again. Clin Radiol. 2010;65(7):517–21.
Aerts HJ, Velazquez ER, Leijenaar RT, et al. Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun. 2014;5:4006.
Diehn M, Nardini C, Wang DS, et al. Identification of noninvasive imaging surrogates for brain tumor gene-expression modules. Proc Natl Acad Sci USA. 2008;105(13):5213–8.
Segal E, Sirlin CB, Ooi C, et al. Decoding global gene expression programs in liver cancer by noninvasive imaging. Nat Biotechnol. 2007;25(6):675–80.
Gillies RJ, Kinahan PE, Hricak H. Radiomics: images are more than pictures, they are data. Radiology. 2016;278(2):563–77.
Li H, Zhu Y, Burnside ES, et al. Quantitative MRI radiomics in the prediction of molecular classifications of breast cancer subtypes in the TCGA/TCIA data set. NPJ Breast Cancer. 2016;2(1):16012.
Yip SSF, Aerts HJWL. Applications and limitations of radiomics. Phys Med Biol. 2016;61(13):R150–66.
Monti S, Aiello M, Incoronato M, et al. DCE-MRI pharmacokinetic-based phenotyping of invasive ductal carcinoma: a radiomic study for prediction of histological outcomes. Contrast Media Mol Imaging. 2018;17:5076269.
Kirienko M, Cozzi L, Antunovic L, et al. Prediction of disease-free survival by the PET/CT radiomic signature in non small cell lung cancer patients undergoing surgery. Eur J Nucl Med Mol Imaging. 2017;45(2):1–11.
Blanc-Durand P, Van Der Gucht A, Jreige M, et al. 18F-FDG PET-based radiomics score predicts survival in patients treated with Yttrium-90 transarterial radioembolization for unresectable hepatocellular carcinoma. J Nucl Med. 2017;58(460):2017.
Wang J, Wu CJ, Bao ML, et al. Machine learning-based analysis of MR radiomics can help to improve the diagnostic performance of PI-RADS v2 in clinically relevant prostate cancer. Eur Radiol. 2017;27:4082–90.
Jochems A, Hoebers F, De Ruysscher D, et al. Deep learning of radiomics features for survival prediction in NSCLC and Head and Neck carcinoma. Radiother Oncol. 2017;123:S866.
Ingrisch M, Schneider MJ, Nörenberg DN, et al. Radiomic analysis reveals prognostic information in T1-weighted baseline magnetic resonance imaging in patients with glioblastoma. Investig Radiol. 2017;52(6):360–6.
Keek SA, Leijenaar RT, Jochems A, et al. A review on radiomics and the future of theranostics for patient selection in precision medicine. Br J Radiol. 2018;91(1091):20170926.
Huang S, Chaudhary K, Garmire LX. More Is better: recent progress in multi-omics data integration methods. Front Genet. 2017;8:84.
Hernandez-Ferrer C, Ruiz-Arenas C, Beltran-Gomila A, et al. MultiDataSet: an R package for encapsulating multiple data sets with application to omic data integration. BMC Bioinform. 2017;18(1):36.
Hu H, Correll M, Kvecher L, et al. DW4TR: a Data Warehouse for Translational Research. J Biomed Inform. 2011;44(6):1004–19.
Streit M, Gratzl S, Stitz H, et al. Ordino: visual analysis tool for ranking and exploring genes, cell lines, and tissue samples. bioRxiv. 2018. https://doi.org/10.1101/277848.
Han S, Kim D, Kim Y, et al. CAS-viewer: web-based tool for splicing-guided integrative analysis of multi-omics cancer data. BMC Med Genomics. 2018;11:25.
Gao J, Aksoy BA, Dogrusoz U, et al. Integrative analysis of complex cancer genomics and clinical profiles using the cBioPortal. Sci Signal. 2013;6(269):pl1.
Cerami E, Gao J, Dogrusoz U, et al. The cBio cancer genomics portal: an open platform for exploring multidimensional cancer genomics data. Cancer Discov. 2012;2(5):401–4.
Coarfa C, Pichot C, Jackson A, et al. Analysis of interactions between the epigenome and structural mutability of the genome using Genboree Workbench tools. BMC Bioinform. 2014;15:S2.
Schäfer M, Klein HU, Schwender H. Integrative analysis of multiple genomic variables using a hierarchical Bayesian model. Bioinformatics. 2017;33(20):3220–7.
Rohart F, Gautier B, Singh A, et al. mixOmics: an R package for ‘omics feature selection and multiple data integration. PLoS Comput Biol. 2017;13(11):e1005752.
Silverbush D, Cristea S, Yanovich G, et al. ModulOmics: integrating multi-omics data to identify cancer driver modules. bioRxiv. 2018. https://doi.org/10.1101/288399.
Tuncbag N, Gosline SJ, Kedaigle A, et al. Network-based interpretation of diverse high-throughput datasets through the omics integrator software package. PLoS Comput Biol. 2016;12(4):e1004879.
Cline MS, Craft B, Swatloski T, et al. Exploring TCGA pan-cancer data at the UCSC cancer genomics browser. Sci Rep. 2013;3:2652.
Kannan L, Ramos M, Re A, et al. Public data and open source tools for multi-assay genomic investigation of disease. Brief Bioinform. 2016;17:603–15.
Silva TC, Colaprico A, Olsen C, et al. TCGA workflow: analyze cancer genomics and epigenomics data using Bioconductor packages. F1000Res. 2016;5:1542.
Bodalal Z, Trebeschi S, Nguyen-Kim TDL, Schats W, Beets-Tan R. Radiogenomics: bridging imaging and genomics. Abdom Radiol. 2019;44(6):1960–84.
Haas R, Zelezniak A, Iacovacci J, et al. Designing and interpreting ‘multi-omic’ experiments that may change our understanding of biology. Curr Opin Struct Biol. 2017;6:37–45.
Chakraborty S, Hosen MI, Ahmed M, et al. Onco-multi-OMICS approach: a new frontier in cancer research. Biomed Res Int. 2018;2018:9836256.
Mirza B, Wang W, Wang J, et al. Machine learning and integrative analysis of biomedical big data. Genes. 2019;10:87. https://doi.org/10.3390/genes10020087.
Gevaert O, Xu J, Hoang CD, et al. Non–small cell lung cancer: identifying prognostic imaging biomarkers by leveraging public gene expression microarray data—methods and preliminary results. Radiology. 2012;264:387–96.
Mazurowski MA, Zhang J, Grimm LJ, Yoon SC, Silber JI. Radiogenomic analysis of breast cancer: luminal B molecular subtype is associated with enhancement dynamics at MR imaging. Radiology. 2014;273:365–72.
Guo W, Li H, Zhu Y, et al. Prediction of clinical phenotypes in invasive breast carcinomas from the integration of radiomics and genomics data. J Med Imaging. 2015;2(4):041007.
Karlo CA, Di Paolo PL, Chaim J, et al. Radiogenomics of clear cell renal cell carcinoma: associations between CT imaging features and mutations. Radiology. 2014;270:464–71.
Shofty B, Artzi M, Ben Bashat D, Liberman G, Haim O, Kashanian A, Bokstein F, Blumenthal DT, Ram Z, Shahar T. MRI radiomics analysis of molecular alterations in low-grade gliomas. Int J Comput Assist Radiol Surg. 2018;13(4):563–71.
Li Y, Liu X, Xu K, Qian Z, Wang K, Fan X, Li S, Wang Y, Jiang T. MRI features can predict EGFR expression in lower grade gliomas: a voxel-based radiomic analysis. Eur Radiol. 2008;28(1):356–62.
Mazurowski MA. Radiogenomics: what it is and why it is important. J Am Coll Radiol. 2015;12:862–6.
Meng C, Zeleznik OA, Thallinger GG, et al. Dimension reduction techniques for the integrative analysis of multi-omics data. Brief Bioinform. 2016;17:628–41.
Edwards NJ, Oberti M, Thangudu RR, et al. The CPTAC data portal: a resource for cancer proteomics research. J Proteome Res. 2015;14(6):2707–13.
Wilson S, Fitzsimons M, Ferguson M, et al. Developing cancer informatics applications and tools using the NCI genomic data commons API. Cancer Res. 2017;77:e15–8.
Zhang J, Baran J, Cros A, et al. International Cancer Genome Consortium Data Portal—a one-stop shop for cancer genomics data. Database. 2011;19:bar026.
Clark K, Vendt B, Smith K, et al. The Cancer Imaging Archive (TCIA): maintaining and operating a public information repository. J Digit Imaging. 2013;26:1045–57.
Zheng-Bradley X, Flicek P. Applications of the 1000 Genomes Project resources. Brief Funct Genomics. 2017;16(3):163–70.
Katako A, Shelton P, Goertzen AL, et al. Machine learning identified an Alzheimer’s disease-related FDG-PET pattern which is also expressed in Lewy body dementia and Parkinson’s disease dementia. Sci Rep. 2018;8:13236.
Pont-Sunyer C, Tolosa E, Caspell-Garcia C, et al. The prodromal phase of leucine-rich repeat kinase 2-associated Parkinson disease: clinical and imaging Studies. Mov Disord. 2017;32:726–38.
Kang UJ, Goldman JG, Alcalay RN, et al. The BioFIND study: characteristics of a clinically typical Parkinson’s disease biomarker cohort. Mov Disord. 2016;31:924–32.
Payakachat N, Tilford JM, Ungar WJ. National Database for Autism Research (NDAR): big data opportunities for health services research and health technology assessment. Pharmacoeconomics. 2016;34:127–38.
Gwinn K, David KK, Swanson-Fischer C, et al. Parkinson’s disease biomarkers: perspective from the NINDS Parkinson’s Disease Biomarkers Program. Biomark Med. 2017;11:451–73.
Hodes RJ, Buckholtz N. Accelerating Medicines Partnership: Alzheimer’s Disease (AMP-AD) knowledge portal aids Alzheimer’s drug discovery through open data sharing. Expert Opin Ther Targets. 2016;20:389–91.
Butkiewicz M, Blue EE, Leung YY, et al. Functional annotation of genomic variants in studies of late-onset Alzheimer’s disease. Bioinformatics. 2018;34:2724–31.
Fonseca CG, Backhaus M, Bluemke DA, et al. The Cardiac Atlas Project—an imaging database for computational modeling and statistical atlases of the heart. Bioinformatics. 2011;27:2288–95.
Giffen CA, Carroll LE, Adams JT, et al. Providing Contemporary Access to Historical Biospecimen Collections: development of the NHLBI Biologic Specimen and Data Repository Information Coordinating Center (BioLINCC). Biopreserv Biobank. 2015;13:271–9.
Liu B, Madduri RK, Sotomayor B, et al. Cloud-based bioinformatics workflow platform for large-scale next-generation sequencing analyses. J Biomed Inform. 2014;49:119–33.
Ye Z, Kalloo FS, Dalenberg AK, et al. An electronic medical record-linked biorepository to identify novel biomarkers for atherosclerotic cardiovascular disease. Glob Cardiol Sci Pract. 2013;2013:82–90.
Craig T, Smelick C, Tacutu R, et al. The Digital Ageing Atlas: integrating the diversity of age-related changes into a unified resource. Nucleic Acids Res. 2015;43:D873–8.
Tryka KA, Hao L, Sturcke A, et al. NCBI’s database of genotypes and phenotypes: dbGaP. Nucleic Acids Res. 2014;42:D975–9.
Lappalainen I, Almeida-King J, Kumanduri V, et al. The European Genome-phenome Archive of human data consented for biomedical research. Nat Genet. 2015;47:692–5.
Barrett T, Wilhite SE, Ledoux P, et al. NCBI GEO: archive for functional genomics data sets—update. Nucleic Acids Res. 2012;41:D991–5.
Tacutu R, Thornton D, Johnson E, et al. Human Ageing Genomic Resources: new and updated databases. Nucleic Acids Res. 2018;46:D1083–90.
Kodama Y, Mashima J, Kosuge T, et al. DNA Data Bank of Japan: 30th anniversary. Nucleic Acids Res. 2018;46:D30–5.
Bakas S, Akbari H, Sotiras A, Bilello M, et al. Segmentation labels and radiomic features for the pre-operative scans of the TCGA-LGG collection. Cancer Imaging Archiv. 2017. https://doi.org/10.7937/K9/TCIA.2017.GJQ7R0EF.
Morris E, Burnside E, Whitman G, et al. Using computer-extracted image phenotypes from tumors on breast mri to predict stage. Cancer Imaging Archiv. 2014. https://doi.org/10.7937/K9/TCIA.2014.8SIPIY6G.
Bakas S, Akbari H, Sotiras A, Bilello M, et al. Segmentation labels and radiomic features for the pre-operative Scans of the TCGA-GBM collection. Cancer Imaging Archiv. 2017. https://doi.org/10.7937/K9/TCIA.2017.KLXWJJ1Q.
Singh A, Gautier B, Shannon CP. DIABLO: from multi-omics assays to biomarker discovery, an integrative approach. bioRxiv. 2018. https://doi.org/10.1101/067611.
Tenenhaus A, Philippe C, Guillemot V, et al. Variable selection for generalized canonical correlation analysis. Biostatistics. 2014;15(3):569–83.
Argelaguet R, Velten B, Arnol D, et al. Multi-omics factor analysis—a framework for unsupervised integration of multi-omics data sets. Mol Syst Biol. 2018;14(6):e8124.
Lock EF, Hoadley KA, Marron JS, et al. Joint and individual variation explained (JIVE) for integrated analysis of multiple data types. Ann Appl Stat. 2013;7(1):523–42.
Ramos M. curatedTCGA Data: Curated Data From The Cancer Genome Atlas (TCGA) as MultiAssayExperiment Objects. R package version 1.3.5.
GDC Sample Type Codes. https://gdc.cancer.gov/resources-tcga-users/tcga-code-tables/sample-type-codes. Accessed 5 July 2019.
Morgan M, Obenchain V, Hester J et al. SummarizedExperiment: SummarizedExperiment container. R package version 1.10.1.
Bioconductor page of MultiAssayExperiment. http://bioconductor.org/packages/release/bioc/html/MultiAssayExperiment.html. Accessed 5 July 2019.
Lex A, Gehlenborg N, Strobelt H, et al. UpSet: visualization of Intersecting Sets. IEEE Trans Visual Comput Graphics. 2014;20:1983–92.
This work was partially funded by “Ricerca corrente” funding from Ministry of Health and “POR Regione Campania, progetto eMORFORAD”.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Zanfardino, M., Franzese, M., Pane, K. et al. Bringing radiomics into a multi-omics framework for a comprehensive genotype–phenotype characterization of oncological diseases. J Transl Med 17, 337 (2019). https://doi.org/10.1186/s12967-019-2073-2