key: cord-0017467-6t57qq9j authors: Xie, Chen-Yi; Hu, Yi-Huai; Ho, Joshua Wing-Kei; Han, Lu-Jun; Yang, Hong; Wen, Jing; Lam, Ka-On; Wong, Ian Yu-Hong; Law, Simon Ying-Kit; Chiu, Keith Wan-Hang; Fu, Jian-Hua; Vardhanabhuti, Varut title: Using Genomics Feature Selection Method in Radiomics Pipeline Improves Prognostication Performance in Locally Advanced Esophageal Squamous Cell Carcinoma—A Pilot Study date: 2021-04-29 journal: Cancers (Basel) DOI: 10.3390/cancers13092145 sha: 1cb7a86776db002c7e71b7d5eb385614e26844ed doc_id: 17467 cord_uid: 6t57qq9j SIMPLE SUMMARY: Prognosis for patients with locally advanced esophageal squamous cell carcinoma (ESCC) remains poor mainly due to late diagnosis and limited curative treatment options. Neoadjuvant chemoradiotherapy (nCRT) plus surgery is considered the standard of care for patients with locally advanced ESCC. Currently, predicting prognosis remains a challenging task. Quantitative imaging radiomics analysis has shown promising results, but these methods are traditionally data-intensive, requiring a large sample size, and are not necessarily based on the underlying biology. Feature selection based on genomics is proposed in this work, leveraging differentially expressed genes to reduce the number of radiomic features allowing for the creation of a CT-based radiomic model using the genomics-based feature selection method. The established radiomic signature was prognostic for patients’ long-term survival. The radiomic nomogram could provide a valuable prediction for individualized long-term survival. ABSTRACT: Purpose: To evaluate the prognostic value of baseline and restaging CT-based radiomics with features associated with gene expression in esophageal squamous cell carcinoma (ESCC) patients receiving neoadjuvant chemoradiation (nCRT) plus surgery. Methods: We enrolled 106 ESCC patients receiving nCRT from two institutions. Gene expression profiles of 28 patients in the training set were used to detect differentially expressed (DE) genes between patients with and without relapse. Radiomic features that were correlated to DE genes were selected, followed by additional machine learning selection. A radiomic nomogram for disease-free survival (DFS) prediction incorporating the radiomic signature and prognostic clinical characteristics was established for DFS estimation and validated. Results: The radiomic signature with DE genes feature selection achieved better performance for DFS prediction than without. The nomogram incorporating the radiomic signature and lymph nodal status significantly stratified patients into high and low-risk groups for DFS (p < 0.001). The areas under the curve (AUCs) for predicting 5-year DFS were 0.912 in the training set, 0.852 in the internal test set, 0.769 in the external test set. Conclusions: Genomics association was useful for radiomic feature selection. The established radiomic signature was prognostic for DFS. The radiomic nomogram could provide a valuable prediction for individualized long-term survival. Esophageal cancer (EC) accounted for 572,034 new cases and 508,585 deaths of cancer overall worldwide in 2018, ranking seventh in incidence and sixth terms of mortality [1] . There is geographic variation in EC pathological subtype incidence. Approximately 90% of EC cases at the time of diagnosis in China are esophageal squamous cell carcinoma (ESCC) [2] . Because of late-stage cancer diagnosis and limited clinical curative modality, the five-year overall survival (OS) rates for ESCC patients range from 15% to 25% [3] . Surgery has a central role in disease management, but a large proportion of patients showed local or distant metastasis after surgery within 3 years [4, 5] . The addition of adjuvant chemotherapy or radiation therapy has proven to improve survival in patients with involved lymph node disease [6, 7] . However, a recent network meta-analysis showed that adjuvant chemotherapy or radiation therapy could not significantly reduce death risk compared with surgery alone [8] . As shown by well-powered prospective randomized clinical trials, neoadjuvant chemoradiotherapy (nCRT) could benefit patients by improving tumor resection rate and long-term survival for patients with locally advanced EC [9] [10] [11] [12] . The CROSS study demonstrated that patients receiving nCRT followed by surgery have a significantly increased median overall survival than those receiving surgery alone (49.4 vs. 29 .0 months, p = 0.003) [9] . The Chinese study NEOCRTEC5010 also showed that compared with a simple surgery, patients' median survival was improved from 66.5 to 100.1 months (p = 0.025) [10] . However, due to tumor heterogeneity, not all patients could gain a survival benefit from nCRT treatment. Currently, predicting prognosis remains a challenging task for ESCC patients. The ability to identify patients with poor prognoses is required for more effective personalized disease management. Computed tomography (CT) is a broadly used non-invasive tool for disease assessment. For the evaluation of tumor malignancy and patient prognosis, the visualization of tumor heterogeneity is of vital importance. Radiomics are now widely used in prognostic prediction tasks for many tumor types [13] [14] [15] . Previous quantitative imaging research has generally focused on the prediction of the nCRT treatment effect in EC [16] [17] [18] [19] . Furthermore, the majority of esophageal cancer studies were based on imaging data acquired from a single time point [20, 21] . Delta radiomics has been proposed recently that reflected changes of radiomic features across certain therapies. Delta radiomic features were reported to improve model performance for different tasks of a variety of cancer, including diagnosis [22] , therapy response evaluation [23] [24] [25] [26] , and prognosis prediction [27, 28] . Methods to combat the "curse of high dimensionality" intrinsic to radiomics methodology are important for the construction of radiomics prediction models. Methods that can adequately perform feature reduction will enable a more accurate predictive performance and decreased computational costs. Widely used methods mainly focus on data-driven feature selection. For the development of novel models, Wynants et al. [29] recommended the application of prior knowledge and expert opinion for the selection of significant features, rather than choosing a predictor using an entirely data-driven method [30] . This could be more important for some specific clinical scenarios with a small sample size [31] . Previous studies have shown that image-derived radiomic features are the reflection of the underlying molecular changes in the tumor cells with phenotypic consequences. Segal et al. demonstrated that semantic image traits correlated with genetic profiles in human hepatocellular carcinomas (HCC) patients [32] . Kuo genomics analysis helps the identification of patterns of gene expression related to drug response in HCC [33] . Grossmann et al. [34] identified and independently validated 13 radiomic-pathway modules with coherent expression patterns. Eleven of the modules were significantly associated with overall survival, staging, or histology. Panth et al. [35] further proved a causal relationship between gene expression and imaging traits. Traditionally, researchers have concentrated efforts to reveal the association between radiomics and genomic data (including transcriptomic data). To our knowledge, no prior studies have investigated the feasibility of genomics-driven radiomics feature selection. We hypothesize that genomics-driven feature selection of radiomic features will lead to a more robust and generalizable predictive model. The objective of this study is to perform a proof-of-concept study using genomics data as a method for feature selection of radiomics applied to CT scans to demonstrate value when constructing a radiomics-based prognostic prediction model for ESCC patients receiving nCRT followed by surgery. The experimental design of this research was depicted in Figure 1 . Patient records from April 2007 to December 2016 were retrieved from the Sun Yat-sen University Cancer Center, Guangzhou, China (institution 1) and the University of Hong Kong, Hong Kong (institution 2). The selection criteria included: (a) patients aged 18-80 years; (b) had histologically confirmed ESCC; (c) had standardized baseline and post-nCRT enhanced CT scans; and (d) received nCRT plus surgery. The exclusion criteria included: (a) patients who underwent anticancer treatments before the baseline CT scans; (b) with a history of other malignancies; and (c) with incomplete medical records. For institution 1, patients received 75 mg/m 2 cisplatin on day 1 and 25 mg/m 2 vinorelbine on days 1 and 8 for 2 cycles, or 25 mg/m 2 cisplatin and 25 mg/m 2 docetaxel on days 1, 8, 15, and 21, with a total dose of 40 or 44 Gy for concurrent radiotherapy. For institution 2, 50 mg/m 2 paclitaxel and carboplatin AUC 2 for 5 cycles or 100 mg/m 2 cisplatin and 500 mg/m 2 fluorouracil were administrated intravenously for 4 days for weeks 1 and 5, with a total dose of 40 or 41.4 Gy for concurrent radiotherapy. Patients with biopsy samples with genetic profiles from institution 1 were allocated to the training group. The rest from institution 1 was used as the internal test group. Patients from institution 2 were allocated to the external test group. This study has been approved by institutional review boards from both institutions (refer to Supplementary Method for further detail). Patients from institution 1 were part of a prior prospective study [10] . Due to the retrospective nature, informed consent from patients was waived. Regions of interests (ROIs) were manually segmented using ITK-SNAP, and radiomic features extraction was performed by the open-source Python package PyRadiomics [36] . Both original and wavelet-filtered features were extracted. There were three main groups of radiomic features: (1) pre-nCRT features; (2) post-nCRT features; (3) delta features (∆features). The ∆features were the relative changes (expressed in percentage) of the radiomic features before and after nCRT treatment. To assess feature robustness, we conducted a test-retest study. Two radiologists (V.V. 10 years and L.H. 9 years' experience) individually contoured the ROIs in the training set. Two groups of features were extracted, and those with intra-class correlation coefficients (ICC) > 0.80 were selected. To minimize the institutional difference, we used the ComBat method for feature harmonization [37] . The ComBat method has been commonly used in genomic studies and shown to successfully correct the multicenter differences in imaging features values resulting from different image acquisition protocols [38] . Regions of interests (ROIs) were manually segmented using ITK-SNAP, and radiomic features extraction was performed by the open-source Python package PyRadiomics [36] . Both original and wavelet-filtered features were extracted. There were three main groups of radiomic features: (1) pre-nCRT features; (2) post-nCRT features; (3) delta features (Δfeatures). The Δfeatures were the relative changes (expressed in percentage) of the radiomic features before and after nCRT treatment. To assess feature robustness, we conducted a test-retest study. Two radiologists (V.V. 10 years and L.H. 9 years' experience) individually contoured the ROIs in the training set. Two groups of features were extracted, and those with intra-class correlation coefficients (ICC) > 0.80 were selected. To minimize the institutional difference, we used the ComBat method for feature harmonization [37] . The ComBat method has been commonly used in genomic studies and shown to successfully correct the multicenter differences in imaging features values resulting from different image acquisition protocols [38] . For twenty-eight ESCC patients from the training set, the pre-nCRT tissue samples For twenty-eight ESCC patients from the training set, the pre-nCRT tissue samples were extracted from the primary tumor sites around 2 weeks before nCRT. The genomic profiles were measured using a GeneChip ® Human Genome U133 Plus 2.0 Array (Affymetrix, Santa Clara, CA, USA). The primary endpoint was disease-free survival (DFS). DFS referred to the length of time from surgery to recurrence of tumor or death. OS, as the secondary endpoint, was the duration from recruitment to death or the last follow-up. The minimum follow-up period was 36 months after surgery. For patients with no documented clinical endpoints, their survival was censored on 31 December 2019. The clinical records were reviewed by the surgeons and oncologists in charge. Clinical staging was evaluated according to the American Joint Committee on Cancer (AJCC) TNM staging system, 8th edition [38] . Patients' clinical characteristics, including age, sex, treatment response, tumor length, tumor location, histologic grade, ∆BMI, smoking status, drinking status, and family history of tumor, were recorded. Given the imbalanced distribution of DFS (7 out 21 having recurrence), the synthetic minority oversampling technique has been adopted for data re-balancing in the training set [39] . We introduced a feature selection step according to the features' correlation with differentially expressed (DE) genes in the tumor biopsy sample. For twenty-eight ESCC patients from the training set, the "limma" package was applied to detect DE genes between patients with different survival outcomes. DE genes were ranked by the p-value according to the limma test, and the ordered list of DE genes was further analyzed by enrichment analysis of gene terms with the use of g: Profiler [40] . Data sources include gene ontology biological process and pathway collections from Kyoto Encyclopedia of Genes and Genomes, Reactome, and WikiPathways. The enrichment analysis found significant terms consisting of sets of genes. The overlapped genes were defined as DE genes that could be found in both significant gene sets and DE genes. The overlapped genes were used as a filter for the selection of radiomic features. Radiomic features that were significantly correlated with these overlapped genes using Pearson's correlation test. Correlated radiomic features were included for further analysis. In the training set, radiomic features were selected in three steps. First, correlated features (Pearson's correlation coefficient larger than 0.80) were grouped, and each group of features was fitted into a DFS prediction model using a decision tree classifier. Features with the highest importance attributed by the model among features were considered the most important and retained. Second, according to univariate analysis, the top 100 best features predictive of DFS calculated were selected. Finally, we used regularized multivariate logistic regression with the least absolute shrinkage and selection operator (LASSO) penalty to further reduce the feature number [41] . The optimal λ was used to find predictors with non-zero coefficients. A linear regression model with selected features was built for the calculation of the radiomic score (Rad-score) after feature selection. The features selected from genomics feature selection and data-driven machine learning approaches were used to build classification model 1. The features selected from only data-driven approaches were used to build classification model 2. We further built clinical nomograms integrating the radiological score and valuable clinical risk factors for prognosis prediction. Based on Cox proportional hazards model, hazard ratios (HRs) for Rad-score and other clinical variables were calculated. The correlations of the factors with DFS were further investigated in multivariable analyses. The final model was decided by the Akaike information criterion (AIC) in a backward selection manner. The selected risk factors were included to build clinical nomograms. Nomogram 1 and nomogram 2 were based on classification model 1 and classification model 2, respectively. The cut-off points for the nomograms were determined by Youden Index, to divide patients into different risk groups. Statistical analyses and graphic production were conducted using Python 3.7. and R 3.3.1. The "limma" method was used with a false discovery rate < 0.05 and a two-fold difference as cut-off criteria. The enrichment analysis of gene terms of DE genes was conducted by g: Profiler with 0.05 as the cut-off for the false discovery rate. The correlation between radiomic features and overlapped genes were analyzed by Pearson correlation test and deemed significant if p < 0.05. We determined the prediction performance by area under the curve (AUC) of the receiver operating characteristic curve. Time-dependent AUCs for the multivariate Cox model performance were evaluated every 6 months. The calibration performance of the nomograms was measured graphically by calibration plots. Discrimination ability was tested by Harrell's concordance index (C-index). We further employed decision curve analysis (DCA) to detect the net benefit brought by the nomograms for clinical settings [42] . The DFS and OS for patients stratified by nomogram predictions were shown by Kaplan-Meier curves and the statistical difference was measured using log-rank significance tests. Details could be found in the Supplementary Method. Basic patient characteristics were listed in Table 1 . A total of 106 ESCC patients receiving nCRT plus surgery treatment with follow-up information (mean age [standard deviation (SD)]: 59.01 [9.38] ; male: 81.1%) were collected, including 65 from institution 1 and 41 from institution 2. Twenty-eight patients having biopsy samples with genetic profiles from institution 1 were used as the training set, the rest 37 were used as an internal test set, and 41 from institution 2 were allocated to the external test set (Supplementary Figure S1 ). Apart from drinking status, the baseline characteristics were balanced between the training and the internal test set. There were differences in age, tumor location, clinical stage, and drinking status across the two institutions. We extracted 2553 radiomic features, including 851 features from each of the pre-nCRT CT, post-nCRT CT, and delta categories (107 original and 744 with wavelet filtration). For the feature robustness test, 2336 features with ICC > 0.80 were included for feature selection. The statistical analysis in the training set found that 37 genes were differentially expressed between patients with and without relapse groups (p < 0.05) based on the limma test. The pathway enrichment analysis was conducted by using the ordered gene list generated from DE genes. Using these 37 DE genes, we identified 181 pathways that were enriched. Sixteen of the genes encompassed in enriched pathways overlap with 37 DE genes. The 16 overlapping genes were used for further correlation analysis (see Supplementary Tables S1 and S2 ). After genomics feature selection, 35 .4% (829 out of 2336) of radiomic features were found to be significantly correlated with at least one of the overlapped genes. Radiomic features with and without genomics selection were both analyzed by the following machine learning process. After correlated feature elimination, univariate analysis, and LASSO selection, the feature number was finally reduced to eight. Radiomic features derived with and without genomics feature selection were listed in Supplementary Tables S3 and S4. The correlation between selected features and DE genes was shown in Supplementary Figure S2 . Classification nomogram 1 consisted of eight features, all correlating with gene information. For classification nomogram 2, half features were not correlated with any discovered DE genes. Two features were selected for both nomograms. The radiomic classification model 1 consisted of radiomic features with genomics feature selection, which resulted in better performance and generalisability (AUC: 0.912 in the training set, 0.825 in the internal test set, 0.749 in the external test set), as shown in classification receiver operating characteristic curves (Figure 2a ). The classification model 2 was constructed using radiomic features without genomics feature selection (AUC: 0.925 in the training set, 0.782 in the internal test set, and 0.679 in the external test set), as shown in Figure 2b . Prediction probabilities were used as Rad-score for further analysis. We proceeded to develop radiomic nomograms combining the Rad-score and clinicopathological factors. Clinical N staging was significantly correlated with DFS according to the univariate analysis. In the multivariate analysis with AIC stepwise selection for the construction of nomogram 1, Rad-score 1 (HR: 2.55; 95% CI: 1.85,3.52; p < 0.001), and clinical N staging (HR: 3.23; 95% CI: 1.66, 6.29; p < 0.001) were identified as independent prognostic factors in the Cox proportional hazards model and were incorporated into the nomogram 1 (Figure 3 ). Rad-score 2 (HR: 3.25; 95% CI: 1.98, 5.33; p < 0.001), and clinical N staging (HR: 2.76; 95% CI: 1.41, 5.38; p = 0.003) were also selected for nomogram 2. The radiomic classification model 1 consisted of radiomic features with genomics feature selection, which resulted in better performance and generalisability (AUC: 0.912 in the training set, 0.825 in the internal test set, 0.749 in the external test set), as shown in classification receiver operating characteristic curves (Figure 2a ). The classification model 2 was constructed using radiomic features without genomics feature selection (AUC: 0.925 in the training set, 0.782 in the internal test set, and 0.679 in the external test set), as shown in Figure 2b . Prediction probabilities were used as Rad-score for further analysis. We proceeded to develop radiomic nomograms combining the Rad-score and clinicopathological factors. Clinical N staging was significantly correlated with DFS according to the univariate analysis. In the multivariate analysis with AIC stepwise selection for the construction of nomogram 1, Rad-score 1 (HR: 2.55; 95% CI: 1.85,3.52; p < 0.001), and clinical N staging (HR: 3.23; 95% CI: 1.66, 6.29; p < 0.001) were identified as independent prognostic factors in the Cox proportional hazards model and were incorporated into the nomogram 1 (Figure 3 ). Rad-score 2 (HR: 3.25; 95% CI: 1.98, 5.33; p < 0.001), and clinical N staging (HR: 2.76; 95% CI: 1.41, 5.38; p = 0.003) were also selected for nomogram 2. Figure S3) . DCA confirmed the clinical benefits (Supplementary Figure S4 ). Figure S3) . DCA confirmed the clinical benefits (Supplementary Figure S4) . According to the optimal cut-off value (Youden index) for the diagnostic possibility of the clinical nomogram, the patients were classified as the low-risk group with diagnostic possibilities ≤ 0.51 and as the high-risk group with diagnostic possibilities > 0.51. Kaplan-Meier curves demonstrated that the risk stratification of nomogram 1 was associated with the DFS in the training group (p = 0.002) and internal test group (p < 0.001), and this finding was confirmed in the external test group (p < 0.001) ( Figure 5 ). For nomogram 2, Kaplan-Meier curves showed good predictive value in the training group (p < 0.001) but less predictive in the internal test group (p = 0.032) and were not statistically different in the external test group (p = 0.220). Kaplan-Meier curves also showed better risk stratification of patients' OS in nomogram 1 than that in nomogram 2 (Supplementary Figure S5) . nomics feature selection). (b) Nomogram 2 (without genomics feature selection). The C-indexes of nomogram 1 and nomogram 2 were 0.869 and 0.875 in the t group, 0.812 and 0.757 in the internal test group, and 0.719 and 0.668 in the exter group, respectively. Time-dependent AUCs for the multivariate Cox model were ated (Figure 4 ). The performance of nomogram 1 and nomogram 2 for predicting DFS was assessed with respective AUCs of 0.912 and 0.918 in the training group and 0.810 in the internal test group, 0.769 and 0.724 in the external test group. T model of the continuous radiomic signature also demonstrated good calibration f nomograms (Supplementary Figure S3) . DCA confirmed the clinical benefits (Supp tary Figure S4 ). According to the optimal cut-off value (Youden index) for the diagnostic pos of the clinical nomogram, the patients were classified as the low-risk group with d tic possibilities ≤ 0.51 and as the high-risk group with diagnostic possibilities Kaplan-Meier curves demonstrated that the risk stratification of nomogram 1 was ated with the DFS in the training group (p = 0.002) and internal test group (p < 0.00 this finding was confirmed in the external test group (p < 0.001) ( Figure 5 ). For nom 2, Kaplan-Meier curves showed good predictive value in the training group (p < but less predictive in the internal test group (p = 0.032) and were not statistically d in the external test group (p = 0.220). Kaplan-Meier curves also showed better risk fication of patients' OS in nomogram 1 than that in nomogram 2 (Supplementary S5). We further compared the changes of tumor volume in pre-and post-nCRT scans, and its correlation to patients' survival was low (p = 0.571 for DFS, p = 0.215 for OS in KM curve analysis, Supplementary Figure S6 ). The delta radiomic feature selected for both nomograms (Wavelet LLL filtered correlation from GLCM families) was significantly predictive of patients' survival (p = 0.010 for DFS, p = 0.036 for OS in KM curve analysis). This GLCM radiomic feature was not associated with tumor volume (p = 0.482, Kruskal-Wallis test). Cancers 2021, 13, x FOR PEER REVIEW 10 of 16 Clinical risk stratification of patients is important for decision-making for exploring personalized treatment and for the prediction of prognostic outcome. The use of CT modality is widely available. Image assessment using radiomics is an emerging approach to predict response in cancer treatment and long-term survival. This is the first pilot study to include a two-time-point delta radiomics analysis in a prognostic prediction model in conjunction with a biological underpinning feature selection method. The constructed radiomics-based survival prediction in this study achieved good prognostic value with generalizability to the external test set, which could improve personalized management of ESCC patients, potentially improving clinical outcomes. For patients with ESCC treated by nCRT, Laruea et al. [43] developed a CT-based radiomic model with an AUC of 0.61 and borderline significant Kaplan-Meier curve result in the validation dataset (p = 0.053). Foley et al. [20] validated a PET-based prognostic model combined with clinical features in an international cohort, but this model did not enable significant discrimination between patient risk groups. Chen et al. [18] reported that a PET image feature model was independently associated with DFS and OS but with a small sample size (n = 32). Qiu et al. [44] constructed a nomogram using radiomic and clinical features based on one center data at one single time point. Our study established a radiomics-based clinical nomogram with a relatively larger sample size and validated on an external dataset. This was similar to previous findings that nomogram incorporating clinical factors and imaging features were of predictive value for EC patients [45] [46] [47] . Zhang et al. [45] reported that a nomogram based on clinical variables and imaging radiomic features was predictive of lymph node metastases. We proposed a potentially novel way of screening prognostic imaging texture features by gene-driven method. With the advance of next-generation sequencing techniques and machine learning algorithms, there are increasing high-throughput omics data. While genomics and radiomics have been studied individually, the integration of genomic and radiomic data into multi-omics-based machine learning models could provide new scope for precision oncology, which would aid a more comprehensive understanding and management of cancer diseases. A model incorporating delta imaging features may potentially capture characteristics of tumors' response to treatment and therefore improve differentiation of tumor heterogeneity. Shrinkage of tumor volume was an important independent prognostic factor in EC patients, as it could improve the R0 resection rate [48, 49] . Size-based measurement was commonly used in previous studies [16, 50] . However, some cases may involve tumor necrosis, liquefaction, and fibrosis during the treatment process, without a significant decrease in tumor size. More recently, delta radiomic features from pre-and post-treatment were reported to improve cancer treatment response prediction, including chemoradiation therapy [24] [25] [26] and, more recently, immune therapy [51] . One delta radiomic feature (correlation from GLCM families) was significantly predictive of patients' survival than the changes in tumor volume in our study. This is in accordance with previous studies that changes in radiomic features could outperform the volume measures for disease evaluation [23, 24, 46, 52] . Tumor size-based evaluation could not account for some important factors such as spatial heterogeneity of primary tumor lesions that correlated with tumor biology. We demonstrated that radiomic features could have the potential to offer special insight to the tumor characterization as they could capture the advanced tumor heterogeneity that was not visible to the naked eyes. CT-based disease assessment could serve as effective tools for patients' risk stratification. Our results showed that genomics information was useful for radiomic feature selection. The nomogram constructed from radiomic features with genomics feature selection improved prediction value compared with the nomogram without genomics feature selection. Many genes have been proposed as prognostic predictors of ESCC [53] . Instead of analyzing the underlying biological process by gene enrichment analysis [54] [55] [56] , we used these genomics data as a new feature selection filter to assure biological robustness. Radiomic features were correlated with overlapped genes, with the introduction of pathway information from enrichment analysis. Such lists of genes provided an additional biological correlation that is more than a simple correlation with the DFS outcome. Machine learning feature selection methods are known to be prone to data-driven biases related to missing data, sample size and measurement errors. Machine learning selected features were recommended to make clinical sense from practitioners, as algorithms may underestimate clinically meaningful information [57] . The decreased predictive performance from internal to external test set could be largely correlated with overfitting in the training process and dissimilarities among data. The nomogram constructed from radiomic features with genomics feature selection showed better generalizable prediction. We provided a novel feature selection approach based on biological knowledge using genomics data to filter significant radiomic features. This method could achieve clinically important improvements and decrease indirect prejudices associated with data-driven algorithm estimation. Pathological complete response (pCR) was reported to be a significant predictor for improved survival in EC patients [58] . In our analysis, the reason why pCR does not correlate with survival was not clear. One possible reason was the small sample size and sampling bias. The other reason may be binary division nCRT response to pCR and non-pCR may not fully reflect the tumor's response to nCRT treatment, which may be of more graded response. More detailed evaluation criteria such as four categories of complete responses, partial responses, stable diseases, and progressive diseases [59] may provide a more comprehensive and reliable measure of response with increased predictive value. As a pilot investigation, our study was limited by several aspects. The main limitation was the small sample size as data were retrospectively collected from prospective clinical studies to ensure the complete acquisition of images across nCRT, the accuracy of followup information, and accessibility of genetic profiles. This could lead to selection bias, and the presented clinical characteristics become decreasingly representative of the entire population. Secondly, due to the retrospective nature, part of the clinical variables was not balanced for different institutions, which is a common problem for cross-regional research [20] . Further prospective studies with larger sample sizes are required for further validation of the biological correlation between imaging features and genetic markers. Lastly, we used the correlation between radiological features and genetic data for patients with different disease recurrence outcome for feature selection. The gene-based correlationfiltered selection was chosen to avoid ambiguity in this pilot study. Future investigations on the pathway-guided selection process and the underlying driving biology are suggested. Genomics association was useful as a method for radiomic feature selection. The established radiomic signature was prognostic for patients' long-term survival. The radiomic nomogram could provide a valuable prediction for individualized long-term survival. Supplementary Materials: The following are available online at https://www.mdpi.com/article/10 .3390/cancers13092145/s1, Figure S1 : Flowchart of patient selection, Figure S2 : Correlation between selected radiomics features and the overlapped genes, Figure S3 : Calibration plot of 3-year and 5-year time-dependent ROC curves in the training, internal test and external test set, Figure S4 : Decision curve analysis of nomograms, Figure S5 : Overall survival for patients from high-risk and low-risk groups stratified by nomogram predictions, Figure S6 : Survival for patients from high-risk and low-risk groups stratified by delta radiological features. Table S1: The top 10 enriched gene set expression patterns by G: profiler, Table S2 : The differentially expressed genes analyzed by limma and overlapped genes for genomics feature selection for correlation analysis with radiomics features, Table S3 : Numbers of selected features for model constructions, Table S4 : Description of selected radiomic features in the radiomics models for the construction of nomogram. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries Oesophageal cancer National Cancer Data Base report on esophageal carcinoma Advances in the surgical treatment of esophageal cancer Therapeutic strategies in oesophageal carcinoma: Role of surgery and other modalities Controversies in the treatment of local and locally advanced gastric and esophageal cancers Survival After Neoadjuvant and Adjuvant Treatments Compared to Surgery Alone for Resectable Esophageal Carcinoma: A Network Meta-analysis Preoperative chemoradiotherapy for esophageal or junctional cancer Neoadjuvant Chemoradiotherapy Followed by Surgery Versus Surgery Alone for Locally Advanced Squamous Cell Carcinoma of the Esophagus (NEOCRTEC5010): A Phase III Multicenter, Randomized, Open-Label Clinical Trial Phase III trial of trimodality therapy with cisplatin, fluorouracil, radiotherapy, and surgery compared with surgery alone for esophageal cancer: CALGB 9781 Neoadjuvant chemoradiotherapy plus surgery versus surgery alone for oesophageal or junctional cancer (CROSS): Long-term results of a randomised controlled trial Noninvasive imaging evaluation of tumor immune microenvironment to predict outcomes in gastric cancer Radiomics in breast cancer classification and prediction A radiomics approach to assess tumour-infiltrating CD8 cells and response to anti-PD-1 or anti-PD-L1 immunotherapy: An imaging biomarker, retrospective multicohort study PET/CT in the evaluation of treatment response to neoadjuvant chemoradiotherapy and prognostication in patients with locally advanced esophageal squamous cell carcinoma Prediction of Response to Neoadjuvant Chemotherapy and Radiation Therapy with Baseline and Restaging (18)F-FDG PET Imaging Biomarkers in Patients with Esophageal Cancer Combining the radiomic features and traditional parameters of (18)F-FDG PET with clinical profiles to improve prognostic stratification in patients with esophageal squamous cell carcinoma treated with neoadjuvant chemoradiotherapy and surgery CT-based radiomic signatures for prediction of pathologic complete response in esophageal squamous cell carcinoma after neoadjuvant chemoradiotherapy External validation of a prognostic model incorporating quantitative PET image features in oesophageal cancer Development and validation of a radiomics signature on differentially expressed features of (18)F-FDG PET to predict treatment response of concurrent chemoradiotherapy in thoracic esophagus squamous cell carcinoma Radiomics machine-learning signature for diagnosis of hepatocellular carcinoma in cirrhotic patients with indeterminate liver nodules Assessment of response to tyrosine kinase inhibitors in metastatic renal cell cancer: CT texture as a predictive biomarker CT texture analysis in colorectal liver metastases: A better way than size and volume measurements to assess response to chemotherapy? United Eur A Delta-radiomics model for preoperative evaluation of Neoadjuvant chemotherapy response in high-grade osteosarcoma Improving Treatment Response Prediction for Chemoradiation Therapy of Pancreatic Cancer Using a Combination of Delta-Radiomics and the Clinical Biomarker CA19-9 Delta-radiomics features for the prediction of patient outcomes in non-small cell lung cancer Early variation of FDG-PET radiomics features in NSCLC is related to overall survival-the "delta radiomics" concept Prediction models for diagnosis and prognosis of covid-19 infection: Systematic review and critical appraisal Clinical Prediction Modelsl: A Practical Approach to Development, Validation, and Updating Sample size for binary logistic prediction models: Beyond events per variable criteria Decoding global gene expression programs in liver cancer by noninvasive imaging Radiogenomic analysis to identify imaging phenotypes associated with drug response gene expression programs in hepatocellular carcinoma Defining the biological basis of radiomic phenotypes in lung cancer Is there a causal relationship between genetic changes and radiomics-based image features? An in vivo preclinical experiment with doxycycline inducible GADD34 tumor cells Computational radiomics system to decode the radiographic phenotype Batch effect removal methods for microarray gene expression data integration: A survey AJCC Cancer Staging Manual Effect of machine learning re-sampling techniques for imbalanced datasets in (18)F-FDG PET-based radiomics model on prognostication performance in cohorts of head and neck cancer patients Profiler: A web server for functional enrichment analysis and conversions of gene lists (2019 update) Regression shrinkage and selection via the lasso Extensions to decision curve analysis, a novel method for evaluating diagnostic tests, prediction models and molecular markers Pre-treatment CT radiomics to predict 3-year overall survival following chemoradiotherapy of esophageal cancer Development and Validation of a Radiomics Nomogram Model for Predicting Postoperative Recurrence in Patients With Esophageal Squamous Cell Cancer Who Achieved pCR After Neoadjuvant Chemoradiotherapy Followed by Prediction of lymph node metastases using pre-treatment PET radiomics of the primary tumour in esophageal adenocarcinoma: An external validation study Radiomics nomogram outperforms size criteria in discriminating lymph node metastasis in resectable esophageal squamous cell carcinoma A Novel Nomogram Model Based on Cone-Beam CT Radiomics Analysis Technology for Predicting Radiation Pneumonitis in Esophageal Cancer Patients Undergoing Radiotherapy Margin involvement and outcome in oesophageal carcinoma: A 10-year experience in a specialist unit Treatment outcomes of resected esophageal cancer Spatial-temporal [ 18 F]FDG-PET features for predicting pathologic response of esophageal cancer to neoadjuvant chemoradiation therapy Radiomics, tumor volume and blood biomarkers for early prediction of pseudoprogression in metastatic melanoma patients treated with immune checkpoint inhibition Predicting the response to neoadjuvant chemotherapy for breast cancer: Wavelet transforming radiomics in MRI Systematic review and meta-analysis of tumor biomarkers in predicting prognosis in esophageal cancer Deep learning for lung cancer prognostication: A retrospective multi-cohort radiomics study Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach Association of multiparametric MRI quantitative imaging features with prostate cancer gene expression in MRI-targeted prostate biopsies Potential Biases in Machine Learning Algorithms Using Electronic Health Record Data Complete response to neoadjuvant chemoradiotherapy in esophageal carcinoma is associated with significantly improved survival New guidelines to evaluate the response to treatment in solid tumors. European Organization for Research and Treatment of Cancer, National Cancer Institute of the United States, National Cancer Institute of Canada The Declaration of Helsinki