Skip to main content
Erschienen in: European Radiology 8/2020

19.03.2020 | Imaging Informatics and Artificial Intelligence

Diagnostic accuracy and potential covariates for machine learning to identify IDH mutations in glioma patients: evidence from a meta-analysis

verfasst von: Jing Zhao, Yingqian Huang, Yukun Song, Dingxiang Xie, Manshi Hu, Haishan Qiu, Jianping Chu

Erschienen in: European Radiology | Ausgabe 8/2020

Einloggen, um Zugang zu erhalten

Abstract

Objectives

To assess the diagnostic accuracy of machine learning (ML) in predicting isocitrate dehydrogenase (IDH) mutations in patients with glioma and to identify potential covariates that could influence the diagnostic performance of ML.

Methods

A systematic search of PubMed, Web of Science, and the Cochrane library up to 1 August 2019 was conducted to collect all the articles investigating the diagnostic performance of ML for prediction of IDH mutation in glioma. The search strategy combined synonyms for ‘machine learning’, ‘glioma’, and ‘IDH’. Pooled sensitivity, specificity, and their 95% confidence intervals (CIs) were calculated, and the area under the receiver operating characteristic curve (AUC) was obtained.

Results

Nine original articles assessing a total of 996 patients with glioma were included. Among these studies, five divided the participants into training and validation sets, while the remaining four studies only had a training set. The AUC of ML for predicting IDH mutation in the training and validation sets was 93% (95% CI 91–95%) and 89% (95% CI 86–92%), respectively. The pooled sensitivity and specificity were, respectively, 87% (95% CI 82–91%) and 88% (95% CI 83–92%) in the training set and 87% (95% CI 76–93%) and 90% (95% CI 72–97%) in the validation set. In subgroup analyses in the training set, the combined use of clinical and imaging features with ML yielded higher sensitivity (90% vs. 83%) and specificity (90% vs. 82%) than the use of imaging features alone. In addition, ML performed better for high-grade gliomas than for low-grade gliomas, and ML that used conventional MRI sequences demonstrated higher specificity for predicting IDH mutation than ML using conventional and advanced MRI sequences.

Conclusions

ML demonstrated an excellent diagnostic performance in predicting IDH mutation of glioma. Clinical information, MRI sequences, and glioma grade were the main factors influencing diagnostic specificity.

Key Points

• Machine learning demonstrated an excellent diagnostic performance for prediction of IDH mutation in glioma (the pooled sensitivity and specificity were 88% and 87%, respectively).
• Machine learning that used conventional MRI sequences demonstrated higher specificity in predicting IDH mutation than that based on conventional and advanced MRI sequences (89% vs. 85%).
• Integration of clinical and imaging features in machine learning yielded a higher sensitivity (90% vs. 83%) and specificity (90% vs. 82%) than that achieved by using imaging features alone.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Louis DN, Perry A, Reifenberger G et al (2016) The 2016 World Health Organization classification of tumors of the central nervous system: a summary. Acta Neuropathol 131:803–820CrossRef Louis DN, Perry A, Reifenberger G et al (2016) The 2016 World Health Organization classification of tumors of the central nervous system: a summary. Acta Neuropathol 131:803–820CrossRef
2.
Zurück zum Zitat Miller JJ, Shih HA, Andronesi OC, Cahill DP (2017) Isocitrate dehydrogenase-mutant glioma: evolving clinical and therapeutic implications. Cancer 123:4535–4546CrossRef Miller JJ, Shih HA, Andronesi OC, Cahill DP (2017) Isocitrate dehydrogenase-mutant glioma: evolving clinical and therapeutic implications. Cancer 123:4535–4546CrossRef
3.
Zurück zum Zitat Parsons DW, Jones S, Zhang X et al (2008) An integrated genomic analysis of human glioblastoma multiforme. Science 321:1807–1812CrossRef Parsons DW, Jones S, Zhang X et al (2008) An integrated genomic analysis of human glioblastoma multiforme. Science 321:1807–1812CrossRef
4.
Zurück zum Zitat Yan H, Parsons DW, Jin G et al (2009) IDH1 and IDH2 mutations in gliomas. N Engl J Med 360:765–773CrossRef Yan H, Parsons DW, Jin G et al (2009) IDH1 and IDH2 mutations in gliomas. N Engl J Med 360:765–773CrossRef
5.
Zurück zum Zitat Kickingereder P, Sahm F, Radbruch A et al (2015) IDH mutation status is associated with a distinct hypoxia/ angiogenesis transcriptome signature which is non-invasively predictable with rCBV imaging in human glioma. Sci Rep 5:16238CrossRef Kickingereder P, Sahm F, Radbruch A et al (2015) IDH mutation status is associated with a distinct hypoxia/ angiogenesis transcriptome signature which is non-invasively predictable with rCBV imaging in human glioma. Sci Rep 5:16238CrossRef
6.
Zurück zum Zitat Xing Z, Yang X, She D, Lin Y, Zhang Y, Cao D (2017) Noninvasive assessment of IDH mutational status inWorld Health Organization grade II and III astrocytomas using DWI and DSC-PWI combined with conventionalMR imaging. AJNR Am J Neuroradiol 38:1138–1144CrossRef Xing Z, Yang X, She D, Lin Y, Zhang Y, Cao D (2017) Noninvasive assessment of IDH mutational status inWorld Health Organization grade II and III astrocytomas using DWI and DSC-PWI combined with conventionalMR imaging. AJNR Am J Neuroradiol 38:1138–1144CrossRef
7.
Zurück zum Zitat Suh CH, Kim HS, Jung SC, Choi CG, Kim SJ (2019) Imaging prediction of isocitrate dehydrogenase (IDH) mutation in patients with glioma: a systemic review and meta-analysis. Eur Radiol 29:745–758CrossRef Suh CH, Kim HS, Jung SC, Choi CG, Kim SJ (2019) Imaging prediction of isocitrate dehydrogenase (IDH) mutation in patients with glioma: a systemic review and meta-analysis. Eur Radiol 29:745–758CrossRef
8.
Zurück zum Zitat Suh CH, Kim HS, Paik W et al (2019) Falsepositive measurement at 2-hydroxyglutarate MR spectroscopy in isocitrate dehydrogenase wild-type glioblastoma: a multifactorial analysis. Radiology 291(3):752–762CrossRef Suh CH, Kim HS, Paik W et al (2019) Falsepositive measurement at 2-hydroxyglutarate MR spectroscopy in isocitrate dehydrogenase wild-type glioblastoma: a multifactorial analysis. Radiology 291(3):752–762CrossRef
9.
Zurück zum Zitat Pesapane F, Codari M, Sardanelli F (2018) Artificial intelligence in medical imaging: threat or opportunity? Radiologists again at the forefront of innovation in medicine. Eur Radiol Exp 2:35CrossRef Pesapane F, Codari M, Sardanelli F (2018) Artificial intelligence in medical imaging: threat or opportunity? Radiologists again at the forefront of innovation in medicine. Eur Radiol Exp 2:35CrossRef
10.
Zurück zum Zitat Qi S, Yu L, Li H et al (2014) Isocitrate dehydrogenase mutation is associated with tumor location and magnetic resonance imaging characteristics in astrocytic neoplasms. Oncol Lett 7:1895–1902CrossRef Qi S, Yu L, Li H et al (2014) Isocitrate dehydrogenase mutation is associated with tumor location and magnetic resonance imaging characteristics in astrocytic neoplasms. Oncol Lett 7:1895–1902CrossRef
11.
Zurück zum Zitat Zhou H, Vallieres M, Bai HX et al (2017) MRI features predict survival and molecular markers in diffuse lowergrade gliomas. Neuro Oncol 19:862–870CrossRef Zhou H, Vallieres M, Bai HX et al (2017) MRI features predict survival and molecular markers in diffuse lowergrade gliomas. Neuro Oncol 19:862–870CrossRef
12.
Zurück zum Zitat Aerts HJ, Velazquez ER, Leijenaar RT et al (2014) Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun 5:4006CrossRef Aerts HJ, Velazquez ER, Leijenaar RT et al (2014) Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun 5:4006CrossRef
13.
Zurück zum Zitat Liberati A, Altman DG, Tetzlaff J et al (2009) The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clin Epidemiol 62:e1–e34CrossRef Liberati A, Altman DG, Tetzlaff J et al (2009) The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clin Epidemiol 62:e1–e34CrossRef
14.
Zurück zum Zitat Whiting PF, Rutjes AW, Westwood ME et al (2011) QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med 155:529–536CrossRef Whiting PF, Rutjes AW, Westwood ME et al (2011) QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med 155:529–536CrossRef
15.
Zurück zum Zitat Zamora J, Abraira V, Muriel A, Khan K, Coomarasamy A (2006) Meta-DiSc: a software for meta-analysis of test accuracy data. BMC Med Res Methodol 6:31CrossRef Zamora J, Abraira V, Muriel A, Khan K, Coomarasamy A (2006) Meta-DiSc: a software for meta-analysis of test accuracy data. BMC Med Res Methodol 6:31CrossRef
16.
Zurück zum Zitat Deville WL, Buntinx F, Bouter LM et al (2002) Conducting systematic reviews of diagnostic studies: didactic guidelines. BMC Med Res Methodol 2:9CrossRef Deville WL, Buntinx F, Bouter LM et al (2002) Conducting systematic reviews of diagnostic studies: didactic guidelines. BMC Med Res Methodol 2:9CrossRef
17.
Zurück zum Zitat Deeks JJ, Macaskill P, Irwig L (2005) The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. J Clin Epidemiol 58:882–893CrossRef Deeks JJ, Macaskill P, Irwig L (2005) The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. J Clin Epidemiol 58:882–893CrossRef
18.
Zurück zum Zitat Zhang X, Tian Q, Wang L et al (2018) Radiomics strategy for molecular subtype stratification of lower-grade Glioma: detecting IDH and TP53 mutations based on multimodal MRI. J Magn Reson Imaging 48:916–926CrossRef Zhang X, Tian Q, Wang L et al (2018) Radiomics strategy for molecular subtype stratification of lower-grade Glioma: detecting IDH and TP53 mutations based on multimodal MRI. J Magn Reson Imaging 48:916–926CrossRef
19.
Zurück zum Zitat Lohmann P, Lerche C, Bauer EK et al (2018) Predicting IDH genotype in gliomas using FET PET radiomics. Sci Rep 8:13328CrossRef Lohmann P, Lerche C, Bauer EK et al (2018) Predicting IDH genotype in gliomas using FET PET radiomics. Sci Rep 8:13328CrossRef
20.
Zurück zum Zitat Liang S, Zhang RG, Liang DY et al (2018) Multimodal 3D DenseNet for IDH genotype prediction in gliomas. Genes (Basel) 9(8) Liang S, Zhang RG, Liang DY et al (2018) Multimodal 3D DenseNet for IDH genotype prediction in gliomas. Genes (Basel) 9(8)
21.
Zurück zum Zitat Li ZC, Bai H, Sun Q et al (2018) Multiregional radiomics profiling from multiparametric MRI: identifying an imaging predictor of IDH1 mutation status in glioblastoma. Cancer Med 7:5999–6009CrossRef Li ZC, Bai H, Sun Q et al (2018) Multiregional radiomics profiling from multiparametric MRI: identifying an imaging predictor of IDH1 mutation status in glioblastoma. Cancer Med 7:5999–6009CrossRef
22.
Zurück zum Zitat De Looze C, Beausang A, Cryan J et al (2018) Machine learning: a useful radiological adjunct in determination of a newly diagnosed glioma’s grade and IDH status. J Neurooncol 139:491–499 De Looze C, Beausang A, Cryan J et al (2018) Machine learning: a useful radiological adjunct in determination of a newly diagnosed glioma’s grade and IDH status. J Neurooncol 139:491–499
23.
Zurück zum Zitat Chen L, Zhang H, Lu J et al (2018) Multilabel nonlinear matrix completion with transductive multi-task feature selection for jointMGMTand IDH1 status prediction of patient with high-grade gliomas. IEEE Trans Med Imaging 37:1775–1787CrossRef Chen L, Zhang H, Lu J et al (2018) Multilabel nonlinear matrix completion with transductive multi-task feature selection for jointMGMTand IDH1 status prediction of patient with high-grade gliomas. IEEE Trans Med Imaging 37:1775–1787CrossRef
24.
Zurück zum Zitat Yu J, Shi Z, Lian Y et al (2017) Noninvasive IDH1 mutation estimation based on a quantitative radiomics approach for grade II glioma. Eur Radiol 27:3509–3522CrossRef Yu J, Shi Z, Lian Y et al (2017) Noninvasive IDH1 mutation estimation based on a quantitative radiomics approach for grade II glioma. Eur Radiol 27:3509–3522CrossRef
26.
Zurück zum Zitat Tan Y, Zhang ST, Wei JW et al (2019) A radiomics nomogram may improve the prediction of IDH genotype for astrocytoma before surgery. Eur Radiol 29:3325–3337CrossRef Tan Y, Zhang ST, Wei JW et al (2019) A radiomics nomogram may improve the prediction of IDH genotype for astrocytoma before surgery. Eur Radiol 29:3325–3337CrossRef
27.
Zurück zum Zitat Zhang BQ, Chang K, Ramkissoon S et al (2017) Multimodal MRI features predict isocitrate dehydrogenase genotype in high-grade gliomas. Neuro Oncol 19:109–117CrossRef Zhang BQ, Chang K, Ramkissoon S et al (2017) Multimodal MRI features predict isocitrate dehydrogenase genotype in high-grade gliomas. Neuro Oncol 19:109–117CrossRef
28.
Zurück zum Zitat Wijnenga MMJ, French PJ, Dubbink HJ et al (2018) The impact of surgery inmolecularly defined low-grade glioma: an integrated clinical, radiological, and molecular analysis. Neuro Oncol 20:103–112CrossRef Wijnenga MMJ, French PJ, Dubbink HJ et al (2018) The impact of surgery inmolecularly defined low-grade glioma: an integrated clinical, radiological, and molecular analysis. Neuro Oncol 20:103–112CrossRef
29.
Zurück zum Zitat Nakae S, Murayama K, Sasaki H et al (2017) Prediction of genetic subgroups in adult supra tentorial gliomas by pre- and intraoperative parameters. J Neurooncol 131:403–412 Nakae S, Murayama K, Sasaki H et al (2017) Prediction of genetic subgroups in adult supra tentorial gliomas by pre- and intraoperative parameters. J Neurooncol 131:403–412
30.
Zurück zum Zitat Shibahara I, Sonoda Y, Shoji T et al (2015) Malignant clinical features of anaplastic gliomas without IDH mutation. Neuro Oncol 17:136–144CrossRef Shibahara I, Sonoda Y, Shoji T et al (2015) Malignant clinical features of anaplastic gliomas without IDH mutation. Neuro Oncol 17:136–144CrossRef
31.
Zurück zum Zitat Tietze A, Choi C, Mickey B et al (2018) Noninvasive assessment of isocitrate dehydrogenase mutation status in cerebral gliomas by magnetic resonance spectroscopy in a clinical setting. J Neurosurg 128:391–398CrossRef Tietze A, Choi C, Mickey B et al (2018) Noninvasive assessment of isocitrate dehydrogenase mutation status in cerebral gliomas by magnetic resonance spectroscopy in a clinical setting. J Neurosurg 128:391–398CrossRef
Metadaten
Titel
Diagnostic accuracy and potential covariates for machine learning to identify IDH mutations in glioma patients: evidence from a meta-analysis
verfasst von
Jing Zhao
Yingqian Huang
Yukun Song
Dingxiang Xie
Manshi Hu
Haishan Qiu
Jianping Chu
Publikationsdatum
19.03.2020
Verlag
Springer Berlin Heidelberg
Erschienen in
European Radiology / Ausgabe 8/2020
Print ISSN: 0938-7994
Elektronische ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-020-06717-9

Weitere Artikel der Ausgabe 8/2020

European Radiology 8/2020 Zur Ausgabe

Darf man die Behandlung eines Neonazis ablehnen?

08.05.2024 Gesellschaft Nachrichten

In einer Leseranfrage in der Zeitschrift Journal of the American Academy of Dermatology möchte ein anonymer Dermatologe bzw. eine anonyme Dermatologin wissen, ob er oder sie einen Patienten behandeln muss, der eine rassistische Tätowierung trägt.

Ein Drittel der jungen Ärztinnen und Ärzte erwägt abzuwandern

07.05.2024 Klinik aktuell Nachrichten

Extreme Arbeitsverdichtung und kaum Supervision: Dr. Andrea Martini, Sprecherin des Bündnisses Junge Ärztinnen und Ärzte (BJÄ) über den Frust des ärztlichen Nachwuchses und die Vorteile des Rucksack-Modells.

Endlich: Zi zeigt, mit welchen PVS Praxen zufrieden sind

IT für Ärzte Nachrichten

Darauf haben viele Praxen gewartet: Das Zi hat eine Liste von Praxisverwaltungssystemen veröffentlicht, die von Nutzern positiv bewertet werden. Eine gute Grundlage für wechselwillige Ärztinnen und Psychotherapeuten.

Akuter Schwindel: Wann lohnt sich eine MRT?

28.04.2024 Schwindel Nachrichten

Akuter Schwindel stellt oft eine diagnostische Herausforderung dar. Wie nützlich dabei eine MRT ist, hat eine Studie aus Finnland untersucht. Immerhin einer von sechs Patienten wurde mit akutem ischämischem Schlaganfall diagnostiziert.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.