The ISMRM Open Science Initiative for Perfusion Imaging (OSIPI): Results from the OSIPI-Dynamic Contrast-Enhanced challenge
Authors
Shalom, ESKim, H
van der Heijden, RA
Ahmed, Z
Patel, R
Hormuth, D A, 2nd
DiCarlo, J C
Yankeelov, T E
Sisco, N J
Dortch, R D
Stokes, AM
Inglese, M
Grech-Sollars, M
Toschi, N
Sahoo, P
Singh, A
Verma, SK
Rathore, DK
Kazerouni, AS
Partridge, SC
LoCastro, E
Paudyal, R
Wolansky, IA
Shukla-Dave, A
Schouten, P
Gurney-Champion, OJ
Jiřík, R
Macíček, O
Bartoš, M
Vitouš, J
Das, AB
Kim, S G
Bokacheva, L
Mikheev, A
Rusinek, H
Berks, Michael
Hubbard Cristinacce, Penny L
Little, Ross A
Cheung, Susan
O'Connor, James PB
Parker, GJM
Moloney, B
LaViolette, PS
Bobholz, S
Duenweg, S
Virostko, J
Laue, H O
Sung, K
Nabavizadeh, A
Saligheh Rad, H
Hu, LS
Sourbron, S
Bell, LC
Fathi Kazerooni, A
Affiliation
Department of Radiology, The Christie Hospital NHS Trust, Manchester, UK. Division of Cancer Sciences, University of Manchester, Manchester, UK.Issue Date
2023
Metadata
Show full item recordAbstract
PURPOSE: Ktrans has often been proposed as a quantitative imaging biomarker for diagnosis, prognosis, and treatment response assessment for various tumors. None of the many software tools for Ktrans quantification are standardized. The ISMRM Open Science Initiative for Perfusion Imaging-Dynamic Contrast-Enhanced (OSIPI-DCE) challenge was designed to benchmark methods to better help the efforts to standardize Ktrans measurement. METHODS: A framework was created to evaluate Ktrans values produced by DCE-MRI analysis pipelines to enable benchmarking. The perfusion MRI community was invited to apply their pipelines for Ktrans quantification in glioblastoma from clinical and synthetic patients. Submissions were required to include the entrants' Ktrans values, the applied software, and a standard operating procedure. These were evaluated using the proposed OSIPIgold score defined with accuracy, repeatability, and reproducibility components. RESULTS: Across the 10 received submissions, the OSIPIgold score ranged from 28% to 78% with a 59% median. The accuracy, repeatability, and reproducibility scores ranged from 0.54 to 0.92, 0.64 to 0.86, and 0.65 to 1.00, respectively (0-1 = lowest-highest). Manual arterial input function selection markedly affected the reproducibility and showed greater variability in Ktrans analysis than automated methods. Furthermore, provision of a detailed standard operating procedure was critical for higher reproducibility. CONCLUSIONS: This study reports results from the OSIPI-DCE challenge and highlights the high inter-software variability within Ktrans estimation, providing a framework for ongoing benchmarking against the scores presented. Through this challenge, the participating teams were ranked based on the performance of their software tools in the particular setting of this challenge. In a real-world clinical setting, many of these tools may perform differently with different benchmarking methodology.Citation
Shalom ES, Kim H, van der Heijden RA, Ahmed Z, Patel R, Hormuth DA, 2nd, et al. The ISMRM Open Science Initiative for Perfusion Imaging (OSIPI): Results from the OSIPI-Dynamic Contrast-Enhanced challenge. Magnetic resonance in medicine. 2023 Dec 19. PubMed PMID: 38115695. Epub 2023/12/20. eng.Journal
Magnetic Resonance in MedicineDOI
10.1002/mrm.29909PubMed ID
38115695Additional Links
https://dx.doi.org/10.1002/mrm.29909Type
ArticleLanguage
enae974a485f413a2113503eed53cd6c53
10.1002/mrm.29909
Scopus Count
Collections
Related articles
- Contrast-agent-based perfusion MRI code repository and testing framework: ISMRM Open Science Initiative for Perfusion Imaging (OSIPI).
- Authors: van Houdt PJ, Ragunathan S, Berks M, Ahmed Z, Kershaw LE, Gurney-Champion OJ, Tadimalla S, Arvidsson J, Sun Y, Kallehauge J, Dickie B, Lévy S, Bell L, Sourbron S, Thrippleton MJ, on behalf of the ISMRM Perfusion Study Group
- Issue date: 2024 May
- A community-endorsed open-source lexicon for contrast agent-based perfusion MRI: A consensus guidelines report from the ISMRM Open Science Initiative for Perfusion Imaging (OSIPI).
- Authors: Dickie BR, Ahmed Z, Arvidsson J, Bell LC, Buckley DL, Debus C, Fedorov A, Floca R, Gutmann I, van der Heijden RA, van Houdt PJ, Sourbron S, Thrippleton MJ, Quarles C, Kompan IN, on behalf of The Perfusion Study Group of the ISMRM
- Issue date: 2024 May
- Reproducibility of dynamic contrast-enhanced MRI and dynamic susceptibility contrast MRI in the study of brain gliomas: a comparison of data obtained using different commercial software.
- Authors: Conte GM, Castellano A, Altabella L, Iadanza A, Cadioli M, Falini A, Anzalone N
- Issue date: 2017 Apr
- MR multitasking-based dynamic imaging for cerebrovascular evaluation (MT-DICE): Simultaneous quantification of permeability and leakage-insensitive perfusion by dynamic T1/T2* mapping.
- Authors: Hu Z, Christodoulou AG, Wang N, Xie Y, Shiroishi MS, Yang W, Zada G, Chow FE, Margol AS, Tamrazi B, Chang EL, Li D, Fan Z
- Issue date: 2023 Jan
- Accuracy and precision of quantitative DCE-MRI parameters: How should one estimate contrast concentration?
- Authors: Wake N, Chandarana H, Rusinek H, Fujimoto K, Moy L, Sodickson DK, Kim SG
- Issue date: 2018 Oct