Quality appraisal of radiomics-based studies on chondrosarcoma using METhodological RadiomICs Score (METRICS) and Radiomics Quality Score (RQS)
Abstract Objectives To assess the methodological quality of radiomics-based studies on bone chondrosarcoma using METhodological RadiomICs Score (METRICS) and Radiomics Quality Score (RQS). Methods A literature search was conducted on EMBASE and PubMed databases for research papers published up to Ju...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SpringerOpen
2025-06-01
|
| Series: | Insights into Imaging |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s13244-025-02016-3 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849686088579284992 |
|---|---|
| author | Salvatore Gitto Renato Cuocolo Michail E. Klontzas Domenico Albano Carmelo Messina Luca Maria Sconfienza |
| author_facet | Salvatore Gitto Renato Cuocolo Michail E. Klontzas Domenico Albano Carmelo Messina Luca Maria Sconfienza |
| author_sort | Salvatore Gitto |
| collection | DOAJ |
| description | Abstract Objectives To assess the methodological quality of radiomics-based studies on bone chondrosarcoma using METhodological RadiomICs Score (METRICS) and Radiomics Quality Score (RQS). Methods A literature search was conducted on EMBASE and PubMed databases for research papers published up to July 2024 and focused on radiomics in bone chondrosarcoma, with no restrictions regarding the study aim. Three readers independently evaluated the study quality using METRICS and RQS. Baseline study characteristics were extracted. Inter-reader reliability was calculated using intraclass correlation coefficient (ICC). Results Out of 68 identified papers, 18 were finally included in the analysis. Radiomics research was aimed at lesion classification (n = 15), outcome prediction (n = 2) or both (n = 1). Study design was retrospective in all papers. Most studies employed MRI (n = 12), CT (n = 3) or both (n = 1). METRICS and RQS adherence rates ranged between 37.3–94.8% and 2.8–44.4%, respectively. Excellent inter-reader reliability was found for both METRICS (ICC = 0.961) and RQS (ICC = 0.975). Among the limitations of the evaluated studies, the absence of prospective studies and deep learning-based analyses was highlighted, along with the limited adherence to radiomics guidelines, use of external testing datasets and open science data. Conclusions METRICS and RQS are reproducible quality assessment tools, with the former showing higher adherence rates in studies on chondrosarcoma. METRICS is better suited for assessing papers with retrospective design, which is often chosen in musculoskeletal oncology due to the low prevalence of bone sarcomas. Employing quality scoring systems should be promoted in radiomics-based studies to improve methodological quality and facilitate clinical translation. Critical relevance statement Employing reproducible quality scoring systems, especially METRICS (which shows higher adherence rates than RQS and is better suited for assessing retrospective investigations), is highly recommended to design radiomics-based studies on chondrosarcoma, improve methodological quality and facilitate clinical translation. Key Points The low scientific and reporting quality of radiomics studies on chondrosarcoma is the main reason preventing clinical translation. Quality appraisal using METRICS and RQS showed 37.3–94.8% and 2.8–44.4% adherence rates, respectively. Room for improvement was noted in study design, deep learning methods, external testing and open science. Employing reproducible quality scoring systems is recommended to design radiomics studies on bone chondrosarcoma and facilitate clinical translation. Graphical Abstract |
| format | Article |
| id | doaj-art-6f63ec0d23514b3e8013c57e4c7dfdcf |
| institution | DOAJ |
| issn | 1869-4101 |
| language | English |
| publishDate | 2025-06-01 |
| publisher | SpringerOpen |
| record_format | Article |
| series | Insights into Imaging |
| spelling | doaj-art-6f63ec0d23514b3e8013c57e4c7dfdcf2025-08-20T03:22:50ZengSpringerOpenInsights into Imaging1869-41012025-06-0116111110.1186/s13244-025-02016-3Quality appraisal of radiomics-based studies on chondrosarcoma using METhodological RadiomICs Score (METRICS) and Radiomics Quality Score (RQS)Salvatore Gitto0Renato Cuocolo1Michail E. Klontzas2Domenico Albano3Carmelo Messina4Luca Maria Sconfienza5Dipartimento di Scienze Biomediche per la Salute, Università degli Studi di MilanoDepartment of Medicine, Surgery, and Dentistry, University of SalernoArtificial Intelligence and Translational Imaging (ATI) Lab, Department of Radiology, School of Medicine, University of CreteIRCCS Istituto Ortopedico GaleazziDipartimento di Scienze Biomediche per la Salute, Università degli Studi di MilanoDipartimento di Scienze Biomediche per la Salute, Università degli Studi di MilanoAbstract Objectives To assess the methodological quality of radiomics-based studies on bone chondrosarcoma using METhodological RadiomICs Score (METRICS) and Radiomics Quality Score (RQS). Methods A literature search was conducted on EMBASE and PubMed databases for research papers published up to July 2024 and focused on radiomics in bone chondrosarcoma, with no restrictions regarding the study aim. Three readers independently evaluated the study quality using METRICS and RQS. Baseline study characteristics were extracted. Inter-reader reliability was calculated using intraclass correlation coefficient (ICC). Results Out of 68 identified papers, 18 were finally included in the analysis. Radiomics research was aimed at lesion classification (n = 15), outcome prediction (n = 2) or both (n = 1). Study design was retrospective in all papers. Most studies employed MRI (n = 12), CT (n = 3) or both (n = 1). METRICS and RQS adherence rates ranged between 37.3–94.8% and 2.8–44.4%, respectively. Excellent inter-reader reliability was found for both METRICS (ICC = 0.961) and RQS (ICC = 0.975). Among the limitations of the evaluated studies, the absence of prospective studies and deep learning-based analyses was highlighted, along with the limited adherence to radiomics guidelines, use of external testing datasets and open science data. Conclusions METRICS and RQS are reproducible quality assessment tools, with the former showing higher adherence rates in studies on chondrosarcoma. METRICS is better suited for assessing papers with retrospective design, which is often chosen in musculoskeletal oncology due to the low prevalence of bone sarcomas. Employing quality scoring systems should be promoted in radiomics-based studies to improve methodological quality and facilitate clinical translation. Critical relevance statement Employing reproducible quality scoring systems, especially METRICS (which shows higher adherence rates than RQS and is better suited for assessing retrospective investigations), is highly recommended to design radiomics-based studies on chondrosarcoma, improve methodological quality and facilitate clinical translation. Key Points The low scientific and reporting quality of radiomics studies on chondrosarcoma is the main reason preventing clinical translation. Quality appraisal using METRICS and RQS showed 37.3–94.8% and 2.8–44.4% adherence rates, respectively. Room for improvement was noted in study design, deep learning methods, external testing and open science. Employing reproducible quality scoring systems is recommended to design radiomics studies on bone chondrosarcoma and facilitate clinical translation. Graphical Abstracthttps://doi.org/10.1186/s13244-025-02016-3ChondrosarcomaEvidence-based radiologyRadiomicsSarcomaTexture analysis |
| spellingShingle | Salvatore Gitto Renato Cuocolo Michail E. Klontzas Domenico Albano Carmelo Messina Luca Maria Sconfienza Quality appraisal of radiomics-based studies on chondrosarcoma using METhodological RadiomICs Score (METRICS) and Radiomics Quality Score (RQS) Insights into Imaging Chondrosarcoma Evidence-based radiology Radiomics Sarcoma Texture analysis |
| title | Quality appraisal of radiomics-based studies on chondrosarcoma using METhodological RadiomICs Score (METRICS) and Radiomics Quality Score (RQS) |
| title_full | Quality appraisal of radiomics-based studies on chondrosarcoma using METhodological RadiomICs Score (METRICS) and Radiomics Quality Score (RQS) |
| title_fullStr | Quality appraisal of radiomics-based studies on chondrosarcoma using METhodological RadiomICs Score (METRICS) and Radiomics Quality Score (RQS) |
| title_full_unstemmed | Quality appraisal of radiomics-based studies on chondrosarcoma using METhodological RadiomICs Score (METRICS) and Radiomics Quality Score (RQS) |
| title_short | Quality appraisal of radiomics-based studies on chondrosarcoma using METhodological RadiomICs Score (METRICS) and Radiomics Quality Score (RQS) |
| title_sort | quality appraisal of radiomics based studies on chondrosarcoma using methodological radiomics score metrics and radiomics quality score rqs |
| topic | Chondrosarcoma Evidence-based radiology Radiomics Sarcoma Texture analysis |
| url | https://doi.org/10.1186/s13244-025-02016-3 |
| work_keys_str_mv | AT salvatoregitto qualityappraisalofradiomicsbasedstudiesonchondrosarcomausingmethodologicalradiomicsscoremetricsandradiomicsqualityscorerqs AT renatocuocolo qualityappraisalofradiomicsbasedstudiesonchondrosarcomausingmethodologicalradiomicsscoremetricsandradiomicsqualityscorerqs AT michaileklontzas qualityappraisalofradiomicsbasedstudiesonchondrosarcomausingmethodologicalradiomicsscoremetricsandradiomicsqualityscorerqs AT domenicoalbano qualityappraisalofradiomicsbasedstudiesonchondrosarcomausingmethodologicalradiomicsscoremetricsandradiomicsqualityscorerqs AT carmelomessina qualityappraisalofradiomicsbasedstudiesonchondrosarcomausingmethodologicalradiomicsscoremetricsandradiomicsqualityscorerqs AT lucamariasconfienza qualityappraisalofradiomicsbasedstudiesonchondrosarcomausingmethodologicalradiomicsscoremetricsandradiomicsqualityscorerqs |