Which clinical trial designs and statistical approaches have been used in assessments of orphan maintenance by the European Medicines Agency between 2012 and 2022? A cross-sectional study.
Objectives In the European Union, a new orphan medicinal product must demonstrate ‘significant benefit’ over approved medicinal products targeting the same indication. To demonstrate a significant benefit, comparisons between the new product and the already approved medicinal products—either directl...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMJ Publishing Group
2024-12-01
|
| Series: | BMJ Open |
| Online Access: | https://bmjopen.bmj.com/content/14/12/e086171.full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841537010177671168 |
|---|---|
| author | Fabian Windfuhr Kristina Larsson Theodor Framke Florian Lasch |
| author_facet | Fabian Windfuhr Kristina Larsson Theodor Framke Florian Lasch |
| author_sort | Fabian Windfuhr |
| collection | DOAJ |
| description | Objectives In the European Union, a new orphan medicinal product must demonstrate ‘significant benefit’ over approved medicinal products targeting the same indication. To demonstrate a significant benefit, comparisons between the new product and the already approved medicinal products—either directly by a head-to-head comparison within a clinical trial or indirectly as a cross-trial comparison—are necessary. In this study, we investigate the types of trial designs and statistical approaches used for demonstrating a significant benefit of a new orphan medicinal product against approved comparators used between 2012 and 2022.Design This is a cross-sectional study based on the European Medicines Agency's ‘orphan maintenance’ assessment documents between 2012 and 2022. All documents were manually reviewed to extract structured data on the following outcome measures:For every comparison between a new orphan medicinal product and a comparator used for demonstrating a significant benefit as part of an orphan maintenance procedure, we recorded the type and design of the data source and the type of statistical methodology used for the comparison.Results We identified 151 EMA orphan maintenance procedures with a positive decision that required the demonstration of a significant benefit. Within these 151 procedures, 418 comparisons between medicinal products were identified. Indirect comparisons are the most common approach for comparing the new orphan medicinal product to a relevant comparator (44%, 182/418), followed by qualitative comparisons (39%, 162/418) and direct comparisons (18%, 74/418). Among the indirect comparisons, naive side-by-side comparisons are most often used (71%, 129/182), whereas inferential approaches that adjust for population differences and quantify the uncertainty of the comparison are used less often (29%, 53/182). Although there is no clear time trend in the prevalence of any specific comparison type, we find that inferential indirect comparison methods approximately doubled between the first and second half of the reviewed time frame.Conclusions Indirect comparisons play an important role in demonstrating a significant benefit in the assessment of orphan products. Further work is needed to evaluate the appropriateness of different methodologies. |
| format | Article |
| id | doaj-art-2463c3ec68ba4465824cb1620066f6ee |
| institution | Kabale University |
| issn | 2044-6055 |
| language | English |
| publishDate | 2024-12-01 |
| publisher | BMJ Publishing Group |
| record_format | Article |
| series | BMJ Open |
| spelling | doaj-art-2463c3ec68ba4465824cb1620066f6ee2025-01-14T09:55:11ZengBMJ Publishing GroupBMJ Open2044-60552024-12-01141210.1136/bmjopen-2024-086171Which clinical trial designs and statistical approaches have been used in assessments of orphan maintenance by the European Medicines Agency between 2012 and 2022? A cross-sectional study.Fabian Windfuhr0Kristina Larsson1Theodor Framke2Florian Lasch31 European Medicines Agency, Amsterdam, The Netherlands1 European Medicines Agency, Amsterdam, The Netherlands1 European Medicines Agency, Amsterdam, The Netherlands1 European Medicines Agency, Amsterdam, The NetherlandsObjectives In the European Union, a new orphan medicinal product must demonstrate ‘significant benefit’ over approved medicinal products targeting the same indication. To demonstrate a significant benefit, comparisons between the new product and the already approved medicinal products—either directly by a head-to-head comparison within a clinical trial or indirectly as a cross-trial comparison—are necessary. In this study, we investigate the types of trial designs and statistical approaches used for demonstrating a significant benefit of a new orphan medicinal product against approved comparators used between 2012 and 2022.Design This is a cross-sectional study based on the European Medicines Agency's ‘orphan maintenance’ assessment documents between 2012 and 2022. All documents were manually reviewed to extract structured data on the following outcome measures:For every comparison between a new orphan medicinal product and a comparator used for demonstrating a significant benefit as part of an orphan maintenance procedure, we recorded the type and design of the data source and the type of statistical methodology used for the comparison.Results We identified 151 EMA orphan maintenance procedures with a positive decision that required the demonstration of a significant benefit. Within these 151 procedures, 418 comparisons between medicinal products were identified. Indirect comparisons are the most common approach for comparing the new orphan medicinal product to a relevant comparator (44%, 182/418), followed by qualitative comparisons (39%, 162/418) and direct comparisons (18%, 74/418). Among the indirect comparisons, naive side-by-side comparisons are most often used (71%, 129/182), whereas inferential approaches that adjust for population differences and quantify the uncertainty of the comparison are used less often (29%, 53/182). Although there is no clear time trend in the prevalence of any specific comparison type, we find that inferential indirect comparison methods approximately doubled between the first and second half of the reviewed time frame.Conclusions Indirect comparisons play an important role in demonstrating a significant benefit in the assessment of orphan products. Further work is needed to evaluate the appropriateness of different methodologies.https://bmjopen.bmj.com/content/14/12/e086171.full |
| spellingShingle | Fabian Windfuhr Kristina Larsson Theodor Framke Florian Lasch Which clinical trial designs and statistical approaches have been used in assessments of orphan maintenance by the European Medicines Agency between 2012 and 2022? A cross-sectional study. BMJ Open |
| title | Which clinical trial designs and statistical approaches have been used in assessments of orphan maintenance by the European Medicines Agency between 2012 and 2022? A cross-sectional study. |
| title_full | Which clinical trial designs and statistical approaches have been used in assessments of orphan maintenance by the European Medicines Agency between 2012 and 2022? A cross-sectional study. |
| title_fullStr | Which clinical trial designs and statistical approaches have been used in assessments of orphan maintenance by the European Medicines Agency between 2012 and 2022? A cross-sectional study. |
| title_full_unstemmed | Which clinical trial designs and statistical approaches have been used in assessments of orphan maintenance by the European Medicines Agency between 2012 and 2022? A cross-sectional study. |
| title_short | Which clinical trial designs and statistical approaches have been used in assessments of orphan maintenance by the European Medicines Agency between 2012 and 2022? A cross-sectional study. |
| title_sort | which clinical trial designs and statistical approaches have been used in assessments of orphan maintenance by the european medicines agency between 2012 and 2022 a cross sectional study |
| url | https://bmjopen.bmj.com/content/14/12/e086171.full |
| work_keys_str_mv | AT fabianwindfuhr whichclinicaltrialdesignsandstatisticalapproacheshavebeenusedinassessmentsoforphanmaintenancebytheeuropeanmedicinesagencybetween2012and2022acrosssectionalstudy AT kristinalarsson whichclinicaltrialdesignsandstatisticalapproacheshavebeenusedinassessmentsoforphanmaintenancebytheeuropeanmedicinesagencybetween2012and2022acrosssectionalstudy AT theodorframke whichclinicaltrialdesignsandstatisticalapproacheshavebeenusedinassessmentsoforphanmaintenancebytheeuropeanmedicinesagencybetween2012and2022acrosssectionalstudy AT florianlasch whichclinicaltrialdesignsandstatisticalapproacheshavebeenusedinassessmentsoforphanmaintenancebytheeuropeanmedicinesagencybetween2012and2022acrosssectionalstudy |