- Open Access
Systematic review on the evaluation criteria of orphan medicines in Central and Eastern European countries
Orphanet Journal of Rare Diseases volume 11, Article number: 72 (2016)
In case of orphan drugs applicability of the standard health technology assessment (HTA) process is limited due to scarcity of good clinical and health economic evidence. Financing these premium priced drugs is more controversial in the Central and Eastern European (CEE) region where the public funding resources are more restricted, and health economic justification should be an even more important aspect of policy decisions than in higher income European countries.
To explore and summarize the recent scientific evidence on value drivers related to the health technology assessment of ODs with a special focus on the perspective of third party payers in CEE countries. The review aims to list all potentially relevant value drivers in the reimbursement process of orphan drugs.
A systematic literature review was performed; PubMed and Scopus databases were systematically searched for relevant publications until April 2015. Extracted data were summarized along key HTA elements.
From the 2664 identified publications, 87 contained relevant information on the evaluation criteria of orphan drugs, but only 5 had direct information from the CEE region. The presentation of good clinical evidence seems to play a key role especially since this should be the basis of cost-effectiveness analyses, which have more importance in resource-constrained economies. Due to external price referencing of pharmaceuticals, the relative budget impact of orphan drugs is expected to be higher in CEE than in Western European (WE) countries unless accessibility of patients remains more limited in poorer European regions. Equity principles based on disease prevalence and non-availability of alternative treatment options may increase the price premium, however, societies must have some control on prices and a rationale based on multiple criteria in reimbursement decisions.
The evaluation of orphan medicines should include multiple criteria to appropriately measure the clinical added value of orphan drugs. The search found only a small number of studies coming from CEE, therefore European policies on orphan drugs may be based largely on experiences in WE countries. More research should be done in the future in CEE because financing high-priced orphan drugs involves a greater burden for these countries.
According to the definition of the European Medicines Agency orphan drugs (ODs) are intended for diagnosis, prevention or treatment of rare diseases (RDs), whose conditions affect no more than 5 in 10,000 persons, are life-threatening or chronically debilitating and have no satisfactory method of diagnosis, prevention or treatment . The number of orphan drugs designated by the European Committee of Orphan Medicinal Products (COMP) is expected to grow at an average of 10 % per annum between 2011 and 2020. It seems that the success rate for approvals per orphan designation is also averaged at 10 % . The total number of orphan medicines with marketing authorization is growing year by year [3–5].
The Orphan Drug Act in the United States  and the Orphan Drugs Regulation in Europe  (also the legislation in Japan and Australia) seem to be a great success. These legislations have generated incentives for the private sector to develop innovative drugs for rare and serious diseases that have had no treatment yet. In some respects, the regulations tried to handle a supply side market failure . Simultaneously, the regulations raised several new dilemmas; one of the most problematic issues being how to apply health technology assessment (HTA) for ODs to support the evidence base of pricing and reimbursement decisions. Owing to the high cost of these medicines and the limitations in clinical evidence, the standard methodology and decision criteria of HTA seem to be difficult to use regarding most of the ODs. Consequently, there is an intensive debate in the scientific literature and also among policymakers and other stakeholders in the everyday practice on how to increase the evidence base of policy decisions without providing disincentives for R&D in rare diseases. There is a need for an adequate, transparent evaluation process to judge the clinical added value of ODs and to provide a consistent decision support tool for policymakers .
Financing high-priced orphan drugs is even more controversial in the Central and Eastern European (CEE) region. These middle income countries face even greater challenges in the reimbursement decisions of the ODs, as their financial resources are significantly lower compared to the Western European (WE) countries.
The objective of this systematic literature search was to explore and summarize the recent scientific knowledge about the evaluation and reimbursement of orphan medicines. The research placed special attention on the CEE perspective. There was a special emphasis on the key elements of HTA, including efficacy, effectiveness, cost-effectiveness, budget impact and equity. Additional data was collected about different value drivers in the identified evaluation frameworks. The transferability of the general results to the CEE region will be discussed.
A systematic literature search was performed in PubMed and Scopus internet databases to explore recent evidence on value drivers related to the health technology assessment of ODs with a special focus on the perspective of third party payers in CEE countries. The systematic literature review was conducted and reported in compliance with the PRISMA statement . Every relevant record was considered between January 2000 and April 2015. The search terms included rare disease* or orphan and reimburse*, evaluation, effective*, assess*, HTA, threshold, decision, policy or evidence. Title-Abstract screening was performed with predefined exclusion criteria (see Additional file 1). Special attention was given to papers published in the CEE region. Data extraction occurred in concordance with the main components of HTA, information on efficacy, effectiveness, cost-effectiveness, budget impact and equity were collected in Excel sheets.
The goal of this review was to present a comprehensive overview on any potential value drivers described in the scientific literature, therefore no limitations were applied in terms of the quality of evidence presented by the studies. Editorials, letters, as well as systematic reviews were also included. The type of the articles was registered in every case (see Additional file 2).
Descriptive summaries will be presented in the qualitative synthesis; the nature of gathered information does not allow for a quantitative meta-analysis to be carried out. A further limitation is that the materials presented by authorities, legislative bodies or HTA/technology appraisal committees were not reviewed.
All together 2664 items were identified in the two databases from which 1985 records were left after duplicates were removed. Four additional articles were included based on a Google search and after reviewing reference lists in other relevant articles. During the Title/Abstract screening, 1867 records were excluded. The flow of information can be seen on Fig. 1.
After performing a Title/Abstract screening, 122 articles remained for full text screening, which were read and assessed by two reviewers. In the end, 87 full text papers were included in the analysis (see Additional file 2), among which only 5 publications addressed directly the research question from the perspective of CEE countries [11–15].
The systematic search found 42 studies that addressed efficacy and effectiveness of ODs from an HTA perspective. In case of orphan medicines, several factors hamper the measurement of the drug’s clinical added value and it seemed difficult to evaluate the drug’s efficacy in the majority of the cases. Figure 2 summarizes the key reasons.
Many of these characteristics had been acknowledged previously and registration authorities realized that along the lines of conventional requirements, market access for ODs would be almost impossible, therefore they softened the registration criteria . As a consequence, the evidence base of ODs in HTA evaluations is often premature, while these drugs receive marketing authorisation earlier in the development phase [17, 18].
Nevertheless, the picture is nuanced: some papers pointed out that in a significant percentage of rare diseases, well-designed clinical trials (e.g., RCTs) would be feasible [19, 20]. It is also possible to modify traditional RCTs designs (sequential, three-stage or adaptive designs) in order to gain more power from a small patient population [21, 22]. Authors emphasized the importance of surrogate endpoints if clinical data are incomplete. These measures can only be accepted and valued in the assessment process if their relation to clinical efficacy is well-described with its uncertainty too [23–25]. At the same time, it seems difficult to validate surrogate markers without a long-term follow up .
Despite these facts, the evidence on efficacy should be one of the most important if not the most important value driving component of the technology assessment process [24, 27, 28]. In a recent systematic review, the authors concluded that “ODs [should] have to prove effectiveness like any other drug” . These claims are confirmed by the empirical results of two workshops (experts and patients), which weighted the factor ‘Evidence of treatment clinical efficacy and patient clinical outcomes’ with the highest value .
A viable option is to declare transparently that more priority is being given to ODs and greater flexibility is being applied for the assessment of forms and/or quantity of available data. A basic remark to this option is that in cases of rare diseases, which are serious or life-threatening, patients are willing to accept a higher level of risk if no other treatments are available [31, 32]. In such cases policymakers may also be willing to accept lower statistical significance of clinical benefits .
In case of non-curative OD treatments, the stable or progression-delayed patient status can be a therapeutic benefit. However, the curative and non-curative orphan treatments should be differentiated in medical, ethical and economical aspects .
Continuous research after positive reimbursement decisions can be a commitment for the manufacturer (with conditional reimbursement, through observational studies, registries) to generate new evidence with the long-term follow up of patients [34, 35]. Several authors pointed out the usefulness of ongoing evaluations through national and Europe-wide registries of data outcome [24, 36–41].
In summary, the misleading presumptions should be eliminated, the ODs are not a homogenous group, and the feasibility of providing high-quality evidence should be addressed on a case by case basis [42, 43]. Lower standards can only be accepted if substantial efforts failed to gather enough patients in randomized trials . This is the responsibility of registration authorities.
In case of papers referring to the CEE perspective, limited information was available, but the results were similar. Iskrov et al. emphasized in their two papers (2012, 2013) that the absence of clinical data is a common problem for all countries, and especially huge challenge for Bulgaria [11, 12]. The importance of long-term effectiveness measurements was one of the main conclusions of Logviss et al. (2014) also, who analysed the orphan drug situation in Latvia .
The systematic search found 25 studies that addressed the budget impact (BI) of ODs from an HTA perspective. In the majority of countries, BI analysis of ODs is included in the technology assessment process, even though in early years it was not considered a decisive factor due to the low disease prevalence . The relatively small BI facilitated the market access in certain cases . However, due to the escalating drug prices, policymakers started to recognize the growing importance of BI, especially after more and more ODs entered the market. The cumulative expenditure on ODs reached the stimulus threshold of third party payers, and they even expect further increases in the budgets of ODs [2, 12, 29, 32, 33, 41, 45–49]. Based on a projection of Hutchings et al. (2014), BI of ODs in Sweden and France are going to increase slightly until 2020, but it could remain sustainable .
Small impact itself cannot be a decisive factor in reimbursement decisions anymore. Usually, opportunity costs of funding rare diseases are not known and therefore cannot be considered comparable with the benefits. As McCabe et al. (2007) stated, the conclusion cannot be made that many small cuts on the budget have no or little impact on overall health or less impact than a single large cut of comparable costs . Instead of the reimbursement of an expensive orphan medication with relatively a small budget impact, it is also a question why not spend the same budget amount on the treatment of a subpopulation in a more frequent disease with a larger cumulative health gain in cases where a medication was rejected earlier because of its high budget impact . The increasing expenditure of ODs challenges the boundaries of the solidarity principle in public healthcare systems because less and less resources are available for treatments of more common diseases [32, 46].
A significant percentage of the overall budget impact is concentrated on only very few drugs. Based on the French data, the first five ‘blockbuster’ ODs account for 50 % of the French OD budget . Overall cost exposure is related to the disease prevalence, the number of indications, the potential for off-label use and the availability of less expensive treatment options. Several authors emphasized that only a detailed budget impact analysis, which includes calculations of the factors mentioned above, would facilitate responsible planning and enable decision makers to develop a sustainable budget for a rare disease portfolio [24, 25, 31, 52, 53]. Ideally, in case of additional indications, the whole budget impact should also be reported . In cases of previously mentioned blockbuster drugs, presumably not all of these elements were carefully considered or the successive reimbursement dossiers of the same orphan drug were not handled in relation to each other [27, 55].
In CEE countries there is stronger restriction of public resources for financing pharmaceuticals. The relatively small market size of CEE countries contributes to their weak negotiating power to influence the price level of ODs, hence prices of these drugs are not among the lowest in Europe as is usually the case with ‘common drugs’. Consequently, the affordability of ODs is more limited in CEE, which reduces the accessibility of patients with rare diseases to ODs [11, 13, 15]. CEE authors pointed out that often there are shortcomings in budget impact analyses, hence the impact should be assessed more accurately [12, 13]. According to Iskrov et al. (2013), in contrast to ‘common drugs’ the legislation in Bulgaria does not clearly define what type of costs should be calculated in budget impact analyses of ODs . In Latvia, the costs related to rare diseases and ODs are currently included in the national healthcare budget, but there are special rules for drugs with a high annual cost, hence the budget for ODs has not been determined explicitly .
The systematic search found 48 studies that addressed the cost-effectiveness of ODs from an HTA perspective. There is an intensive debate in the literature over how to apply and interpret the cost-effectiveness criteria in the assessment of ODs. The current practice varies across different countries; there are examples where the presentation of a pharmacoeconomic analysis in the reimbursement dossier is not necessary (e.g., Turkey, The Netherlands), in contrast to most other European countries where it is compulsory to perform such an analysis [13, 33, 56–58]. In the past decade, funding for these drugs was rejected more often due to unmet cost-effectiveness criteria . This position was not unified and the issues led to the formulation of a number of questions.
The first problem is the scarcity of good clinical evidence about the effectiveness of ODs, which makes a cost-effectiveness analysis (CEA) difficult. According to some authors, it seems almost impossible to perform a conventional CEA [12, 24, 59]. Even if such an analysis is feasible, only a few ODs get close to meeting the standard cost-effectiveness criterion due to the high incremental costs compared to moderate health gains provided by the drug [45, 46, 48, 60–63]. Cost-ineffective, ultra-orphan drugs have been approved by appraisal committees in several countries, which means that present economic criteria are not sufficient for the evaluation of these drugs, since the true societal value of the provided benefits cannot be measured [42, 43, 64, 65].
Cost-effectiveness thresholds are the symbol of the most highly accepted opportunity cost, in order to determine whether a treatment should be financed publicly or not. Where decisions regarding ODs are systematically made against these norms, these criteria should be revised . If orphan medicines with significantly higher ICERs are routinely reimbursed, then the health gain of rare disease patients are also valued significantly higher. In order to maintain transparency, this preference for severe, rare conditions, which have no other treatment should be explicitly declared [42, 44].
McCabe and colleagues raised an important question: where we insist on applying standard methods to ODs and there is an expectation (as several authors emphasized) that an OD will not receive reimbursement based on pure cost-effectiveness, then a valid question to be asked is why we have incentives to develop them at all. Considering this point, these incentives (previously used resources) are simply sunk costs if the drug is not cost-effective [43, 47]. The most important signal and incentive to the market is the price paid for a drug or the incremental cost-effectiveness ratio used in the evaluation. These values should not be driven by previously provided incentives. If the threshold is transparent, both the evaluation committee and the market know how much money is worth spending on them. The key challenge is the identification of the existence and magnitude of “the orphan premium” . If this can be measured and used transparently, cost-effectiveness threshold could be determined.
One basis of exempting ODs from the standard criteria, if a societal preference could be revealed for prioritizing rarity [61, 63]. A frequently cited study from the NICE Citizen’s Council reported weak evidence about positive social valuation of rarity . Few experimental studies, which investigated this issue, emphasized the choice avoidance and the preference instability of respondents [61, 68–70]. Although experimental research could not confirm any social value, disease rarity alone seems to increase the tolerance of uncertainties by decision makers .
In Latvia, there is no specific reimbursement regulation for ODs, but cost-effectiveness analyses are obligatory, therefore the reimbursement decision is value based. Also in Serbia, the assessment committee take the cost-effectiveness of the drug into account [13, 14]. The cost-effectiveness of ODs is not considered in Bulgaria, but the price of ODs should be based on the lowest reference price from a basket of European countries .
The literature search found several recommendations in connection with the questions described above. Authors stated that if at least moderate clinical evidence is available, a standard cost-effectiveness analysis can be performed. Certain ODs can be cost-effective along a standard threshold [43, 71]. However, there can be huge uncertainty concerning the estimates that can hinder reimbursement until more evidence becomes available . Policymakers may ignore cost-effectiveness evidence, but in this case, the product must provide the minimal requirements of additional health benefits and at least reliable estimates of budget impact [47, 53]. In opposition to such an approach, several authors suggested an intermediate solution, namely that the standard methodologies of cost-effectiveness analysis for ODs are appropriate, but need to be fine-tuned and updated . Table 1 summarizes the proposed solutions.
No matter how we overrate the health gain of rare disease patients, we contradict the ethical principle for evaluation of people’s lives and health equally [32, 63, 72] (see details in section Equity).
In the CEE region, the question is even more contradictory. The prices are moving in a relatively narrow range across Europe mainly due to external reference pricing, but the cost-effectiveness thresholds in different countries are rather in connection with the gross domestic product (GDP) that differs significantly among the European member states . In several CEE countries, there is an explicit threshold for cost-effectiveness related to the GDP per capita (see Hungary, Poland) or the mandatory base monthly salary (see Slovakia), however rarity and severity of the disease have no impact on the explicit threshold. As there are no specific thresholds for ODs, these medicines are even more rarely cost-effective in CEE . However, a well-defined HTA process with mandatory cost-effectiveness analysis still improves the transparency of policy decisions related to ODs .
Equity aspects of the reimbursement of ODs are principal, due to the unique position of rare disease patients. All together 37 papers dealt with equity principles and several viewpoints surfaced in the intensive debate surrounding these issues.
The basic moral dilemma is that if we have an extremely high cost - but effective - OD, we will pay for it, despite scarce resources and the possibility of spending the same money on ‘common’ disease patients, where the cumulated health gain would be significantly greater. To put it in question form, should we value the health gain of rare disease patients more highly or in other words should we accept the higher ICERs of ODs?
The utilitarian viewpoint would say ‘No’. According to utilitarians, we have to produce as much good (health) as possible within our fixed limits. Investing substantial amounts of resources for the treatment of rare conditions may be considered unethical from this perspective, because the society’s benefits (and health gain) are not maximized [19, 34, 75]. Additionally, if we pay for orphan medicines with high ICERs, we overrate the health gain of rare disease patients while undervaluing the health gain of common disease patients. This rationale cannot be justified ethically . As the number of reimbursed ODs is growing, even more ‘common’ patients with equal capacity to benefit will be withdrawn from treatments . As long as there is no scientific evidence about societal preference for treating rare and serious disorders, the more frequent serious diseases should be treated where the cumulative health gain is larger [43, 63].
The utilitarian standpoint must be the basis of resource allocation in general, but if we ask, “Is it fair that people are judged only in terms of how cost-effective their health gain is?”, and the answer is ‘No’ , what can be the basis for giving rare disease patients a chance and for paying the premium price of their drugs? Table 2 summarizes literature findings, including the ethical principles cited as a basis for funding orphan medicines, and as it is seen, these are not mutually exclusive. The third column of Table 2 summarizes the main criticisms against each principle.
According to general criticism against ethical principles, there is a propensity to give greater weight to helping identified victims rather than statistical victims. Identified victim bias should be eliminated in case of valuing health gains of rare disease patients .
The debate about the position of rare disease patients can be translated into vertical and horizontal equity questions, where those representing ethical considerations generally argue in favor of reasons for vertical equity, while their critics argue in favor of horizontal equity .
Summary of value drivers
The evaluation of orphan medicines should include multiple criteria to appropriately measure the value of these drugs. Paulden et al. (2015) in their systematic review identified several value-bearing factors for ODs . We explored the relevance of these factors from the viewpoint of third party payers in CEE countries, and added other value drivers we identified in the systematic literature review. CEE countries may not necessarily apply all value drivers presented in Table 3, however, this list can be an appropriate basis for the multicriteria evaluation framework for the reimbursement process of ODs. If these criteria are applied in an explicit multicriteria decision analysis (MCDA) tool, selection, scoring and weighting of the criteria may provide a tailored approach for each individual CEE countries. Kolasa et al. (2016) in their MCDA tool developed for the Polish reimbursement process of orphan drugs included ten of these criteria .
Our systematic search found few studies referring to CEE countries, despite the fact that reimbursement of ODs is becoming increasingly important for public payers in European regions with more economic constraints . Since international evidence on value drivers of ODs is often generated in higher income countries (e.g., Western Europe), the transferability of these research findings to lower income countries has to be considered carefully.
The information on relative effectiveness is considered transferable between higher and lower income countries . Therefore, if the problem is solved by global regulators and policymakers, there is no additional action item from the viewpoint of CEE countries. However, in this region there is even more limited information on the number and distribution of rare disease patients, therefore it is difficult to predict baseline risks and disease progression. In general, the health status of population is lower in CEE compared to WE, so potentially the same relative risk reduction may result in even greater absolute risk reduction and health gain . In addition, adherence and persistence of patients in CEE is even worse than in WE, thus it is difficult to judge how efficacy measured in clinical trials may translate to effectiveness in the real world . Nevertheless, the main objective of third-party payers is to buy health gain. If there is significant uncertainty related to the clinical added value of an OD, it does not make sense to grant reimbursement based on equity to access without considering the efficacy criterion. If initial efficacy results of an OD are very promising in a Phase 2 study, societies may ensure rapid registration, but until the evidence is sufficiently confirmed, the manufacturer has to accept risk-sharing arrangements (e.g., coverage with evidence development) with payers to manage uncertainties related to health outcomes.
Economic principles should be the driver for the allocation of scarce resources . Cost-effectiveness evidence of ODs stems from two different sources, therefore decision should be made on how to manage uncertain estimates of costs and effects . Transferability of cost-effectiveness evidence is highly limited from one country to another, especially if there is a significant difference between the socioeconomic status of the countries. Therefore, the relevance of cost-effectiveness evidence generated in WE is highly limited in CEE, thus local adaptation of international economic models are necessary to draw conclusions on the value of any technologies, including ODs .
Presumably, our sense of equity and solidarity form the basis of our willingness to pay a premium price for these drugs. Both equity principles and their counter arguments can be seen as true when examined separately, but if there is an effective and curative drug for a serious, life-threatening disease, everything must be done to finance the price that is placed on the clinical added value of the medicine. There is a tradition to accept equity principles in post-communist CEE countries. The question is how this tradition can be translated to rare diseases, especially in difficult economic periods.
There is an international aspect of equity related to the accessibility of patients to ODs in higher vs. lower income European countries. Within the European Union, there should not be differences between member states in the accessibility of patients with rare diseases to medicines. However, in CEE the public health budgets are particularly limited and vulnerable . Unfortunately, external price referencing may prevent manufacturers of ODs from launching their products at significantly lower prices in lower income European countries . Consequently, the deviation of OD prices is relatively small across Europe, but their affordability is very different across the regions. Systematic research of orphan drug utilization across European countries is rare, however existing information indicates that there are significant differences between WE and CEE countries. O'Mahony et al. (2013) found differences in the availability of treatment and care of hemophilia patients across Europe . Pavlovic et al. (2012) identified inequities in access to ODs between Serbia, Bulgaria and Sweden . Also, Picavet et al. (2012) observed a substantial difference in market uptake of ODs between European countries. They concluded that such variation should have an effect on access to care and should produce a significant inequality of treatment . Logviss et al. (2014) also raised attention to the availability problem of orphan medicines in Latvia. Moreover, those drugs that were available, were often not accessible because of the insufficient reimbursement . Availability and affordability are equally important components of inequities in patient access in EU countries according to EURORDIS . Due to their limited access, the cumulative budget impact of ODs can be similar in CEE and WE, but if CEE countries intend to grant the same access for their patients, the relative impact within the whole budget should be significantly higher. The transferability of budget impact analysis from one country to another is highly limited. If the budget impact of an orphan drug is relatively low in a WE country due to a small patient population, the drug is still not necessarily affordable in CEE.
Equity aspects can justify some price premium, but the magnitude should be acceptable from a societal perspective. And here is a difficult question to raise: is it acceptable that lower income countries have to pay the same high price for ODs on the basis of equity as their wealthier counterparts? Probably not. The value-based price of a new technology is country-specific, usually less in lower income countries and larger in higher income countries, since the willingness to pay for one unit of health gain is different. If European policymakers provide incentives for R&D of ODs to reduce the inequity between patients of common vs. rare diseases, they should develop plans to transfer these benefits to patients in CEE countries. Otherwise, mainly WE patients may enjoy the positive results of EU policies regarding rare diseases. Joint European procurement of ODs might reduce the price of these medicines, and payment according the “ability to pay” by each EU member state can potentially reduce the unequal patient access. However, this solution requires the revision of current EU framework related to external price referencing and parallel trade practices.
Pricing and reimbursement of ODs should be more transparent and evidence based in the CEE region. Manufacturers should take the budget constraints and the lower ability into account to reimburse these high priced drugs. Policy tools have to be developed to alleviate negative consequences on external pharmaceutical price referencing systems in relation to the accessibility of patients to ODs. Until external price referencing exists and is strengthened even compared to current European practices, manufacturers will not be motivated to implement differential pricing to guarantee faster access of patients in countries with less market potential. The relatively small market potential partially explains why our search found a very small number of studies coming from the CEE region. It is highly unfortunate that policy research is less prevalent in those countries where access to these drugs is more limited. More policy research in CEE is needed in order to take the needs and constraints of these countries into account when developing a European policy framework for ODs.
Current joint policy initiatives by supranational bodies and scientific organizations are promising. The CAVOMP (Clinical Added Value of Orphan Medicinal Products) , the IRDiRC (International Rare Diseases Research Consortium), the MoCA (Mechanism of Coordinated Access to Orphan Medicinal Products) Working Group , the Rare Diseases Special Interest Group of ISPOR  or more broadly the EUnetHTA  may provide better evaluation framework for ODs in the near future, which hopefully takes into account the necessities of lower income economies as well.
BI, budget impact; CAVOMP, Clinical Added Value of Orphan Medicinal Products; CE, cost-effectiveness; CEA, cost-effectiveness analysis; CEE, Central and Eastern Europe; COMP, European Committee of Orphan Medicinal Products; EU, European Union; EUnetHTA, European network for Health Technology Assessment; EURORDIS, European Organisation for Rare Diseases; GDP, gross domestic product; HTA, health technology assessment; ICER, incremental cost-effectiveness ratios; IRDiRC, International Rare Diseases Research Consortium; ISPOR, International Society For Pharmacoeconomics and Outcomes Research; MoCA, Mechanism of Coordinated Access to Orphan Medicinal Products; OD, orphan drug; QALY, quality adjusted life year; R&D, research and development; RCT, randomized controlled trial; RD, rare disease; WE, Western Europe
Orphan Designation. European Medicines Agency, London. http://www.ema.europa.eu/ema/index.jsp?curl=pages/regulation/general/general_content_000029.jsp&mid=WC0b01ac05800240ce. Accessed 26 October 2015.
Schey C, Milanova T, Hutchings A. Estimating the budget impact of orphan medicines in Europe: 2010–2020. Orphanet J Rare Dis. 2011;6:62. doi:10.1186/1750-1172-6-62.
Register of designated Orphan Medicinal Products. European Commission. Directorate General Health and Food Safety. http://ec.europa.eu/health/documents/community-register/html/orphreg.htm. Accessed 5 October 2015.
Orphan medicines designation (COMP). EURORDIS, Paris. www.eurordis.org/content/orphan-drug-designation. Accessed 5 October 2015.
List of orphan drugs with marketing authorizations. Orphanet Portal. http://www.orpha.net/consor/cgi-bin/Drugs_ListOrphanDrugs.php?lng=EN. Accessed 5 October 2015.
How to Apply for Designation as an Orphan Product (Orphan Drug Act). Food and Drug Administration, HHS. 1992. http://www.fda.gov/ForIndustry/DevelopingProductsforRareDiseasesConditions/HowtoapplyforOrphanProductDesignation/ucm135122.htm. Accessed 5 October 2015.
REGULATION (EC) No 141/2000 OF THE EUROPEAN PARLIAMENT AND OF THE COUNCIL of 16 December 1999 on orphan medicinal products. Europena Parliament and the Council. 2000. http://ec.europa.eu/health/files/eudralex/vol-1/reg_2000_141/reg_2000_141_en.pdf. Accessed 26 October 2015.
McCabe C. Balancing economic, ethical and equity concerns in orphan drugs and rare diseases. EJHP Practice. 2010;16(4):22–5.
Hughes-Wilson W, Palma A, Schuurman A, Simoens S. Paying for the Orphan Drug System: Break or bend? Is it time for a new evaluation system for payers in Europe to take account of new rare disease treatments? Orphanet J Rare Dis. 2012;7:74. doi:10.1186/1750-1172-7-74.
Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264–9. w64.
Iskrov G, Miteva-Katrandzhieva T, Stefanov R. Challenges to orphan drugs access in Eastern Europe: the case of Bulgaria. Health Policy. 2012;108(1):10–8.
Iskrov GG, Raycheva RD, Stefanov RS. Insight into reimbursement decision-making criteria in Bulgaria: implications for orphan drugs. Folia Med. 2013;55(3-4):80–6.
Logviss K, Krievins D, Purvina S. Rare diseases and orphan drugs: Latvian story. Orphanet J Rare Dis. 2014;9(1):147. doi:10.1186/s13023-014-0147-z.
Pavlović N, Stanimirov B, Stojančević M, Paut-Kusturica M, Stoimenova A, Goločorbin-Kon S, et al. An insight on differences in availability and reimbursement of orphan medicines among Serbia, Bulgaria and Sweden. Biotechnol Biotechnol Equip. 2012;26(5):3236–41.
Picavet E, Annemans L, Cleemput I, Cassiman D, Simoens S. Market uptake of orphan drugs - A European analysis. J Clin Pharm Ther. 2012;37(6):664–7.
Sasinowski F. Quantum of effectiveness evidence in FDA’s approval of orphan drugs. Drug Inf J. 2012;46:238–63.
Côté A, Keating B. What is wrong with orphan drug policies? Value Health. 2012;15(8):1185–91.
Kalo Z, Landa K, Dolezal T, Voko Z. Transferability of National Institute for Health and Clinical Excellence recommendations for pharmaceutical therapies in oncology to Central-Eastern European countries. Eur J Cancer Care. 2012;21(4):442–9. doi:10.1111/j.1365-2354.2012.01351.x.
Dear JW, Lilitkarntakul P, Webb DJ. Are rare diseases still orphans or happily adopted? The challenges of developing and using orphan medicinal products. Br J Clin Pharmacol. 2006;62(3):264–71. doi:10.1111/j.1365-2125.2006.02654.x.
Kanters TA, de Sonneville-Koedoot C, Redekop WK, Hakkaart L. Systematic review of available evidence on 11 high-priced inpatient orphan drugs. Orphanet J Rare Dis. 2013;8:124. doi:10.1186/1750-1172-8-124.
Facey K, Granados A, Guyatt G, Kent A, Shah N, van der Wilt GJ, et al. Generating health technology assessment evidence for rare diseases. Int J Technol Assess Health Care. 2014;30(4):416–22. doi:10.1017/s0266462314000464.
Kesselheim AS, Gagne JJ. Strategies for postmarketing surveillance of drugs for rare diseases. Clin Pharmacol Ther. 2014;95(3):265–8.
Foltánová T, Mazág M. Orphan dugs in EU. Acta Facultatis Pharmaceuticae Universitatis Comenianae. 2013;60(SUPPL. 8):26–31.
Clarke JT. Is the current approach to reviewing new drugs condemning the victims of rare diseases to death? A call for a national orphan drug review policy. CMAJ. 2006;174(2):189–90. doi:10.1503/cmaj.050706.
Winquist E, Bell CM, Clarke JTR, Evans G, Martin J, Sabharwal M, et al. An evaluation framework for funding drugs for rare diseases. Value Health. 2012;15(6):982–6.
Laupacis A. Evidence and values: requirements for public reimbursement of drugs for rare diseases - A case study in oncology. Can J Clin Pharmacol. 2009;16(2):e282–e94.
Hyde R, Dobrovolny D. Orphan drug pricing and payer management in the United States: are we approaching the tipping point? Am Health Drug Benefits. 2010;3(1):15–22.
Rosenberg-Yunger ZRS, Daar AS, Thorsteinsdóttir H, Martin DK. Priority setting for orphan drugs: an international comparison. Health Policy. 2011;100(1):25–34.
Paulden M, Stafinski T, Menon D, McCabe C. Value-based reimbursement decisions for orphan drugs: a scoping review and decision framework. Pharmacoeconomics. 2015;33(3):255–69. doi:10.1007/s40273-014-0235-x.
Sussex J, Rollet P, Garau M, Schmitt C, Kent A, Hutchings A. A pilot study of multicriteria decision analysis for valuing orphan medicines. Value Health. 2013;16(8):1163–9.
Panju AH, Bell CM. Policy alternatives for treatments for rare diseases. CMAJ. 2010;182(17):E787–E92.
Dupont AG, Van Wilder PB. Access to orphan drugs despite poor quality of clinical evidence. Br J Clin Pharmacol. 2011;71(4):488–96.
Tordrup D, Tzouma V, Kanavos P. Orphan drug considerations in Health Technology Assessment in eight European countries. Rare Dis Orphan Drugs. 2014;1(3):86–97.
Hughes DA, Tunnage B, Yeo ST. Drugs for exceptionally rare diseases: Do they deserve special status for funding? QJM. 2005;98(11):829–36.
Simoens S. Pricing and reimbursement of orphan drugs: the need for more transparency. Orphanet J Rare Dis. 2011;6:42. doi:10.1186/1750-1172-6-42.
Simoens S, Picavet E, Dooms M, Cassiman D, Morel T. Cost-effectiveness assessment of orphan drugs: a scientific and political conundrum. Appl Health Econ Health Policy. 2013;11(1):1–3.
Drummond M, Evans B, LeLorier J, Karakiewicz P, Martin D, Tugwell P, et al. Evidence and values: requirements for public reimbursement of drugs for rare diseases - A case study in oncology. Can J Clin Pharmacol. 2009;16(2):e273–e81.
Drummond M, Towse A. Orphan drugs policies: a suitable case for treatment. Eur J Health Econ. 2014;15(4):335–40.
Kanavos P, Nicod E. What is wrong with orphan drug policies? Suggestions for ways forward. Value Health. 2012;15(8):1182–4.
Sheldon T. Dutch doctors call for EU evaluation of cost effectiveness of high cost orphan drugs. BMJ. 2012;345:e5461. doi:10.1136/bmj.e5461.
Zitter M. Managing drugs for rare genetic diseases: trends and insights. Manag Care. 2005;14(2):52–4, 7–5460, 63–64; quiz 66–67.
Drummond MF, Wilson DA, Kanavos P, Ubel PA, Rovira J. Assessing the economic challenges posed by orphan drugs: a response to McCabe et al. . Int J Technol Assess Health Care. 2007;23(3):401–4.
McCabe C, Tsuchiya A, Claxton K, Raftery J. Assessing the economic challenges posed by orphan drugs: a comment on Drummond et al. . Int J Technol Assess Health Care. 2007;23(3):397–401.
McCabe C, Edlin R, Round J. Economic considerations in the provision of treatments for rare diseases. Adv Exp Med Biol. 2010;686:211–22. doi:10.1007/978-90-481-9485-8_13.
Denis A, Mergaert L, Fostier C, Cleemput I, Simoens S. A comparative study of European rare disease and orphan drug markets. Health Policy. 2010;97(2-3):173–9.
Denis A, Mergaert L, Fostier C, Cleemput I, Simoens S. Issues surrounding orphan disease and orphan drug policies in Europe. Appl Health Econ Health Policy. 2010;8(5):343–50.
Coyle D, Cheung MC, Evans GA. Opportunity cost of funding drugs for rare diseases: the cost-effectiveness of eculizumab in paroxysmal nocturnal hemoglobinuria. Med Decis Making. 2014. doi:10.1177/0272989x14539731.
Heemstra HE. Variations in access and use of orphan drugs among EU member states. EJHP Practice. 2010;16(4):25–7.
Kanters TA, Steenhoek A, Hakkaart L. Orphan drugs expenditure in the Netherlands in the period 2006–2012. Orphanet J Rare Dis. 2014;9:154. doi:10.1186/s13023-014-0154-0.
Hutchings A, Schey C, Dutton R, Achana F, Antonov K. Estimating the budget impact of orphan drugs in Sweden and France 2013-2020. Orphanet J Rare Dis. 2014;9:22. doi:10.1186/1750-1172-9-22.
Rollet P, Lemoine A, Dunoyer M. Sustainable rare diseases business and drug access: no time for misconceptions. Orphanet J Rare Dis. 2013;8(1):1–9.
Picavet E, Cassiman D, Simoens S. Reimbursement of orphan drugs in Belgium: what (else) matters? Orphanet J Rare Dis. 2014;9(1):139. doi:10.1186/s13023-014-0139-z.
Winquist E, Coyle D, Clarke JTR, Evans GA, Seager C, Chan W, et al. Application of a policy framework for the public funding of drugs for rare diseases. J Gen Intern Med. 2014;29(SUPPL. 3):S774–S9.
Denis A, Mergaert L, Fostier C, Cleemput I, Simoens S. Budget impact analysis of orphan drugs in Belgium: estimates from 2008 to 2013. J Med Econ. 2010;13(2):295–301. doi:10.3111/13696998.2010.491427.
Denis A, Mergaert L, Fostier C, Cleemput I, Hulstaert F, Simoens S. Critical assessment of Belgian reimbursement dossiers of orphan drugs. Pharmacoeconomics. 2011;29(10):883–93.
Koçkaya G, Wertheimer AI, Kilic P, Tanyeri P, Mert Vural I, Akbulat A, et al. An overview of the orphan medicines market in Turkey. Value in Health Reg Issues. 2014;4(1):47–52.
Morgane M, Toumi M. Access to orphan drugs in Europe: current and future issues. Expert Rev Pharmacoecon Outcomes Res. 2012;12(1):23–9. doi:10.1586/erp.11.95.
Vegter S, Rozenbaum MH, Postema R, Tolley K, Postma MJ. Review of regulatory recommendations for orphan drug submissions in the netherlands and scotland: focus on the underlying pharmacoeconomic evaluations. Clin Ther. 2010;32(9):1651–61.
Tambuyzer E. Rare diseases, orphan drugs and their regulation: Questions and misconceptions. Nat Rev Drug Discov. 2010;9(12):921–9.
Drummond MF, Wilson DA, Kanavos P, Ubel P, Rovira J. Assessing the economic challenges posed by orphan drugs. Int J Technol Assess Health Care. 2007;23(1):36–42.
Desser AS, Olsen JA, Grepperud S. Eliciting preferences for prioritizing treatment of rare diseases: the role of opportunity costs and framing effects. Pharmacoeconomics. 2013;31(11):1051–61.
Hughes D. Rationing of drugs for rare diseases. Pharmacoeconomics. 2006;24(4):315–6.
McCabe C, Claxton K, Tsuchiya A. Orphan drugs and the NHS: Should we value rarity? Br Med J. 2005;331(7523):1016–9.
Hughes D. Orphan drugs revisited: Author's response . QJM. 2006;99(5):350–1.
Hyry HI, Stern AD, Cox TM, Roos JC. Limits on use of health economic assessments for rare diseases. QJM. 2014;107(3):241–5. doi:10.1093/qjmed/hcu016.
Burls A, Austin D, Moore D. Commissioning for rare diseases: view from the frontline. Br Med J. 2005;331(7523):1019–21.
Nice Citizens Council Report - Ultra Orphan Drugs. National Institute for Clinical Excellence, London. 2004. https://www.nice.org.uk/Media/Default/Get-involved/Citizens-Council/Reports/CCReport04UltraOrphanDrugs.pdf. Accessed 5 Oct 2015.
Desser AS. Prioritizing treatment of rare diseases: a survey of preferences of Norwegian doctors. Soc Sci Med. 2013;94:56–62.
Dragojlovic N, Rizzardo S, Bansback N, Mitton C, Marra CA, Lynd LD. Challenges in measuring the societal value of orphan drugs: insights from a canadian stated preference survey. Patient. 2015;8(1):93–101. doi:10.1007/s40271-014-0109-5.
Desser AS, Gyrd-Hansen D, Olsen JA, Grepperud S, Kristiansen IS. Societal views on orphan drugs: cross sectional survey of Norwegians aged 40 to 67. BMJ. 2010;341:c4715. doi:10.1136/bmj.c4715.
Cheng MM, Ramsey SD, Devine EB, Garrison LP, Bresnahan BW, Veenstra DL. Systematic review of comparative effectiveness data for oncology orphan drugs. Am J Manag Care. 2012;18(1):47–62.
McCabe C, Tsuchiya A, Claxton K, Raftery J. Orphan drugs revisited. QJM. 2006;99(5):341–5.
Cost effectiveness and strategic planning (WHO-CHOICE) WHO. http://www.who.int/choice/costs/CER_levels/en/. Accessed 20.10.2015.
Kaló Z, Gheorghe A, Huic M, Csanádi M, Kristensen FB. HTA Implementation Roadmap in Central and Eastern European Countries. Health Econ. 2016;25 Suppl 1:179–92. doi:10.1002/hec.3298.
Fishman JC, Skrepnek GH. Pharmacoeconomic analyses of treatments for rare disease. Pharm Policy Law. 2012;14(1):51–67.
Sheehan M. Orphan drugs and the NHS: fairness in health care entails more than cost effectiveness. BMJ. 2005;331(7525):1144–5.
London AJ. How should we model rare disease allocation decisions? Hastings Cent Rep. 2012;42(1):3.
Kolasa K, Zwolinski KM, Kalo Z, Hermanowski T. Potential impact of the implementation of multiple-criteria decision analysis (MCDA) on the Polish pricing and reimbursement process of orphan drugs. Orphanet J Rare Dis. 2016;11:23. doi:10.1186/s13023-016-0388-0.
Szegedi M, Molnar MJ, Boncz I, Kosztolanyi G. Shift of focus in the financing of Hungarian drugs. Reimbursement for orphan drugs for treating rare diseases: financing of enzyme replacement therapy in Hungary. Orv Hetil. 2014;155(44):1735–41. doi:10.1556/oh.2014.30031.
Drummond M, Augustovski F, Kalo Z, Yang BM, Pichon-Riviere A, Bae EY et al. Challenges faced in transferring economic evaluations to middle income countries. Int J Technol Assess Health Care. 2015;31(6):442–8. doi:10.1017/s0266462315000604.
Morrison V, Fargher E, Parveen S, Plumpton C. Determinants of patient adherence to antihypertensive medication: a multi-national cross-sectional survey. Ascertaining Barriers for Compliance: policies for safe, effective and cost-effective use of medicines in Europe - Final Report. 2012. p. 78–103.
Kalo Z, Annemans L, Garrison LP. Differential pricing of new pharmaceuticals in lower income European countries. Expert Rev Pharmacoecon Outcomes Res. 2013;13(6):735–41. doi:10.1586/14737167.2013.847367.
O'Mahony B, Noone D, Giangrande PL, Prihodova L. Haemophilia care in Europe - a survey of 35 countries. Haemophilia. 2013;19(4):e239–47. doi:10.1111/hae.12125.
EURORDIS. Improving patient access to orphan drugs in Europe EURORDIS. 2009. http://www.eurordis.org/content/improving-patient-access-orphan-drugs-europe. Accessed 29.04.2016.
EUCERD. EUCERD Recommendation for a CAVOMP Information Flow. 2012. http://www.eurordis.org/sites/default/files/cavomp.pdf. Accessed 20.04.2016.
MoCA-OMP. Process on Corporate Social Responsibility in the Field of Pharmaceuticals - Platform on Access to Medicines in Europe, Working Group on Mechanism of Coordinated Access to Orphan Medicinal Products (MoCA-OMP). 2013. http://ec.europa.eu/DocsRoom/documents/7631/attachments/1/translations/en/renditions/pdf. Accessed 18.04.2016.
Richter T, Nestler-Parr S, Babela R, Khan ZM, Tesoro T, Molsen E, Hughes DA, International Society for Pharmacoeconomics and Outcomes Research Rare Disease Special Interest Group. Rare disease terminology and definitions-a systematic global review: report of the ISPOR Rare Disease Special Interest Group. Value Health. 2015;18(6):906–14.
Kristensen FB, Mäkelä M, Neikter SA, Rehnqvist N, Håheim LL, Mørland B, Milne R, Nielsen CP, Busse R, Lee-Robin SH, Wild C, Espallargues M, Chamova J, European network for Health Technology Assessment (EUnetHTA). European network for health technology assessment, EUnetHTA: planning, development, and implementation of a sustainable European network for health technology assessment. Int J Technol Assess Health Care. 2009;25 Suppl 2:107–16.
Davies JE, Neidle S, Taylor DG. Developing and paying for medicines for orphan indications in oncology: Utilitarian regulation vs equitable care. Br J Cancer. 2012;106(1):14–7.
Simoens S, Cassiman D, Dooms M, Picavet E. Orphan drugs for rare diseases: Is it time to revisit their special market access status? Drugs. 2012;72(11):1437–43.
What type of evidence is currently being considered in the development of clinical practice guidelines for rare diseases? Institute for Quality and Efficiency in Health Care: Executive Summaries. 2011. http://www.ncbi.nlm.nih.gov/pubmedhealth/PMH0065182/pdf/PubMedHealth_PMH0065182.pdf. Accessed 2 October 2015.
Mentzakis E, Stefanowska P, Hurley J. A discrete choice experiment investigating preferences for funding drugs used to treat orphan diseases: an exploratory study. Health Econ Policy Law. 2011;6(3):405–33.
Picavet E, Dooms M, Cassiman D, Simoens S. Orphan drugs for rare diseases: grounds for special status. Drug Dev Res. 2012;73(3):115–9.
European policies on orphan diseases and drugs stimulate drug development, but could be improved. Drugs Ther Perspect. 2011;27(5):24–6. doi:10.2165/11601550-000000000-00000.
Hogerzeil HV. Rare diseases and essential medicines: Global perspective. Int J Pharm Med. 2005;19(5-6):285–8.
Pinxten W, Denier Y, Dooms M, Cassiman JJ, Dierickx K. A fair share for the orphans: ethical guidelines for a fair distribution of resources within the bounds of the 10-year-old European Orphan Drug Regulation. J Med Ethics. 2012;38(3):148–53.
Kinney J. Health disparities: exploring the ethics of orphan drugs. Am J Health Syst Pharm. 2014;71(9):692–3.
Largent EA, Pearson SD. Which orphans will find a home? The rule of rescue in resource allocation for rare diseases. Hastings Cent Rep. 2012;42(1):27–34.
We thank Dániel Fata, who gave helpful assistance in processing the large number of publications during the screening and data extraction phase of the systematic literature review.
Our research is purely academic, we have not received any funding or sponsorship from any stakeholders.
Availability of data and materials
The datasets supporting the conclusions of this article are included within the article and its additional files.
TZ managed the whole research process, participated in every phase of the systematic review and drafted the initial manuscript. KZ participated in the conceptualization and planning of the study, supervised the review process and contributed in writing the manuscript. MM participated in the phase of discussion and critically reviewed the manuscript. MSz took part in the systematic review process, participated in the discussion, and contributed in writing and reviewing the manuscript. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
Includes the detailed literature search strategy in PudMed and Scopus databases. Furthermore, the document contains the predefined exclusion criteria for Title-Abstract screening of the records. (DOCX 15 kb)
Contains the extracted dataset which summarizes the general characteristics of the included articles and type of articles. Furthermore, separate columns summarizes the main findings of the articles referring to the specific elements of HTA, as well as other factors to consider in terms of public reimbursement. (XLSX 86 kb)
About this article
Cite this article
Zelei, T., Molnár, M.J., Szegedi, M. et al. Systematic review on the evaluation criteria of orphan medicines in Central and Eastern European countries. Orphanet J Rare Dis 11, 72 (2016). https://doi.org/10.1186/s13023-016-0455-6
- Rare disease
- Orphan drug
- Economic evaluation
- Technology assessment
- Cost effectiveness
- Drug approval
- Central and Eastern Europe