Skip to main content

Are supplemental appraisal/reimbursement processes needed for rare disease treatments? An international comparison of country approaches



There is increasing recognition that conventional appraisal approaches may be unsuitable for assessing the value rare disease treatments (RDTs). This research examines what supplemental appraisal/reimbursement processes for RDTs are used internationally and how they can be characterised. A qualitative research design was used that included (1) documentation of country appraisal/reimbursement processes for RDTs via questionnaires, desk research and iterative interactions with country experts to produce country vignettes, and (2) a cross-country analysis of these processes to identify and characterise features in supplemental processes for RDTs, and compare them to countries without supplemental processes.


Thirty-two of the 37 invited countries participated in this research. Forty-one percent (13/32) use supplemental processes for RDTs. Their level of integration within standard processes ranged from low to high, characterised by whether they are separate or partially separate from the standard process, adapted or accelerated standard processes, or standard processes that may be applied to RDTs. They are characterised by features implemented throughout the appraisal process. These features are mechanisms that allow application of different standards to assess the value of the medicine, support to the appraisal/decision-making process, overcome the issues of lack of cost-effectiveness, or exempt from part of/the full appraisal/reimbursement process. They increase the likelihood of reimbursement by adjusting and/or foregoing part of the assessment process, or accepting to pay more for the same added benefit as for common conditions. A large proportion of countries with standard processes include one or more of these features (formally or informally) or are discussing potential changes in their systems.


Results suggest revealed preferences to treat RDTs differently than conventional medicines. Some of the challenges around uncertainty and high price remain, but supplemental process features can support decision-making that is more flexible and consistent. Many of these processes are new and countries continue to adjust as they gain experience.


Health systems are increasingly challenged to fund new and often high-cost medicines in a timely manner [1]. These include medicines to treat rare diseases affecting small patient numbers, which are often severe (life-threatening and/or causing significant disability), genetically acquired and have an onset of symptoms in childhood. In many parts of the world, financial and procedural incentives to facilitate research, development and marketing authorisation have been implemented for rare disease treatments (RDTs) to reduce the high unmet need for disease modifying treatments. In Europe, these incentives are provided by the European Medicines Agency (EMA) through the EU Regulation on Orphan Medicinal Products (OMPs), which was implemented in 2000 targeting medicines treating less than 5 in 10,000 people [2]. These measures are considered to have been successful with the development of 1706 products designated as OMPs, of which 176 have been authorised by the EMA [2].

Decisions relating to reimbursement, pricing and availability of treatments in health systems are often informed by health technology assessment (HTA), which is based on international evidence that is then deliberatively appraised by a committee of experts to determine the added clinical benefit and/or cost-effectiveness of new technologies in a specific health system. The two common challenges in HTA appraisal of RDTs are the uncertainties apparent in the evidence and the high price of the products [3]. The deliberation by the appraisal committee is particularly important for RDTs given the uncertainties resulting from the small and heterogeneous patient populations, lack of information about the natural history of the disease, and the direct and indirect burden of these conditions [4,5,6,7]. These uncertainties, combined with the high prices of these medicines (to recoup R&D costs from small patient populations), often lead to cost-effectiveness estimates, such as Cost/Quality Adjusted Life-Year (Cost/QALY), that are much higher than traditional willingness-to-pay (WTP) thresholds [4, 8]. In such circumstances, it may be doubly difficult to justify reimbursement. These aspects have led to increasing recognition that it may be difficult to subject RDTs to conventional HTA processes, particularly in those diseases that require highly specialised care and that are very rare or for so-called “ultra-OMPs” [3, 4, 9,10,11].

One way to overcome this issue would be to exempt RDTs from HTA altogether, as was the case initially within Germany’s Act on the Reform of the Market for Medicinal Products (AMNOG) system, or pay more for the same added benefit for a patient with a rare disease compared to one with a common condition, as is the case in England’s Highly Specialised Technology (HST) programme [8, 12, 13]. A lower level of scrutiny or a greater willingness to pay could also be seen as acceptable, given the smaller population (and associated budget impact) [11]. However, this has been criticised in the past by some analysts, on the grounds that all health care expenditure deserves thorough scrutiny, or that paying more for health benefit in RDTs could have a high opportunity cost in terms of the services that other patients with common conditions may have to forego [12]. Another way to deal with these issues is to adapt conventional HTA processes to facilitate the appraisal of RDTs. For example, some HTA bodies have stated that the QALY may not capture all elements of value, have adopted a broader decision-making framework and implemented processes to incorporate wider considerations from clinical and patient experts [4, 13]. Other HTA bodies are implementing managed entry agreements (MEAs) to collect outcomes to inform individual treatment decisions, to generate additional evidence for later re-appraisal or to accelerate access to these treatments [14]. Other countries have expedited processes for RDTs that allow patients to get access to these medicines sooner.

As pharmaceutical expenditure is shifting from treatments for more prevalent conditions to medicines that fall within the OMP legislation, the challenges relating to conventional appraisal processes will be faced more frequently [15]. However, the growing number of OMPs are not all for rare, genetic, previously untreatable conditions. Some may be for specific forms of a more prevalent condition, allowing stratified or personalised treatment within a clear patient pathway, whereas others may be very rare conditions where there is no country expertise.

Therefore, the key question is whether supplemental appraisal processes are needed that would better deal with the specificities of RDTs, and if so, what form these should take? This research aimed to address this question by examining how countries are appraising RDTs, with a special focus on those that have implemented supplemental processes specifically for RDTs. This work is part of a Work Package (10) within the EU-funded Horizon 2020 IMPACT-HTA project; it feeds into the overarching objective of the Work Package to develop guidance on novel approaches to appraising medicines to treat rare diseases to support robust and accountable decision-making across Europe on high-cost products.


A mixed-methods design was used that included (1) documentation of country appraisal/reimbursement processes for RDTs via questionnaires, desk research and iterative interactions with country experts to produce vignettes for each country, and (2) a qualitative review of these processes to identify and characterise appraisal processes for RDTs and identify the features used in these “supplemental” processes.

The study countries comprised all European Member States and countries from the European Economic Area (Iceland, Liechtenstein, Norway, and Switzerland). Australia, Canada and New Zealand were also included to learn from these jurisdictions with more mature HTA processes. Experts involved in the HTA appraisal/reimbursement processes for RDTs were identified for each country using the authors’ networks or via internet searches. Exchanges were often with just one expert per country, since he/she was often the person with the right competence to provide this information. In a few cases where the responsibility for health care provision is regional (Canada, Spain), several experts for one country were contacted. Experts were invited to participate in this research by email. In case of non-response after numerous follow-up emails, other experts with the appropriate expertise were contacted until appropriate input was received.

A questionnaire with open-ended questions was designed to collect information about country HTA appraisal/reimbursement processes for RDTs, associated challenges, impact and expected policy changes. The questionnaire was reviewed by co-authors (KF, MD) and project partners, and piloted with two institutional partners (National Institute for Health and Clinical Excellence (NICE) in England and the Dental and Pharmaceutical Benefits Board (TLV) in Sweden). Adjustments were made based on the feedback received to ensure the questionnaire was clear and enabled the information of interest to be collected. The questionnaire and accompanying documentation (information sheet and informed consent form) were sent to all country experts by email.

Country vignettes summarising individual country appraisal/reimbursement processes for RDTs were created. If one country had several jurisdictions, these were all included in the same country vignette. Additional desk research was also conducted to confirm and complement some of the information. The country vignette was created and reviewed in an alternating approach by two of the co-authors (AW, EN). Country experts were sent the draft vignettes by email with follow-up questions and opportunity to comment, and for their review and validation on two (or more) occasions, respectively. For some of the countries with RDT supplemental processes, the first validation round was conducted via 1–1 discussions on Skype to allow a more detailed understanding of the features of these supplemental processes to be obtained. The process of creating the vignettes was undertaken from January 2019 until March 2020.

Country definitions of rare and ultra-rare disease treatments were used. In Europe, RDTs are defined by the OMP legislation, but as there is no legislation about ultra-RDTs, this definition differed across countries. In this study, RDTs are defined as all medicines that would fulfil the EMA’s OMP prevalence criteria (medicines to treat less than 5 in 10,000 people), and the term OMP is used when reference is made by the country specifically to those with an orphan designation from the EMA. A process was defined as supplemental if it only included rare and/or ultra-rare disease treatments and related to routine use for a defined patient population within a health service. Our analysis did not include for example, named patient programs in which reimbursement is sought for individuals. Similarly, other special processes that are not specifically for RDTs, but that might work to their advantage, were discussed in the section about standard processes if they had been noted by country experts.

The analysis focused on characterising these supplemental processes in terms of (1) level of integration within standard appraisal/reimbursement processes, and (2) their features (unique and/or different) to standard processes. These features were grouped according to their occurrence in the HTA process: (a) categories of evidence required, (b) assessment of the evidence (including evidentiary standards), (c) appraisal or deliberative process for decision-making, and (d) recommendations for pricing, reimbursement of use of the RDT. Countries without supplemental processes were then examined to determine whether there were other features within their processes that could be applied to support appraisal of RDTs.


Thirty-two of 37 countries (86%) were included in the study. Vignettes for each of these were created [16]. The five non-respondent countries excluded from the study were: Australia, Croatia, Cyprus, Luxembourg, and Wales. Responses were provided by 33 country experts (two experts for the different jurisdictions in Canada) (Fig. 1). Eighty percent of experts work within, or close to, HTA/reimbursement processes in the public sector, with the remaining being from academia, health care providers or private sector. Their positions are directorship-level involved in the pricing and reimbursement processes (45%), HTA scientific experts (30%), appraisal committee members (6%), academics or clinical experts (18%), or consultants (3%).

Fig. 1
figure 1

Responder characteristics (n = 33)

The next section provides an overview of the countries with supplemental processes, explores their key features according to the typology, and examines countries without RDT supplemental processes.

Supplemental processes for rare disease treatments

Forty one percent (13/32) of countries include supplemental processes specifically targeting rare and/or ultra-RDTs, with two of these countries (Scotland, Slovakia) each having two distinct supplemental processes for rare and ultra-RDTs, respectively (Fig. 2). Integration levels of these supplemental processes within standard processes were categorised as low, medium and high. Processes with low integration are either completely (2/15) or partially separate (2/15) from the standard process. The main distinction between separate supplemental and standard processes are the different evidence submission requirements and appraisal committees. This is the case for the HST programme in England and the ultra-OMP pathway in Lithuania, both targeting ultra-RDTs. They also include different features intended to better adapt to the specificities of RDTs. Both recognise the challenges for evidence generation and tend to be more lenient with its interpretation. The HST programme in England has an explicit decision-making framework that allows for broader consideration of treatment value (nature of the condition, clinical effectiveness, value for money, impact beyond direct health benefits) and greater WTP, whereas the ultra-OMP pathway in Lithuania has different appraisal rules (therapeutic value not graded), a special reimbursement list with no waiting list, and special pricing rules.

Fig. 2
figure 2

Classification of supplemental processes by level of integration and applicability to rare versus ultra-rare. This figure provides an overview of the study countries that have supplemental processes for the routine use of rare and/or ultra-rare disease treatments in a defined patient population within a health service. * Scotland and Slovakia have two different supplemental pathways for rare and ultra-rare disease treatments respectively, which are differentiated here. ** Rare disease treatment with orphan designation from European Medicines Agency (“Orphan Medicinal Product”, OMP); ultra-rare disease treatment defined by individual country definitions, often alongside other criteria. RDT: rare disease treatment; OMP: orphan medicinal product; P&R: pricing and reimbursement process

Partially integrated supplemental processes include the ultra-OMP pathway in Scotland (where the wider decision-making framework implemented in 2016 was changed to an ultra-OMP pathway in 2019) and the OMP pathway in Germany. In Scotland, once a product is designated as an ultra-RDT by the Scottish Medicines Consortium (SMC), it is submitted for initial assessment to SMC using a special submission form and it is then made available in Scotland for 3 years with a data collection plan and re-assessment after 3 years. In Germany, the assessment and appraisal are conducted by the Federal Joint Committee (G-BA) instead of the independent Institute for Quality and Efficiency in Health Care (IQWiG). RDTs are also subject to more simplified evidentiary requirements (e.g. no need for comparative data), and their additional benefit is considered automatically proven. There is also an option for conditional approval.

Countries were defined as having adapted processes for RDTs when they include adjustments to their standard process that allow better management of the challenges with RDTs. This is the case for Norway, Sweden and Slovakia, in which the adapted process targets ultra-RDTs, and in Scotland for OMPs. The main process features common to all the countries relate to a greater understanding of the challenges to produce high quality evidence for RDTs, and more favourable reimbursement through a higher WTP. Slovakia also includes an exemption from presenting an economic evaluation. In Scotland, being an OMP has been seen as a “modifier” to the appraisal process for many years, providing more flexibility in the decision-making process [17]. Recently, there is also the possibility to hold a patient and clinician engagement (PACE) meeting for OMPs [18].

Five of the 13 countries with supplemental processes for RDTs have a high level of integration with standard processes. These are either expedited processes or processes where rarity is weighted. The three countries with expedited processes allow for an earlier start of the assessment process (and subsequently earlier access for patients to these treatments). The other two countries have points systems to determine reimbursement status (e.g. Romania) and WTP (e.g. Slovakia), where OMPs get extra points.

Two of the 13 countries with supplemental processes use alternative routes to reimburse subgroups of RDTs, through HTA exemptions. These include the separate state-reimbursement budget for children living with rare diseases in Latvia and a list of rare diseases for which medicines are automatically reimbursed in Bulgaria.

Distinction of rare versus ultra-rare disease treatments within supplemental processes

All processes with a medium to low level of integration within standard processes target ultra-RDTs, with the exception of the orphan medicines pathway in Germany and the PACE process and SMC modifiers in Scotland intended for OMPs (Table 1). The ultra-RDT definitions are defined using prevalence criteria ranging from less than 1 in 50,000 (Scotland, Slovakia) to less than 1 in 200,000 patients (Lithuania, Bulgaria), or are not defined (Sweden, likely to be less than 1 or 2 in 200,000 patients). Additionally, most countries limit these special processes to ultra-RDTs with specific characteristics, such as treating a severe condition with high unmet need, to potentially effective and/or high cost treatments, requiring highly specialised management. Regarding the more integrated supplemental processes, eligible medicines are those with an OMP designation.

Table 1 Country definitions for rare and ultra-rare disease treatments, and their use as eligibility criteria within supplemental processes for rare disease treatments

Key process features for appraisal of rare disease treatments

The distinctions between supplemental and standard processes have been characterised as features occurring throughout the HTA process, and are discussed in this section (Fig. 3).

Fig. 3
figure 3

Features included in supplemental processes for rare diseases across the HTA process. Illustrates the (unique and/or different) features of supplemental processes to standard ones. They have been categorised according to their occurrence throughout the HTA process. RDT: rare disease treatment; WTP: willingness-to-pay

Evidence submissions

The countries with separate or partially separate processes have different clinical and/or economic evidence submission requirements. This is done through use of different submission forms as seen for the HST in England and ultra-OMP pathways in Lithuania and Scotland, or with the possibility of presenting a simplified version of the standard submission in Germany (exempt from presenting comparative data). In all other countries, evidentiary requirements are the same as for standard processes with the exception of Lithuania, Slovakia and Belgium, which don’t require economic models for ultra-RDTs.


The inclusion of disease-specific input is being achieved by involving patient and clinical experts in different ways across the HTA process, starting from the assessment phase. First, through the stand-alone PACE process in Scotland, where the SMC assessors discuss the added benefit of the treatment not captured within conventional clinical and cost-effectiveness assessments with those who have experience of the disease and/or treatment being assessed. This meeting can be requested by the manufacturer if a negative opinion is initially given by the assessment committee. A PACE statement is then drafted and becomes part of the evidence submitted to the appraisal committee. Secondly, the process may allow for clinical (and in some cases patient) experts to provide input about the condition, the care pathway in the country and impacts of treatment in standard clinical practice, which supports understanding and interpretation of the evidence and assumptions. Most countries, including countries with standard processes for RDTs, allow this. Third, some countries have established committees with rare disease experts that support decision-making around pricing, reimbursement and use of the medicine. This is the case in Bulgaria with their rare disease expert committee that decides on inclusion of diseases on the special positive formulary (for which all treatments are reimbursed), and in New Zealand with their clinical advisory committee.

Additionally, some processes may allow for an earlier start in the assessment process to guarantee more timely access to RDTs. This is seen in Belgium, Italy and New Zealand in their expedited processes targeting RDTs, which allow for the assessment process to start before marketing authorisation is granted.


The greatest number of features implemented in the supplemental processes relate to the appraisal phase. The main distinction seen within separate supplemental processes for ultra-RDTs is the existence of different appraisal committees, which provides a standing group with rare disease expertise who only assess RDTs. One of the main distinctions seen in England is in membership composition with the inclusion of rare disease clinical specialists (adult and paediatric), ethicists, geneticists, and rare disease expert centre representatives.

Broader consideration of value is another feature adopted in England’s and Scotland’s supplemental processes for ultra-RDTs (within their ultra-OMP decision frameworks), where context and specification of issues specific to rare diseases are considered as evidence. This is done by more detailed consideration about the nature of the condition (including consideration of severity, unmet need and existence of alternative treatments), and accounting for indirect costs and benefits on patients, carers and health system.

The most common feature in supplemental processes relates to allowing more leniency in the quality of the evidence. This is done through less stringent requirements for demonstrating added benefit (e.g. acceptance of non-comparative data), and/or willingness to accept surrogate endpoints or non-randomised controlled trials (RCTs). Generally, this is done on a case-by-case basis, if appropriate justification is provided or if the evidence is considered to be of best possible quality. Greater leniency may also be more acceptable for medicines with a high level of unmet need or those that have a high media profile.

In those countries where cost-effectiveness needs to be proven (e.g. where an economic submission is required), there may be more flexibility in the interpretation of the economic evidence. This is done by accepting natural outcome measures instead of QALYs or cost-consequence analyses, and including sensitivity analyses that reflect wider costs and benefits (Scotland) [19].

Some of the features included in supplemental processes allow for different decision rules. The first relates to different WTP, where a higher ICER than would be admissible in common conditions (Scotland, Norway, Sweden), or a higher adjusted WTP that increases with magnitude of benefit and QALY gained (England) would be accepted, or through a points-system calculation of the WTP threshold where OMPs get extra points (Slovakia). The second relates to alternative reimbursement rules, where the therapeutic benefit of the medicine would be considered proven (Germany), or would not be graded (Lithuania). In Romania, reimbursement status is based on a points system, where OMPs get extra default points. Third, the process features also include decision modifiers in the appraisal framework, which impact deliberation about WTP or reimbursement status. While most processes, including the standard ones, are mainly interested in severity, unmet need and existence of treatment alternatives, some of the processes explicitly account for rarity or other criteria that may favour appraisal of RDTs (e.g. children, equality or the innovative nature of treatment [20]). Rarity is accounted for in Scotland as part of its decision modifiers. Other criteria that may influence the decisions are equality (England, New Zealand), children (Germany), ethical considerations (Bulgaria, Latvia), or innovative nature of treatment (England, Italy).

Pricing and reimbursement

Many countries include different forms of conditional approval agreements or MEAs, aiming to collect additional data to facilitate later re-assessment of added benefit or cost-effectiveness. This is the case for England’s HST programme, Scotland’s ultra-OMP pathway, Germany, Norway, Slovakia, Italy and Belgium. A few countries also include alternative routes to pricing and reimbursement for a group of RDTs, where they would be exempt from HTA as a whole. This is the case in Bulgaria, where all medicines used to treat conditions included on a special list of rare diseases would be automatically reimbursed, and in Latvia, with their separate state-budget for children with rare diseases.

Impact and proposed changes

Country experts were asked to state the impacts of their supplemental processes for RDTs. Increased acceptance rate was the most common response, resulting in the reimbursement of medicines that otherwise would not be reimbursed. The assumption of proven added benefit was considered to ensure a stronger negotiating position for the manufacturer and more flexibility in pricing. Some countries stated that these processes are more adapted to dealing with specificities in appraisal of RDTs. These processes allow special approaches to be taken for reimbursement of RDTs with clinical and/or budgetary issues in a consistent way, rather than on a case-by-case basis, supporting fairness in the decision-making system.

Changes in four of the 13 countries with supplemental processes are also being discussed, including refinement of processes (Sweden), potential legislative changes (Romania), implementation of a separate budget for adult rare disease patients (Latvia) and establishment of a therapy monitoring process (Bulgaria).

What are countries with standard processes doing?

In total, 19 countries (out of 32) do not have supplemental processes targeting RDTs, but may have features in their standard processes that might work to the advantage of RDTs. Ten (out of 19) adopt one or more of the features identified, but these are not specific to RDTs. Nine countries (of the 10 countries adopting one or more of the features) have a process that allows more leniency around quality of evidence (Austria, Canada, France, Estonia, Hungary, Poland, Portugal, Czech Republic, and Netherlands). Two (out of 10) countries have different clinical and economic submission requirements (Estonia, Czech Republic). Two (out of 10) countries have a process that allows for more flexibility in the use of the economic model in decision-making (Estonia, Slovenia). For example, Estonia has a process for accepting different WTP. Six (out of 10) countries can implement conditional approval schemes (Austria, Canada, Ireland, Czech Republic, Netherlands). Two (out of 10) have separate budgets (Italy has a separate fund for innovative and cancer medicines and Austria has specific funds for political solutions). Ireland has a Rare Diseases Technology Review Committee enabling clinicians and other stakeholders to provide input in the post-HTA phase, and review MEA proposals (was not included as a country with a supplemental appraisal process, since this applies to post-HTA/appraisal). Some of these 10 countries and two without process adaptations (Finland and Greece) have appraisal criteria likely to favour RDTs. These relate to rarity (Netherlands), equality (Netherlands), children (Netherlands), ethical considerations (Netherlands, Slovenia, Finland), or innovative nature of treatment (Greece).

Some countries include additional processes that are not specifically for RDTs, but might work to their advantage. In the Czech Republic, highly innovative medicines are eligible for conditional reimbursement, and do not need to prove cost-effectiveness. Switzerland automatically grants reimbursement for diseases included in the national list of birth defects and congenital disorders [21]. In France, their expedited processes target medicines with high unmet need.

Eleven of the 19 countries without supplemental processes are engaged in ongoing discussions about implementing changes in their processes for RDTs. Discussions revolve around general process changes in the standard pathway, or process changes for orphan medicines, including implementing exemptions for economic models or including bespoke patient involvement processes.


This research contributes to a better understanding of how countries’ reimbursement/appraisal processes are dealing with RDTs. The distinctive contribution is in the primary nature of the data collected from experts closely involved within these processes, which allow the first comprehensive and detailed review of the supplemental processes targeting RDTs in Europe and beyond. This issue has been previously explored through systematic reviews or case studies, however, these earlier findings target a narrow sample of countries (with scarce information on Eastern European countries [6]), and focus on their evaluation criteria [6, 22,23,24], and/or on governance structures for pricing and reimbursement [24]. This study additionally identified and characterised the process features that facilitate appraisal of RDTs. A range of features impact access to orphan medicines across countries and this paper has not sought to address those, its focus is simply on appraisal/reimbursement systems.

Forty-one percent (13/32) of countries include supplemental processes for RDTs characterised by (add-on or adjusted) process features. This section discusses how these features help deal with uncertainty and price, and, on this basis, whether supplemental processes are needed for RDTs in all appraisal systems. It explains how the features can support application of different standards, resolution of uncertainties, lack of cost effectiveness and expedited decisions.

Different standards

The features that are specific to RDTs allow for different standards to demonstrate the value of RDTs. This is reflected in the different submission requirements, standards in assessing the quality of the evidence, value assessment frameworks, and decision rules around determination of value.

First, different submission requirements may enable submission of evidence that would not normally be acceptable or additional information to augment the clinical evidence base. For example, no comparative data are required for OMPs in Germany as their added benefit is assumed to be proven. However, some manufacturers may choose not to use this route as those medicines for which there are no comparative data are likely to be categorised with “non-quantifiable” added benefit, which may render price negotiations more challenging [25, 26].

Secondly, when assessing the quality of evidence, most HTA bodies use standard processes that take no account of the small populations available to study and the limitations caused by the lack of clinical and epidemiological understanding of a rare disease that is needed to develop a robust evidence base [27]. This has been shown in different reviews of HTA methods guides that identified only a few exceptions to standard methods for rare diseases [11, 28]. We identified a few countries that have some adjustment to their assessment processes for RDTs, undertaking special consultations with experts to feed into the appraisal deliberations. However, it is unclear how well targeted these expert engagements are and whether they have the standing in the process to influence the confirmation or rejection of assumptions that drive the understanding of value.

Thirdly, different value assessment frameworks considered within England and Scotland’s ultra-OMP pathways allow for consideration of a wider perspective of treatment value. This may help overcome limitations of QALY-based approaches that may lack sensitivity in assessing value [7, 29], or management of high levels of uncertainty characteristic of rarer and more severe conditions [29, 30]. A structured appraisal framework for RDTs could include wider perspectives, as well as guidance on how to account for these in determining added benefit during decision-making. This is particularly important to clarify for the qualitative considerations of evidence, which includes non-quantified (e.g. where data may be lacking) or non-quantifiable considerations (e.g. where no appropriate measure exists to quantify a criterion), as they tend to be given less weight in appraisal compared to quantitative evidence [11].

Fourthly, the different decision rules around determination of value are another way to forgo part of the HTA process to determine added benefit and grant reimbursement.

Resolution of uncertainties

These features can help resolve uncertainties in the interpretation of clinical (and related economic) evidence. First, some processes allow for disease-specific input to inform the appraisal by gathering additional information not included in the original submission (e.g. PACE meeting in Scotland), by receiving input on clinical issues (e.g. plausibility of clinical assumptions, relevance of outcomes and meaningfulness of improvement [13]), or by having special rare disease committees to support pricing, reimbursement and treatment use decisions. Secondly, specific appraisal committees composed of decision-makers with experience in rare diseases may better understand some of the specificities with RDTs given their experience accumulated across very rare conditions (England and Lithuania). Thirdly, most countries (with and without supplemental processes) recognise the challenges to generate robust evidence for RDTs and the implications this will have for increased uncertainties and so are willing to be more flexible in interpretation of evidence by, for example, assessing if it is the best quality evidence based on the feasibility of conducting RCTs and comparisons. Fourthly, although conditional approvals requiring some form of evidence generation post HTA approval have proved challenging in the past, with improvements in collection of real-world data and sharing of experiences across countries [31], there is renewed interest in their application, particularly for highly innovative RDTs.

Lack of cost effectiveness

These features help overcome the issue of lack of cost-effectiveness. This can be done by accepting different WTP levels or granting exemption from submitting a cost-effectiveness model, which may be a way to recognise the unsuitability of conventional approaches in appraising RDTs. Different WTP for RDTs would consist in accepting higher and/or adjusted thresholds, or in other words, by accepting to pay more for the same level of benefit compared to common conditions. Some countries, however, are still faced with cost effectiveness estimates above the revised WTP threshold. Another approach to dealing with this issue is by granting more flexibility in the use of the economic model, accepting other types of models such as cost-consequence, recognising that it is not always possible to populate economic models, using alternative pricing approaches, or giving less weight to the economic model in appraisal. Some countries do not require an economic model for certain types of medicines (e.g. highest level of added benefit or highly innovative medicines), coupled with other measures to manage risk (e.g. under conditional approval). Generally, an economic model may provide a useful benchmark for some. Indeed, the Institute for Clinical and Economic Review in the US considered removing the requirement for an economic model when reviewing their Value Assessment Framework for ultra-rare conditions, but decided to keep it, due to its usefulness in decision-making, alongside consideration of other relevant information not captured within the model [32]. This brings us to one of the key issues about how these additional elements, often difficult to quantify, may influence decision-making particularly when cost-effectiveness is not demonstrated (even within an “adapted” processes for RDTs).

Accelerated processes

These features aim to expedite the HTA/reimbursement decision to guarantee more timely access to patients to RDTs despite the uncertainty in the evidence base. First, HTA processes can be started before marketing authorisation is granted to enable an HTA decision soon after CHMP decision. However, this can be challenging for a RDT where the submitted indication may be more likely to be amended given paucity of data and implications for the benefit:risk profile. This would then require an alteration in the HTA submission to be in line with the approved indication. Secondly, some countries forgo the HTA process by granting access via separate budgets or rare disease positive lists. However, separate routes, such as ear-marked budgets, heavily rely on political support and risk being revised or discontinued [10], particularly in a time when the proportion of pharmaceutical expenditure is likely to increase for RDTs and other high cost medicines [33].

Do we need supplemental processes for RDTs?

These results do not outline what an ideal process for RDTs looks like, but identify some of the key features that can be implemented to facilitate this process. Our results indicate revealed preferences to treat RDTs differently in many jurisdictions. Indeed, 78% of the 32 study countries are dealing with RDTs differently: 41% (13/32) of countries have supplemental processes for RDTs, 31% (10/32) of countries with standard processes utilise other special features facilitating appraisal of RDTs, and 6% (2/32) of countries account for appraisal criteria likely to favour RDTs. Of the seven countries remaining, four are planning changes in their systems. The high number of countries with standard processes that are applying some of the features facilitating appraisal of RDTs or that are planning changes in their systems suggests that these countries are adopting similar approaches to supplemental processes, but in a less systematic and more ad hoc manner.

Despite the observed inter-country heterogeneity, the features implemented within supplemental processes aim to manage the specificities of RDTs fairly and consistently. They allow for different standards to demonstrate the value of RDTs, support the interpretation of limited clinical (and related economic) evidence, help overcome the issues of lack of cost-effectiveness, and aim to accelerate the HTA process to guarantee more timely access to RDTs for patients. Their impact increases the likelihood of reimbursement by adjusting and/or forgoing some part of the assessment process, and by being willing to pay more for the same added benefit as for common conditions, which is also likely to lead to accepting high prices. They apply to ultra-RDTs and/or RDTs, and are often applied in combination. Having supplemental processes does not mean that all issues are being dealt with. The challenges around uncertainty and high price remain, but these process features allow for more consistent, adapted and flexible decision-making processes and improved accountability for reasonableness [34]. Many of these processes are new and countries continue to adjust them as they gain more experience in their use.

As regional and pan-European cross-border Payer/HTA collaborations, such as Beneluxa, Finose, Valletta Declaration or Eunethta [35,36,37,38] are being implemented to conduct joint value assessments, one of the key questions is whether RDTs should have a common appraisal framework and/or undergo a common appraisal process? A first consideration is the extremely fragmented and complex market in Europe, which makes it difficult to navigate particularly for small/medium-sized companies. Secondly, national evidence generation may be more challenging for rare diseases with a limited patient population. Under such circumstances, a common appraisal framework more adapted to rare disease specificities in terms of the type of evidence to submit and the approaches to deal with uncertainty would be beneficial. Further discussion about wider perspectives of value, or the types of reimbursement decision rules would also be useful, although under the principle of subsidiarity, these items are likely to remain within the competence of EU member states. Additionally, in light of the nature of some of these very rare conditions, which in some cases can affect 10 or fewer patients in a given country, it could seem counter-productive for a company to have to produce a bespoke submission for each individual country. In such circumstances, some form of joint approach to appraisal/reimbursement could be more efficient and less time- and resource-consuming for all parties involved.

The results presented in this paper do not outline what an ideal appraisal framework looks like. It represents a first step to understanding how countries are dealing with RDTs and how they can learn from each other about the different ways to adapt standard processes to better deal with RDTs. This could then be used to shape a common appraisal framework and be useful when implementing cross-border joint assessment collaborations.


A number of challenges arose when compiling the vignettes and analysing the data collected. Responses to questionnaires may have included an insufficient level of detail and/or absence of links or documentation, making it difficult to grasp the full context and complexity of the systems in different countries. In order to minimise the risk of missing relevant information, desk research, feedback from institutional partners, and several rounds of validation with country experts were conducted. Also, the focus of this research was to characterise the process features commonly used across countries in appraisal for RDTs. It does not extend to the examination of methodological approaches to better deal with RDTs. Another challenge was that despite repeated efforts to contact different experts, for five out of 37 it was not possible to create a robust vignette. However, based on public knowledge these countries do not include supplemental processes. Furthermore, the less formal aspects of the appraisal processes that are implicit or not documented may not have been captured. For example, some countries stated they do not allow for flexibility in evidence quality, but in practice they may do so. A number of other special processes/criteria that may be applied to RDTs were also identified (e.g. process for highly specialised medicines in Czech Republic), but these have not been identified systematically. Processes are also evolving rapidly; since the creation of the vignettes there have already been some updates (which are captured in this paper), but these may not capture the most recent changes. An update of these vignettes at the end of 2020 to capture any recent developments is planned. Issues related to implementation of stated appraisal processes vs. actual appraisal processes are studied in another part of our research and will be reported in the future.


This comprehensive overview developed with the support of country experts has explored the use of supplemental HTA appraisal processes for RDTs in Europe, Canada and New Zealand. A wide variety of approaches have been identified that permit leniency in standard HTA processes, or in a few cases bespoke processes that involve rare disease experts. The supplemental approaches used build on the ethos of the HTA process within each particular country and may require different evidence submissions, additional assessment inputs, broader considerations in appraisal or special considerations for pricing and reimbursement. The processes enable flexibility with standard processes but seek to promote some consistency when handling RDTs within a country and are being adapted as a result of legislative direction or stakeholder feedback. It is important that as more RDTs come to market, there is transparency in national appraisal processes not just to ensure fair and accountable decisions within countries, but to determine if a common appraisal framework could be developed for RDTs or ultra-RDTs across Europe.

Availability of data and materials

The datasets generated and analysed during the current study are available on the IMPACT-HTA website:



Anatomical therapeutic chemical classification


European Economic Area


European Medicines Agency


Joint Federal Committee


Highly Specialised Technology


Health Technology Assessment


Incremental Cost-effectiveness Ratio


Institute for Quality and Efficiency in Health Care


Member States


National Institute for Health and Care Excellence


Orphan Medicinal Product


Patient and Clinical Engagement


Quality Adjusted Life Years


Randomised Controlled Trial


Rare Disease Treatment


Scottish Medicines Consortium


Dental and Pharmaceutical Benefits Board


Ultra-rare Disease Treatment




  1. Godman B, Malmstrom R, Diogene E, Gray A, Jayathissa S, Timoney A, et al. Are new models needed to optimize the utilization of new medicines to sustain healthcare systems? Expert Rev Clin Pharmacol. 2015;8:77–94.

    Article  Google Scholar 

  2. European Commission. Orphan medicinal products. [Cited 2020 Jan 20]. Available from:

  3. UK Genetic Alliance. Action for access: a report from genetic Alliance UK for the all party parliamentary group on rare, genetic and undiagnosed conditions; 2019.

    Google Scholar 

  4. Nicod E, Annemans L, Bucsics A, Lee A, Upadhyaya S, Facey K. HTA programme response to the challenges of dealing with orphan medicinal products: process evaluation in selected European countries. Health Policy (New York). 2019;123:140–51.

    Article  Google Scholar 

  5. Nestler-Parr S, Korchagina D, Toumi M, Pashos CL, Blanchette C, Molsen E, et al. Challenges in research and health technology assessment of rare disease technologies: report of the ISPOR rare disease special interest group. Value Health. 2018;21:493–500.

    Article  Google Scholar 

  6. Zelei T, Molnár MJ, Szegedi M, Kaló Z. Systematic review on the evaluation criteria of orphan medicines in central and eastern European countries. Orphanet J Rare Dis. 2016;11:72.

    Article  Google Scholar 

  7. Pearson I, Rothwell B, Olaye A, Knight C. Economic modeling considerations for rare diseases. Value Health. 2018;21:515–24.

    Article  Google Scholar 

  8. Drummond M, Towse A. Orphan drugs policies: a suitable case for treatment. Eur J Health Econ. 2014;15:335–40.

    Article  Google Scholar 

  9. Henderson N, Errea M, Skedgel C, Jofre-Bonet M. Ethical and economic issues in the appraisal of medicines for ultra-rare conditions. London: OHE Consulting Report; 2020. Available from:

    Google Scholar 

  10. Annemans L, Aymé S, Le Cam Y, Facey K, Gunther P, Nicod E, et al. Recommendations from the European working Group for Value Assessment and Funding Processes in rare diseases (ORPH-VAL). Orphanet J Rare Dis. 2017;12:50.

    Article  Google Scholar 

  11. Ollendorf D, Chapman R, Pearson S. Assessing the effectiveness and value of drugs for rare conditions; 2017. Available from:

    Google Scholar 

  12. McCabe C, Stafinski T, Menon D. Is it time to revisit orphan drug policies? BMJ. 2010;341:c4777.

    Article  Google Scholar 

  13. Ollendorf DA, Chapman RH, Pearson SD. Evaluating and valuing drugs for rare conditions: no easy answers. Value Health. 2018;21:547–52.

    Article  Google Scholar 

  14. Ferrario A, Kanavos P. Dealing with uncertainty and high prices of new medicines: a comparative analysis of the use of managed entry agreements in Belgium, England, the Netherlands and Sweden. Soc Sci Med. 2015;124:39–47.

    Article  Google Scholar 

  15. Mestre-Ferrandiz J, Palaska C, Kelly T, Hutchings A, Parnaby A. An analysis of orphan medicine expediture in Europe: is it sustainable? Orphanet J Rare Dis. 2019;14:287.

    Article  Google Scholar 

  16. Nicod E, Whittal A, Drummond M, Facey K. Country vignettes on HTA appraisal/reimbursement processes for rare disease treatments; 2020. [Cited 2020 Feb 26]. Available from:

    Google Scholar 

  17. SMC modifiers used in appraising new medicines. 2012. Available from:

  18. Scottish Medicines Consortium. Patient and clinician engagement process (PACE). [Cited 2020 Jun 5]. Available from:

  19. Guidance to submitting companies for completion of new product assessment form (NPAF). Supplement for medicines for extremely rare conditions (ultra-orphan medicines). Glasgow; 2019. Available from:

  20. Nicod E, Kanavos P. Scientific and social value judgments for orphan drugs in health technology assessment. Int J Technol Assess Health Care. 2016;32:218–32.

    Article  Google Scholar 

  21. Federal Office of Public Health. Projects and measures under the National Rare Disease Policy. [Cited 2020 May 25]. Available from:

  22. Degtiar I. A review of international coverage and pricing strategies for personalized medicine and orphan drugs. Health Policy (New York). 2017;121:1240–8.

    Article  Google Scholar 

  23. Rosenberg-Yunger ZR, Daar AS, Thorsteinsdottir H, Martin DK. Priority setting for orphan drugs: an international comparison. Health Policy (New York). 2011;100:25–34.

    Article  Google Scholar 

  24. Denis A, Mergaert L, Fostier C, Cleemput I, Simoens S. A comparative study of European rare disease and orphan drug markets. Health Policy (New York). 2010;97:173–9.

    Article  Google Scholar 

  25. Bouslouk M. G-BA benefit assessment of new orphan drugs in Germany: the first five years. Expert Opin Orphan Drugs. 2016;116:147–53.

    Google Scholar 

  26. Kirchmann T, Ewald A, Schönermark M. Orphan drugs in Germany - lessons learned from AMNOG, best and worst practices and strategic implications. Value Health. 2018;21:S200.

    Article  Google Scholar 

  27. Facey K, Granados A, Guyatt G, Kent A, Shah N, Van Der Wilt GJ, et al. Generating health technology assessment evidence for rare diseases. Int J Technol Assess Health Care. 2014;30(4):416.

    Article  Google Scholar 

  28. NICE. Interim process and methods of the highly specialised technologies Programme updated to reflect 2017 changes; 2017. Available from:

    Google Scholar 

  29. Towse A, Garau M. Appraising ultra-orphan drugs: is cost-per-QALY appropriate? A review of the evidence; 2018. Available from:

    Google Scholar 

  30. Richter T, Janoudi G, Amegatse W, Nester-Parr S. Characteristics of drugs for ultra-rare diseases versus drugs for other rare diseases in HTA submissions made to the CADTH CDR. Orphanet J Rare Dis. 2018;13:15.

    Article  Google Scholar 

  31. Eunethta. Post Launch Evidence Generation activities. [cited 2020 Jun 5]. Available from:

  32. Modifications to the ICER value assessment framework for treatments for ultra-rare diseases. 2017. Available from:

  33. Drummond MF. Challenges in the economic evaluation of orphan drugs. Eurohealth (Lond). 2008;14:1.

    Google Scholar 

  34. Daniels N, Sabin JE. Accountability for reasonableness: an update. BMJ. 2008;337:a1850.

    Article  Google Scholar 

  35. Beneluxa. [Cited 2020 May 28]. Available from:

  36. Finose - Process for joint assessment. 2018 [Cited 2020 May 28]. Available from:

  37. Valletta Declaration on Strengthening Euro-Mediterranean Cooperation through Research and Innovation. 2017 [Cited 2020 May 28]. Available from:

  38. Eunethta. 2018 [Cited 2020 May 28]. Available from:

Download references


We would like to thank all country experts for their time and valuable contribution in providing the information used to create the country vignettes and validate this vignette. Specifically: Claudia Wild, Inneke van Vijver, Tatyana Benicheva, Brendan McIntosh, Sylvie Bouchard, Erki Laimae, Piia Rannanhaimo, Carine Busin, Anne d’Andon, Gergo Meresz, Sveinbjorn Hognason, Panos Kanavos, Entela Xoxi, Diana Araja, Stefan Tomaselli, Andrius Vagoras, Andrej Janžič, Antonia Formosa, Angel Link, Ben Campbell Macdonald, Ana Zaremba, Aneta Lipinska, Claudia Santo, Ileana Mardare, Elena Marusakova, Thomas Fankhauser, Mercè Obach and Jan Jones. A special thanks also to the IMPACT-HTA team for their input throughout the creation of the vignettes, specifically to Sheela Upadhyaya and Jaime Espin.


This research was funded by the European Commission’s Horizon 2020 research and innovation programme and was undertaken under the auspices of IMPACT-HTA (Grant number 779312). The results presented here reflect the authors’ views and not the views of the European Commission. The European Commission is not liable for any use of the information communicated.

Author information

Authors and Affiliations



EN, AW, MD, KF contributed to the conception and design of the work; EN, AW collected the data; MD, KF reviewed the data collected; EN, AW, MD, KF contributed to the data analysis; EN, AW, MD, KF have drafted the work or substantively revised it. EN, AW, MD, KF have approved the submitted version; EN, AW, MD, KF have agreed both to be personally accountable for the author’s own contributions and to ensure that questions related to the accuracy or integrity of any part of the work, even ones in which the author was not personally involved, are appropriately investigated, resolved, and the resolution documented in the literature. The authors read and approved the final manuscript.

Corresponding author

Correspondence to Elena Nicod.

Ethics declarations

Ethics approval and consent to participate

The primary data was collected from country experts via a questionnaire, and follow-up and validation questions either via email or Skype. Ethics approval was required for this. An information sheet and an informed consent form were developed according to the Bocconi ethics guidance. Ethics approval was received by the Bocconi Ethics Committee on May 9th 2018, after which additional modifications were implemented to be in line with the General Data Protection Regulation end of May.

Consent for publication

Not applicable.

Competing interests

EN is part time employed and AW is contracted on a project base by Dolon Ltd. They do not have any competing interests with this work. MD and KF do not have any conflict of interests to declare.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nicod, E., Whittal, A., Drummond, M. et al. Are supplemental appraisal/reimbursement processes needed for rare disease treatments? An international comparison of country approaches. Orphanet J Rare Dis 15, 189 (2020).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: