Volume 7 Supplement 2

6th European Conference on Rare Diseases and Orphan Products

Open Access

Listening to children’s and parents’ voices: using patient reported outcomes to empower patients with orphan diseases and their parents

Orphanet Journal of Rare Diseases20127(Suppl 2):A30

DOI: 10.1186/1750-1172-7-S2-A30

Published: 22 November 2012


Systematic evaluation of outcomes is essential for clinical trial research, yet outcomes often neglect the voice of the child and parent, particularly within paediatric orphan diseases.

While guidance for the development and validation of Patient Reported Outcomes (PROs) and Observer Reported Outcomes (ObsRO) measures are available from EMA and FDA , little attention has focused on paediatric and orphan disease PRO/ObsRO development methods[1, 2].


We summarize considerations for the development, validation and use of paediatric measures and provide examples of their successful use.


Table 1 provides the recommended steps for PRO/ObsRO development, as well as the challenges and potential solutions in PRO/ObsRO development in paediatrics and orphan diseases. When developing paediatric measures, it is critical to use developmentally appropriate language and techniques to ensure measures have content validity and will be reliable and valid.
Table 1

Challenges and potential solutions for PRO/ObsRO development and implementation in paediatrics and orphan indications

Steps to PRO/ObsRO development



Literature Review/Desk Research

• Literature often limited

• Broad age ranges covered

• Consider grey literature (blogs, dissertations)

• Conduct interviews with expert clinicians, nurses and patient advocacy groups

Concept Elicitation

• Limitations in memory, cognitive ability, language by age/condition

• Children can be shy

• Rarity of condition makes recruitment/saturation hard to achieve

• Parents unable to report some symptoms/domains not known to them

• Carefully guided interview guides and well trained interviewers

• Creative interview techniques, toys and drawings

• Collapse age groups where appropriate

• Must achieve saturation within each narrow age range – can this be relaxed for orphan indications? Get FDA feedback early

• Consider other respondents (teachers, nanny etc)

Selection/ development of a measure

• Few disease specific measures exist in paediatrics and orphan diseases

• Existing instruments don’t meet FDA/EMA guidance

• Who is the best respondent?

• How should you administer the questionnaire?

• How should the questionnaire be worded?

• Child can’t remember without a concrete event to recall to

• Parent items must be observable….but they may not be with the child all day

• Think about PRO selection early

• Talk to patient advocacy groups

• Engage FDA early

• Consider EPRO vs pen/paper vs IVRS in context of condition and age of child

• Questions/responses should be clear and simply worded

• Short recall period required

• Consider all types of respondents (parent, teacher, nurse, child, dr)

• Consider ‘child told me’ questions

Cognitive debriefing/ content validity testing

• Hypothetical situations don’t work with children

• Children give you answers they think you want to hear

• Small sample sizes in rare conditions

• Allow child to complete diaries at home for a few days prior

• Use carefully worded interview guides and well trained interviewers

• Questioning should not be too repetitive nor lengthy

• When analysing, check for consistency between behaviour and responses

• Collapse age groups as appropriate

Psychometric validation

• Sample should be stratified by age group, but small samples in orphan indications

• Consider validating as part of trial and/or include data from cognitive debriefing (move forward at risk)

• Consider collapsing across age groups

• Consult regulatory early

• Utilize psychometrics done in other diseases if adapting a measure

Concept elicitation (using qualitative research) and psychometric validation require samples sizes within narrow age bands (0-2, 3-5, 6-8, 9-11, 12-14, 15-17), but also need to consider rates of development within the context of the condition being studied. From 0-5 years, parents are asked about child behaviours they observe that are indicative of symptoms or impact. For 6-11 years, the child and parent should be asked though simple questions, with images attached to responses, should be used for the child. For 12-17 years, more adult language (without jargon) can be used. Pooling data across ages can only be considered if different age versions are shown to be conceptually equivalent.

PROs have been used to aid decision making for regulatory approval (as in the case of Icatibant for the treatment of Heriditary Angioedema)[35] and reimbursement (as in the case of Exjade for the treatment of iron overload for B-thallaesemia and sickle cell disease)[6, 7].


Strong paediatric PRO/ObsRO research is needed to ensure ‘fit for purpose’ outcomes are used in paediatric trials to collect robust evidence regarding the safety and efficacy of drugs for children who have orphan diseases. When successfully implemented, all stakeholders benefit: regulators, payers, doctors, parents and most importantly, the children themselves.

Authors’ Affiliations

Rob Arbuckle, Adelphi Values


  1. US Department of Health and Human Services, Food and Drug Administration: Guidance for Industry: Patient-reported outcome measures: use in medical product development to support labeling claims. 2009, Available at http://www.fda.gov/downloads/Drugs/GuidanceComplianceRegulatoryInformation/Guidances/UCM193282.pdfAccessed January 20, 2012Google Scholar
  2. EMEA: Reflection paper on the regulatory guidance for the use of health-related quality of life (HRQL) measures in the evaluation of medical products. Available at: http://www.ispor.org/workpaper/emea-hrql-guidance.pdf
  3. Fierce Bio tech;FDA advisory committee strongly recommends approval and self-administration of FIRAZYR (icatibant). 2011, Fierce Biotech, [http://www.fiercebiotech.com/press-releases/fda-advisory-committee-strongly-recommends-approval-and-self-administration]
  4. FDA Pulmonary-Allergy Drugs Advisory Committee Meeting Transcripts. 2011. [http://www.fda.gov/downloads/AdvisoryCommittees/CommitteesMeetingMaterials/Drugs/Pulmonary-AllergyDrugsAdvisoryCommitee/UCM266639.pdf]
  5. Committee for orphan medicinal products public summary of positive opinion for orphan designation of icatibant acetate for treatment of angioedema. [http://www.ema.europa.eu/docs/en_GB/document_library/Orphan_designation/2009/11/WC500006538.pdf]
  6. Cappellini MD, Bejaoui M, Agaoglu L, Porter J, Coates T, Jeng M: Prospective evaluation of patient-reported outcomes during treatment with deferasirox or deferoxamine for iron overload in patients with beta-thalassemia. Clin Ther. 2007, 29: 909-917. 10.1016/j.clinthera.2007.05.007.View ArticlePubMedGoogle Scholar
  7. SMC approves Exjade: No more needles in Scotland - good news for peopel with sickle cell disease and thalassaemia. Blood Medical News. 2011, [http://anticariat-online.info/?p=598]Google Scholar


© Abetz-Webb; licensee BioMed Central Ltd. 2012

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.