Development and psychometric validation of measures to assess the impact of phenylketonuria and its dietary treatment on patients’ and parents’ quality of life: the phenylketonuria – quality of life (PKU-QOL) questionnaires
Orphanet Journal of Rare Diseases volume 10, Article number: 59 (2015)
The aim of our study was to develop and validate the first set of PKU-specific Health-related Quality of Life (HRQoL) questionnaires that: 1) were developed for patients with PKU and their parents, 2) cover the physical, emotional, and social impacts of PKU and its treatment on patients’ lives, 3) are age specific (Child PKU-QOL, Adolescent PKU-QOL, Adult PKU-QOL), 4) enable the evaluation of the HRQoL of children by their parents (Parent PKU-QOL), and 5) have been cross-culturally adapted for use in seven countries (i.e. France, Germany, Italy, The Netherlands, Spain, Turkey and the UK).
The PKU-QOL questionnaires were developed according to reference methods including patients’, parents’ and healthcare professionals’ interviews; testing in a pilot study (qualitative step in six countries), and linguistic validation of the finalised pilot versions in Turkish. For finalisation and psychometric validation, the pilot versions were included in a multicentre, prospective, non-interventional, observational study conducted in 34 sites in France, Germany, Italy, The Netherlands, Spain, Turkey and the UK. Iterative multi-trait analyses were conducted. Psychometric properties were assessed (concurrent and clinical validity, internal consistency reliability and test-retest reliability).
Data from 559 subjects (306 patients, 253 parents) were analysed. After finalisation, the PKU-QOL questionnaires included 40 items (Child PKU-QOL), 58 items (Adolescent PKU-QOL), 65 items (Adult PKU-QOL) and 54 items (Parent PKU-QOL), distributed in four modules: PKU symptoms, PKU in general, administration of Phe-free protein supplements and dietary protein restriction. The measurement properties of the Adolescent, Adult and Parent PKU-QOL questionnaires were overall fairly satisfactory, but weaker for the Child questionnaire.
The four PKU-QOL questionnaires developed for different ages (Child PKU-QOL, Adolescent PKU-QOL, Adult PKU-QOL), and for parents of children with PKU (Parent PKU-QOL) are valid and reliable instruments for assessing the multifaceted impact of PKU on patients of different age groups (children, adolescents and adults) and their parents, and are available for use in seven countries. They are very promising tools to explore how patients’ perceptions evolve with age, to increase knowledge of the impact of PKU on patients and parents in different countries, and to help monitor the effect of therapeutic strategies.
Phenylketonuria (PKU, OMIM 261600) is a rare genetic disorder (with an incidence of 1 in 10,000 births in Europe ) characterised by a deficiency of the hepatic enzyme, phenylalanine hydroxylase (PAH, EC 18.104.22.168), responsible for the conversion of the essential amino acid phenylalanine (Phe) into tyrosine. The absence of or deficiency in PAH results in increased blood concentrations of Phe and toxic accumulation in the brain. If left untreated, PKU may lead to intellectual impairment, deficit in cognitive functions, seizures, behavioural problems and psychiatric symptoms [2,3]. Historically, PKU can be classified by Phe level at the time of diagnosis, with levels 360–1200 μmol/L being classified as mild-moderate PKU and >1200 μmol/L as classical PKU.
With the implementation of new-born screening programmes and early diagnosis and treatment, patients with PKU can develop normally. Current treatment for PKU includes a life-long diet highly restrictive in Phe, supported nutritionally with a Phe-free protein supplement (medical food, metabolic formula, amino acid mixtures), and excluding high protein foods such as meat, fish, eggs, cheese, milk products and bread . Recent and on-going development of pharmacological treatment tools may allow modification of dietary restriction, but do not yet consistently allow discontinuation of traditional diet therapy.
However, even when treated, PKU may have an impact on neurocognitive and psychosocial outcomes. In a meta-analysis examining neuropsychological outcomes in early and continuously treated adolescents and adults, Moyle et al.  demonstrated that patients with PKU differed significantly from controls on Full-Scale IQ, processing speed, attention, inhibition, and motor control. Psychological disorders such as low self-esteem, lower achievement motivation, decreased autonomy and decreased social competence have been reported in early-treated children, and adolescents and adults may be at risk for depressed mood, generalized anxiety, and social isolation [6,7].
The management of PKU is complex, requiring adherence to diet therapy and Phe-free protein supplement intake, regular collection of blood samples, recording of food intake, and regular visits to the PKU clinic . Adherence to the diet is especially important during the early childhood years since cognitive outcomes are closely related to the control of blood phenylalanine levels , and should be maintained through adulthood to protect from neuropsychological dysfunction [10,11,5,12]. However, the strict low-Phe diet imposes a burden on patients and their families and has been associated with dietary non-compliance, especially in adolescents and young adults [10,13-15]. Primary obstacles to better adherence include time constraints and stress associated with food preparation and record-keeping, and the restrictions imposed on social life .
For years, preventing intellectual impairment has been the primary goal of PKU treatment. At present, ‘a life as normal as possible’ is an additional goal of therapy , aiming not only for normal neuropsychological test outcomes, but also for normal quality of life . Health-related quality of life (HRQoL) has been defined as a broad and multidimensional concept representing the patient’s subjective perception of the impact of his disease and its treatment(s) on his daily life, physical, psychological and social functioning and well-being . HRQoL studies focusing on patients with PKU and their parents are still scarce [18-22,11,23-27]. Most studies suggest that the HRQoL of patients with PKU is comparable to that of the general population [18,19,21,11,23,24,26] with the exception of a lower HRQoL demonstrated in a group of Italian children , a low score on the cognitive domain in adults , and of severe to moderate distress in 45% of non-compliant adults patients . Parents of children with PKU perceive their HRQoL positively overall even though it may be affected by the emotional and social impact of parenting a child with PKU [22,25]. These studies all used generic measures of HRQoL, i.e. questionnaires intended for use irrespective of the underlying disease. The positive HRQoL results observed in patients with PKU may, at least in part, be caused by the fact that these questionnaires may be not be sensitive enough to allow detection of the specific or subtle problems of patients with PKU[29-31]. A PKU-specific HRQoL questionnaire developed with and for patients with PKU will allow their experience to be more accurately captured, with all its complexity. Therefore, such an instrument will be able to detect decrements in specific domains of the life of patients with PKU as well as potential improvements in these domains due to therapeutic interventions. In addition, a PKU-specific questionnaire will make more sense to patients with PKU, which will certainly lead them to naturally adhere to the questionnaire and therefore generate better data.
The aim of our study was to develop and validate the first set of PKU-specific HRQoL questionnaires that: 1) were developed with patients with PKU and their caregivers for children, 2) identify the physical, emotional, and social impacts characteristic for PKU and its treatment on patients’ lives, 3) are age specific (Child PKU-QOL, Adolescent PKU-QOL, Adult PKU-QOL), 4) enable the evaluation of the HRQoL of children by their parents (Parent PKU-QOL), and 5) are cross-culturally adapted to seven countries (i.e. France, Germany, Italy, The Netherlands, Spain, Turkey and the UK).
Development of the questionnaires
The questionnaires were developed in a sequential four step approach. The first step included exploratory interviews (in 2007) with patients with PKU, parents (and healthcare professionals). Interviews were carried out simultaneously in France, Germany, Spain and the UK (Table 1). These interviews collected disease-related concepts important to patients and their parents regarding the impact of PKU and its treatment (i.e. diet and Phe-free protein supplements) on their life. The thematic analysis of the qualitative information collected with both patients, parents and healthcare professionals during this first phase allowed the creation of conceptual models of the impact of PKU and its treatment for patients and parents (Figure 1).
As a second step, question items were generated based on the conceptual models in six languages (Dutch [The Netherlands], English [UK], French [France], German [Germany], Italian [Italy] and Spanish [Spain]). These formed the content of four questionnaires: one for children, adolescents, adults and parents (to assess their child’s as well as their own HRQoL). After item generation, the preliminary test versions of the questionnaires were reviewed and refined by native speakers of each language to produce the final test versions. The third step, comprehension testing, aimed at checking the acceptability of the questionnaires, the relevance and understanding of the items and response choices, the comprehensiveness of the questions, and opinions regarding format and layout, and suggestions for rewording of questionnaires if applicable. Ninety-seven interviews were conducted in The Netherlands, Germany, Italy, Spain, France and the UK (Table 1). Overall, the questionnaires were well accepted and understood by participants. However, children younger than 9 years of age showed some difficulty in understanding the questionnaire by themselves, and therefore the age range of the child version, originally planned for children aged 6–11 years, was narrowed to 9–11 years. Based on participants’ input and on experts’ experience, the test versions were modified to produce pilot versions appropriate for the validation study. The pilot versions of the PKU-QOL questionnaires (Child, Adolescent, Adult and Parent) contained 43, 62, 70 and 55 items, respectively. Items were divided into sections assessing patients’ health, PKU diet and Phe-free protein supplements, patient’s/parent’s daily life with PKU, and patient’s/parent’s general feeling about PKU. The recall period focused on the past seven days for all sections except for ‘patient’s/parent’s general feeling ’ where the recall period was ‘in general’. Items had a 5-point Likert-type intensity or frequency response scale with an additional “Does not apply” or “I don’t…/My child doesn’t” response to some questions.
The final step of questionnaire development involved linguistic validation of the pilot versions of the PKU-QOL questionnaires into Turkish following a standardised and rigorous process that provides a language version that is consistent, comparable and conceptually equivalent to the original instruments [32,33]. As part of this process, interviews were conducted to test the wording of the questionnaires with Turkish patients or parents of children with PKU (Table 1).
A PKU-QOL Steering Committee (composed of ABu, AC, ABo and Pr. Peter Burgard) was convened at each key milestone of the development of the questionnaires to provide expert insight regarding: development of conceptual models, item generation and comprehension testing. The PKU-QOL Steering Committee was also convened for the design and interpretation of the validation study of the PKU-QOL questionnaire.
Validation study design
From December 2011 to November 2012, a multicentre, prospective, non-interventional, observational study was conducted in 34 sites in France, Germany, Italy, The Netherlands, Spain, Turkey and the UK to finalise and validate the PKU-QOL questionnaires. More specifically, the primary objectives of the observational study were: (1) to define the scoring rules of the four PKU-QOL questionnaires (how items are grouped into domains); and (2) to assess the psychometric properties of these four questionnaires, namely validity (clinical validity and concurrent validity) and reliability (internal consistency reliability and test-retest reliability). Characterisation of the HRQoL of patients with PKU was a secondary objective of the study, with results presented elsewhere .
To be included, patients needed to be aged ≥9 years old, with confirmed diagnosis of PKU and treated for PKU with a Phe-restricted diet and/or Phe-free protein supplement and/or pharmacological therapy. To be included, parents needed to be parents of at least one patient aged <18 years old treated for PKU with a Phe-restricted diet and/or Phe-free protein supplement and/or pharmacological therapy. Patients and parents were excluded if they had a significant psychiatric disorder or conditions preventing their participation as per physician’s judgment, a history of alcohol or drug abuse in the 12 previous months or current abuse, or if they were already included in an interventional clinical trial. In addition, parents were excluded if they were diagnosed with PKU.
Three groups of patients with PKU were recruited based on age: children (9–11 years), adolescents (12–17 years) and adults (≥18 years). In addition, parents of included children and adolescents were asked to participate in the study. To supplement this study group and validate the parent questionnaire for parents of children of all ages, parents of children <9 years of age were also included, although children < 9 years were not considered able to complete the child questionnaire.
Patients/parents were asked to complete the PKU-QOL questionnaire twice (at baseline and after 2 weeks), and a generic questionnaire at baseline (Children and adolescents completed the Pediatric Quality-of-Life Inventory (PedsQL) , adult patients completed the Medical Outcome Survey 36 item Short Form (SF-36)  and Parents of patients with PKU completed the Child Health Questionnaire 28 item Parent Form (CHQ-PF28) ). They completed the questionnaires at home and mailed them. For each recruited patient, the physician was asked to complete a short case report form with clinical and demographic information on the patient and parent.
The study was performed in accordance with good clinical practices and in compliance with local regulatory requirements. The appropriate national authorities and institutional review boards approved the protocol before study commencement. All patients or their legally authorised representatives provided written informed consent before participation in the study.
The validation study protocol was submitted to the Conseil National de l’ordre de Médecins (CNOM) in France, to the Ethik-Kommission an der Medizinischen Fakultät der Universität Leipzig, Ethikkommission der Medizinischen Fakultät Heidelberg, Ethik-Kommission der MHH, Ethik-Kommission des Fachbereichs Medizin der Johann Wolfgang Goethe- Universität, Ethik-Kommission der Ärztekammer Westfalen-Lippe und der medizinischen Fakultät der Westfälischen Wilhelms Universität Münster and Ethik-Kommission bei der Landesärztekammer Baden-Württemberg in Germany, to the Comitato Etico della Azienda Ospedaliero-Universitaria di Bologna, Comitato Etico per la Sperimentazione Clincal della Provincia di Vicenza, Comitato Etico per la Sperimentazione della Azienda Ospedaliera di Padova, Comitato Etico della ASL NA/1 di Napoli, Comitato di Etica dell 'IRCCS Istituto Giannina Gaslini de Genova' and Comitato Etico Dell 'Azienda Policlinico Umberto I Di Roma' in Italy, to the Academisch Medisch Centrum Amsterdam, Universitair Medisch Centrum Groningen and Academisch Ziekenhuis Maastricht (AZM) in the Netherlands, to CCAA Andalucía, CCAA Galicia, CCAA Aragón, CCAA Baleares, CCAA Pais Vasco and H. Univ Virgen del Rocio in Spain, to Istanbul University Cerrahpasa Medical Faculty Ethic Committee in Turkey, to R&D of Glasgow Royal Infirmary, R&D of Central Manchester University Hospitals NHS Foundation Trust, R&D of University Hospitals Bristol and Guy's & St Thomas' Hospital NHS Foundation Trust in the UK.
Scaling structure and the scoring rules of the four PKU-QOL questionnaires
Item selection and creation of the scoring method were based on the quality of completion of the items, the distribution of the responses, and the initial hypothesised structure of the questionnaires.
Multi-trait analysis  was used to test the association between single items and the grouping of items into domains. This method is based on the analysis of the correlations between each item and each subscale according to the following principles: each item should be strongly correlated with its own scale –correlation coefficient greater than 0.4 are expected  – (item convergent criterion) and should be more correlated with its own scale than with others (item discriminant criterion). Iterative applications of the multi-trait analysis were performed with the following constraints: the structure should accurately reflect conceptual preconceptions and be kept as similar as possible across the four questionnaires, and the different areas explored by the questionnaire (i.e. PKU symptoms, impact of PKU and its management, dietary protein restrictions, administration of Phe-free protein supplements) should be kept separate.
Assessment of psychometric properties
The psychometric validation included assessment of reliability (internal consistency reliability and test-retest reliability) and validity (concurrent validity and clinical validity). Internal consistency reliability was estimated using Cronbach’s alpha . Test-retest reliability is defined as the extent to which the questionnaire leads to the same results on repeated assessments over short periods of time. The PKU-QOL questionnaires were administered twice (i.e. baseline and Week 2) to allow the assessment of test-retest reliability which was measured by calculating the Intraclass Correlation Coefficient (ICC) . A recommended threshold for reliability coefficients (i.e. Cronbach’s alpha or ICC) is 0.7 .
Validity is defined as the accuracy with which a measurement tool measures the concept it is intended to measure. Concurrent validity was evaluated by investigating the association between PKU-QOL scores and scores of generic HRQoL questionnaires corresponding to each age group: the Pediatric Quality-of-Life Inventory (PedsQL) for children and adolescents , the 36-item Short Form (SF-36) Health Survey  for adults, and the Child Health Questionnaire–Parent Form 28 (CHQ-PF28)  for parents, using Spearman correlation coefficients. The hypothesis was that domains measuring related concepts have high correlation levels while domains measuring different concepts have low correlations. For clinical validity, the associations between PKU-QOL scores with severity of PKU (Phe levels at diagnosis), using a t-test, and with overall assessment of patient’s health status as rated by the investigator who recruited the patient (i.e., “In general, how would you rate the overall health status of your patient?” Poor/Fair/Good/Very good/Excellent), using an analysis of variance (ANOVA), were observed. The patients with worse health status or more severe PKU were expected to have worse HRQoL.
Population characteristics in the validation study
Of the 617 subjects recruited in the study, 559 returned a PKU-QOL questionnaire and were used in the analyses: 306 patients with PKU and 253 parents of patients with PKU. The patient population included 92 children aged 9 to 11 years, 110 adolescents aged 12 to 17 years and 104 adults older than 18 years of age. The Parent population included the parents of 201 subjects from the child or adolescent population, and 52 additional parents of children younger than 8 years old. See Table 1 for a repartition by age group and country.
Patients who completed the PKU-QOL were aged between 9 and 45 years (Table 2). The age distribution in the child and adolescent populations covered the full age range (9–11 and 12–17 years), with a mean age in the middle of this range (9.8 years for children and 14.5 years for adolescents). The mean age of adult PKU patients was 25.8 years. Parents were between 24 and 66 years old, with a mean age of 41.6 years, and their children had a mean age of 10.7 years. There were about as many male as female patients in both the child and adolescent groups (46.7% and 50.9% males, respectively), whereas there were more females than males in the adult and parent groups (63.5% and 72.7% females, respectively).
More than two-thirds of the patients (68%) had classic PKU (characterized by blood Phe level at diagnosis >1200 μmol/L). This proportion of patients with classic PKU was fairly stable across all age groups.
Almost all patients were following dietary restriction (94.1%) and were taking Phe-free protein supplements (89.2%), and 22.5% were receiving pharmacological therapy, tetrahydrobiopterin (BH4).
Scaling structure and scoring rules
The return rate of the PKU-QOL questionnaires was 90% at baseline and 77% at Week 2, indicating a good acceptability of the questionnaire by patients and their parents. The return rate was notably lower at both time points (81% [baseline] and 63% [Week 2]) for parents of young children (8 years old or younger).
Quality of completion
On average, there were 1.6, 3.0, 1.4 and 2.4 missing items in the Child PKU-QOL, Adolescent PKU-QOL, Adult PKU-QOL and Parent PKU-QOL, respectively. Given the relatively high number of items in the questionnaires, this represented a small number of missing data (<5% of the items for all versions). The items that had a higher level of missing data were those asking about the ‘attribution’ of a symptom to PKU (e.g. ‘If you had headaches, do you think it was related to PKU?’). These were systematically missing for more than 10% of the patients. This could be due to a difficulty in understanding those questions, or in attributing a symptom to the disease.
Distribution of responses
The distribution of the responses was skewed towards the most positive response options for a large majority of items. The items with the most severely skewed response distribution were listed and reviewed by the PKU-QOL Steering Committee to determine whether they were non-informative and could be deleted from the questionnaire or were considered a key concept that should be retained in the final questionnaire. Eight items with severely skewed distribution were identified in the Child PKU-QOL questionnaire, seven in the Adolescent PKU-QOL, 14 in the Adult PKU-QOL and two in the parent versions. Among these, three were deleted after PKU-QOL Steering Committee appraisal in the Child PKU-QOL questionnaire (‘Nausea’; ‘Participating in activities at school’; ‘Difficulty to do other things due to burden of care for PKU’), four in the Adolescent PKU-QOL questionnaire (‘Nausea’; ‘Participating in activities at school’; ‘Difficulty to do other things due to burden of care for PKU’, ‘Difficulty starting romantic relationships’), five in the Adult PKU-QOL questionnaire (‘Nausea’, ‘Participating in activities at school’, ‘Difficulty to do other things due to burden of care for PKU’, ‘Difficulty starting romantic relationships, ‘missing supplements because of college/university constraints’) and one in the Parent PKU-QOL questionnaire (‘Nausea’).
The four questionnaires were structured in four modules: PKU symptoms, PKU in general, administration of Phe-free protein supplements and dietary protein restriction (see Table 3 for the final scaling structure of the four questionnaires). Iterative multitrait analyses led to the grouping of items in domains within each module. Results of the final multitrait analyses for each module of each version of the PKU-QOL questionnaire are provided as Additional file 1.
The ‘PKU symptoms’ module consists of single-item symptom scores.
The domains related to the ‘PKU in general’ module include the following PKU impact scores: practical, social, emotional and overall impact of PKU. In addition, additional specific scores were created: anxiety due to blood tests, and anxiety due to high blood Phe levels. The adult and parent versions included single-item scores assessing the level of information on PKU and the financial impact of PKU, and the parent version included an extra score for the impact on the parent owing to the child’s anxiety towards blood tests.
The domains related to the module ’administration of Phe-free protein supplements’ include scores of adherence to Phe-free protein supplements, score on guilt due to poor adherence to Phe-free protein supplements, and scores of impact of Phe-free protein supplements on daily life and family.
Finally, the domains related to the ‘dietary protein-restrictions’ module included scores on food temptations (except for parents), adherence to dietary protein restrictions, overall difficulty following dietary restrictions, guilt if the diet is not followed, social impact of the diet, practical impact of the diet (except for children), food enjoyment and taste of specialty low-protein food products. An overall score gathering the two impact scores was also created.
For each item of the questionnaire, an item score ranging from 0 to 4 was obtained based on the response of the patient. Then, domain scores were calculated by summing the item scores and applying linear transformation to the sum to have all domain scores ranging from 0 to 100:
Each domain score is calculated only if at least 70% of the items of the domain have been completed; otherwise the domain score was set as missing.
The following interpretation rules were applied for all domain scores in a range from 0 to 100:
for symptom scores, a higher score is associated with more frequent symptoms,
for adherence scores, a higher score is associated with a poorer adherence,
for other scores, a higher score is associated with a greater impact.
Overall, the pattern of correlation between the scores of the PKU-QOL questionnaires and scores of the generic instruments was meaningful: the highest correlation coefficients were observed between scores supposed to assess close concepts. In particular, the ‘Emotional impact of PKU’ scores were well correlated with generic scores of ‘Emotional functioning’ (as measured by the PedsQL) in children and adolescents (see Table 4) and with the generic score of ‘Parental emotional impact’ in parents (as measured by the CHQ-PF28) (see Table 5). In adults, the PKU-QOL score ‘Overall impact of PKU’ was correlated with the ‘General health’ score of the SF-36 (see Table 6).
For all PKU-QOL questionnaires, the disease symptom scores were among the scores with the highest correlations with generic HRQoL measures. This could be explained by the natural fairly direct relationship between the symptoms of a chronic disease like PKU and the HRQoL of patients coping with this disease. Conversely, the scores related to Phe-free protein supplements or dietary restrictions tap into domains of patients’ life that cannot be captured by the generic measures. This also justifies the need for specific measures of PKU to accurately reflect the impact of the disease.
Comparison of the PKU-QOL scores according to overall health status as rated by the investigator
PKU-QOL symptom scores and scores assessing the impact of PKU, which could be assumed to be related to a patient’s overall health status, tended to have lower medians in patients with better rating of health status. For example, the median ‘Overall impact of PKU’ score for adults with an ‘excellent’ health status was 18 while it was 27 for adults with ‘very good’ health status and 40 for those with a ‘good’ health status. In adolescents, the median ‘Overall impact of PKU’ score was 18 for patients with an ‘excellent’ health, 20 for those with a ‘very good’ health and 25 for those with a ‘good’ health. In children, the median ‘Overall impact of PKU’ score was 17 for patients with an ‘excellent’ health, 19 for those with a ‘very good’ health and 28 for those with a ‘good’ health. On the other hand, domain scores which were not expected to be directly related with global health status (scores related to the impact of Phe-free protein supplement intake or dietary protein restriction) showed little association with patient’s health status as assessed by the clinician.
Comparison of the PKU-QOL scores according to severity of PKU
No clear association between the PKU-QOL domain scores assessing the symptoms of PKU or the impact of PKU and the severity of PKU (as defined by blood Phe level at diagnosis) were observed. A consistent pattern emerged in the association between scores assessing the impact of Phe-free protein supplement and the severity of PKU: patients with classical PKU reporting a higher impact of Phe-free protein supplements. In particular, adolescent and adult patients with mild/moderate PKU had a median ‘Practical impact of supplements’ of respectively 6 and 13 while for those with classical PKU median was 19 in both groups. PKU-QOL scores assessing the aspects related to the diet were associated to the severity of PKU in adolescents and children: adolescents and children with classical PKU had a slightly poorer adherence to their diet and higher impact (social and emotional). However, this association pattern was not found in adults.
Internal consistency reliability
Internal consistency reliability of the majority of multi-item scores in adults, adolescents and parents was acceptable (above the threshold value of 0.70), even if some scores were not fully satisfactory (practical impact of PKU: Adolescent, α = 0.47; Adult, α = 0.50; and social impact of PKU: Adolescent, α = 0.45; Adult, α = 0.63). Reliability coefficients of the Child PKU-QOL scores were below the standards generally used. See Tables 7 and 8.
The analyses of the change in Child PKU-QOL scores between baseline and Week 2 for the child evaluable population showed ICCs below the threshold of acceptability for the majority of scores (0.21–0.67). The ICC exceeded the threshold for good test-retest reliability only for ‘Social impact of PKU’ (0.70), ‘Relationships within family because of supplements’ (0.72) and ‘Taste – supplements’ (0.81). See Table 7.
The ICC exceeded the threshold for good test-retest reliability for 14 of 31 Adolescent PKU-QOL scores (0.70–0.95), for 16 of 33 Adult PKU-QOL scores (0.70–0.87) and for 11 of 30 Parent PKU-QOL scores (0.70–0.85). See Tables 7 and 8.
The PKU-QOL questionnaires are disease specific questionnaires developed for and in collaboration with patients with PKU and parents of children with PKU to allow assessment of the impact of PKU on the HRQoL of patients. Three age-specific versions were developed for children, adolescents and adults with PKU, plus one version for parents of a child with PKU. All questionnaires were cross-culturally adapted in seven countries, by either simultaneous development (for the Netherlands, the UK, France, Germany, Italy and Spain) or proper linguistic validation (for Turkey). The impact of PKU on HRQoL being assumed to be a culturally sensitive concept, this approach was applied in an effort to optimise the cross-cultural validity of the measure. Nonetheless, even though this process is already very sophisticated and warrant a good level of cross-cultural validity of the instrument, it cannot definitely guarantee that the PKU-QOL is fully cross-culturally equivalent over all cultures (e.g. some very specific concepts in some cultures may have been missed since exploratory interviews were not conducted in all countries).
It was also decided from the beginning that the four questionnaires (child, adolescent, adult, and parent) would be similarly structured to facilitate use and comparison across all ages. While this put a constraint on the development and validation of the instrument, it is a clear strength of the questionnaire as it may further allow following patients longitudinally over time, e.g. from childhood to adulthood.
The conceptual model underlying the questionnaire was derived from the experience directly reported by the patients and parents, complemented by the opinion of healthcare professionals. The aspects to be assessed by the questionnaires appeared very clearly: PKU symptoms, impact of PKU on patients’ life and impact of the commonly used treatment options for PKU (namely dietary protein restriction and Phe-free protein supplement administration). Of note, the impact of other therapeutic interventions, in particular pharmacological treatment, did not appear as central in the experience of patients so was not included in the PKU-QOL questionnaire. This may be due to the fact that pharmacological treatment of PKU (i.e. BH4) was used in a minority of patients (e.g. it was the case of less than one fourth of patients in the validation study). Should pharmacological treatment of PKU become more frequent, an additional module might be developed for the PKU-QOL questionnaire to assess this aspect.
Hence, the novelty of the PKU-QOL questionnaires was that they have been developed for and with patients with PKU and parents of patients with PKU. This provides a strong advantage over generic HRQoL measures [19,25,26], questionnaires developed for unspecific chronic illness (e.g. Ulm Quality-of-Life Inventory for Parents of chronically ill children)  or even the more recent “PKU-specific” HRQoL questionnaire (PKU-QOLQ) , which had been adapted from a questionnaire used in another condition (juvenile diabetes) and thus had not been designed fully from the beginning for patients with PKU specifically. Because it is truly disease specific, the PKU-QOL questionnaire captures aspects that are important for PKU patients and their parents and impact their daily lives (e.g. dietary protein restriction, Phe-free protein supplement administration) that are not addressed by other HRQoL measures. Hence, the disease specific nature of the PKU-QOL allows a better acceptance of the questionnaire by patients (as demonstrated by the very good return rates and quality of completion in the validation study) and draws a more accurate picture of the impact of PKU on patients’ lives.
The measurement properties of the Adolescent, Adult and Parent PKU-QOL questionnaires were acceptable overall, although reliability of some scores (in particular single item scores) was not fully satisfactory. Measurement properties were also clearly weaker for the Child questionnaire. However, poorer results were expected for the Child questionnaire because measurement of concepts as complex as HRQoL is known to be challenging for children to self-report . The clinical validity of the PKU-QOL confirmed the hypothesis that more compromised HRQoL is found in patients with more severe classical PKU, and exhibiting worse health status. These findings tend to show that the PKU-QOL scores seem to capture the difference in the experience of patients with the management of their disease (diet and Phe-free protein supplement), as patients with classical PKU have a more strict management in terms of dietary restriction and Phe-free protein supplement intakes. Further analysis of PKU-QOL scores and comparisons according to PKU severity, treatment with pharmacological adjunctive treatment (e.g. BH4) and health status as assessed by a clinician is presented in details elsewhere .
A remarkable feature of the validation study of the PKU-QOL was that there were about as many males as females in the child and adolescent patient samples while there were substantially more women in both the adult and parent samples. This may reflect the higher number of female PKU patients who continue genetics care as adults, in particular due to the risks associated with pregnancy in PKU, and the persisting central role of mothers in the management of children.
A skewed distribution of responses was observed for most of PKU-QOL items. This finding was not unexpected given the overall good health status of the population of patients with PKU and limited impact of PKU or its treatment on the lives of many patients, which were reported previously and confirmed at all stages of our research. While this is not an issue in terms of measurement by the PKU-QOL questionnaire (since it reflects the reality of patients’ experience), from an analytical point of view, this may affect the estimation of correlation coefficients on items (e.g. in the multi-trait analysis) and even on scores (e.g. in the concurrent validity analysis): This could have weakened the convergent validity of results and could explain why the correlation between PKU-QOL scores and generic HRQoL measures could be regarded at best as moderate.
The validation study of the PKU-QOL had some features that potentially affected the results. First, even if this study cohort was large for a disease as rare as PKU (34 sites in seven countries), the samples available for the finalisation and validation of each version of the PKU-QOL questionnaire were relatively small for this kind of exercise, which generally requires at least 200 patients. However, these features were anticipated and addressed by using simple statistical methods adapted to small samples (such as rank order correlations). Second, the severity of PKU was only characterised in the study using Phe level at diagnosis. This decision was made in an effort to keep the study as simple as possible with the minimum burden on the clinicians, but another indicator of severity of PKU, Phe tolerance, might have allowed complementary analyses to be performed. Third, the study was conducted in seven countries with clearly different cultures. This should be considered as a strength of the PKU-QOL questionnaires as they have now been validated in diverse cultural settings. However, the cultural differences may also introduce some heterogeneity, adding on to the variability of the results, and potentially increasing the risk of loss of robustness of the data.
Future applications of these questionnaires include the possibility of further targeted evaluation of HRQoL as impacted by PKU throughout the lifespan. This would allow better understanding and documentation of the implications of traditional dietary therapy requirements, pharmacological treatment (e.g. BH4 supplementation) and characteristic psychological issues impacting HRQoL. These questionnaires allow prospective observations of HRQoL over time and evaluation of evolution of patients’ perceptions with age, as well as the assessment of differences between parents’ and patients’ perceptions. In addition, the availability of disease specific PKU-QOL questionnaires in seven languages will facilitate their comparative use across population included in international clinical trials, increase knowledge of the impact of PKU on the HRQoL of patients and parents in different countries, and allow exploring HRQoL cross-cultural differences in PKU patients and their parents. The PKU-QOL questionnaires may also help to monitor the efficacy of therapeutic and non-therapeutic (e.g. nutrition, psychotherapeutic consulting) treatment strategies by assessing their impact on HRQoL. Finally, clinical use of this questionnaire will help to address gaps in understanding between physicians, patients and parents concerning their perceptions of HRQoL as affected by PKU.
A better understanding of the impact of PKU on patients and their families still requires further research. To this end, we invite researchers to use the PKU-QOL questionnaires, which are the first validated questionnaires specifically developed for this purpose. Further data collection would create an additional body of evidence that will allow better understanding for patients, parents and physicians. This, in turn may allow improved quality and consistency of care in this chronic disease.
Our study aimed to develop and validate a disease specific PKU HRQoL questionnaire – the first self-administered questionnaire designed to comprehensively assess the impact of PKU and its treatment on the HRQoL of patients and their parents. The questionnaires were developed in seven languages, in four different populations: children aged 9–11 years (Child PKU-QOL), adolescents aged 12–17 years (Adolescent PKU-QOL), adults aged 18 years and above (Adult PKU-QOL), and parents of patients with PKU (Parent PKU-QOL). The four questionnaires assess comprehensively the different factors of life specific to PKU and the treatment required (such as symptoms and feelings, daily life, administration of Phe-free protein supplements, and dietary protein restriction), and share a very similar structure, but still reflect the specific realities of each of the populations. A comprehensive methodology was applied to validate the questionnaires in a prospective validation study demonstrating that all questionnaires had satisfactory measurement properties and can be used for evaluation of HRQoL in PKU patients and their parents. The PKU-QOL questionnaires will allow assessing and documenting how patients’ perceptions evolve according to age, increasing our knowledge of the impact of PKU on patients and parents’ life in different countries, and eventually helping monitor the efficacy of therapeutic strategies.
Intellectual property and condition of use
The PKU-QOL questionnaires are protected by international copyright – PKU-QOL © Merck Serono S.A. - Geneva – 2010-.
The PKU-QOL questionnaire is available freely for use in individual medical practice and in non-funded academic research. Access to the questionnaire, as well as further information on, or permission to use the PKU-QOL and/or its translations, can be found on http://www.proqolid.org.
Analysis of variance
- BH4 :
Child Health Questionnaire–Parent Form
Health-related quality of life
Intraclass correlation coefficient
Pediatric Quality-of-Life Inventory
PKU-specific self-report QOL questionnaire
Quality of life
36-item Short Form
Hardelid P, Cortina-Borja M, Munro A, Jones H, Cleary M, Champion MP, et al. The birth prevalence of PKU in populations of European, South Asian and sub-Saharan African ancestry living in South East England. Ann Hum Genet. 2008;72(Pt 1):65–71. doi:10.1111/j.1469-1809.2007.00389.x.
Blau N, Van Spronsen FJ, Levy HL. Phenylketonuria. Lancet. 2010;376(9750):1417–27. doi:10.1016/S0140-6736(10)60961-0.
Waisbren SE, Noel K, Fahrbach K, Cella C, Frame D, Dorenbaum A, et al. Phenylalanine blood levels and clinical outcomes in phenylketonuria: a systematic literature review and meta-analysis. Mol Genet Metab. 2007;92(1–2):63–70. doi:10.1016/j.ymgme.2007.05.006.
Poustie VJ, Rutherford P. Dietary interventions for phenylketonuria. Cochrane Database Systematic Reviews. 2000;2, CD001304. doi:10.1002/14651858.CD001304.
Moyle JJ, Fox AM, Arthur M, Bynevelt M, Burnett JR. Meta-analysis of neuropsychological symptoms of adolescents and adults with PKU. Neuropsychol Rev. 2007;17(2):91–101. doi:10.1007/s11065-007-9021-2.
Brumm VL, Bilder D, Waisbren SE. Psychiatric symptoms and disorders in phenylketonuria. Mol Genet Metab. 2010;99 Suppl 1:S59–63. doi:10.1016/j.ymgme.2009.10.182.
Gentile JK, Ten Hoedt AE, Bosch AM. Psychosocial aspects of PKU: hidden disabilities–a review. Mol Genet Metab. 2010;99 Suppl 1:S64–7. doi:10.1016/j.ymgme.2009.10.183.
MacDonald A, Gokmen-Ozel H, Van Rijn M, Burgard P. The reality of dietary compliance in the management of phenylketonuria. J Inherit Metab Dis. 2010;33(6):665–70. doi:10.1007/s10545-010-9073-y.
Waisbren SE, Mahon BE, Schnell RR, Levy HL. Predictors of intelligence quotient and intelligence quotient change in persons treated for phenylketonuria early in life. Pediatrics. 1987;79(3):351–5.
Belanger-Quintana A, Burlina A, Harding CO, Muntau AC. Up to date knowledge on different treatment strategies for phenylketonuria. Mol Genet Metab. 2011;104(Suppl):S19–25. doi:10.1016/j.ymgme.2011.08.009.
Gassio R, Campistol J, Vilaseca MA, Lambruschini N, Cambra FJ, Fuste E. Do adult patients with phenylketonuria improve their quality of life after introduction/resumption of a phenylalanine-restricted diet? Acta Paediatr. 2003;92(12):1474–8.
Van Spronsen FJ, Belanger-Quintana A. Outcomes of phenylketonuria with relevance to follow-up. JIMD reports. 2011;1:49–55. doi:10.1007/8904_2011_16.
Bilginsoy C, Waitzman N, Leonard CO, Ernst SL. Living with phenylketonuria: perspectives of patients and their families. J Inherit Metab Dis. 2005;28(5):639–49. doi:10.1007/s10545-005-4478-8.
Mutze U, Roth A, Weigel JF, Beblo S, Baerwald CG, Buhrdel P, et al. Transition of young adults with phenylketonuria from pediatric to adult care. J Inherit Metab Dis. 2011;34(3):701–9. doi:10.1007/s10545-011-9284-x.
Walter JH, White FJ, Hall SK, MacDonald A, Rylance G, Boneh A, et al. How practical are recommendations for dietary control in phenylketonuria? Lancet. 2002;360(9326):55–7.
Van Spronsen FJ, Burgard P. The truth of treating patients with phenylketonuria after childhood: the need for a new guideline. J Inherit Metab Dis. 2008;31(6):673–9. doi:10.1007/s10545-008-0918-6.
European Medicines Agency. Reflection paper on the regulatory guidance for the use of healthrelated quality of life (HRQL) measures in the evaluation of medicinal products - EMEA/CHMP/EWP/139391/2004. 2005. http://www.ema.europa.eu/docs/en_GB/document_library/Scientific_guideline/2009/09/WC500003637.pdf. Accessed Accessed 23 October 2014.
Bik-Multanowski M, Didycz B, Mozrzymas R, Nowacka M, Kaluzny L, Cichy W, et al. Quality of life in noncompliant adults with phenylketonuria after resumption of the diet. J Inherit Metab Dis. 2008;31 Suppl 2:S415–8. doi:10.1007/s10545-008-0978-7.
Bosch AM, Tybout W, Van Spronsen FJ, De Valk HW, Wijburg FA, Grootenhuis MA. The course of life and quality of life of early and continuously treated Dutch patients with phenylketonuria. J Inherit Metab Dis. 2007;30(1):29–34. doi:10.1007/s10545-006-0433-6.
Cotugno G, Nicolo R, Cappelletti S, Goffredo BM, Dionisi Vici C, Di Ciommo V. Adherence to diet and quality of life in patients with phenylketonuria. Acta Paediatr. 2011;100(8):1144–9. doi:10.1111/j.1651-2227.2011.02227.x.
Douglas TD, Ramakrishnan U, Kable JA, Singh RH. Longitudinal quality of life analysis in a phenylketonuria cohort provided sapropterin dihydrochloride. Health Qual Life Outcomes. 2013;11:218. doi:10.1186/1477-7525-11-218.
Fidika A, Salewski C, Goldbeck L. Quality of life among parents of children with phenylketonuria (PKU). Health Qual Life Outcomes. 2013;11:54. doi:10.1186/1477-7525-11-54.
Landolt MA, Nuoffer JM, Steinmann B, Superti-Furga A. Quality of life and psychologic adjustment in children and adolescents with early treated phenylketonuria can be normal. J Pediatr. 2002;140(5):516–21. doi:10.1067/mpd.2002.123663.
Simon E, Schwarz M, Roos J, Dragano N, Geraedts M, Siegrist J, et al. Evaluation of quality of life and description of the sociodemographic state in adolescent and young adult patients with phenylketonuria (PKU). Health Qual Life Outcomes. 2008;6:25. doi:10.1186/1477-7525-6-25.
Ten Hoedt AE, Maurice-Stam H, Boelen CC, Rubio-Gozalbo ME, Van Spronsen FJ, Wijburg FA, et al. Parenting a child with phenylketonuria or galactosemia: implications for health-related quality of life. J Inherit Metab Dis. 2011;34(2):391–8. doi:10.1007/s10545-010-9267-3.
Thimm E, Schmidt LE, Heldt K, Spiekerkoetter U. Health-related quality of life in children and adolescents with phenylketonuria: unimpaired HRQoL in patients but feared school failure in parents. J Inherit Metab Dis. 2013;36(5):767–72. doi:10.1007/s10545-012-9566-y.
Ziesch B, Weigel J, Thiele A, Mutze U, Rohde C, Ceglarek U, et al. Tetrahydrobiopterin (BH4) in PKU: effect on dietary treatment, metabolic control, and quality of life. J Inherit Metab Dis. 2012;35(6):983–92. doi:10.1007/s10545-012-9458-1.
Demirdas S, Maurice-Stam H, Boelen CC, Hofstede FC, Janssen MC, Langendonk JG, et al. Evaluation of quality of life in PKU before and after introducing tetrahydrobiopterin (BH4); a prospective multi-center cohort study. Mol Genet Metab. 2013;110(Suppl):S49–56. doi:10.1016/j.ymgme.2013.09.015.
Briançon S, Gergonne B, Guillemein F, Empereur F, Klein S. Disease-Specific Versus Generic Measurement of Health-Related Quality of Life in Cross-Sectional and Longitudinal Studies: an Inpatient Investigation of the SF-36 and Four Disease-Specific Instruments. In: Mesbah M, Cole BF, Ting Lee ML, editors. Statistical Methods for Quality of Life Studies. Boston: Kluwer Academic Publisher; 2002. p. 87–99.
Guyatt GH, Juniper EF, Walter SD, Griffith LE, Goldstein RS. Interpreting treatment effects in randomised trials. BMJ. 1998;316(7132):690–3.
Patrick DL, Deyo RA. Generic and disease-specific measures in assessing health status and quality of life. Med Care. 1989;27(3 Suppl):S217–32.
Acquadro C, Conway K, Giroudet C, Mear I. Linguistic Validation Manual for Health Outcome Assessments. Lyon: Mapi Institute; 2012.
Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of Good Practice for the Translation and Cultural Adaptation Process for Patient-Reported Outcomes (PRO) Measures: report of the ISPOR Task Force for Translation and Cultural Adaptation. Value Health. 2005;8(2):94–104. doi:10.1111/j.1524-4733.2005.04054.x.
Bosch AM, Burlina A, Cunningham A, Bettiol E, Moreau-Stucker F, Benmedjahed K, et al. Assessment of the impact of phenylketonuria and its treatment on quality of life of patients and parents from seven European countries. Orphanet Journal of Rare Disease. 2014.
Varni JW, Seid M, Rode CA. The PedsQL: measurement model for the pediatric quality of life inventory. Med Care. 1999;37(2):126–39.
Ware JE, Snow KK, Kosinski M, Gandek B. SF-36® Health Survey Manual and Interpretation Guide. Boston: New England Medical Center, The Health Institute; 1993.
Landgraf JM, Abetz L, Ware JE. The CHQ User’s Manual. Boston: New England Medical Center, The Health Institute; 1996.
Campbell DT, Fiske DW. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychol Bull. 1959;56(2):81–105.
Hays RD, Hayashi T. Beyond internal consistency reliability: rationale and user’s guide for Multitrait analysis program on the microcomputer. Behav Res Methods Instrum Comput. 1990;22(2):167–75.
Cronbach LJ, Warrington WG. Time-limit tests: estimating their reliability and degree of speeding. Psychometrika. 1951;16(2):167–88.
Deyo RA, Diehr P, Patrick DL. Reproducibility and responsiveness of health status measures. Statistics and strategies for evaluation. Control Clin Trials. 1991;12(4 Suppl):142S–58S.
Nunnally JC, Bernstein IH. Psychometric theory. 3rd ed. New York: McGraw-Hill Inc; 1994.
De Civita M, Regier D, Alamgir AH, Anis AH, Fitzgerald MJ, Marra CA. Evaluating health-related quality-of-life studies in paediatric populations: some conceptual, methodological and developmental considerations and recent applications. Pharmacoeconomics. 2005;23(7):659–85.
We want to thank all the physicians who participated in the study:
We want to thank the physicians who participated in the study: France: Jean-Baptiste Arnoux, Pierre Broué, François Feillet, François Labarthe, François Maillot, Karine Mention; Germany: Skadi Beblo, Peter Burgard, Anibh Das, Peter Freisinger, Jürgen Herwig, Franck Rutsch; Italy: Milva Orquidea Bal, Alessandro Burlina, Maria Teresa Carbone, Roberto Cerone, Vincenzo Leuzzi; Netherlands: Floris Hofstede, Estella Rubio, Francjan van Spronsen; Spain: Javier Blasco, Maria Bueno Delgado, Maria Luz Couce Pico, Maria García Jiménez, Maria Angeles Ruiz; Turkey: Turgay Coskun, Mubeccel Demirkol; United Kingdom: Peter Galloway, Andrew Morris, Germaine Pierre, Yusof Rahman.
We are also extremely grateful to the children and parents who have contributed to this study. Special thanks to Professor Peter Burgard (University of Heidelberg) for his valuable support during questionnaire development, study design, conduction and data interpretation. Béatrice Tugaut (Mapi) participated in the development of the PKU-QOL questionnaires; Fatoumata Fofana (Mapi) and Juliette Meunier (Mapi) participated in the statistical analysis and interpretation of results of the psychometric validation of the PKU-QOL questionnaires; Linda Abetz-Webb (formerly Mapi) participated in the development of the PKU-QOL questionnaires and interpretation of the psychometric validation results. We thank Catherine Acquadro (Mapi Research Trust) for her support in developing and finalising the manuscript.
This work was funded by Merck Serono SA Geneva, Switzerland, a subsidiary of Merck KGaA, Darmstadt, Germany.
ABo, ABu and AC received an honorarium from Merck Serono SA Geneva, a subsidiary of Merck KGaA, Darmstadt, Germany for their scientific advice and expertise. EB was an employee of Merck Serono SA Geneva, a subsidiary of Merck KGaA, Darmstadt, Germany, at the time of the study. FMS is an employee of EMD Serono Inc., a subsidiary of Merck KGaA, Darmstadt, Germany. KB and AR are employees of Mapi, a consulting company commissioned by Merck Serono SA Geneva, a subsidiary of Merck KGaA, Darmstadt, Germany, for this study. Merck Serono SA Geneva, a subsidiary of Merck KGaA, Darmstadt, Germany, participated in the design and conduct of the study, interpretation of data, review, and approval of the manuscript.
ABo, ABu, and AC provided clinical and scientific expertise about PKU throughout the project, in particular with regards to the definition of objectives, subject inclusion and exclusion criteria validation, patient recruitment, interpretation of results, choice of concepts to be measured, and finalisation of the questionnaire; and critically reviewed the manuscript. EB managed the project, participated in the validation study design and in the development of the questionnaire, and critically reviewed the manuscript. FMS participated in the finalisation of the questionnaire and critically reviewed the manuscript. KB managed the global organisation of the project, led the item generation of the questionnaire, and participated in the development of the manuscript. AR participated in the study design, designed the statistical analyses, participated in the interpretation of results, and drafted the manuscript. All authors read and approved the final manuscript.
Multitrait analysis of the Child PKU-QOL.
Clinical Validity of the Child PKU-QOL.
Clinical Validity of the Adolescent PKU-QOL.
Clinical Validity of the Adult PKU-QOL.
Clinical Validity of the Parent PKU-QOL.
About this article
Cite this article
Regnault, A., Burlina, A., Cunningham, A. et al. Development and psychometric validation of measures to assess the impact of phenylketonuria and its dietary treatment on patients’ and parents’ quality of life: the phenylketonuria – quality of life (PKU-QOL) questionnaires. Orphanet J Rare Dis 10, 59 (2015). https://doi.org/10.1186/s13023-015-0261-6