Skip to main content

Measuring Duchenne muscular dystrophy impact: development of a proxy-reported measure derived from PROMIS item banks

Abstract

Background

Person-reported outcomes measurement development for rare diseases has lagged behind that of more common diseases. In studies of caregivers of patients with rare diseases, one relies on proxy report to characterize this disability. It is important to measure the child’s disability accurately and comprehensively because it affects caregiver burden. We aimed to create a condition-specific caregiver proxy-report measure for Duchenne Muscular Dystrophy (DMD) in order to understand the impact of DMD on the caregiver. Drawing on relevant item banks from the Patient-Reported Outcome Measurement Information System (PROMIS), we sought to confirm their reliability and validity in the target sample of DMD caregivers.

Methods

This web-based study recruited DMD caregivers via Rare Patient Voice, patient-advocacy groups, and word of mouth. Recruitment was stratified by age of the caregiver’s child with DMD, which broadly represents stages of DMD progression: 2–7, 8–12, 13–17, and > 18. Telephone interviews with DMD parent-caregivers pretested possible measures for content validity. The web-based study utilized an algorithm to categorize respondents’ ambulatory status for tailored administration of PROMIS Parent-Proxy items as well as some new items developed based on caregiver interviews. Item response theory analyses were implemented.

Results

The study sample included 521 DMD caregivers representing equally the four age strata. The proxy-report measure included the following domains: fatigue impact, strength impact, cognitive function, upper extremity function, positive affect, negative affect, sleep-device symptoms, and mobility. The first five domains had strong psychometric characteristics (unidimensionality; acceptable model fit; strong standardized factor loadings; high marginal reliability). Negative Affect, covering anger, anxiety, depressive symptoms, and psychological stress, fit a bifactor model with good model fit, high marginal reliability, and strong factor loadings. The Sleep-device symptoms domain was not unidimensional, and the mobility domain did not have a simple structure due to residual correlations among items at opposite end of the mobility-disability continuum. These two domain scores were retained as clinimetric indices (i.e., uncalibrated scales), to achieve the overall goal of having a content-valid DMD-specific measure across all stages of disease severity.

Conclusions

The present study derived a DMD-specific proxy-report measure from PROMIS item banks and supplemental items that could potentially be utilized in caregiver research across all stages of the care recipient’s DMD. Future research will focus on assessing the responsiveness and validity of the measure over time and its comparison to DMD patient self-report.

Introduction

The introduction of person-reported outcomes (PROs) over the past few decades has facilitated clinical research in many ways. PROs make it increasingly feasible for the patient’s voice to be heard in important studies of great relevance to them [1,2,3]. Similarly, when using parent-proxy report, PROs enable the parent to reflect their child’s experience when the child is too young or not able to complete a survey him/herself. Further, in order to understand the impact of caregiving, it would be critical to consider the multiple domains of their care recipient’s disability. Some domains may be easier to address and manage, whereas others may present more stressful and distressing challenges.

For conditions with high prevalence, condition-specific PROs and proxy measures were often developed early in the field of quality-of-life (QOL) research. For example, cancer measures were among the first to be developed, with site-specific modules created in the US [4] and Europe [5] complementing general measures. For less prevalent conditions, the early approach was to use a more generic measure, such as the SF-36™ [6, 7] for primary care [8], end-stage renal disease [9], arthritis [10], etc.; or, in some cases, to add some condition-specific items to fit the purpose (e.g., multiple sclerosis [11], epilepsy [12]). These early measures were later complemented by fully disease-specific PRO and proxy-report measures that tapped the relevant domains for the target condition (e.g., multiple sclerosis [13], arthritis [14, 15], epilepsy [16]).

For rare diseases such as Duchenne Muscular Dystrophy (DMD), however, PRO and proxy measurement development has typically been slower. Perhaps due to the substantial effort to undertake recruitment of patients with rare conditions, this measurement gap remains a concern. Research studies that fail to utilize content-valid PRO or proxy measures risks missing important effects of interventions, medications, or developmental changes. Other DMD-specific measures have been proposed, such as the PedsQL DMD module [17], the MDCHILD out of Canada [18], and the DMD-QoL work as part of Project HERCULES in the UK [19]. A recent review of QOL measures in DMD revealed that evidence was lacking on the content and structural validity of the PedsQL DMD module, and the MDCHILD, which had been used on but not validated for people with DMD, and that no measures for adults with DMD had a sufficient evidence base to support recommendation [20]. The DMD-QOL was developed after the above review, and lists the above findings as part of its motivation for developing a new PRO.

The present work thus sought to derive a condition-specific proxy-reported measure of DMD disability. This measure was intended to support an in-depth investigation of the impact of DMD on caregiver QOL, work productivity, ambitions, and financial well-being. By measuring via proxy report the DMD patient’s level and scope of disability, we hoped to gain a better understanding of the context of caregiving. Accordingly, patient disability (the target construct) was deemed relevant to caregiver impact,Footnote 1 which was the focus of the larger investigation from which the present study grew. The “DMD disability” construct is defined to be the patient’s level of functioning in domains affected by DMD, such as upper and lower extremity function, strength, mobility, fatigue, cognitive function, and affect. Such a construct is clearly within the purview of QOL measures, and would constitute a disease-specific measure for DMD.

We thus sought to derive a reliable and valid proxy measure by drawing on the available and sophisticated National Institutes of Health-funded resource for clinical researchers: the Patient-Reported Outcome Measurement Information System (PROMIS) [22,23,24]. The advantages of building from a well-characterized item bank are numerous [25], including utilizing well-honed items that tap a well-defined construct, have known item characteristics in other study populations, and can facilitate comparisons across study populations. The fit of the PROMIS item banks to the DMD context is, however, unknown. Accordingly, the present work sought to address that gap.

DMD is a progressive rare neuromuscular disorder that occurs primarily in males in 16–20 per 100,000 live births in the United States and United Kingdom [26,27,28]. DMD is usually diagnosed by age 5. The disorder presents as delayed development that includes motor difficulties [29] and may include cognitive impairment and attention deficit disorders [30]. Progressive muscle weakness leads to loss of ambulation, upper-limb function problems, and comorbid conditions such as scoliosis and muscular contractures [29]. As DMD continues to progress, patients experience life-threatening heart and lung conditions [31], and face profound uncertainty regarding lifespan, typically dying in their late 20 s to early 30 s [31]. While disability progression is heterogenous across individuals, on average the trajectory can be categorized in age-related stages: ambulatory (up to age 7), transitional (ages 8–12), and non-ambulatory (≥ age 13). Because disability worsens as patients age into adulthood [32], we sought to create a proxy-report measure so that DMD caregivers could provide consistent information about their child’s functioning, regardless of the child’s age, level of DMD progression, or cognitive function. This approach was chosen to avoid issues such as method variance [33] in the source of disability assessment across care-recipients’ ages and across raters.

Methods

Sample and procedure

This study recruited participants via Rare Patient Voice, patient-advocacy groups, and word of mouth. Eligible participants were age 18 or older, able to complete an online questionnaire, and were providing caregiving support to a family-member with DMD at least two years old, usually their son. This survey was administered through the HIPAA-compliant, secure Alchemer engine (www.alchemer.com). Recruitment was stratified by age of the caregiver’s child with DMD: 2–7, 8–12, 13–17, and >  = 18. These strata broadly correspond to the disease-related phases of progression [31]: ambulatory phase (age 2–7), transitional phase (up to age 12), and non-ambulatory phase (age ≥ 13), with increasing dependence and involvement of other systems as the person ages into adulthood (age ≥ 18). If caregivers had more than one person with DMD for whom they were providing caregiving support, they were asked to report on the eldest or most disabled person with DMD (the index patient). Caregivers were paid $75 honoraria to compensate them for their time completing the survey. The protocol was reviewed and approved by the New England Independent Review Board (NEIRB #20201623), and all participants provided informed consent prior to beginning the survey.

Conceptual development

Telephone interviews were conducted with DMD caregivers to pretest possible measures of DMD disability (i.e., symptoms and impact). In this context, we sought to further scale development, rather than to engage in extensive qualitative research on the participants or on the construct of disability. We relied on the extensive foundational work done by the PROMIS Health Measures collaborative group (www.promishealth.org), and focused on pretesting items in the selected domains thought most applicable to DMD by several of the authors (CES, KG, and IA).

Candidate interviewees were first identified through Rare Patient Voice, which provided the ages of the caregivers’ DMD children. Interviewees were then recruited using a stratified random sampling to represent evenly the three age strata of interest for our research. Two rounds of interviews (n = 9 and 6, respectively) were conducted and documented by the first author. Feedback from the first round informed the materials assessed in the second round. While we aimed to balance males and females in the interview group, the numbers responding were 3 and 12, respectively.

Prior to the interview, participants completed a brief online survey that included the questions from PROMIS item banks and/or short forms being considered for inclusion on the basis of a literature review on DMD disability. The interview then discussed the survey items, asking whether they captured relevant aspects of the care recipient’s disability, whether the items were understandable, and whether additional domains or content should be included. Two important additions that followed from these interviews was the creation of the sleep disturbance items, and inclusion of both positive and negative affect domains. Numerous other changes were made to individual items in various domains, such as revising response options for applicability and for consistency across domains, changing “kids” to “people”, including peer-relationship domains, asking about the full range of mobility impairment so that more of the experience of DMD was reflected. With all of these changes, we aimed to reflect accurately the disability experiences of DMD, and implicitly to acknowledge the challenges faced by these families.

Based on content identified in these interviews, we selected 11 PROMIS [23, 24] parent-proxy short forms and/or item banks: mobility, sleep disturbance, fatigue, strength impact, upper extremity, cognitive function, positive affect, anger, anxiety, depressive symptoms, and psychological stress. A small set of items from each of these latter four domains were selected to tap ‘negative affect.’

Item development

PROMIS items

Using item calibrations provided by the PROMIS Assessment Center, we further selected a set of items within each domain deemed relevant to DMD. With permission from the Center, we made adjustments to items to reference the name of the person with DMD rather than “your child,” to accommodate the fact that the caregiver might be reporting on someone ranging in age from early childhood to middle-age and that may not be their child. In addition, again with permission, we changed response options for the strength-impact domain to be the same as for the upper-extremity domain for the sake of consistency within the measure, and we allowed respondents to select “do not know/prefer not to answer” on all items, to avoid survey attrition.

New items

We wrote new items to tap concepts not adequately captured in the PROMIS parent-proxy items, specifically peer-group relations (adapted self-report PROMIS items to proxy-report), use of a medical scooter for mobility, and aspects of sleep-disturbance related to medical devices (e.g., leg braces, continuous positive airway pressure machine). Again, all new items were framed from the perspective of the parent-proxy.

Tailored administration

The resulting measure of eight domains included 54 items, but some would only be relevant to a subset of the caregivers. For example, items related to low levels of ambulation disability would only be relevant to caregivers of ambulatory DMD patients, whereas items related to later stages of ambulation disability would only be relevant to caregivers of non-ambulatory DMD patients. Presenting such irrelevant items might also be upsetting to the respondent. We thus categorized items as to whether they should be seen across all levels of DMD—i.e., Ambulatory (A), Transitional (T), Non-ambulatory (N) or only by a subset (i.e., A, AT, ATN, TN, or N). We then utilized a method developed earlier by members of our group for creating disability-specific short forms for multiple sclerosis [34, 35]. Accordingly, we utilized the Lowes Lab Ambulatory Status Algorithm [36] (“Lowes Algorithm”), a recognized branching logic to identify the questions appropriate to the child’s level of disability, and to effectively reduce measure length. This approach was more feasible for our assessment context than the PROMIS computerized adaptive test because the survey engine was not compatible with the PROMIS Application Programming Interface, which such a test would have required.

For ease of interpretation, ambiguous domain names were modified such that ‘impact’ indicated a ‘higher-is-worse’ score, whereas ‘function’ indicated a ‘higher-is-better’ score (e.g., “strength” became “strength impact” and “cognitive” became “cognitive function”).

Other measures

The Lowes Lab Ambulatory Status Algorithm [36] was used to categorize caregiver respondents for a tailored item administration for the mobility and sleep-disturbance domains. Respondents were asked three to five questions in order to categorize their child with DMD as either ambulatory, transitional, or non-ambulatory. These questions were set up as branching logic in the survey engine.

Demographic characteristics included year of birth, gender, cohabitation/marital status, employment status, ethnicity, race, education, height, weight, difficulty paying bills, with whom the person lives, smoking status, and whether they received help to complete survey.

Statistical analysis

For items with missing data due to the skip logic of the tailored administration, missing data were imputed to reflect the individual’s level of functioning known from the Lowes Algorithm. For example, if the individual was categorized as Non-Ambulatory, then an item related to being able to walk a mile was recoded from missing to ‘not able to do’. Such imputation was applicable only for certain mobility and sleep items.

Psychometric analysis included item response theory (IRT) modeling [37, 38]. Because we started with a previously-validated set of PROMIS items, the construct validity has already been demonstrated. Further, the content validity of the selected items/domains was established on the basis of the pretesting interviews with caregivers. The focus of analysis within a domain was on selecting the best set of unidimensional items so that the final scale would be comprehensive, not contain redundant items, and have high internal consistency reliability.

Confirmatory factor analysis (CFA) using Mplus version 8.4 [39] was implemented in all eight domains: fatigue impact, strength impact, negative affect, sleep-device symptoms, cognitive function, upper extremity function, positive affect, and mobility. CFAs were implemented in an iterative fashion to identify items that should be dropped due to high residual correlations as reflected in the modification indices. We examined model-fit statistics, standardized factor loadings, marginal reliability, and modification indices. All CFA analyses used weighted least squares mean- and variance-adjusted estimation, and used as default listwise deletion [39]. Sensitivity analyses compared results with and without the imputation described above. Model fit focused on the Root Mean Square Error of Approximation (RMSEA), the Comparative Fit Index (CFI), and the Tucker-Lewis Index (TLI). While we would generally use standard criteria for good fit (i.e., RMSEA < 0.08, CFI ≥ 0.90, TLI ≥ 0.95) [40], it has been shown that in CFA the RMSEA criterion depends substantially on sample size, number of items in a scale, and meeting distributional assumptions that are often not met with PRO data [41, 42]. Thus, the RMSEA cut-offs are somewhat arbitrary, and assessing whether an item bank is “unidimensional enough” for modeling using IRT requires a balanced consideration of all three fit statistics [41]. Using IRT PRO version 3.1 [43], we then implemented IRT analyses, fitting a graded-response model [44] using marginal maximum likelihood so that all response patterns were analyzed whether data were missing or otherwise. Each IRT model computed slopes, intercepts, thresholds, item information functions, item trace lines, and the marginal reliability of the scaled scores. It also yielded an IRT scoring table based on the summed score for each domain. IRT PRO and flexMIRT® [45] were used to compute a bifactor graded response model [46, 47] when relevant.

Scoring options were created to increase the accessibility of the DMD Impact Measure derived from PROMIS parent-proxy item banks. End-users could choose between one method based on simple sums, and another based on IRT-based T-scores. An application of the derived measures’ scores was shown using a box-and-whiskers plot for each of the eight domain T scores within each age stratum (2–7, 8–12, 13–17, and 18 +). Univariate Analysis of variance (uni-ANOVA) models computed using SPSS tested for age-related group differences in each of the eight domains.

Descriptive analyses were done using IBM SPSS version 27 [48].

Results

Sample

The study sample included 521 DMD caregivers representing equally four age strata: age 2–7, 8–12, 13–17, and 18 or older. The caregiver sample had a mean age of 41.5, and 76% were female (Table 1). The sample was 84% white and 9% black; 11% were Hispanic. The sample was drawn from the contiguous United States, with a larger proportion in the South Atlantic (24%) than other regions. Eighty-six percent of respondents were married or in a domestic partnership. Over half of the sample was employed, about a third of whom worked full-time. The median level of education was a two-year university degree. Caregivers had an average of 1.4 comorbid health conditions out of 15 presented, with the most prevalent being back pain, depression, insomnia, and arthritis. Most were never-smokers, and the average body mass index reflected being overweight.

Table 1 Descriptive Statistics of Caregivers (N = 521)

Caregivers reported providing support to one to five people with DMD (mean = 1.1, SD = 0.4), of whom up to three were their children (Table 2). Families had an average of two people other than the caregiver providing this support. Caregivers were almost all (97%) parents of the DMD index person (Table 2). The index person with DMD had a mean age of 12.9 and had an average of 1.6 comorbidities, the most prevalent of which were anxiety, learning disabilities, attention-deficit, scoliosis, sleep disorder, overweight, and depression. According to the Lowes Algorithm, 29% of the sample was ambulatory, 24% transitional, and 42% non-ambulatory (5% were missing information).

Table 2 Descriptive statistics of caregiver context and DMD care recipients (N = 521)

Psychometric results

All domains’ descriptive statistics are shown in Table 3. Results of the CFAs showed acceptable unidimensional model fit (Table 4), strong standardized factor loadings (Table 5), and high marginal reliability (Table 4) for the five domains of fatigue impact, strength impact, upper extremity function, cognitive function, and positive affect. Negative Affect fit a bifactor model, which is to be expected since its items were drawn from varied item banks covering anger, anxiety, depressive symptoms, and psychological stress. Negative-affect factor loadings were constrained to equality for one specific factor with only two items. The General factor from this bifactor model had good model fit, high marginal reliability, and strong factor loadings (Tables 4 and 5). Item trace lines within IRT-scored domains suggested that scores reflect the full range of the corresponding latent variable (data not shown). The length of this tailored measure ranges from 48 to 50 items, depending on the level of ambulation disability in the DMD index person (Table 3).

Table 3 Descriptive statistics of PROMIS parent proxy domains (N = 521)
Table 4 Model fit statistics of PROMIS parent proxy domains
Table 5 DMD disability domains: item content and factor loadings where applicable

Two domains –mobility and sleep-device symptoms—did not fit a unidimensional model well although the standardized factor loadings were all high (i.e., ≥ 0.79, data not shown). These domains thus required substantial further modeling. Both domains were retained because caregiver-interview feedback emphasized their patient relevance.

The mobility domain’s lack of simple structure presented analytic challenges. Mplus CFA output revealed that for a number of items one could almost entirely predict the response to one item based on another. These items were, however, retained because they were needed to reflect the full spectrum of mobility disability. For example, if one requires a wheelchair to get around, one is not able to run a mile; but both extremes of the continuum need to be assessed for the content validity of the measure. This problem was not resolved by reverting to the pre-imputed mobility items (i.e., where missing values remained rather than being imputed). Iterative modeling aimed at resolving issues of residual correlations yielded a brief item set that missed content specifically noted by caregivers as relevant and important to the DMD disability experience. We tried recoding items with problematic item trace lines, collapsing five response options into two or three. This recoding did not improve model fit. We also tried modeling the three groups separately (A, T, N), but this approach also failed to yield a simple structure.

In the process, we noted that item distributions among the A group included a large subset of participants (n ~ 60) that reported their child was not able to do activities that would be expected of ambulatory individuals, such as get up from the floor or walk across the room. We thus excluded this subset from the ambulatory cohort and computed a CFA within the modified A group (n ~ 90). Further, we were able to create a unidimensional model that included six of the 13 mobility items and generated an RMSEA of 0.106. However, we considered the missing item content as well as the general multi-dimensionality and residual-correlations across A, T, and N, subgroups, and we decided that retaining all 13 items would better serve the overall goal of having a content-valid DMD-specific measure across all stages of disease severity.

Thus, for both mobility and sleep-device symptoms, we retained them as clinimetric indices [49,50,51] (i.e., uncalibrated scales), represented as a simple summative indices. This simple summation is justified by the abovementioned high standardized factor loadings.

Scoring

In order to increase the accessibility of the DMD Impact Measure derived from PROMIS parent-proxy item banks, we provide two approaches for scoring the domains: (1) simple sums (i.e., raw total score); (2) IRT-based T-scores. For IRT-based scoring of all domains except sleep-device symptoms and mobility, we would recommend use of the scoring tables provided in the associated manual (available upon request). These scores use a standardized T-score metric, with a mean of 50 and a standard deviation of 10. Pearson correlation coefficients assessing the association between these two scoring approaches suggest that the simple-sum scoring yields a good estimate of the IRT-based scoring (0.95 ≤ r ≤ 0.99; Table 3). We anticipate, however, that the IRT-based scoring will be more sensitive and responsive to change.

Application: comparison of proxy-reported domain scores by care-recipient age

As an illustration of the use of this DMD-specific parent-proxy measure, Fig. 1 shows box-and-whiskers plots for each of the eight domain T scores within each age stratum. All eight domains had age-group differences that were significant at the p < 0.000001 level in uni-ANOVA models, and explained variance for a given domain ranged from 0.07 to 0.47. Domains that showed the largest age-related decreases in functioning or increases in impact were, in order of explained variance, mobility, sleep-device symptoms, fatigue impact, strength impact, upper extremity function, negative affect, positive affect, and cognitive function (partial eta2 = 0.47, 0.28, 0.23, 0.23, 0.19, 0.08, and 0.07, respectively). Plotting the DMD patient’s scores over time could be useful for pinpointing issues needing clinical attention.

Fig. 1
figure 1

Box-and-Whiskers Plot of the Eight Parent-Proxy Domain Scores by the Four Age Groupings. This plot illustrates how the DMD-specific parent-proxy measure could be used in clinical practice. Plotting the DMD patient’s T-scores over time (y-axis) could be useful for pinpointing issues needing clinical attention. The study data show clear age-related decreases in functioning or increases in impact. Domains with largest age-related worsening were, in order of explained variance, mobility, sleep-device symptoms, fatigue impact, strength impact, upper extremity function, negative affect, positive affect, and cognitive function

Discussion

The present study created a DMD-specific proxy-report measure derived from PROMIS item banks that measure the full range of DMD outcomes noted as important and relevant by DMD caregivers. Validating the PROMIS Parent Proxy item sets in the DMD population was a central reason motivating this work. We do not believe that the construct validity of a disability domain would differ across patient populations, but rather that some items may be far more or far less likely to be endorsed in some patient populations. Such differences might result in dependency between items which challenges unidimensionality. Based on our analysis for example, we opted to retain more items in the mobility domain than the mobility short form, in order to clearly capture the range of mobility disability and to retain items deemed relevant by the caregivers. This decision was motivated by a desire for better content validity, while at the same time it undermined unidimensionality (i.e., high RMSEA). Mobility was thus relegated to the “clinimetric” category. Thus, construct validity for a disability domain measure is not different for those with DMD, but some items used to measure the construct may function in a different way.

The resulting measure includes eight domains that reflect the conceptualization based on caregiver input. Six of these domains had strong psychometric characteristics, and two of which are better conceptualized as clinimetric and are scored using raw sums. The resulting measure can be scored quickly and manually or using the IRT-scoring tables to provide more precise metrics. The scores resulting from the two methods are highly correlated.

The caregivers included in this study were generally parents of the person with DMD. As is the case with most childhood-onset health conditions, parents bear the greatest responsibility for their child. While siblings, other relative, and paid aides may also provide caregiving support, our study predominantly reflects parental caregivers. Future research might explicitly focus on siblings, other relatives, and paid aides in furthering the validation of this condition-specific proxy report measure of DMD disability. Additionally, the present work supports the use of the new measure in observational research, it would be worthwhile to examine the measure’s longitudinal construct validity (i.e., responsiveness [52]), as well as its usefulness in clinical work. Input from clinicians would be helpful in ascertaining how helpful this proxy-reported information is in the clinical setting.

Of note, the mobility scale posed many challenges for psychometric scale development. Most pointedly, exclusion of key items might have resolved issues of local dependence (i.e., residual correlations) but would have overlooked content specifically noted by caregivers as central to the DMD disability experience. An approach that was blinded to item content might have produced a short form that had good psychometric characteristics. However, this approach ignored the reality that most people with DMD use a wheelchair at a relatively young age and, as their disability progresses, lose the ability to walk a block, walk across the room, or get up from the floor. Dropping such items that are ‘predictable’ from an IRT perspective sacrifices content validity and possibly responsiveness to clinically important change over time.

This initial version of the DMD-specific proxy-report measure built on the Lowes Algorithm and reduced the number of items presented by about eight. The tailored administration is now only one or two items shorter than the full administration because the psychometric analyses supported removing a number of items from the final item set. Even if one were to rely only on one to two questions to determine wheelchair use to tailor the mobility and sleep-device symptoms items, the total number of items administered would be about the same in a tailored versus not-tailored administration. Thus, tailoring does not reduce the length of the measures and would not be recommended. Future research will investigate whether full administration of all items within the mobility and sleep-device symptoms domains renders any differences in terms of simple structure and model fit.

The present study had clear advantages in terms of relatively large sample sizes across the disability trajectory (~ 130 in each child age group). The data enabled careful psychometric modeling that considered relevant subgroups. The limitations of the study must be acknowledged, however. First and foremost, the study is only able to address the cross-sectional characteristics of the measure. Longitudinal construct validity [52] was not addressed, in particular responsiveness to clinically important change [53] and stability in the face of no change [54]. Second, as with any scale development, its validation is iterative. Future work should continue the validation of the new measure in an independent data set. Such future work might explicitly include a Patient and Public Involvement phase that expands the role of the DMD caregivers to be partners at all stages of the research [55,56,57,58]. Third, it would be worthwhile to investigate differential item function related to gender and education. While this investigation is beyond the scope of the present study, future work might address this important aspect of item function. Fourth, the new measure is explicitly for proxy assessment, not patient assessment. This decision was made because the study was focused on DMD caregivers, not patients. Accordingly, we did not collect patient data in conjunction with the proxy-reported measure. Future work might utilize the patient-reported versions of the proxy domains and items used, and validate this set of PROMIS scales for use in patient-reported research.

Conclusions

In summary, we present a measure derived from the PROMIS Parent Proxy item banks for use in DMD research and clinical practice. The measure reflects content noted by DMD caregivers in qualitative interviews, and will facilitate a better understanding of how care-recipients’ disability impacts caregiver burden. Scoring metrics enable quick manual scoring and slightly more computer-intensive IRT-based scoring to fit the user’s purpose. Future research to assess the responsiveness and validity of the measure over time is warranted, to fully support its use for person-centered DMD research over the full range of patients’ ambulatory status. Future research should also address the relationship between caregiver proxy report and DMD patient self-report.

Availability of data and materials

The study data are confidential and thus not able to be shared.

Code availability

Requests for software code will be considered, and will be made available if deemed reasonable.

Notes

  1. The term “impact” is used because it is less negative than “burden”. Past research done by members of our group with caregivers of children with genetic disorders revealed that caregivers preferred the former to the latter because it allowed for positive aspects of caregiving which were broadly acknowledged by study participants [21].

Abbreviations

Uni-ANOVA:

Univariate Analysis of Variance

CFI:

Comparative fit index

DMD:

Duchenne Muscular Dystrophy

IRT:

Item response theory

LLC:

Limited liability corporation

PRO:

Person-reported outcome

PROMIS:

Patient-Reported Outcome Measurement Information System

QOL:

Quality of life

RMSEA:

Root mean square error of approximation

TLI:

Tucker-Lewis Index

References

  1. Austin E, LeRouge C, Hartzler AL, Segal C, Lavallee DC. Capturing the patient voice: implementing patient-reported outcomes across the health system. Qual Life Res. 2020;29(2):347–55.

    Article  Google Scholar 

  2. Calvert MJ, O’Connor DJ, Basch EM. Harnessing the patient voice in real-world evidence: the essential role of patient-reported outcomes. Nat Rev Drug Discovery. 2019;18:731–2. https://doi.org/10.1038/d41573-019-00088-7.

    Article  CAS  PubMed  Google Scholar 

  3. Van Hemelrijck M, Sparano F, Moris L, Beyer K, Cottone F, Sprangers M, et al. Harnessing the patient voice in prostate cancer research: Systematic review on the use of patient-reported outcomes in randomized controlled trials to support clinical decision-making. Cancer Med. 2020;9(12):4039–58. https://doi.org/10.1002/cam4.3018.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Cella DF, Tulsky DS, Gray G, Sarafian B, Linn E, Bonomi A, et al. The Functional Assessment of Cancer Therapy scale: development and validation of the general measure. J Clin Oncol. 1993;11(3):570–9.

    Article  CAS  Google Scholar 

  5. Niezgoda HE, Pater J. A validation study of the domains of the core EORTC quality of life questionnaire. Qual Life Res. 1993;2(5):319–25.

    Article  CAS  Google Scholar 

  6. Ware J, Kosinski M, Bjorner J, Turner-Bowker D, Gandek B, Maruish, M. SF-36v2® Health Survey: a primer for healthcare providers. Lincoln, RI: QualityMetric Incorporated (2008).

  7. Ware JE, Jr, Bayliss MS, Rogers WH, Kosinski M, Tarlov AR. Differences in 4-year health outcomes for elderly and poor, chronically ill patients treated in HMO and fee-for-service systems. Results from the Medical Outcomes Study. JAMA, (1996);276(13), 1039–47.

  8. Brazier JE, Harper R, Jones N, O’cathain A, Thomas K, Usherwood T, et al. Validating the SF-36 health survey questionnaire: new outcome measure for primary care. BMJ. 1992;305(6846):160–4.

    Article  CAS  Google Scholar 

  9. Wight J, Edwards L, Brazier J, Walters S, Payne J, Brown C. The SF36 as an outcome measure of services for end stage renal failure. BMJ Qual Saf. 1998;7(4):209–21.

    Article  CAS  Google Scholar 

  10. Kosinski M, Keller SD, Ware Jr, JE, Hatoum HT, Kong SX (1999) The SF-36 Health Survey as a generic outcome measure in clinical trials of patients with osteoarthritis and rheumatoid arthritis: relative validity of scales in relation to clinical measures of arthritis severity. Med Care, MS23–39.

  11. Vickrey B, Hays RD, Harooni R, Myers LW, Ellison GW. A health-related quality of life measure for multiple sclerosis. Qual Life Res. 1995;4(3):187–206.

    Article  CAS  Google Scholar 

  12. Jacoby A, Baker GA, Steen N, Buck D. The SF-36 as a health status measure for epilepsy: a psychometric assessment. Qual Life Res. 1999;8(4):351–64.

    Article  CAS  Google Scholar 

  13. Schwartz CE, Vollmer T, Lee H. Reliability and validity of two self-report measures of impairment and disability for MS. North American Research Consortium on Multiple Sclerosis Outcomes Study Group. Neurology, 1999; 52(1), 63–70.

  14. Orbai A-M, Holland R, Leung YY, Tillett W, Goel N, Christensen R, et al. PsAID12 provisionally endorsed at OMERACT 2018 as core outcome measure to assess psoriatic arthritis-specific health-related quality of life in clinical trials. J Rheumatol. 2019;46(8):990–5.

    Article  Google Scholar 

  15. Ren XS, Kazis L, Meenan RF. Short-form Arthritis Impact Measurement Scales 2: tests of reliability and validity among patients with osteoarthritis. Arthritis Care Res. 1999;12(3):163–71.

    Article  CAS  Google Scholar 

  16. Sabaz M, Cairns DR, Lawson JA, Nheu N, Bleasel AF, Bye AM. Validation of a new quality of life measure for children with epilepsy. Epilepsia. 2000;41(6):765–74.

    Article  CAS  Google Scholar 

  17. Davis SE, Hynan LS, Limbers CA, Andersen CM, Greene MC, Varni JW, et al. The PedsQL™ in pediatric patients with Duchenne muscular dystrophy: feasibility, reliability, and validity of the Pediatric Quality of life inventory neuromuscular module and generic core scales. J Clin Neuromuscul Dis. 2010;11(3):97–109.

    Article  Google Scholar 

  18. Propp R. Development and psychometric evaluation of the muscular dystrophy child health index of life with disabilities (MDCHILD) questionnaire in children with Duchenne muscular dystrophy. University of Toronto (Canada); 2017.

  19. Powell PA, Carlton J, Rowen D, Chandler F, Guglieri M, Brazier JE. Development of a new quality of life measure for Duchenne muscular dystrophy using mixed methods: the DMD-QoL. Neurology. 2021;96(19):e2438–50.

    Article  CAS  Google Scholar 

  20. Powell PA, Carlton J, Woods HB, Mazzone P. Measuring quality of life in Duchenne muscular dystrophy: a systematic review of the content and structural validity of commonly used instruments. Health Qual Life Outcomes. 2020;18(1):1–26.

    Article  Google Scholar 

  21. Schwartz CE, Powell VE, Eldar-Lissai A. Measuring hemophilia caregiver burden: validation of the Hemophilia Caregiver Impact measure. Qual Life Res. 2017;26(9):2551–62. https://doi.org/10.1007/s11136-017-1572-y.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Cella D, Yount S, Rothrock N, Gershon R, Cook K, Reeve B, et al. The Patient-Reported Outcomes Measurement Information System (PROMIS): progress of an NIH Roadmap cooperative group during its first two years. Med Care. 2007;45(5 Suppl 1):S3.

    Article  Google Scholar 

  23. Yount SE, Cella D, Blozis S. PROMIS®: standardizing the patient voice in health psychology research and practice. Health Psychol. 2019;38(5):343.

    Article  Google Scholar 

  24. Varni JW, Thissen D, Stucky BD, Liu Y, Gorder H, Irwin DE, et al. PROMIS® Parent Proxy Report Scales: an item response theory analysis of the parent proxy report item banks. Qual Life Res. 2012;21(7):1223–40.

    Article  Google Scholar 

  25. Cella D, Gershon R, Lai J-S, Choi S. The future of outcomes measurement: item banking, tailored short-forms, and computerized adaptive assessment. Qual Life Res. 2007;16(1):133–41.

    Article  Google Scholar 

  26. Ryder S, Leadley R, Armstrong N, Westwood M, De Kock S, Butt T, et al. The burden, epidemiology, costs and treatment for Duchenne muscular dystrophy: an evidence review. Orphanet J Rare Dis. 2017;12(1):79.

    Article  CAS  Google Scholar 

  27. Mendell JR, Shilling C, Leslie ND, Flanigan KM, al‐Dahhak R, Gastier‐Foster J, et al. Evidence‐based path to newborn screening for Duchenne muscular dystrophy. Ann Neurol.; 2012;71(3), 304–13.

  28. Moat SJ, Bradley DM, Salmon R, Clarke A, Hartley L. Newborn bloodspot screening for Duchenne muscular dystrophy: 21 years experience in Wales (UK). Eur J Hum Genet. 2013;21(10):1049–53.

    Article  CAS  Google Scholar 

  29. Ciafaloni E, Fox DJ, Pandya S, Westfield CP, Puzhankara S, Romitti PA, et al. Delayed diagnosis in Duchenne Muscular Dystrophy: data from the Muscular Dystrophy Surveillance, Tracking, and Research Network (MD STARnet). J Pediatr. 2009;155(3):380–5.

    Article  Google Scholar 

  30. Pane M, Lombardo ME, Alfieri P, D'Amico A, Bianco F, Vasco G, et al. Attention deficit hyperactivity disorder and cognitive function in Duchenne muscular dystrophy: phenotype-genotype correlation. J Pediatrics 2012; 61(4), 705–9.

  31. Kohler M, Clarenbach CF, Bahler C, Brack T, Russi EW, Bloch KE. Disability and survival in Duchenne muscular dystrophy. J Neurol Neurosurg Psychiatry. 2009;80(3):320–5.

    Article  CAS  Google Scholar 

  32. Hamdani Y, Mistry B, Gibson BE. Transitioning to adulthood with a progressive condition: best practice assumptions and individual experiences of young men with Duchenne muscular dystrophy. Disabil Rehabil. 2015;37(13):1144–51.

    Article  Google Scholar 

  33. Bagozzi RP, Yi Y. Assessing method variance in multitrait-multimethod matrices: the case of self-reported affect and perceptions at work. J Appl Psychol. 1990;75(5):547.

    Article  Google Scholar 

  34. Schwartz CE, Bode RK, Vollmer T. The symptom inventory disability-specific short forms for multiple sclerosis: reliability and factor structure. Arch Phys Med Rehabil., 2012; 93(9), 1629–36.

  35. Schwartz CE, Bode RK, Quaranto BR, Vollmer T. The symptom inventory disability-specific short forms for multiple sclerosis: construct validity, responsiveness, and interpretation. Arch Phys Med Rehabil. 2012; 93(9),1617–28.

  36. Lowes LP. Lowes lab ambulatory status algorithm. 2020; Personal Communication, Columbus, OH.

  37. Embretson SE, Reise SP. Item response theory for psychologists. London: Lawrence Erlbaum Associates; 2000.

    Google Scholar 

  38. Van der linden WJ, Hambleton RK. Handbook of modern item response theory. New York: Springer; 1997.

  39. Muthén LK, Muthén BO. Mplus user's guide (Seventh ed.). 1998–2020; Los Angeles, CA: Muthén & Muthén.

  40. Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Eq Model Multidiscip J. 1999; 6(1), 1–55.

  41. Cook KF, Kallen MA, Amtmann D. Having a fit: impact of number of items and distribution of data on traditional criteria for assessing IRT’s unidimensionality assumption. Qual Life Res. 2009;18(4):447–60. https://doi.org/10.1007/s11136-009-9464-4.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Kenny DA, Kaniskan B, McCoach DB. The performance of RMSEA in models with small degrees of freedom. Sociol Methods Res. 2015;44(3):486–507.

    Article  Google Scholar 

  43. Cai L, Du Toit S, Thissen D. IRTPRO: Flexible, multidimensional, multiple categorical IRT modeling [Computer software]. Chicago: Scientific Software International; 2011.

    Google Scholar 

  44. Samejima F. Graded response models. In Handbook of item response theory (pp. 95–107): CRC Press; 2016.

  45. Cai L, THissen D, Chapman C, du Toi J. Flexible multilevel multidimensional item response modeling and test scoring (flexMIRT(R)). (3.6.1 ed.). Chapel Hill, NC: Vector Psychometric Group, LLC; 2013–20.

  46. Reise SP, Morizot J, Hays RD. The role of the bifactor model in resolving dimensionality issues in health outcomes measures. Qual Life Res. 2007;16(1):19–31.

    Article  Google Scholar 

  47. Toland MD, Sulis I, Giambona F, Porcu M, Campbell JM. Introduction to bifactor polytomous item response theory analysis. J Sch Psychol. 2017;60:41–63.

    Article  Google Scholar 

  48. IBM. IBM SPSS Statistics for Windows. 26th ed. Armonk: IBM Corp; 2019.

    Google Scholar 

  49. Feinstein AR. Clinimetric perspectives. J Chronic Dis. 1987;40(6):635–40.

    Article  CAS  Google Scholar 

  50. Schwartz CE, Merriman MP, Reed G, Byock I. Evaluation of the Missoula-VITAS Quality of Life Index - Revised: Research tool or clinical tool? J Palliat Med. 2005;8(1):121–35.

    Article  Google Scholar 

  51. Schwartz CE, Stark RB, Rapkin BD. Capturing patient experience: does quality-of-life appraisal entail a new class of measurement? J Patient-Rep Outcomes. 2020;4(1):1–11.

    Article  Google Scholar 

  52. Liang, M. H. Longitudinal construct validity: establishment of clinical meaning in patient evaluative instruments. [Review]. 2000; Medical Care, 38(9 Suppl), II84–90.

  53. Hays R, Hadorn D. Responsiveness to change: an aspect of validity, not a separate dimension. Qual Life Res. 1992;1(1):73–5.

    Article  CAS  Google Scholar 

  54. Beaton DE, Bombardier C, Katz JN, Wright JG. A taxonomy for responsiveness. J Clin Epidemiol. 2001;554:1204–17.

    Article  Google Scholar 

  55. Kirwan JR, De Wit M, Frank L, Haywood KL, Salek S, Brace-McDonnell S, et al. Emerging guidelines for patient engagement in research. Value Health. 2017;20(3):481–6.

    Article  Google Scholar 

  56. Haywood K, Brett J, Salek S, Marlett N, Penman C, Shklarov S, et al. Patient and public engagement in health-related quality of life and patient-reported outcomes research: what is important and why should we care? Findings from the first ISOQOL patient engagement symposium. Qual Life Res. 2015;24(5):1069–76.

    Article  Google Scholar 

  57. Hoddinott P, Pollock A, O'Cathain A, Boyer I, Taylor J, MacDonald C, et al. How to incorporate patient and public perspectives into the design and conduct of research. F1000Research, 7; 2018.

  58. Carlton J, Peasgood T, Khan S, Barber R, Bostock J, Keetharuth A. An emerging framework for fully incorporating public involvement (PI) into patient-reported outcome measures (PROMs). J Patient-Reported Outcomes. 2020;4(1):1–10.

    Article  Google Scholar 

Download references

Acknowledgements

We are grateful to Brian Stucky, Ph.D., Maria Orlando Edelen, Ph.D., and David Waldman, Ph.D., for helpful input during data analysis; and to the participants themselves who provided data for this project.

Funding

This work was funded by Sarepta Therapeutics.

Author information

Authors and Affiliations

Authors

Contributions

CES, IA and KG designed the research study. CES, RBS, and KB implemented analyses. CES, RBS, KB, and DC interpreted the results. CES wrote the paper, and RBS, DC, KB, IA, and KG edited the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Carolyn E. Schwartz.

Ethics declarations

Ethics approval and consent to participate

The protocol was reviewed and approved by the New England Independent Review Board (NEIRB #20201623). All participants provided informed consent prior to beginning the survey.

Consent for publication

All participants agreed to their data being published in a journal article.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Schwartz, C.E., Stark, R.B., Cella, D. et al. Measuring Duchenne muscular dystrophy impact: development of a proxy-reported measure derived from PROMIS item banks. Orphanet J Rare Dis 16, 487 (2021). https://doi.org/10.1186/s13023-021-02114-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13023-021-02114-7

Keywords