Skip to main content

Advancing qualitative rare disease research methodology: a comparison of virtual and in-person focus group formats

Abstract

Background

Rare disease research is hampered in part by the fact that patients are geographically dispersed. Rare disease patient communities are recognized for their use of the internet to learn about their condition and find peer-to-peer support. As such, web-based technologies offer promise for overcoming geographic barriers in rare disease research for many. Qualitative focus groups (FGs) are a widely used methodology used to understand patients and parents/families ‘lived experience’ and unmet needs is important to improve care for rare diseases. It is unclear if web-enabled (virtual) FGs are comparable to traditional in-person approaches. We conducted in-person (n = 3) and virtual (n = 3) FGs with rare disease patients to determine if virtual FGs produce similar results in-person FGs.

Results

Three in-person (n = 33 participants) and three virtual (n = 25 participants) FGs were conducted examining attitudes and beliefs regarding genetic testing and family communication of risk. Participants included 30 males, 18 females, and 10 parents/guardians. Two independent investigators identified excerpts (meaningful sections of text) and coded themes/sub-themes using a codebook. Inter-coder agreement across identified excerpts (n = 530) in both FG formats was 844/875 (96.5%). Two additional investigators reviewed coded excerpts and did not identify additional themes/sub-themes—supporting data saturation across FG formats. Virtual FGs accounted for 303/530 (57.2%) of total excerpts and 957/1721 (55.7%) of all identified themes/sub-themes. Formats were similar in terms of overall number of excerpts (101 ± 7.8 vs. 75.7 ± 18.8, p = 0.26) and themes/sub-themes (319 ± 6.1 vs. 254.7 ± 103.6, p = 0.34) between virtual and in-person FGs. However, virtual FGs had significantly more coded excerpts specifically relating to sensitive/intimate topics including ‘attitudes and beliefs’ (n = 320 vs. n = 235, p < 0.001), ‘information and support’ (n = 184 vs. n = 99, p < 0.001), and ‘family communication’ (n = 208 vs. n = 114, p < 0.001).

Conclusions

Virtual FGs yielded similar numbers of coded excerpts compared to traditional in-person FGs. Virtual FGs appear to support the relative anonymity of participants, resulting in richer discussion of highly sensitive, intimate topics. Findings support the validity and methodologic rigor of using web-enabled technologies for conducting FGs in rare diseases.

Background

A major barrier to conducting rare disease research is that patients with rare diseases are geographically dispersed [1, 2]. Indeed, rare disease studies are typically limited by small sample size (i.e., single-center cohorts), most do not have sufficient power, and many studies are not completed [3]. One approach to overcome such barriers has been to form networks and consortia to aggregate patients and consolidate research on rare diseases [4, 5]. However, there are more than 6000 rare disorders and research networks do not exist for many rare conditions.

In addition to recruitment challenges, geographic barriers also contribute to feelings of isolation and marginalization frequently reported by rare disease patients [6, 7]. For many rare disease patients and parents/families, the internet has been a powerful tool for finding information, locating online patient organizations, and obtaining peer-to-peer support [8]. Researchers have used the internet to enhance enrollment in registries [9] and bolster recruitment for rare disease clinical trials [10, 11]. Some investigators collaborate with advocacy groups (i.e., patient support organizations) to overcome recruitment barriers [12, 13]. Others have embraced less transactional models of research by actively engaging patients as key stakeholders and partners in research (i.e. community-based participatory methods) thereby enhancing patient recruitment [14].

Rare disease patients have been referred to as internet “power-users” due to their facile use of the internet [15]. We have previously validated using community engagement with patient organizations and online recruitment to reach geographically dispersed rare disease patients for quantitative research [16]. However, it is unclear if using web-based technologies for qualitative rare disease research (e.g., interviews, focus groups) produce similar results as traditional, in-person methods.

In this study, we aimed to compare traditional face-to-face and web-enabled (virtual) qualitative research using focus groups (FGs). Given the well-recognized geographic barriers to rare disease research, we considered that demonstrating validity of virtual FGs (compared to traditional in-person methods) could support methodologic rigor of qualitative inquiry in rare diseases and hold implications for the broader rare disease research community.

Methods

The prospective qualitative study involved both in-person (n = 3 face-to-face) and virtual (n = 3 online) focus group discussions. The study was conducted in accordance with the Declaration of Helsinki. The study protocol was reviewed and approved by the ethics committee of the University of Lausanne (protocol #2016_02184) and the Boston College Institutional Review Board (protocol #18.081.01). Participants provided written informed consent or opt-in electronic consent for in-person and virtual focus groups respectively and were offered a $25 gift card as remuneration for study participation.

Participants

Focus group participants included adult patients and parents/guardians of children with congenital hypogonadotropic hypogonadism (CHH, ORPHA174590)/ Kallmann syndrome (KS, ORPHA478). Briefly, CHH/KS is a rare endocrine disorder resulting from deficient secretion (or action) of gonadotropin releasing hormone (GnRH) that clinically manifests as absent/incomplete puberty and infertility [17]. There are a range of non-reproductive phenotypes associated with CHH, most notably about half of patients have impaired olfactory function (anosmia)—a feature that differentiates normosmic CHH from KS [17]. Other associated phenotypes occur at variable rates including midline defects (i.e., cleft lip/palate), skeletal/dental anomalies, unilateral renal agenesis, synkinesia (mirror movements), and sensory deficits (i.e., hearing loss, eye movement disorders) [17]. By current estimates, CHH occurs in approximately 1:48,000 persons [18] with a notable 4:1 (male:female) sex discordance [17].

Unlike many rare diseases, effective treatments are available for inducing secondary sex characteristics (i.e., sex steroid replacement) and specialized treatments (i.e., gonadotropin injections or pulsatile GnRH) can induce fertility in roughly 75–80% of cases [17]). Notably, CHH/Ks is a diagnosis of exclusion and delayed diagnosis is common [19, 20]. Moreover, later diagnosis is associated with increased psychosocial morbidity as well as psychosexual concerns [16, 21, 22]. Similar to the variability in clinical presentation, CHH/KS is genetically heterogeneous. To date, more than 60 loci has been identified to underlie CHH/KS, accounting for approximately half of cases [23]. Inheritance patterns include X-linked, autosomal recessive, and autosomal dominant yet many cases are characterized by incomplete penetrance and variable expressivity [23]. Further, the genetic architecture is complex with digenic and oligogenic cases having been reported [23].

To recruit the purposive sample, we employed a community-based participatory research framework [24, 25]. We partnered with a CHH/KS patient community leader (NS) to co-organize and conduct informational patient meetings (in-person and virtual). Patient meetings provide general information about CHH/KS including an overview of pathophysiology, genetics, diagnosis, treatment options, living with CHH/KS, and health promotion topics. At the close of the informational meetings, English-speaking adult patients (18-years and older) and parents/guardians of a child/adolescent with CHH/KS were invited to participate in a focus group discussion.

Focus group (FG) discussions

The face-to-face FGs were conducted at annual in-person patient meetings (2017–2019). Virtual FGs were conducted over Zoom (January to June 2021). Semi-structured FG discussions (90–120 min) were led by an investigator (AD) and the patient group leader (NS). The question prompts related to experiences around genetic testing for CHH/KS, issues related to decision-making, and discussing CHH/KS with potentially at-risk blood relatives (Additional file 1). All FG discussions were audio recorded and transcribed verbatim. Transcripts were deidentified (i.e., assigning participant numbers) for qualitative analysis (coding). A critical aspect of qualitative inquiry is the concept of saturation—meaning the time at which no new codes emerge. Typically, three to five FGs discussions are needed to reach saturation [26]. We have previously demonstrated that saturation can be reached in three FGs with rare disease patients (i.e., CHH/KS) [27]. We conducted three in-person and three virtual FGs to reach data saturation for each approach to ensure an appropriate comparison of methods (i.e. in-person vs. virtual).

Analyses

We employed thematic analysis for coding FG discussions as previously described [27]. To create the codebook for analyzing FG transcripts, two independent investigators (AD, MU) reviewed and coded the first face-to-face FG transcript using Dedoose (Version 9.0.17, SocioCultural Research Consultants LLC, Los Angeles, CA, www.dedoose.com). Briefly, investigators highlighted excerpts (sections of meaningful content in the transcript) and labeled these with an identifying code (representing a theme or sub-theme). Subsequently, investigators met to create the codebook by discussing themes/sub-themes, collapsing similar codes and operationalizing theme/sub-theme definitions. Differences in coding the initial FG transcript were resolved by discussion to create the codebook. Investigators then used the codebook to independently code the remaining five transcripts for themes/sub-themes. Following completion of consensus coding, focus group transcripts and the list of themes/sub-themes were sent to two additional investigators who served as external reviewers to validate (i.e., ensure all themes/subthemes were appropriately captured) the consensus coding. The patient group leader (NS) and an investigator experienced in qualitative research (SD) served as reviewers to validate the consensus coding.

Participant characteristics are reported using descriptive statistics (i.e., range, median, mean, standard deviation). Codes (i.e., themes/sub-themes) were mapped for presence in each FG discussion (in-person vs. virtual). Inter-coder reliability was determined for both highlighted excerpts and codes. The number of excerpts and codes (themes/sub-themes) appearing in FG discussions were compared to in-person FG #1 excerpt/codes (used to create the codebook). Categorical between-group comparisons were performed using Chi-square tests. Student’s T-test was used to compare the number of identified excerpts and codes between in-person and virtual FGs. A p value < 0.05 was considered statistically significant.

Results

Six FG discussions were conducted including three in-person (n = 33 participants) and three virtual (n = 25 participants). Overall, the purposive sample included 30 males, 18 females, and 10 parents/guardians. Participant characteristics are depicted in Table 1. Rates of male patients and parents/guardians were similar between in-person and virtual FGs. Virtual FGs included more female participants (n = 12 vs. n = 6, p = 0.032). This difference is accounted for by the fact that female patients asked the patient support organization for a dedicated “female only” meeting. Male and female participants were similarly aged between in-person and virtual FGs yet the parents/guardians in the virtual meetings were significantly younger than in-person FGs (31 ± 1.4 years vs. 49 ± 9.9 years, p = 0.04).

Table 1 Characteristics of focus group participants (n = 58)

Qualitative analysis revealed five emergent themes and 16 sub-themes in FG discussions (Table 2). The five overarching themes appeared in all FGs. In total, 13/16 (81%) sub-themes appeared in all FGs (Additional file 2). Virtual and in-person FGs were equivalent in terms of presence of themes/sub-themes (i.e., 3 FGs X 21 themes/sub-themes = 63 possible mentions) and 60/63 (95%) of possible themes/sub-themes appeared in both formats. Of the three absent sub-themes, two related to ‘ethical concerns’—the least noted of the six overarching themes (Additional file 2). The ‘ethical concerns’ sub-themes of ‘informed consent’ and ‘sample traceability’ were absent in in-person #3/virtual #1 and in-person#3/virtual #1/virtual#2 respectively. The sub-theme ‘cost’ did not appear in the in-person #2 FG.

Table 2 Themes and sub-themes appearing in the in-person (33 participants) and virtual (25 participants) focus groups

A comparison of relative contribution of in-person and virtual FG to each theme/sub-theme is presented in Table 2. Virtual FGs accounted for a significantly greater number of collapsed codes for ‘attitudes and beliefs (n = 320 vs. n = 235, p < 0.001), ‘information and support’ (n = 184 vs. n = 99, p < 0.001), and ‘family communication’ (n = 208 vs. n = 114, p < 0.001). Virtual and in-person FGs had similar numbers of codes for ‘return of results’ (virtual: n = 204, in-person: n = 202, p = 0.94). In-person FGs had a greater number of codes for ‘ethical concerns’ (n = 114 vs. n = 41, p < 0.001). Thus, while themes nor sub-themes equally present in in-person and virtual FGs, differences were noted in the weighting of contributions to specific themes and sub-themes.

Inter-coder reliability of independent coding

Thematic analysis of FG discussions yielded a total of 530 excerpts (i.e., highlighted sections of meaningful text) identified by the two independent coders. No differences were observed in the number of excerpts identified by the coders (n = 272 [51.3%] vs. n = 258 [48.7%], p = 0.39). In total, 503/530 (94.9%) of excerpts were identified by both coders supporting the fidelity of independent excerpt identification. Each excerpt was labelled with a code reflecting an overarching theme and/or sub-theme. Excerpts were labelled with more than one theme/sub-theme as appropriate. The codebook (composed of 5 themes and 16 subthemes) was applied by independent coders to identify 875 total themes/sub-themes. No differences were observed in the number of codes independently identified by coders (n = 445 [50.7%] vs. n = 430 [49.1%], p = 0.29). In total, 844/875 (96.5%) of themes/sub-themes were identified by both coders supporting high concordance (inter-coder reliability) of independent coding. Following independent coding of the FG transcripts, two additional investigators served as external reviewers to review the transcripts and code book. External reviewers verified the consensus coding and did not identify any new themes/sub-themes—confirming that data saturation had been met in both in-person and virtual FGs.

Comparison of focus group formats

Virtual FGs accounted for 303/530 (57.2%) of total excerpts. No differences were observed in mean number of excerpts between virtual and in-person FGs (101 ± 7.8 vs. 75.7 ± 18.8, p = 0.26). Virtual FGs accounted for 55.7% of all identified codes. No differences were observed in the mean number of codes between virtual and in-person FGs (319 ± 6.1 vs. 254.7 ± 103.6, p = 0.34) (Fig. 1).

Fig. 1
figure 1

Percentage of total excerpts and codes by focus group. The first in-person FG (black bar) was used to create the code book and was set as the ‘standard’. A Excerpts from in person FGs (n = 113, 53, 61 respectively) did not differ from virtual FGs (n = 96, 110, 97 respectively). B Codes from in-person FGs (n = 374, 188, 202 respectively) did not differ from virtual FGs (n = 315, 326, 316 respectively)

Discussion

Herein we report findings comparing qualitative data collected via two different formats: in-person versus virtual FGs. Comparing qualitative formats requires that a comparable, rigorous approach was used in both groups to enable comparability. In the present study 95% of all excerpts and 97% of all codes (i.e., themes/sub-themes) were identified by two independent coders suggesting high fidelity and inter-coder reliability of the independent coding. Further, the coding was validated by two additional investigators (i.e., an experienced qualitative researcher, patient leader) who served as external reviewers and no additional themes/sub-themes were identified, thereby supporting that data saturation was reached in both FG formats.

Several findings support the validity of using a virtual format in lieu of in-person format for rare disease research. No differences were observed between virtual and in-person FGs in terms of number of excerpts, number of codes, or presence of codes. It is worthwhile to note that while the number of excerpts and codes were normally distributed (enabling use of Student’s T-test), the power was low (0.061, 0.10) and thus interpretation merits caution. Interestingly, as shown in Fig. 1, virtual FGs seemed to yield more consistent results as demonstrated by smaller ranges for excerpts (range 96–110 vs. 53–113) and codes (range 315–326 vs. 188–374). Moreover, examining the specific themes/sub-themes revealed that the virtual focus groups were richer in capturing personal, sensitive discussions. The in-person FGs included significantly more discussion of less personal objective topics (i.e., collapsed theme: ‘ethical concerns’ and sub-theme ‘lack of return of results’). In contrast, virtual FGs had significantly more coding related to personal/sensitive experiences (i.e., collapsed code ‘attitudes and beliefs’, ‘information and support’, ‘family communication’). Thus, while broadly comparable (i.e., number of excerpts, number of codes, code presence), the relative anonymity of virtual FGs may have helped facilitate participants sharing of experiences that were sensitive and private in nature.

Prior studies in other patient populations have highlighted the utility of virtual focus groups for engaging difficult to reach populations (i.e., adolescents) and traditionally marginalized groups (i.e., sex and gender minorities) as well as for collecting data on sensitive topics like sexual health. Among the earliest of examples, a 2008 study examined in-person and internet focus groups for qualitatively exploring relationships of gay men [28]. Investigators concluded that using the internet for qualitative research can enhance sample recruitment and produce trustworthy data. Subsequently, a 2014 study examined how online FGs affected sexual health attitudes/behavior intentions among 75 adolescent gay, bisexual, and queer males. Investigators observed positive effects with participants reporting greater comfort in talking about sex/sexuality and the online format helped them feel less isolated. Additional studies have used virtual FGs for HIV prevention in adolescents [29], examining attitudes towards human papilloma virus vaccine [30], and for eliciting perspectives and preferences for a mobile health tool for men who have sex with men [31].

Cumulatively, prior studies support the position that a virtual format can help overcome barriers to participation for hard to reach and marginalized groups and that participants feel safe and anonymous in discussing intimate topics. Rare disease patients are also hard to reach, overlooked, and patients may feel marginalized by feelings of guilt and shame that accompany a genetic/rare disease diagnosis [27, 32]. Thus, in light of our present findings, it appears that the same aspects that make web-enabled technologies useful for difficult to reach and marginalized sex/gender minorities also hold true for virtual FG discussions with rare disease patients. In other words, virtual focus groups with rare disease patients can reliably be used to complement (or replace) traditional in-person focus groups that are challenging due to geographic barriers. Rare disease patients frequently use the internet use to find information on their condition and obtain peer-to-peer support [15]. Several studies published over the past decade highlight the important role of internet and social media for patients and families living with rare diseases [27, 33,34,35,36]. Moreover, the European Reference Network on Rare Endocrine Conditions underscores the importance of effective partnerships with patient organizations for conducting needs assessments [19, 20, 27, 37]. A key aspect of understanding the unmet needs of rare disease patients involves gaining a deeper understanding of their “lived experience” through qualitative methodology [27, 38]. In the present study we partnered with a patient organization to organize FGs and leveraged web-based technologies to conduct virtual FGs.

It is worthwhile to note that this study has several limitations. First, the sample size (n = 58) is rather limited. However, from the standpoint of qualitative inquiry, the sample size is rather sizeable. Indeed, 58 participants is quite robust for qualitative research in a rare disease population. Second, participants were not matched between groups and more female patients participated in the virtual FG discussions. This observation is due to the request for a “women’s only” meeting during the conduct of virtual FGs. A central aspect of qualitative research is the concept of saturation. Saturation refers to the time at which no new codes emerge. Traditionally saturation is reached by conducting three to five focus group discussions [26]. We have previously shown that saturation can be reached in three focus groups when probing a specific topic with rare disease patients [27]. In the present study we conducted three in-person and three virtual FGs enabling us to reach data saturation and appropriate comparison between methods—as confirmed by external reviewers. Another consideration for the study is that we used statistical methods to compare in-person and virtual FGs. While some forms of qualitative research ‘quantitize’ qualitative findings, qualitative inquiry does not traditionally rely on quantitative analysis. Rather, the goal of qualitative inquiry to gain a deeper understanding of patients’ lived experiences and perspectives. As such, this validation study may veer from traditional views of qualitative research. The rationale for this approach was to support the methodologic validity and rigor of using web-enabled technologies (i.e. virtual FGs) for conducting qualitative research in a rare disease population.

Conclusions

Geographically dispersed patients have posed significant roadblocks for rare disease research resulting in small sample sizes and underpowered studies. As rare disease patients have been referred to as internet “power users”, web-enabled technologies hold promise for reaching dispersed rare disease patients and surmounting geographic barriers for many. To our knowledge, the present study is the first to support the validity of virtual focus groups for qualitative rare disease research. Moreover, the present findings suggest the anonymity afforded by the internet can facilitate discussion of highly sensitive and intimate topics. This observation is important as feelings of stigma and shame are frequently experienced by patients living with a rare disease—particularly in a condition like CHH that has a psychosexual/sexual health component [19,20,21,22]. The present findings support methodologic rigor of using web-enabled technologies for qualitative research using focus groups in rare diseases.

Availability of data and material

De-identified data will be made readily available upon request for research purposes to qualified individuals within the scientific community.

Abbreviations

CHH:

Congenital hypogonadotropic hypogonadism

FG:

Focus group

GnRH:

Gonadotropin releasing hormone

KS:

Kallmann syndrome

SD:

Standard deviation

References

  1. Kempf L, Goldsmith JC, Temple R. Challenges of developing and conducting clinical trials in rare disorders. Am J Med Genet A. 2018;176(4):773–83.

    Article  Google Scholar 

  2. Day S, Jonker AH, Lau LPL, Hilgers RD, Irony I, Larsson K, et al. Recommendations for the design of small population clinical trials. Orphanet J Rare Dis. 2018;13(1):195.

    Article  Google Scholar 

  3. Rees CA, Pica N, Monuteaux MC, Bourgeois FT. Noncompletion and nonpublication of trials studying rare diseases: a cross-sectional analysis. PLoS Med. 2019;16(11): e1002966.

    Article  Google Scholar 

  4. Hiort O, Cools M, Springer A, McElreavey K, Greenfield A, Wudy SA, et al. Addressing gaps in care of people with conditions affecting sex development and maturation. Nat Rev Endocrinol. 2019;15(10):615–22.

    Article  Google Scholar 

  5. Monaco L, Zanello G, Baynam G, Jonker AH, Julkowska D, Hartman AL, et al. Research on rare diseases: ten years of progress and challenges at IRDiRC. Nat Rev Drug Discov. 2022;21(5):319–20.

    CAS  Article  Google Scholar 

  6. EURORDIS. The voice of 12,000 patients: experiences and expectations of rare disease patients on diagnosis and care in Europe. In: Book The voice of 12,000 patients: experiences and expectations of rare disease patients on diagnosis and care in Europe Boulogne-Billancourt, France; 2009.

  7. EURORDIS. The voice of 12,000 patients: Experiences and expectations of rare disease patients on diagnosis and care in Europe. France; 2009.

  8. Fox S. Peer-to-peer healthcare: many people—especially those living with chronic or rare diseases—use online connections to supplement professional medical advice. Washington, DC: Pew Internet; 2011.

    Google Scholar 

  9. Johnson KJ, Mueller NL, Williams K, Gutmann DH. Evaluation of participant recruitment methods to a rare disease online registry. Am J Med Genet A. 2014;164A(7):1686–94.

    Article  Google Scholar 

  10. Krischer J, Cronholm PF, Burroughs C, McAlear CA, Borchin R, Easley E, et al. Experience with direct-to-patient recruitment for enrollment into a clinical trial in a rare disease: a web-based study. J Med Internet Res. 2017;19(2): e50.

    Article  Google Scholar 

  11. Applequist J, Burroughs C, Ramirez A Jr, Merkel PA, Rothenberg ME, Trapnell B, et al. A novel approach to conducting clinical trials in the community setting: utilizing patient-driven platforms and social media to drive web-based patient recruitment. BMC Med Res Methodol. 2020;20(1):58.

    Article  Google Scholar 

  12. Forsythe LP, Szydlowski V, Murad MH, Ip S, Wang Z, Elraiyah TA, et al. A systematic review of approaches for engaging patients for research on rare diseases. J Gen Intern Med. 2014;29(Suppl 3):S788-800.

    Article  Google Scholar 

  13. Merkel PA, Manion M, Gopal-Srivastava R, Groft S, Jinnah HA, Robertson D, et al. The partnership of patient advocacy groups and clinical investigators in the rare diseases clinical research network. Orphanet J Rare Dis. 2016;11(1):66.

    Article  Google Scholar 

  14. Hoekstra F, Mrklas KJ, Khan M, McKay RC, Vis-Dunbar M, Sibley KM, et al. A review of reviews on principles, strategies, outcomes and impacts of research partnerships approaches: a first step in synthesising the research partnership literature. Health Res Policy Syst. 2020;18(1):51.

    CAS  Article  Google Scholar 

  15. Fox S. Peer-to-peer healthcare. Washington, DC: Pew Internet; 2011.

    Google Scholar 

  16. Dwyer AA, Zeng Z, Lee CS. Validating online approaches for rare disease research using latent class mixture modeling. Orphanet J Rare Dis. 2021;16(1):209.

    Article  Google Scholar 

  17. Young J, Xu C, Papadakis GE, Acierno JS, Maione L, Hietamaki J, et al. Clinical management of congenital hypogonadotropic hypogonadism. Endocr Rev. 2019;40(2):669–710.

    Article  Google Scholar 

  18. Laitinen EM, Vaaralahti K, Tommiska J, Eklund E, Tervaniemi M, Valanne L, et al. Incidence, phenotypic features and molecular genetics of Kallmann syndrome in Finland. Orphanet J Rare Dis. 2011;6:41.

    Article  Google Scholar 

  19. Dwyer AA, Quinton R, Pitteloud N, Morin D. Psychosexual development in men with congenital hypogonadotropic hypogonadism on long-term treatment: a mixed methods study. Sex Med. 2015;3(1):32–41.

    Article  Google Scholar 

  20. Dzemaili S, Tiemensma J, Quinton R, Pitteloud N, Morin D, Dwyer AA. Beyond hormone replacement: quality of life in women with congenital hypogonadotropic hypogonadism. Endocr Connect. 2017;6(6):404–12.

    Article  Google Scholar 

  21. Dwyer AA, Smith N, Quinton R. Psychological aspects of congenital hypogonadotropic hypogonadism. Front Endocrinol. 2019;10:353.

    Article  Google Scholar 

  22. Dwyer AA. Psychosexual effects resulting from delayed, incomplete, or absent puberty. Curr Opin Endocr Metab Res. 2020;14:15–21.

    Article  Google Scholar 

  23. Cangiano B, Swee DS, Quinton R, Bonomi M. Genetics of congenital hypogonadotropic hypogonadism: peculiarities and phenotype of an oligogenic disease. Hum Genet. 2021;140(1):77–111.

    CAS  Article  Google Scholar 

  24. Wallerstein N, Duran B. Community-based participatory research contributions to intervention research: the intersection of science and practice to improve health equity. Am J Public Health. 2010;100(Suppl 1):S40–6.

    Article  Google Scholar 

  25. Kwon SC, Tandon SD, Islam N, Riley L, Trinh-Shevrin C. Applying a community-based participatory research framework to patient and family engagement in the development of patient-centered outcomes research and practice. Transl Behav Med. 2018;8(5):683–91.

    Article  Google Scholar 

  26. Hennink MM, Kaiser BN, Weber MB. What influences saturation? Estimating sample sizes in focus group research. Qual Health Res. 2019;29(10):1483–96.

    Article  Google Scholar 

  27. Dwyer AA, Quinton R, Morin D, Pitteloud N. Identifying the unmet health needs of patients with congenital hypogonadotropic hypogonadism using a web-based needs assessment: implications for online interventions and peer-to-peer support. Orphanet J Rare Dis. 2014;9:83.

    Article  Google Scholar 

  28. van Eeden-Moorefield B, Proulx C, Pasley K. A comparison of internet and face-to-face (FTF) qualitative methods in studying the relationships of gay men. J GLBT Fam Stud. 2008;4:181–204.

    Article  Google Scholar 

  29. Ybarra ML, DuBois LZ, Parsons JT, Prescott TL, Mustanski B. Online focus groups as an HIV prevention program for gay, bisexual, and queer adolescent males. AIDS Educ Prev. 2014;26(6):554–64.

    Article  Google Scholar 

  30. Fontenot HB, Domush V, Zimet GD. Parental attitudes and beliefs regarding the nine-valent human papillomavirus vaccine. J Adolesc Health: Off Publ Soc Adolesc Med. 2015;57(6):595–600.

    Article  Google Scholar 

  31. Fontenot HB, Rosenberger JG, McNair KT, Mayer KH, Zimet G. Perspectives and preferences for a mobile health tool designed to facilitate HPV vaccination among young men who have sex with men. Hum Vaccin Immunother. 2019;15(7–8):1815–23.

    Article  Google Scholar 

  32. James CA, Hadley DW, Holtzman NA, Winkelstein JA. How does the mode of inheritance of a genetic condition influence families? A study of guilt, blame, stigma, and understanding of inheritance and reproductive risks in families with X-linked and autosomal recessive diseases. Genet Med: Off J Am Coll Med Genet. 2006;8(4):234–42.

    Article  Google Scholar 

  33. Tozzi AE, Mingarelli R, Agricola E, Gonfiantini M, Pandolfi E, Carloni E, et al. The internet user profile of Italian families of patients with rare diseases: a web survey. Orphanet J Rare Dis. 2013;8:76.

    Article  Google Scholar 

  34. Nicholl H, Tracey C, Begley T, King C, Lynch AM. Internet use by parents of children with rare conditions: findings from a study on parents’ web information needs. J Med Internet Res. 2017;19(2): e51.

    Article  Google Scholar 

  35. Titgemeyer SC, Schaaf CP. Facebook support groups for rare pediatric diseases: quantitative analysis. JMIR Pediatr Parent. 2020;3(2): e21694.

    Article  Google Scholar 

  36. Morgan T, Schmidt J, Haakonsen C, Lewis J, Della Rocca M, Morrison S, et al. Using the internet to seek information about genetic and rare diseases: a case study comparing data from 2006 and 2011. JMIR Res Protoc. 2014;3(1): e10.

    Article  Google Scholar 

  37. Dwyer AA, Tiemensma J, Quinton R, Pitteloud N, Morin D. Adherence to treatment in men with hypogonadotrophic hypogonadism. Clin Endocrinol. 2017;86(3):377–83.

    CAS  Article  Google Scholar 

  38. Kocher A, Simon M, Dwyer AA, Blatter C, Bogdanovic J, Kunzler-Heule P, et al. Patient and healthcare professional eHealth literacy and needs for systemic sclerosis support: a mixed methods study. RMD Open. 2021;7(3):e001783.

    Article  Google Scholar 

Download references

Acknowledgements

The authors wish to thank the patients and parents/guardians who generously gave their time in participating in the focus group discussions.

Funding

This work was supported by the National Institutes of Health Eunice Kennedy Shriver National Institute of Child Health and Human Development (1P50HD104224-01).

Author information

Authors and Affiliations

Authors

Contributions

AAD conceived and designed the work, acquired and curated the data, conducted data analysis, contributed to interpreting the data, and drafted the manuscript. MU conducted data analysis, contributed to interpreting the data and provided critical feedback on the manuscript. SD contributed to interpreting the data and provided critical feedback on the manuscript. NS assisted in acquiring the data, contributed to interpreting the data, and provided critical feedback on the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Andrew A. Dwyer.

Ethics declarations

Ethics approval and consent to participate

The study protocol was approved by the ethics committee of the University of Lausanne (Commission Cantonale [VD] d’ethique de la recherche sur l’etre humain, protocol #2016_02184) and the Boston College Institutional Review Board (protocol #18.081.01). Prior to study participation participants provided written informed consent (for in-person focus groups) or opt-in electronic consent (for virtual focus groups).

Consent for publication

Not applicable.

Competing interests

The authors have no financial or non-financial competing interests to declare.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Focus group questions/prompts.

Additional file 2.

Presence of themes and sub-themes by focus group.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Dwyer, A.A., Uveges, M., Dockray, S. et al. Advancing qualitative rare disease research methodology: a comparison of virtual and in-person focus group formats. Orphanet J Rare Dis 17, 354 (2022). https://doi.org/10.1186/s13023-022-02522-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13023-022-02522-3

Keywords

  • Community based participatory research
  • Genetic testing
  • Hypogonadotropic hypogonadism
  • Kallmann syndrome
  • Qualitative research methods
  • Rare disease