This research project embraces several recently described best practices for designing a quantitative PPS, in particular the importance of high-quality qualitative research, involvement of patients as partners, conducting scientific advice with a health authority, and initiation of the research very early in the product lifecycle2,3,6,36,37,25,35,38–43. Our manuscript is one of the first examples to describe FDA scientific advice, how the process was conducted and how the input informed and improved the design of the PPS, building on the work of others37,11,12 to illustrate the value created through this activity.
Early consultation supports the FDA’s recommendation of “early and often” dialogue between the Agency and study sponsors. Scientific advice ensures the design and methodology are fit for purpose and that studies meet Health Authority (HA) expectations, so that results can appropriately inform decision-making. To date, however, there are very few examples in the literature of the scientific advice / HA feedback process as it pertains to the design of a PPS: Tervonen and colleagues11 have described a successful FDA Type C meeting process to inform the design of a DCE with alopecia areata patients, with changes made to the design based on the FDA feedback. Additionally, a recent conference panel discussion on maximizing the impact of patient experience data in regulatory decision-making, presented a case study where a patient preference study was designed to support benefit-risk trade-off discussions with the FDA on new product submissions, with a Type C and subsequent follow-up meetings held to inform the final preference study protocol and study design12. While the Type C meeting was considered successful, the process took 31 months, leading to recommendations for how the process could be improved in future. Two further examples of scientific advice regarding patient preference studies have been conducted with health technology assessment (HTA) bodies in Chronic Obstructive Pulmonary Disease (COPD) and multiple sclerosis8,9,10.
Our scientific advice discussions with the FDA CDRH allowed for the PPS design to evolve as an industry/patient/HA interaction. Such collaborative effort in this novel area of preference research is of utmost importance, where all stakeholders are learning and gaining knowledge about acceptable approaches to PPS design that ensure studies and their results will meet the needs of decision-makers. In our experience, working with CDRH at FDA was smooth and was completed within six months. The initial informal discussions helped establish the information needed and format of the formal advice meeting, culminating in an efficient process and advice that was considered appropriate, timely, fit-for-purpose, and not prohibitive. This led to improved focus of the preference study design, which should enhance the richness of the study results. Whilst scientific advice on preference study design, especially advice sought very early in the product or device lifecycle, is still in its infancy and evolving as a concept, our experience was positive and will hopefully serve as a model that others can follow. More such examples are needed from other medicine and/or device developers working with decision-makers on PPS design, so that the advice process can be further optimized.
There is a recent evolution of the interaction between industry and the patient community6,42, going beyond the more traditional involvement of patients at specific touchpoints of the research, to engage patients as study members across the entirety of a project, as true research partners in all aspects of the research design, conduct and interpretation of results1,43. Building on other recent best practice examples in this area44 the observation that several of the recommendations made by patient partners in our study concerning design aspects and focus, were in alignment with advice obtained from the FDA through scientific advice, is a testament to the value created through their involvement. As discussed during the FDA advice meeting, the preferences of MS patients cannot automatically be assumed to represent the preferences of patients with other diseases (particularly those where characteristics of the disease and its course may differ greatly from MS) and thus, the additional engagement with people living with MS post-FDA meetings helped refine the A&L grid of the future quantitative PPS.
Consistent with previous research15–18,23,45,46 the insights generated through the qualitative research with patients, caregivers, and HCPs, suggest an attraction toward easy-to-use devices for self-administration in the home setting. Ross et al.22 have shown in a multi-country study, that independent, easy to perform self-injection were the most important device attributes for autoinjectors ranked by both MS patients and nurses. Our quantitative DCE will further evaluate the relative importance of different SC device features (see Table 5) to MS patients, a population known to place high importance on the mode of treatment administration but also exhibit heterogeneity in their individual preferences10.
Strengths of our study are based upon the comprehensive qualitative research using mixed methods, with a diverse representation of MS patients, to build a PPS design that is relevant and meaningful to the patient target group and should avoid uncertainties and misunderstandings when patients participate in the survey. The qualitative research addressed improvements to the survey design (target groups, geography, statistical analyses) and to the DCE attributes and levels. Comprehension of the DCE survey by participants will be ensured through the educational materials designed with the input of patient partners and MS patients during these qualitative research phases.
As regards study limitations, the study is designed based on hypothetical devices and features in a virtual research environment, the patients having no physical contact with the devices in consideration.
The research we have conducted was limited to experienced patients in research panels and patient support groups and with internet/computer access, with the risk that this may exclude some segments of the patient population. Nonetheless, the target quotas set, as well as non-screening variables (e.g., income, region, health literacy) aimed to adequately frame outputs with respect to the general USA MS population.