Study Selection
A total of 1,030 articles were identified in the PRO guidelines search, and after removing duplicates with other sources such as additional records from experts, a total of 1,039 titles and abstracts were reviewed. After full-text reviews of 65 articles, 41 articles were found to have satisfied the inclusion criteria. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flowchart in Figure 1a shows the process of selecting the article information. Regarding books, a total of 490 books were identified, and 296 titles and abstracts were selected after removing duplicates. As a result of full-text reviews of the 37 books, six books were found to have satisfied the inclusion criteria. The PRISMA flowchart in Figure 1b shows the process of selecting the books. In the combined review of the articles and books, we re-evaluated them from the perspective of guidelines not intended for specialists, and ultimately, incorporated information from 25 articles and one book into this study.
Overview of guidelines
Since the issuance of the FDA’s PRO guidelines in 2009 [9], the number of issued guidelines has increased (see Figure 2, years of publication). From 2009 to 2016, a total of 11 PRO guidelines were published. However, in 2017, the year after the issuance of the EMA PRO guidelines [11], a total of 14 PRO guidelines were published. Table 1 provides an overview of the articles and books included in this study. The selected guideline designations were guidelines (n = 6) [11,24,25,26,27,28], recommendations (n = 6) [29,30,31,32,33,34], guides [35,36], task force reports [37,38], educational reviews [39,40] (all n = 2), and guidance [41], that were used as search terms, while expert-recommended guideline designations were checklists [42] and reflection papers [43] (both n = 1). Guidelines on clinical trials were 16 in number and covered a wide range of PRO measurement processes such as design and reporting (n = 8) [11,25,29,27,39,35,36,41], questionnaire preparation (n = 14) [11,24,43,29,30,31,27,44,32,37,35,40,36,41], collection method including ePRO and analysis (n =11) [11,44,32,33,34,39,28,35,40,36,41], and clinical interpretation (n = 5) [11,39,28,35,36]. However, five guidelines on clinical practice [26,35,36,40,42] that cover a wide range of PRO processes, from PRO assessment design to feedback, treatment choice, and electronic health records, although they omit detailed descriptions of the PRO analysis, were included. Guidelines on the application of PRO in decision-making, such as HTA [38], comprised one study. Finally, the pilot selected two disease-specific PRO guidelines: one was related to the clinical interpretation of PRO (MID or MCID) in clinical trials [28] and the other was an educational review for integrating PRO into daily clinical practice [40].
Summary of review results
The collected PRO guidelines were classified according to the stage (evaluation or application for decision-making) of evaluation (clinical trial or clinical practice) and evaluation process (design, questionnaire preparation, collection method and analysis, clinical interpretation of the results, or feedback). Their brief descriptions are as follows:
1. PRO measure in clinical trials and research
1.1 Design and report of research using PRO
The design and reporting of clinical trials are inextricably linked [11]. After the Consolidated Standards of Reporting Trials (CONSORT) Group published its reporting format for clinical trial results in 1996, the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) Group issued a statement on clinical trial protocols in 2013. The two groups have been updating and extending the items in coordination with each other, and extensions to the PRO measures were provided in 2013 [24] and 2018 [25] (see Appendix II for details on the extended items by CONSORT-PRO and SPIRIT-PRO).
1.2 Questionnaire preparation for research using PRO
1.2.1 Qualitative research and survey instrument development
Qualitative research involving patients' subjectivity and experiences can serve as the basis for providing scientific evidence to complement the research [45]. Qualitative research is also adopted as a procedure in a series of instrument development procedures to validate the conceptual framework, item creation, and content validity of scales [9], and in self-report by interview, provided that the interviewer records only patient responses [11]. The Standards for Reporting Qualitative Research: A Synthesis of Recommendations [46] and Consolidated Standards for Reporting Qualitative Research [47] have been developed to facilitate qualitative research.
1.2.2 Copyright issues and translation
Several PRO questionnaires have been developed and owned by third parties. Therefore, it is important to first check with the owner of the instrument if translation is possible and then obtain a license and author's agreement [43]. General guidelines for the translation of PRO questionnaires [48] have been provided by the ISPOR Task Force and are referred to in the guidelines of the FDA [9] and EMA [11]. However, several issues need to be considered even for questionnaires in the same language for multinational clinical trials, and Wild et al. [29] have summarized recommendations for them. McKown et al. [30] pointed out that considerations in the translation of PRO questionnaires have an impact on other elements of COAs.
1.2.3 Selection of PRO measures
What are the minimum requirements for the selection of PRO measures? The ISOQOL scientific advisory task force listed the following requirements [31] for the selection of PRO measures: 1) conceptual and measurement model, 2) evidence for reliability 3) content validity, 4) construct validity, 5) responsiveness, 6) interpretability of scores, 7) quality translation, and 8) acceptable patient and investigator burden. Crossnohere et al. [49] compared the above requirements with other regulatory guidelines [9, 11, 31] and developed the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) guidelines [26,27,50,51] as core indicators of PRO measure selection.
1.3 Collection method and analysisof research using PRO
1.3.1 ePRO
PROs used in clinical trials and research are increasingly electronic PROs (ePROs), with references in the FDA [9] and EMA guidance [11], and four of the 16guidelines in this review were specific to ePRO. Byrom and Muehlhausen [44] summarized the following essential components of ePRO: ePRO design, migration validity consideration [32], language processing, system validation [37] when conducting ePRO assessments, training of users [33], and "Bring Your Own Device (BYOD)."
1.3.2 PRO assessments collecting safety information
Although drug safety information is already collected during the clinical trial phase, the systematic collection of PRO assessments in the post-marketing phase is limited, except in oncology. Therefore, Banerjee et al. [41] proposed a framework for defining, collecting, and analyzing post-marketing adverse events by refining the PRO measurement methods adopted in clinical trials.
1.3.3 Analysis in research using PRO
Although the guidelines for trial design and reporting are provided in Section 1.1, it is important to note that Coen et al. [34] categorized the remaining challenges using the example of interpreting the results of clinical trials in cancer specific to PRO measurement, including the taxonomy of study objectives, statistical methods consistent with objectives, definition and management of missing data, and providing recommendations for addressing them.
1.4 Clinical interpretation
PRO guidelines [9,11] recommend the use of predefined measures (anchors) to facilitate a reasonable definition of "response" and "deterioration" in individual patients and the interpretation of PRO data. Wyrwich et al. [39] cautioned that the cumulative distribution function of the response recommended in the FDA guidance [9] cannot replace anchor-based methods. Cocks et al. [28] provided examples of the clinical significance and interpretation of major changes based on these definitions in their meta-analysis of clinical trials using data from the European Organization for Research and Treatment of Cancer (EORTC) the Quality-of-Life Questionnaire Core 30 (QLQ-C30).
2.PRO assessment in clinical practice
2.1. From design to feedback of PRO assessment
Following the creation of a 'User's Guide to Implementing PRO Assessment in Clinical Practice' [14] by ISOQOL in 2011, revised in 2015[52], a Companion Guide [35] was released to assist PRO assessment implementations in clinical practice and overcome implementation challenges based on information from a semi-structured survey or telephone interview.
Both guides consisted of: 1) identifying the goals for collecting PROs, 2) selecting patients and settings, 3) determining which questionnaire(s) to use, 4) selecting the timing of assessments, 5) choosing a mode for administering and scoring the questionnaire, 6) identifying aids to facilitate score interpretation, 7) designing processes for reporting results, 8) developing strategies for responding to issues identified by the questionnaires, and 9) evaluating the impact of PRO assessment on clinical practice.
2.2 PRO for clinical decision-making
In Section 2.1, in addition to the assessment of PROs for individual patients, an application of the results was presented as "responding to issues identified by the questionnaires."[14,35,52]. However, guidelines for the application of PRO measured in clinical trials to routine clinical practice have been identified by Wu et al. [42] recommending the use of PRO reporting literature and COSMIN guidelines [26,51] for systematic reviews.
2.3 Embracing PRO in routine clinical practice
As indicated in a series of ISPOR guidelines [14,35,52], Ivatury et al. [40] summarized how to incorporate PRO into routine clinical practice, specifically in an educational review of instrument selection, delivery methods, frequency of inquiries, and costs and resources for the systematic collection of PROs. Snyder et al. [36] summarized the integration of PRO into electronic health records (EHRs) as a system of guidelines covering strategies, training, and assessment, as well as administrative, ethical, and legal considerations.
3.PRO application for decision-making
Decisions are made using PROs in the context of reimbursements through HTA. Haywood et al. [45] described eight key stages in the development of PRO measures used in HTA and discussed ways to involve patients in the process. Many clinical studies employing PRO measures do not include preference-based measures (PBMs) to calculate the required utilities for HTA and lack a relevant preference-based scoring system. Mapping aims to fill these evidence gaps, and the ISPOR Task force [38,53] has provided detailed guidance regarding the procedure.