Figure 1 shows the PRIDI model for D&I. It depicts the dynamic connection between the cyclical process of executing and evaluating D&I (center), the intervention and strategies (left side), the multi-level nature of the context (upper side), and goals and outcomes of D&I (right side). Consistent with recent emphasis on iterative and pragmatic nature of D&I, (25, 26) its journey is not a linear process, particularly in the fluid and dynamic contexts of emergencies. This cyclical process of Assess > Plan > Do > Evaluate > Report should be done quickly and iteratively as an intervention and strategies to support it are rolled out. (27)
As shown in Fig. 1, we incorporated this cyclical process to the center of the PRIDI model. The cycle of D&I itself activates lateral cycles (shown by the cyclical relation between the middle circle and three arms), which involve revisiting the mental models, goals and outcomes, interventions and D&I strategies, and individuals and contexts, through the course of D&I cycles. It resembles a double-loop learning model. (28, 29) This is particularly critical in emergencies, where traditional mental models may not fit the emerging problems and contexts. If we apply Plan > Do > Study > Act (PDSA) cycles using existing models i.e. single loop learning, we might fail to learn from the higher order feedback loops that requires more than incremental improvements in efficiency and time. Second order learning might inform entirely different approaches based on different assumptions and different mental models.
To the extent possible, monitoring and evaluation should be prioritized, and results should be regularly communicated with stakeholders, and meaningfully and consistently incorporated in any re-design or planned adaptations/modifications within the system. (2) If an intervention or a D&I strategy is not working, it should be modified or abandoned (de-implemented) in a timely manner. Evaluations and monitoring may include information that changes the nature of the evidence supporting the effectiveness of the intervention itself or strategies to support its use (see cyclical path from the implementation to effectiveness).
The engagement of stakeholders within these dynamic contexts is critical throughout this process to understand what is working or not and why, where inequities are emerging, and the feasibility and acceptability of the programs and practices. The double loop nature of the process also has implications for engagement of diverse stakeholders in the context of psychological safety where people feel free to express contrarian views thus fostering opportunities to challenge conventional assumptions. For example, suppose we assume that African Americans by virtue of higher SARS-CoV-2 infection rates and worse outcomes will have higher demand for COVID-19 testing and vaccines in development. This would be a reasonable assumption from which we could develop cyclical PDSAs for messaging. This assumption would suggest that finding ways to promote awareness in the African American community regarding where to get tested and where to receive the future vaccine will reduce disparities in infection. Yet, if the African American community were at the table and divergent views were encouraged based on recognition of second order learning, members might express reservations about COVID-19 testing including risk for family separation, forced quarantine with pay, and greater stigma. Similarly, members might voice deep skepticism towards receiving future vaccines including mistrust of government statements, concerns about being guinea pigs for a vaccine that has been rushed to market, and/or concerns about the vaccine containing virus. This second order learning might suggest a fundamentally different approach rather than incremental changes in content, dose or frequency in messages.
In Table 1, we summarized the suggested aspects of D&I activity that should be collected, discussed, and re-evaluated at each round.
Table 1
A template for recording progress in PRIDI cycles
Rounds | | D&I goals | Intervention/Evidence | Intervention Adaptations/Refinements | Individuals: Users, D&I actors | Settings (Inner and Outer Context) | D&I strategies | Other Key Stakeholders | D&I/Effectiveness Evaluation Metrics (RE-AIM domains) with a focus on equity |
Round 1 | Description | | | | | | | | |
Opportunities and challenges | | | | | | | | |
Plans for next round/plans to address challenges | | | | | | | | |
Round 2… | Progress/ Adaptations/ Revisions | | | | | | | | |
Opportunities and challenges | | | | | | | | |
Plans for next round/plans to address challenges | | | | | | | | |