In total, 32 out of 35 (91%) practice staff were interviewed, comprising general practitioners (n = 15), practice nurses (n = 3), administrative staff (n = 13), and a psychologist (n = 1). Three clinicians were unable to attend their scheduled interview, and as data saturation was reached, these interviews were not rescheduled. Interviews were conducted in person at the general practice clinic, or via teleconference, and were audio-recorded and transcribed verbatim, lasting between 17 and 50 minutes (mean = 35.5). Participating staff had been working at MQGP for between 3 weeks and 15 years.
Aim 1: MQ Health General practice as a learning health system
Science and Informatics
An important element of a LHS is the use of digital platforms and EHRs. When asked about access to digital platforms to aid in their day-to-day work, several respondents highlighted the benefit of the practice’s affiliation with the university, which allowed for access to research and evidence through the university’s subscription to educational resources that may otherwise be inaccessible due to the associated high costs:
“I’m lucky because I work at the University, so we do have we do have access to [subscriptions], we have the Macquarie University ID you can access that through the library … outside of this clinic it can get quite expensive” (GP2)
In addition to university-provided subscriptions, the local Primary Health Network (PHN) provided access to HealthPathways, an online primary care support tool(23), and CAT4, a clinical audit tool that gives practitioners an overview of their patient cohort as well as facilitating quarterly data transmission to the PHN to understand practice data in comparison to other practices in the same geographic location (24). The CAT4 tool was able to extract data from the practice management and billing software and was accessible to all staff on request. Despite this, many GPs and administrative staff reported being unfamiliar with the software, and unaware of its utility. Of the GPs interviewed, nine had heard of the software, but only three had used it. Similarly, three of the administrative staff were familiar with the software, and only one had used it. On the other hand, all three nurses were aware of the software, with one having previously used it in the practice. Nevertheless, generally, practice staff expressed an interest in learning more about its utility:
“I’ve had it shown to me, but I haven't had to use it directly myself, so I know it conceptually, I think I could quite comfortably sit down and extract data and use it.” (GP10)
“As a practice we use it, I don't necessarily do the extractions. [At] the practice I [previously worked] at I used to lead the accreditation, so I had become familiar with [CAT4 provider]and actually looking at things.” (GP3)
Recently, the practice had also trialled an app to provide patients with access to their medical records and streamline the care process within the practice, as well as track referrals, prescriptions, and imaging results. The app was provided to patients at no cost and holds patient data for up to ten years.
“We were looking at a way that patients can access the record and minimize the work that admin have to do and doctors have to do … that happens so often in our day, we are reprinting or re-emailing … that was one of the reasons for thinking about this app, because it is one app that does all of that.” (ADMIN12)
Benefits of the app included simplified communication between patients, clinicians and the administrative team, and prevention of overlap in the work conducted. However, in real time, the app demonstrated limited use to inform clinical decision-making, instead serving as more of an administrative assistant tool and enabling digital record keeping for patients.
Patient-clinician partnerships
A key element and outcome of a successful LHS is patients who are empowered and engaged in their own care(4). Practice staff were asked to describe current and future patient involvement within their practice. Staff outlined several ways that patients could be involved with the practice, with the most notable being a focus group, where patients were given the opportunity to provide feedback on the recently developed app for the practice:
“We've been looking at an app called MyPractice so that the patient is more in control of their scripts, referrals results … We just weren't sure how patients would feel about that, so we ran a patient focus group, and that went really well.” (GP12)
Many staff members recognised the potential benefit of receiving regular, formal feedback from patients, whether in written survey format or via focus groups. However, there was mixed sentiment around how best to involve patients in the practice, considering issues surrounding patient recruitment and potential risk of bias:
“You couldn't take a random selection of patients. You have to be quite intentional about patients that you select. Some people don't have much health literacy … you're not going to get valuable feedback from someone who doesn't really understand system to begin with.” (GP15)
Recently, the practice had begun to seek reviews from patients about their experiences visiting the clinic, following consultations with the university hospital. Clinical staff commented on the benefits of these online reviews as a means of collecting patient feedback, connecting with patients and following up on patient concerns.
“[A] patient made some comments on a Google review about how our booking system [has] been going. They identified some problems and [ADMIN1] saw this message, and he took action on it. I think he actually contacted the patient ask what's the problem?” (NUR2)
The involvement of patients in the practice was twofold: holding focus groups served to engage patients in the early stages of implementing new initiatives, whilst actively collecting feedback via online reviews gave patients a role in QI initiatives.
Incentives
Two important applications oof incentives in an LHS model are: using incentives to reduce low-value care, as well as to assist with implementing changes within the organisation to stimulate its LHS journey. Financial incentives within the practice included key performance indicators (KPIs) and salaries for the doctors, often purported to increase value-based care instead of volume-based care. KPIs were awarded not only on the volume of care delivered, but also for engagement in teaching activities.
“As part of our contract, we have KPIs. If you do meet your KPIs which are around your contributions to the practice, to education, to research, if you're meeting all four or five criteria you'll make a percentage on your billings, the gap between your threshold and your billings” (GP1)
As this model extended only to medical staff, some doctors made suggestions on how best to create an incentive system in the practice that benefits all staff and fosters collaboration instead of competition:
“Part of the issue is getting the philosophy of what's a proper incentive system … because it can then drive behaviours. You don't want it to be competing with your colleagues, you want it to be collaborative and fair ... It also has to be inclusive, one of the discussions we're having at the moment is why would you have incentives for the doctors and not the nurses and the administrative staff.” (GP10)
Another characteristic of the LHS incentives is transparency. Securing suitable levels of transparency involves ensuring that care is continually improved among multiple dimensions (safety, quality, processes, costs and outcomes). Both administrative and clinical staff focused on the importance of making health outcome metrics available to patients:
“We had this idea of having metrics that were readily available- the internal metrics, but also external metrics, depending on our website- measures for each of the Quadruple Aim … we haven't settled on what we would publish and a system for maintaining that.” (ADMIN1)
A unique element of MQGP is its proximity to specialist clinics and hospital facilities, allowing for patients to be referred to specialists on-site. As a private billing organisation, one doctor highlighted the need for transparency about out-of-pocket costs associated with patients being referred to specialists that operate adjacent to the general practice. Other doctors commented on the importance of patients knowing additional information about specialists, such as the days that they work and their subspecialties.
“It’d be useful to have an idea of out-of-pocket costs … to be able to give them some idea of what they might have to pay. It actually starts with us as well, the transparency about referrals” (GP15)
All of this suggests that MQGP broadly values transparency and has moved away from traditional approaches to funding and incentivising medical staff. Including both salaries and KPIs as financial incentives encourages not only value-based care, but also involvement in other research and teaching activities, which are important components of an LHS.
Continuous learning culture
Vital to the success of an LHS is the culture of learning; which is one supported by leaders within the organisation, and emphasises ongoing reflection and skill-building for staff(5). The most frequently referenced aspect of the continuous learning culture by staff were the weekly update emails that were circulated by the business manager. These emails included updates on changes to health guidelines (particularly pertaining to COVID-19), invitations to educational events, and publicly acknowledged staff achievements. These updates were welcomed by clinical and non-clinical staff alike.
“We get a newsletter every week from [ADMIN1] who is our manager, and he updates protocols on a weekly basis.” (ADMIN 12)
The university environment was identified as a contributor to a culture of learning within the practice, as it presented frequent opportunities to engage in teaching, supervision, and learning:
“That's the other thing … if you're teaching students you have to make sure that your knowledge is up to date as well, its inherent in this environment.” (GP7)
“They provide educational sessions, they have collaborative discussions with each other. I think a lot of us are involved with the university. They provide us with access to resources and we've got social media groups that we can work together to improve learning as well” (GP2)
One doctor highlighted the value of grand rounds at the adjacent hospital as both an opportunity to learn and meet specialists that worked in the adjacent clinics:
“Grand rounds was probably the most powerful unifying meeting or unified one single point of contact for the whole of the clinic and it was very solidifying. Everyone was there once a month, chit chat beforehand, chit chat afterwards” (GP6)
The practice’s affiliation with an academic institution was the greatest contributor to the culture of learning, predominantly through opportunities for staff to be involved with teaching and supervision within the university. Furthermore, the value placed on learning and reflection by the leadership team, and the constant communication to staff created an environment where staff were engaged in educational initiatives.
Structure and governance
‘Structure and governance’ were proposed in 2020 as an addition to the IoM’s framework for LHSs(5). Governance structures can assist to facilitate progress toward an LHS by enabling policies and regulations that facilitate research, collaboration and learning. Participants were asked about what governance structures were in place to contribute to the learning culture in the practice. Such structures included multidisciplinary working groups for chronic disease management that involved both clinical and non-clinical staff, and a mentoring system between doctors, nurses, and administrative staff.
“We have a doctor-buddy system as well. I'd be allocated to three or four different doctors, but then there'd be a few admin staff as well” (ADMIN9)
Participants were also asked about the nature of the collaborations for staff within and between the two GP sites, as well as with staff in the adjacent specialist and allied health clinics. Responses revealed that despite co-locating within one building with the specialist clinics, there were few opportunities to interact besides when referring patients.
“I think there is a lot of collaboration between each [MQGP] clinic, it's kind of odd though that there's not a lot of collaboration between uni clinics. We are all sharing the same building, I always thought that that was kind of odd.” (ADMIN3)
Whilst the practice did not have specific policies in place to facilitate learning and collaboration, they were implicit. The willingness of leadership to participate in research and QI initiatives enabled facilitation of several aspects of the LHS, further emphasising the crucial role of leadership in creating a culture of learning.
Aim 2: Outcomes from the embedded research
Embedding a researcher within a site of healthcare delivery has clearly articulated benefits in the research process by enhancing access and buy-in among participants and facilitating system learning(25). Ideally, such a researcher should be co-located within the site, if only on a part time basis. This was the original plan in this study, however, two months after agreeing to include an embedded researcher, the outbreak of the Delta variant of COVID-19 resulted in a city-wide lockdown of Sydney, lasting 107 days, and limiting the prospect of physical co-location. Despite the impact of COVID-19, the embedded researcher coordinated regular monthly meetings of the project steering committee, and fortnightly meetings with the business manager and one academic GP. The researcher was also included in the practice emails and was able to access and use the CAT4 software to better understand the demographics of the practice population. These remote ways of working, ubiquitous in the COVID-period, still allowed for some degree of embedding to occur. From these strategies the researcher gained detailed insights into methods of staff communication, day-to-day clinic activities, acceptability of implemented initiatives (e.g. mobile phone app) and changes to practice operations aligning with changing COVID-19 guidelines. Despite the significant impact of COVID-19 on the healthcare system, the embedded research approach was facilitated in part through the engagement and commitment of the clinical and administrative practice staff, reflected by their regular attendance of steering committee meetings and ongoing communication with researchers.
The embedded researcher model offers broader benefits in exposing a health system workforce to empirical research, and supporting longer-lasting and more meaningful partnerships between them and researchers, as opposed to transactional, project-based work (26). A range of metrics point to success in this regard over the duration of the study: the project team expanded to include two additional GPs: one senior academic GP, and the other a recently trained GP. Furthermore, the Business Manager (FL) at MQGP took up an adjunct research role within the institute where the research was taking place, and one GP planned to undertake a PhD under the supervision of some members of the research team. The embedded researcher (GD) and senior research fellow (LAE) also joined another QI study with members of MQGP. The partnership between the practice and research institute leveraged further research opportunities, resulting in additional grant and funding applications that were led by clinic staff, and supported by the researchers.