Patient characteristics explained the bulk of the variance in associations between practices and outcomes. Nevertheless, there remained sufficient variance at the level of practice to be considered a target of policy, interventions and ongoing data monitoring. The largest practice-level variance was 17% for ED attendance. The highest rate for ED attendance was in Trust/NGO practices, and the lowest in HCH and Pacific practices. The regressions further allowed us to assess the associations of seven practice models of care, after adjusting for patient and practice characteristics. There were 36 associations between model of care and patient outcomes (six outcome regressions for seven models less a reference model). Twenty-four associations were statistically non-significant, indicating no difference in outcome attributable to model of care after adjustment for patient and practice characteristics. At the level of model of care there were seven associations with worse patient outcomes and four associations with better patient outcomes. While some findings are small in absolute terms, it should be noted that they are cumulative over time and over the six outcomes measured. Furthermore, there are likely to be similar small but cumulative differences accruing across multiple health outcomes we did not measure.
Broadly, models fall into two groups, based on patient profiles and outcomes in Tables 2, 3, 4 and 5; Traditional, Corporate, HCH and PHO/DHB; and Trust/Other, Māori and Pacific. This is consistent with the fact that most Corporate, HCH and PHO/DHB practices started life as Traditional practices. It is also consistent with the overlap of classifications Trust/Other, Māori and Pacific practices shown in Table 1.
Traditional practices as a reference
In the regressions, Traditional practice was used as a reference group for the other ownership categories of Corporate, PHO/DHB and Trust/NGO. In 14 of 18 estimates, Traditional was not statistically different from these models. Because 73% of all patients were enrolled in Traditional practices, these had a dominant effect on the overall averages for each outcome. These averages can be directly compared with the estimates for other models of care and for explanatory variables. Table 3 shows Traditional practices to have the highest rate of HbA1c testing, while being mid-range for rates of cervical smears and cardiovascular risk assessment.
Trust/NGO, Māori and Pacific practices
One or more of these practice models show worse patient outcomes for HbA1c testing, immunisations, child ASH, adult ASH and ED attendances (Table 5). In each case worsening outcome is also associated with increased GP and NP consultations combined, often also with increased GP and RN time. Together, this seems to show that practices increase clinical input in response to need, but the increase was not sufficient to meet overwhelming patient need. That need, and related complexity, is shown in high levels of poverty (quintile 5, IMD) and comorbidity (M3, diabetes, and need for specific medications) (Table 4).
Most of these practices had low patient fees. Very Low Cost Access contracts were held by 94% of Māori practices, 87% of Pacific practices and 78% of Trust/NGO practices, compared with the national average of 30%.
Trust/NGO, Māori and Pacific models, compared to other models, had higher ratios of nurses to patients, GPs to patients, and nurses to GPs (Table 4). This suggests differences in function within the models, which are discussed further in the accompanying Nursing paper in this Journal.
Māori practices
Many Māori Provider Organisations were established in the 1980s as predominantly nursing services that employed GPs. These services placed an emphasis on meeting the clinical and cultural needs of local communities. In this study 34% of Māori practices were considered rural which is twice that of the overall practice average (17%).
Patients enrolled in Māori practices showed a lower rate of polypharmacy in people over 64 than patients enrolled in other practice models. A beneficial effect of lower polypharmacy might be mediated by engagement in a culturally safe environment with gains, for example, in communication, health literary, and adherence to therapies and prescribed medications [41–43]. However, given the suggestion above that Māori practices are overwhelmed (together with Trust/NGO and Pacific practices), lower polypharmacy might indicate under-prescribing. Overwhelmed practices seem the likely explanation for lower rates of HbA1c testing and immunisations.
Pacific practices
ED admissions were lower in Pacific practices. These practices were all in urban areas. The enrolled population in a given practice often comprise (mostly) a single Pacific ethnic population using a shared first language. There is some evidence that language is a primary barrier to Pacific peoples engaging with primary care that, elsewhere, is largely conducted in English [44]. Pacific practices also have a high ratio of nurses to patients; all nurses speak English but many also speak one or more Pacific languages. Cultural concordance goes beyond language as noted above for Māori practices.
Corporate practices
Adult ASH rates were higher in Corporate than Traditional practices. Corporate practices that serve large numbers of patients in urban, high need areas are typically accessible via longer opening hours and lower fees than are Traditional practices, suggesting they could be more readily available to provide care that reduces need for ED attendances or hospital admissions. It is possible that referral patterns from primary care to hospital varies between practice models, but we have no data to explore this. Furthermore, patients can attend ED and be admitted to hospital without going through primary care, but it is not known whether the rate of self-referral varies between models of care.
In terms of preventative care, Corporate practices achieved the highest rate for cervical screening, while being at the low end for cardiovascular risk assessment and mid-range for Hba1c testing.
There appear to be differences in prioritisation of preventive care between models of care, for reasons that are not clear. Cardiovascular risk assessment attracted fee-for-service funding, as a national target, at the time of this study. HbA1c testing, as a component of a free diabetes annual review, had long been subject to a fee for service although this had ceased well before this study. Cervical screening has never been subject to national targets or a fee-for-service subsidy except in local initiatives for women considered high risk.
Health Care Homes
The enrolled population profile for HCH practices showed lower patient need than for all practice models except Traditional. HCH practices were associated with a higher immunisation rate, fewer ED attendances and the lowest rates of cervical screening and cardiovascular risk assessment. The HCH Collaborative emphasises systematic care processes and data recording [18]. It is uncertain how well developed the defined HCH features are in non-certificated practices that have started HCH implementation. At the time of this study only 14 of 127 HCH practices were certificated as mature examples of the HCH, with others newer to this style of practice. Early adopters of the HCH model were self-selected and were acknowledged to be high-functioning Traditional practices. As the model is spread further, the same level of performance may not be achieved in all practices. Nevertheless, all HCH practices have committed to uniform standards which may result in less variation between HCH practices than between practices in other models.
Immunisations
Immunisation at 6 months were lower in Māori practices and Pacific practices than for others. With the immunisation schedule requiring vaccines at 6 weeks, 3 months and 5 months, measuring immunisation rates at 6 months leaves a window of only one month in which to administer vaccines due at 5 months [36]. Residential mobility is one barrier to timely immunisation. The proportion of patients who changed practice in the previous year, in our data, was 21% overall but 27% in Māori practices and 33% in Pacific practices. While dissatisfied patients do change practice, it is perhaps more likely that these data reflect residential mobility, some of which will be associated with poverty [45]. Another barrier to immunisation is respiratory infection, a common reason to delay immunisation, and there is evidence of high rates of respiratory illness in Māori and Pacific children [46].
Primary care clinical input
We considered the level of primary care clinical input (GP, NP, RN consultations and time) into the management of individual patients to be a marker of patient need. Secondary care clinical input via First Specialist Assessment is considered to be a measure of both patient need and primary care response by referral.
Primary care clinical input was associated, independent of practice models, with higher (worse) outcomes for polypharmacy, child ASH, adult ASH and ED attendances, and higher (better) outcomes for HbA1c testing and immunisations. This suggests that, independent of model, primary care clinical input was sufficient to meet need for HbA1c and immunisations but not for the other outcomes. This implies a need for more GPs, NPs, RNs and other health care workers, across models, to address hospital use in particular.
HbA1c testing and child ASH
HbA1c testing is a direct measure of quality of care because it is a necessary step on the pathway to good glucose control. Associations with decreased HbA1c testing (Māori practice, Māori patients, Pacific patients, Quintile 5 deprivation, urban practice, M3) suggest this may be due to diabetes being lower priority in the presence of complexity and multimorbidity.
Respiratory illnesses, including pre-school asthma, contribute to the national statistics for child ASH [47]. Young children are vulnerable to rapid deterioration with respiratory illnesses and primary care clinicians appropriately send infants and children to hospital; some children go directly to hospital without attending primary care. The optimum rate of child ASH remains unknown [47]. However, statistically significant differences still indicate real practice-level and model-level variation.
Differences in enrolled populations
Differences in patient health outcomes were associated more strongly with patient need than with practice model. Table 4 shows 15 measures, thought to indicate individual and population need; a markedly higher proportion of higher-risk patients were enrolled in Māori, Pacific and Trust/NGO practices than in other practice models. Taken together, these point to a raised workload necessary to respond toa concentration of complexity in Māori, Pacific and Trust/NGO practices, with direct implications for resourcing.
The majority (59%) of Māori patients and half (49%) of Pacific patients were enrolled in Traditional practices where they were typically a small percentage of enrolees in any one practice. Traditional practices face the challenge of how to specifically address cultural safety when caring for Māori, Pacific, and other ethnic groups in these practices.
Trust/NGO, Māori and Pacific practices employed a higher ratio of nurses to patients, and nurses to doctors, than other models of care. They explicitly address both the health and social needs of patients and often work in a complex organisation. Most Māori and Pacific practices were constrained within the same funding streams as other practices, although some have received additional support through the Māori Provider Development Fund or the equivalent Pacific fund.
Current resourcing options do not target the range of patient need
Equitable resource allocation is required to improve health outcomes for Māori, Pacific and people living with material deprivation. At the time of this study, funding and resources to support primary care were provided through a range of mechanisms that target financial support for health services to: individuals (Capitation and the High Use Card [48]; the individual and family (Community Services Card [49]); the whanau / household (Prescription subsidy scheme [50]); the practice at which the patient is enrolled (Very Low Cost Access (VLCA) [51]); specific services (DHB and PHO programmes e.g. palliative care); specific conditions (DHB and PHO disease management programmes) and on residential area deprivation (Services to Improve Access). All these subsidies are paid to health care providers and do little to address the multiple additional barriers to access [52], especially for patients with complex clinical or social circumstances. In addition, many PHOs support locality-based resources – such as employing kaiawhina / community health workers who work across multiple practices.
Practice size
Practice size was not retained in any of the final models. It is possible that any effect of practice size was captured in factors that correlated with size such as rurality, workforce consultations and FTE and continuity of GP. The literature is mixed on the relationship of practice size to measures of process or outcomes. A report from the UK analysed data on practice size in relation to measures from the Quality and Outcomes Framework and rates of ASH [53]. They found that larger practices performed better, but with wide variation, and without being able to adjust for patient characteristics. A systematic review in 2013 included 13 cross-sectional studies. Five of 10 studies reported better scores on some processes of care in larger practices, while three studies of patient-reported outcomes found better access in smaller practices [54].
Rurality
In many jurisdictions, rurality is a risk factor for poor health outcomes. This is likely to be due to associations of rurality and other known risk factors, including access to health services and socio-economic disadvantage compared to urban dwellers [55]. In the current study, rural patients are, by a small margin, more likely to have an HbA1c test, but otherwise rurality is not associated with the outcomes we measured, after adjustment for a wide range of patient characteristics. We note, however, that rurality is associated with several measures that may themselves influence health service access including greater distance to nearest ED, small practices, PHO/DHB practices and Trust/Other practices and Māori practices, and Māori but not Pacific ethnicity, .
Primary care data
Despite collecting the largest data set on primary care in Aotearoa New Zealand to date, we are aware of gaps in the data, such as for mental health care and nurse work.
National datasets were largely clean and consistent, reflecting the substantial infrastructure behind them. However, significant effort was needed to clean and interpret national data from practice registers. Historically, the registers were assembled for capitation purposes, and did not always match the definition of a practice from other perspectives. For example, satellite clinics might be listed as separate entities or might be merged with the parent clinic. It is unclear whether the National Enrolment System, implemented since we extracted our data, will make this task easier in the future.
Extracting data from practices via PHOs presented significant challenges. Each PHO had a different approach to permitting data to be used and the extent of data they collected routinely so were able to the study.
There is a need to standardise data collection and analysis from all practices, using, for example, existing measures in the Atlas of Variation. There are important unresolved questions about who owns patient data and the extent to which analysis and reporting anonymises practitioners and practices preventing scrutiny that may be in the patient or public interest. Without data, inequity remains hidden [56] and the health and social systems cannot allocate resources to address equity.
We have identified markers of individual patient risk that could be used to help target resources. Those currently in use are age, gender, ethnicity and deprivation as measured by Quintile 5. In addition, there are strong and consistent associations with patient health outcomes and M3 score, number of NP or GP consultations, FSA or not attending a FSA, change of practice enrolled in, and being prescribed an antibiotic or tramadol. Furthermore, deprivation as measured by IMD was more consistently associated with patient health outcomes than was Quintile 5. We have identified models of care where most practices had high measures of accumulated patient health need, compared to other models of care (Māori, Pacific and Trust/NGO practices).
2022 Aotearoa New Zealand health reforms
The health system in Aotearoa New Zealand is being restructured under the Pae Ora (Healthy Futures) Act, which took effect on 1 July 2022. A central driver of reform is the need to address decades of disparities in health outcomes, especially for Māori. The 20 DHBs present when this study was conducted have been dis-established and hospital and health services now operate under a single national entity, Te Whatu Ora – Health New Zealand. Also newly established, Te Aka Whai Ora – Māori Health Authority, is an independent statutory authority to lead improvement in Māori health [57]. Te Aka Whai Ora is not a separate health system for Māori, but an entity to co-design and co-commission for the new health system.
Up to 80 community localities are planned across Aotearoa New Zealand to provide health service advice. The relationships between localities, PHOs and general practices, are in development. PHOs might be dis-established; many of their functions such as clinical improvement and service coordination will continue, albeit under another entity [58]. The primary care sector is unsettled. There are longstanding staffing shortages, COVID has created additional demands for services and there is concern about a legacy of unmet preventive care.
Study Limitations
We acknowledge that measurement of associations cannot prove causality, that many factors affecting outcomes reside outside primary care and many remain unmeasured. The purpose of regressions was to “remove” the effects of patient characteristics but this can never be done perfectly due to imprecise measurement of each concept for which the variables are a proxy, exacerbated when the differences between practice populations are large.
Our explanations for differences between the practice models of care, as shown in the regression outputs, are based on available data and research team expertise. While the best outcome for individual patients remains unknown, we have assumed that, at a system level, a lower rate is better for polypharmacy, ASH and ED attendances, and a higher rate is better for HbA1c testing and immunisations.
Trends over time for each outcome may have been more informative than a cross sectional analysis. However, patient turnover within practices (21% per year in our data) and major changes to practices with opening, closing or merging during the year studied (35 practices in our initial data) and periodic changes to practice funding policies, all make longitudinal data difficult to interpret.
Although explanatory variables were divided into three categories – patient characteristics, practice characteristics and clinical input, it is clear that some factors fall into more than one category. For example, attending a VLCA practice might be patient choice due to lower fees or a practice financial decision. Having a First Specialist Assessment reflects both patient need and a referral from primary care in response to that need. Patients changing practice within a year might reflect dissatisfaction with a practice but are more likely to reflect changing patient circumstances such as change of address, itself a correlate of poverty.
We recognise that each practice had its own history of adapting to their enrolled patient population and region, and changes in policy and funding context. Grouping them together into “models” as we have done was a necessary simplification to address our research question.