Baseline characteristics of all intervention CHs included in the cRCT and those purposively selected for the process evaluation interviews are presented in Table 1. Apart from care home registration, baseline characteristics in the process evaluation homes were representative of those included in the study overall. Most CHs were privately owned and were registered as residential. Most staff were permanently employed in the care homes and were White/White British.
Table 1: Care home characteristics
Characteristics
|
Process evaluation care homes
N = 12
|
All intervention care homes
N = 37
|
Care home ownership (n (%))
|
Local authority
|
0
|
1 (2.7%)
|
Charity
|
0
|
2 (5.4%)
|
Private
|
12 (100%)
|
34 (91.9%)
|
Registration (n (%))
|
Nursing
|
0
|
0
|
Residential
|
9 (75%)
|
21 (56.8%)
|
Residential and nursing
|
3 (25%)
|
16 (43.2%)
|
Care home residents
|
Mean (SD) number of residents per home
|
37.67 (16.56)
|
39.4 (16.7)
|
Median (IQR) number of residents per home
|
37 (22.5 – 54)
|
39 (27 – 54)
|
Care home staff (mean (SD))
|
Permanent staff
|
47.1 (16.6)
|
48.6 (19.5)
|
Bank staff
|
3.9 (4.9)
|
3.7 (4.0)
|
Agency staff
|
1.6 (3.7)
|
2.9 (3.1)
|
Voluntary staff
|
2.6 (1.6)
|
1.1 (1.6)
|
Staff ethnicity, mean (SD)
|
White / White British
|
38.0 (17.3)
|
32.5 (18.7)
|
Black African/Caribbean/Black British
|
2.8 (2.9)
|
4.2 (6.4)
|
Mixed/multiple ethnic group
|
3.9 (8.1)
|
3.8 (7.1)
|
Asian / Asian British
|
4.0 (5.0)
|
5.7 (10.4)
|
Other Ethnic group
|
0.8 (1.8)
|
0.4 (1.3)
|
For anonymity, CHs included in the process evaluation interviews have been assigned a letter ID (A-L). A total of 26 interviews were conducted with CHS (see Table 2), including managers, manager & proprietor, care staff, housekeeper, cook, activities coordinator and administrator. In two of the CHs (B and G) only managers consented to interviews. In CH I, three staff consented to interviews but not the manager.
Table 2: Interviews CH managers and staff characteristics
Characteristics
|
Managers (n=11)
|
Staff (n=15)
|
Sex
|
Female
|
11 (100%)
|
13 (86.7%)
|
Age range
|
20-29
|
0
|
1
|
30-39
|
0
|
2
|
40-49
|
5
|
4
|
50-59
|
2
|
7
|
60-69
|
2
|
1
|
Missing data
|
2
|
0
|
Ethnicity
|
White British
|
8
|
13
|
White Other
|
2
|
1
|
South Asian
|
0
|
1
|
Missing data
|
1
|
0
|
A total of 17 interviews with VPs were conducted, including nine who were external to the process evaluation CHs. This was done to maximise variation in roles and experiences. Professions of interviewed vaccination providers included nine pharmacists, two general practitioners, three nurses, one paramedic, one frailty practitioner and one assistant practice manager.
3.1 Implementation of the FluCare interventions components
3.1.1 Implementation FluCare video
Results regarding implementation of videos in all 37 intervention CHs are presented in supplementary file 1. All intervention CHs received the promotional video which was 3 min 55 secs long and had optional subtitles in four languages (English, Romanian, Polish, Hindi). The video was not accessed at all by staff in 16 out of 37 (43%) CHs. Only five staff representing five CHs viewed over three minutes of the video. The average number of clicks per CH was four (range 0-27) and the average view duration per CH was 0 min 40 secs (range 0-3min 54secs). English language subtitles were used in 19 out of the 21 (90%) CHs which had views.
3.1.2 Implementation FluCare clinics
Implementation characteristics of FluCare clinics arranged by pharmacy and GP vaccine providers in all 37 intervention CHs are presented in Table 3. Sixty-five percent (24/37) of intervention CHs held at least one vaccination clinic, highlighting partial implementation of the intervention (only posters and leaflets) in the remaining 13 CHs.
A total of 48 clinics were delivered between November 2022 and March 2023, 14 of which did not vaccinate any staff. Most clinics (34/48) were delivered by pharmacy-led vaccine providers, which tended to show greater flexibility in days the clinics were delivered (e.g., including at the weekend). Most VPs delivered one or two clinics. Variation in the number of clinics was primarily due to VP capacity (i.e. shortage of pharmacists) and late timing of flu clinics which resulted in limited availability of flu vaccines (see Section 3.3). A total of 146 staff were vaccinated during the FluCare clinics. After excluding 14 clinics which were held but no staff were vaccinated, the maximum total number of staff vaccinated per CH was 12 and the median (IQ) staff vaccinated per clinic was 3 (2-5).
Table 3: Characteristics of clinics arranged by pharmacy and GP vaccine providers
|
Pharmacy-led vaccine provider
|
GP- led vaccine provider
|
Total
|
No. CHs
|
|
|
|
CHs in which clinics were held
|
17 (46%)
|
7 (19%)
|
24 (65%)
|
No. Clinics
|
|
|
|
Clinics held
|
34
|
14
|
48
|
Clinics (%) where at least one staff member was vaccinated
|
23 (68%)
|
11 (79%)
|
34 (71%)
|
Vaccinated staff
|
|
|
|
Total staff vaccinated
|
101
|
45
|
146
|
Maximum of staff vaccinated in a clinic
|
11
|
12
|
12
|
Median (IQR) staff vaccinated per clinic
|
2 (0-4.8)
|
2 (1-3.8)
|
2 (0-4.3)
|
Median (IQR) staff vaccinated per clinic, excluding 14 clinics where zero staff vaccinated
|
3 (2-6)
|
3 (1.5-4.5)
|
3 (2-5)
|
Day and time of clinics
|
|
|
|
Days of week when clinics were held
|
Mon-Sun
|
Weds-Fri
|
Mon-Sun
|
Day of week when most clinics held (#clinics)
|
Thursday (13)*
|
Wednesday (8)*
|
Thursday (18)*
|
Range of clinic start time
|
08:30-17:00
|
09:00-18:30
|
08:30-18:30
|
* Data excludes clinics vaccinating zero patients.
3.1.3 Implementation of FluCare by managers: distribution of behavioural change information materials (leaflets, posters videos) and clinic organisation
There were notable differences in the manager reported engagement with distributing the information materials and arranging clinics. Levels of engagement of managers have been categorised as high, medium and low. This classification was done by firstly ranking the CHs by implementation (i.e., staff reports of whether posters/leaflets were displayed, video analytics, number of clinics delivered, and number of staff vaccinated) and then identifying whether this was associated with negative/positive attitudes towards being vaccinated. A sample of this mapping, with illustrative quotes can be found in Table 4 and full data mapping in Supplementary file 2.
Managers who implemented all components of the FluCare intervention (and personally engaged with the intervention to some degree) were categorised as ‘high’ engagers. Six managers were classed as ‘high engagers’ and corresponded to CHs with the highest number of staff vaccinated. These managers distributed the materials, and they were either convinced by the information provided, which for some resulted in behaviour change (getting vaccinated for the first time) or were already pro-vaccination due to personal underlying conditions. For example, Manager 001_CH-L reported creating an information corner using balloons sent by the FluCare team to get staff attention and distributed the video via staff handovers and other team meetings. The manager reported reading the materials themselves and were convinced by the materials. In preparation for the clinics the manager informed staff about the clinics and was vaccinated themselves for the first time. They then championed the vaccinations by sharing their experience of getting vaccinated to their staff. The number of staff vaccinated in this CH was 13.
Two managers were classed as a ‘medium’ engager. These managers implemented some components of the intervention without making much effort to engage staff. For example, M010-CH-C put posters and leaflets up but they themselves did not necessarily read the content. In addition, clinics were organised without proper communication to inform and engage the staff. Only one clinic was delivered in this CH despite intentions to deliver two more. The number of staff vaccinated in this CH was five.
Managers who did not fully implement all components of the intervention and held anti-vaccination views and attitudes that mirrored the very barriers that FluCare was trying to address, were classed as ‘low’ engagers. Four managers representing three CHs were grouped in this category. Some of these managers reported putting the posters up and distributing leaflets, but other staff including deputy managers did not recall ever seeing them. None of these managers appeared to have distributed the video, supported by no clicks on the video link from staff in their CHs. These managers were not so convinced about their need for the vaccine and the importance of the intervention. Staff vaccinated in these CHs ranged between 0-2. An example of a low engager is manager M013_CH-H who perceived that she did not need the vaccine and was concerned about the safety of vaccines. Interestingly, analysis of staff interviews from the same CH-H also highlighted similar views to that of their management (Table 7 and Supplementary file 3), possibly suggesting influence from the manager or highlighting similarity of staff attitudes within the same CH. CH-H was the only process evaluation CH where clinics were arranged but no staff got vaccinated. Interview data on manager engagement, when triangulated with data on implementation of clinics and videos (Table 3) provides explanation for variations in implementation across the CHs.
Table 4: Manager engagement with FluCare intervention
Staff CH ID
|
Implementation of poster and leaflet
|
Implementation of video
|
Implementation of clinics
|
Attitude regarding flu vaccines for self and staff
|
High engagers: Managers who implement and personally engage with all components of the FluCare intervention
|
M001_CH-L
|
We just used all the materials and created a Flu Care info point … the balloons made it eye-catching so that it took people’s attention… I think I know it by heart now because it’s literally opposite my office door … we shared some information with staff here on email and handovers.
|
No. video clicks: 10
Average view duration (mins:secs): 1:35
We shared the email [video link] via private email, with all the care staff. We played after handovers and we had some time, we made time in the staff meetings as well.
|
No. clinics: 4
No. staff vaccinated: 13
We would just print a notice to signpost staff… to let staff know where in the building…We would pop an email out to staff and let them know that they would be in the home at that time and we would talk about it in handovers.
|
I’ve never had my flu vaccination which is awful because I’m the manager…it was not because I had any reason not to have it but I just never got round to it because I’d never make the appointment…because it was here and lots of different times, I was able to nip in and get it and then I could speak to the staff about my experience because a lot of people are very worried about side effects and things aren’t they, so it was nice to be able to tell them from personal experience rather than just what I’d heard.
|
Medium Engagers: These managers implement some components of the intervention without making much effort to engage the staff
|
M010-CH-C
|
I can’t remember now if we got leaflets. We may well have done…. But we certainly got the posters because they went up. So, we had one [poster] in the staff room… We had one on our board which is outside the main office... But the main one for us is the staff room, because…all staff go into the staff room.
|
No. video clicks: 5
Average view duration (mins:secs): 1:07
The videos, we didn’t utilise them as much as we should have done. I don’t know how many staff did the QR code. …. The way that we got it out was the QR codes on the posters….
|
No. clinics: 1
No. staff vaccinated: 5
The clinics, they were a little bit hit and miss. So I think we had the initial one, which was completely my fault it wasn’t advertised for the staff…the second one I think they didn’t turn up. I don’t think they cancelled they just didn’t come in.
|
|
Low engagers: Managers who didn’t fully implement all components of the intervention and held views that were anti-vaccination and whose attitudes that mirrored the very barriers that FluCare was trying to address
|
M013-CH-H
|
We had some posters, yes, we had some brochures, yes, we had that kind of stuff…I think my staff were reading about it, I think I haven’t read it yet, to be honest.
|
No. video clicks: 0
Average view duration (mins:secs): 00:00
|
No. Clinics: 2
No. Staff Vaccinated: 0
|
I never had it before, and I really don’t want to have it… My residents have it and they get poorly afterwards anyway… I don’t really want to get anything to my body, you know… I’d rather just get it and get through it. Yes, to be honest, I think it’s good for the… older people like my residents… I’m nearly 50 but my immune system is quite strong So, yes, I don’t think I need it… My staff… are young people, they don’t really want to have it yet because they’re afraid and they’re thinking they don’t need it… Like I said we quite healthy so, you know, you can’t force anyone
|
3.1.4 Performance monitoring with feedback, and financial incentives
Two of the 75 CHs participating recorded more than 70% of CHS receiving a flu vaccination as reported on the Department of Health and Social Care Capacity Tracker. Both CHs were in the intervention arm of the study and received the £850 incentive at the end of the study.
Monitoring was performed by the FluCare team, by regularly communicating with CH managers to follow-up on data completion of staff and resident logs (data collected for health economics elements of the cRCT). However, discussions with the FluCare team revealed that the intervention as rolled out did not include feedback on performance. This was due to several reasons: 1) when the intervention was designed for the feasibility study, no feedback was included due to the very short timescale of the intervention delivery (video/posters/clinics were provided and delivered within a couple of weeks); when the intervention was revisited for the cRCT trial, there was no information available on how the feedback could/should be provided; 2) CHs struggled to provide data logs on a monthly basis, such that there was at times no data upon which to provide feedback; 3) the very short time scale over which the intervention was delivered including clinics reduced opportunity for feedback. Therefore, while the study operations team attempted to monitor vaccination uptake, there was no attempt to introduce behaviour change by providing feedback on performance (e.g., highlighting how a CH was doing compared to others and discussing ways of how to improve vaccination uptake). Hence, this behaviour change element was not fully implemented.
3.2 Mechanisms of impact
3.2.1 Staff engagement with components of the FluCare intervention
To understand mechanisms of impact, staff interviews were analysed to explore engagement levels with intervention components and perceived impact of FluCare on behaviour change. Four staff categories were identified and mapped according to staff engagement with each intervention component and attitudes towards being vaccinated. A sample of this mapping, with illustrative quotes can be found in Table 5 and a full mapping in Supplementary file 3.
The first category consisted of staff who engaged with all aspects of the intervention and had the vaccine for the first time. Without the intervention these staff would not have sought the vaccine because they did not see a need for it. All staff in this group related seeing and reading the information, mainly posters and leaflets (not the videos), which for some triggered discussions with colleagues about the importance of vaccination for their role. The information then worked together with the convenience of the clinics to influence behaviour. For two staff members (S002_CH-L and S003_CH-A), the primary reason for getting the vaccination was being convinced of its importance for the protection of residents. These findings indicate that, for those who have not previously had an opportunity to receive information and free flu vaccination, the FluCare intervention could influence behaviour.
The second category were staff whose behaviour was primarily influenced by accessibility/convenience of clinics. Staff in this group already had a positive attitude towards having flu vaccinations, prior to the FluCare intervention. Therefore, engagement with the FluCare materials was variable for this group and largely served as a prompt for discussions with other staff and a confirmation of prior attitudes. For these staff, motivations for having the vaccine included a perceived need to protect themselves, vulnerable residents and vulnerable family members. Although these staff reported that they probably would have sought to have the vaccine with or without FluCare, it was late in the season when the FluCare clinics were offered and they had not sought a vaccination. This suggests convenience of vaccination clinic may have been an important element of the interventions to influence their behaviour.
The third staff category did not engage with any FluCare components. These were aware of the posters/leaflets but did not read them at all. They also did not watch the video, nor engage with the clinics. The influence of non-engagement was based on prior bad experiences of flu vaccination, perceived lack of need or misunderstanding about vaccines being live. This finding suggests limited opportunity for behaviour change for those who choose not to engage with behaviour change materials.
The fourth and final category consisted of staff who were already pro-vaccination because of responsibility in their role, their own and family vulnerabilities, or their age. Some of these participants had already had the vaccine by the time the clinics were run or missed the clinic at the CH and sought it elsewhere proactively.
Table 5: Staff engagement with components of the FluCare intervention
Staff_CH ID
|
Poster and leaflet
|
Video
|
Clinics
|
Staff attitude regarding flu vaccinations
|
Category 1: Staff influenced by all FluCare components i.e., either poster/leaflet or video AND clinics
|
S002_CH-L
|
Yes, I did (see the posters) It made me realise that obviously it was available, and I should probably do it… it did the job, it got me to have the flu vaccine, which I probably wouldn’t have done.
|
I think so, I can’t remember now [seeing the video].
|
Interviewer: If they hadn’t come into the clinic, do you think you would have got the flu vaccine? 002: No, probably not…because they were there and I got the notice… I prioritised it…if it was up to me and I had to go and get it at the doctor’s, I highly doubt I probably would have managed to have gone and done it.
|
I probably see it quite the same, really, they’re (covid and flu vaccine) needed for like the vulnerable, but not necessarily for everybody. But I still probably don’t fully understand how me working in a CH…I don’t understand the connection. If it’s to help me, if I was to get sick, I don’t understand why I should have it because I work in a CH.
|
Category 2: Engagers with FluCare clinics
|
S008_CH-I
|
It made it more [me] aware that the flu vaccine was available… the posters were quite open about when it was going to happen.
|
No, I haven’t seen the video.
|
I would have had the flu vaccine anyway, but it was just more convenient for me to have it within my workplace
|
Well, I’m for having the flu vaccine. I think the majority of people should have it because it does protect yourself and flu is very unpleasant.
|
Category 3: Staff who didn’t engage with any of the FluCare intervention components
|
S012_CH-H
|
I didn’t read it, if I’m honest, no…. Yes, I’ve just been too busy, to be fair.
|
|
|
I think the flu vaccines are good for people that need it the problem is they get poorly after the fact which obviously they need a bit more care and things like that. A bit of extra TLC but obviously I know it’s like a live ingredient isn’t it… So it’s got part of the virus in it, a small amount of virus in it to build up our immunity, that’s what we we’ve always been taught.
|
Category 4: Staff who were already pro-vaccine and had the vaccine elsewhere
|
S009_CH-I
|
When there is a group of us in the staff room you look at the leaflets and you start to have a discussion… to me if they’re giving you something that you haven’t got to pay for me personally I’ll just take it.
|
No, I haven’t seen the video, no.
|
I just live at the back of … my chemist is just out there. I could have had it at work but I was off work that day but I just walked through to my chemist, it’s just five minutes. I’ve had it for the last three years nothing has happened to me, I haven’t had any symptoms like it’s knocked me off my feet or I’ve had to go off sick or anything like that. I think it’s just going round and being confident in yourself that you’ve had it and then not putting a negative edge on something.
|
All the residents were having it and I’m thinking, what about if I get a cold…So working in a care setting you’re going to work and then you think to yourself, hold on a minute, I can fight off this runny nose and cough and things like that but what about if I’m passing it on to these old folk that are in their nineties.
|
3.3 The role of context in FluCare intervention implementation and engagement
3.3.1 Contextual barriers and enablers to delivering FluCare clinics
FluCare clinic implementation was influenced by four key barriers/enablers: 1) GP and community pharmacy capacity challenges; 2) vaccine supplies related to the timing of the clinics; 3) communication between managers and vaccine providers; 4) varying levels of managerial engagement.
Where intervention homes had clinics, despite up to four onsite clinics being funded, most VP’s delivered only one to two clinics. This was due to a number of factors including pressures that GPs and pharmacies in the UK were facing during the trial period, including availability of pharmacists. Additionally, shortages in flu vaccines, especially later in the Winter season of 2022-2023, also limited delivery of FluCare clinics. Low staff vaccination uptake was also a factor.
“Like I said, later in the season it is harder to get flu vaccines so it is a little bit more difficult to have enough prepared. But, yes that was the only bit, a little bit of co-ordination that was needed.” VP_11_Pharmacist_CH36
FluCare clinics were designed to be delivered flexibly, at different times of the day, and as walk-ins. However, due to capacity challenges, some vaccine providers preferred pre-determining how many staff would take up the vaccine, which was not in line with FluCare intention. In addition, most GPs were not able to deliver clinics outside their working hours.
“[It] was really restrictive. We would’ve said – there are some people that only work weekends, so why couldn’t we have had one on a Saturday morning? Well, that’s an obvious no from them. People who work night shifts, can’t we have one much later in the night? That’s the sort of thing we do with staff meetings and supervisions, we work around the shifts. But obviously, with the GP, we worked to what they could do. That was a problem” M002_CH-B
Some CH managers and vaccine providers reported communication challenges with arranging clinics times resulting in delivery of clinics at very short notice, and without staff being aware of their availability.
“Sometimes I felt like the staff in the CH didn’t actually know that we were coming or there was a pre-booking or there wasn’t enough notice given to them. So, they weren’t prepared for it or didn’t want to help straightaway, rather than have a discussion about it” VP_11_Pharmacist_CH36
Some vaccination providers attributed communication challenges to a lack of engagement from the CH Manager: “So it took me a little while to set them up. The CH Manager didn’t seem to be very engaged and he said, you know, it wasn’t one of the priorities” [VP_01_Nurse_CH-C]. Where there was effective communication and coordination among vaccine providers and CH managers, there was successful clinic implementation. Vaccination provider familiarity with the CH environment, as well as existing relationships with CHS, streamlined implementation.
“We already have a really, really good relationship with our GP. We’ve obviously got the enhanced GP service, and we either see the GP or the nurse practitioner at least once a week. So to incorporate [name of vaccine provider], who is the nurse practitioner, to come in and do a flu clinic, it’s kind of like, yes, she’d do the flu clinic, and then she’d just cracked on with the rest of the ward round. So, because we’ve already got that relationship and she comes in every week, yes, it was good. It just went smoothly” M002_CH-B
3.3.2 Contextual barriers and facilitators to staff engagement with FluCare clinics
Most flu clinics were delivered between January and March 2023. Vaccine Providers, CH managers and staff highlighted that the lateness of delivery of FluCare clinics negatively influenced vaccination uptake, making it one of the key barriers to vaccine uptake. Starting earlier in September or October was discussed as a more effective approach.
“It was just from the study’s point of view, it started very, very late…I think if they’d been a lot earlier, so at the beginning of when people normally have their flu…but if they stay like they were this year, then definitely not. I think it was a complete waste of time. But if they were a lot earlier, then I think it would be beneficial.” M010_CH-C
“As I said, the only downside to the service was that the FluCare study started this late. So that is the reason why we didn’t actually have a great uptake in it as well. So yes, I think maybe if it was to start at the beginning of the [flu] season, then definitely it would be much better.” VP-07-Pharmacist_CHP16
The impact of the COVID-19 pandemic and ensuing policies was both a barrier and enabler. There was an indication that the COVID 19 mandatory legislation had a negative impact on staff willingness to get vaccination and that some staff had concerns about having both the flu and COVID vaccines at the same time.
“I know we’ve had a lot of staff that were very reluctant, and since they were forced to have the COVID vaccine, I’ve had an awful lot of staff that have turned against any sort of vaccine and are very reluctant to have, even if they used to have flu vaccines before” M005_CH-D
However, the experience of having Covid clinics delivered in CHs, seemed to have facilitated the implementation of the flu clinics and normalised the process for staff. The COVID pandemic also played an educating role, in raising awareness of the potential impact of viral infections on themselves and residents.
“I think the whole COVID thing has made me think more about things like flu because obviously… I’m not a very sickly sort of person, I don’t get very much. So, I just assumed I had a good immunity and – but obviously nobody had immunity to COVID. So, that was a completely new thing, so we all had to rethink that side of it…so obviously then when the flu vaccine was offered, although in the past I would have always said, “No thanks, I don’t need that,” obviously that has changed my opinion now” S003_CH-A