Participant characteristics
Data were collected from 16 health facilities including five health centre IVs, and 11 health centre IIIs, in four districts of southwestern Uganda. A total of 51 participants were interviewed including four Assistant District Health Officers (ADHO-MCH) in charge of maternal and child health service coordination and monitoring in each district, four cold chain technicians, 15 Expanded Program on Immunisation (EPI) health centre focal persons and 28 health care providers. The role of ADHOs in charge of maternal and child health is to assist the District Health Officer in ensuring efficient, effective and affordable delivery of Maternal Child Health and Nursing Services for the wellbeing of the population of the District and ensure quality assurance in all Health Institutions in the District. The number of interviews conducted with the health care providers were 28 and not 32 as planned because certain health facilities had only one (1) health care provider and one (1) EPI focal person involved in outreach immunisation sessions. More than 80% were females and the median experience in vaccine management was 5 years (Table 1).
Table 1
Participant and outreach site characteristics
Variable | n(%) |
Age in years: median(IQR) | 35(29, 42) |
Gender | |
Females | 43(84.3) |
Males | 8(15.7) |
Highest level of education | |
Degree | 4(7.8) |
Diploma | 24(47.1) |
Certificate | 23(45.1) |
Years of professional experience: median(IQR) | 9(3, 18) |
Duration of experience in vaccine management: median(IQR) | 5(2, 14) |
Health care provider’s training/ cadre (n = 28) | |
Midwife | 16 |
Nurse (comprehensive, enrolled, registered) | 5 |
Nursing Assistant | 3 |
Vaccinator | 1 |
Counsellor | 1 |
Medical Entomology | 1 |
Laboratory Technician | 1 |
Distance to the outreach site (n = 16) | |
2–4 km | 5 |
5–12 km | 11 |
Nature of the outreach site (n = 16) | |
In a building | 8 |
Under tree | 5 |
Tent/ veranda | 4 |
IQR: Inter-quartile rang |
Nature Of Outreach Sites
Some health facilities were conducting one outreach in a week, others one outreach in 2 weeks and some, one outreach per month. Only one outreach session per health facility was attended by the study team. Nine of the 16 outreach vaccination sessions observed were conducted in the open; under the tree (5 of 16), or veranda (4 of 16) (Table 1). Where outreach sessions were conducted in the open, there were no gazetted buildings for community vaccination activities thus health care providers always improvised.
Observed Gaps In Vaccine Management Practices
The gaps in vaccine management practices during vaccination outreach sessions were categorized into themes at the different levels of individual, interpersonal, community/health facility and policy or enabling environment levels in line with the socioecological framework. These gaps were concerned with the cold chain and included insufficient monitoring of vaccine integrity, handling and storage affecting vaccine quality, poor documentation, refrigerator management, refrigerator overload, transportation of vaccines and conducting the outreach in inappropriate spaces.
Individual Level
Theme: Insufficient monitoring of vaccine integrity
Sub theme: Inability to use the vaccine vial monitor
Vaccines that require reconstitution come with vaccine vial monitors to enable health care providers determine whether the vaccine to be administered has been exposed to heat or not by observing the colour change on the vaccine vial monitor (VVM). The majority of health care providers reported not knowing how to check the vaccine vial monitor (VVM) and some did not know what it was.
“When it is either stage 1, you give. Stage 2 and 3…Ahhh am not sure about those things but we just see there and we determine that this thing can be given or not”. Health care provider, RW01- 01.
It was also observed that at 8 of 16 health facilities, health care providers did not check the vaccine vial monitor status while preparing for the outreach (Table 2).
Table 2
Key observations made in the 16 health facilities using the observation checklist
Variable | Frequency( n = 16) |
Health facility level | |
Lack electronic freeze indicator | 15 |
Lack foam pads or not enough | 3 |
Health worker- Individual level practices | |
Did not check for open vial dates on the multi-dose vaccines | 13 |
Did not check the vaccine vial monitor status | 8 |
Did not properly place vaccines, diluents and correct number of ice packs in the vaccine carrier | 1 |
Did not keep the vaccine hard lid cover closed tightly | 12 |
Did not administer each vaccine according to the recommended technique and correct injection site | 5 |
Did not communicate key messages including potential AEFIs and date of next visit | 7 |
Did not discard all reconstituted vaccines and liquid multi-dose vaccines | 4 |
Did not check vaccine vial monitor status for vaccines containing preservatives before returning them to the refrigerator | 9 |
Did not record dates of opening on vials that could be used and didn’t place them in the ‘first box’ in the refrigerator when back to the facility | 12 |
Did not complete session summary reports | 7 |
Sub theme: Failure to check expiry dates.
Failure to check expiry dates was noticed in all outreach sites. None of the health care providers would check the expiry dates on the vaccines and this was admitted by most health care providers claiming that it is the work of the EPI focal person.
“Like sometimes, they find a staff has gone to mix like BCG and doesn’t check on the manufacturer or the expiry date. Though I know that in my store, I have the update… expiry dates which are updated, but you find he/she doesn’t want to check”. Key informant, M02- 01.
Theme: Poor Handling And Storage
Poor handling of vaccines manifested in the forms of holding the vaccine vails incorrectly and opening multiple vaccine vails at once during outreach immunisation sessions. Improper storage practices included using few or unconditioned ice packs, keeping vaccine carriers open throughout the outreach vaccination session and returning vaccines to the refrigerator that should be discarded. Although less common, the carrying vaccines in inappropriate material like a safety box was also observed.
Sub theme: Poor storage of vaccines
Proper vaccine storage is very important to maintain the potency of the vaccines. However, some health care providers admitted to be storing these vaccines and their diluents poorly during outreach sessions. While vaccines were mostly packed in recommended vaccine carriers for outreach sessions, it was reported in the interviews and also seen in one outreach site that vaccines were carried in a safety box.
“…like when we are taking the vaccines in the safety box, of course it is not right…” Health care provider, RW02- 01.
It was observed that some health care providers used few and/or unconditioned ice packs during outreach immunisation sessions. In addition, at 12 of 16 outreach sessions vaccine carriers were seen open throughout the outreach session instead of being tightly covered when not vaccinating; it was observed that health care providers did not keep the vaccine hard lid cover closed tightly during vaccination (Table 2).
Sub theme: Poor holding of vaccine vials
Vaccine vials are supposed to be held from the neck to minimize contact with the provider’s body to maintain vaccine temperature. During outreach vaccination sessions, it was observed that some health care providers held the vials in their folded palm contrary to the guideline of holding the neck or the tip. In the interviews, health care providers agreed with this field observation reporting that some health care providers touch the vial ‘everywhere’ which can lead to warming.
“Ehhhhhh (she laughs) of course when you are going to mix the vaccine… You are supposed to touch it in the neck but you find someone is touching it everywhere which can make the vaccine to be warm”. Health care provider, RW02- 01.
Sub theme: Opening multiple vaccine vials at once
The guidelines encourage health care providers to open one vaccine vial at a time when the clients are there to avoid removing more vaccines from below the sponge in the vaccine carrier while vaccinating to maintain the right vaccine temperatures and avoid wastages. However, it was observed that health care providers had a tendency of reconstituting all vaccines at once even before a reasonable number of clients turned up. This gap was also known to district EPI coordination teams.
“There are facilities which are still opening more than two vials at a time at the start of the session. Whereby it is not advisable for a person who is going to vaccinate to open more than one vial. To open more than one vial at a time when clients are there”. Key informant, K-CCT.
Sub theme: Not labelling multi-dose vaccine vials
Vaccine labelling is very crucial in vaccine management. However, it was reported in most outreaches that health care providers were not labelling the multi-dose vaccine vials after outreach immunisation sessions. Even during the outreaches, no health care provider was observed labelling any multi-dose vial.
The one they opened yesterday when I had left this place, I found it there this morning. It was not labelled. We say that when you open BCG and measles, after 6 hours, it should be discarded. So now, should I have used it or not used it?
Health care provider, M01- 01.
The practice of returning partially used multi-dose vaccine vials to the refrigerator irrespective of duration spent outside the fridge was noted. It was observed that vaccines which are meant to be discarded after an outreach immunization session, particularly measles and BCG vaccines, were often returned to the refrigerator. This practice was also reported by health care providers themselves and EPI focal persons at health facilities. In addition to the lack of knowledge, this practice may also be influenced by the late time of returning from the immunization outreach session and poor attitude of health care providers.
“You can find you are returning it is like at 4pm. You are rushing to go home, your time off work is coming. So, you come and put everything in the fridge, and you go”. Health care provider, RW02- 01.
Theme: Poor Documentation
Sub theme: Poor tracking of vaccine usage
In most outreach sites, it was discovered that there was poor documentation of vaccines yet it is known that when documentation is poor, timely requisition and supply of vaccines can be affected, lead to stock outs and wastages. It was observed during the immunisation outreach sessions that none of the health care providers filled the vaccine control book. This observation was further backed up information interview data from healthcare providers themselves and their supervisors. Some supervisors even pointed out how they had challenges in balancing vaccines due to the poor documentation.
“I can call it a gap in balancing the vaccines. Because you find that someone goes to the outreach but doesn’t show how many they had taken and how many have come back. So you find it hard to first go and ask….how many did you take…then… so we are not doing the documentation….”. Health care provider, M01- 02.
Despite the gaps identified, there were quite a number of good vaccine management practices observed in all the 16 outreaches including using foam pads while in the outreaches, using auto-disable syringes, reconstituting all vaccines with the matching diluents for the lyophilized vaccines (e.g measles-rubella), completing immunisation registers and tally sheets, determining eligible vaccinations based on the national schedule and client’s age and immediately discarding all the used syringes in a safety box. Fourteen of 16 health facilities had two or more health care providers involved in the outreach immunisation sessions. At one of the outreach sites, there was only one health care provider who didn’t have even a lay community health worker (Village Health Team-VHT) to support her, and one (1) facility involved a VHT in vaccine management during outreach sessions.
Interpersonal Level
No gaps were identified at this level.
Policy/enabling Environment Level
Theme: Vaccine transportation
Transporting vaccines by untrained local boda boda cyclists was reported by district-level health managers who supervise disbursement of vaccines from district vaccine stores (DVS) to health facilities and provide ongoing support regarding issues of cold-chain management.
“some people just come to pick vaccines without requisitions and usually they send some boda bodas (local motor cyclist)….They send some boda boda men and yet they will not know how to carry the vaccines safely from here to the facility ”. Key informant, R-ADHO.
Theme: Arrangement Of Vaccines In The Fridge
Mixing of freeze sensitive and heat sensitive vaccines in the same chamber was observed in several health facilities.
“Maybe some of them are doing them ‘to whom it may concern’. Maybe there is an EPI focal person; is going to come and arrange them with time and most of them….maybe they think the EPI focal person is forever there to arrange for them..” Key informant, R02-01.
Theme: Vaccine Vial Monitor (Vvm)
Some participants reported that some vaccines come from National Medical Stores and reach District Vaccine Stores when they are already in stage 2.
“Other vaccines do arrive at districts when they are in stage 2. Since we have 4 stages of vaccine management whereby the 1st and the 2nd are supposed to be used. The 3rd and the 4th, we are supposed to discard vaccines. And sometimes the rota and IPV normally reach here at district level when they are in stage 2. And by the time we deliver them to facilities, sometimes you find other facilities do keep them and the VVM goes off to reach the stage 3”. Key informant, K-CCT.
Theme: Refrigerator Overload
Overloading the vaccine fridges at the DVS were reported by several cold chain technicians and Assistant District Health Officers in charge of maternal and child health.
“No funds for transportation of vaccines and when they bring other vaccines, you find that we are overloaded and the fridge is too small”. Key informant, RW-CCT.