In assessing the usability of the system, three main themes 1) variations in use, 2) barriers to use, and 3) recommendations to improve use, were identified (Table 2).
Variation in use:
The private facility and some CHVs used the system more than health workers at the public facilities. Generally, the system was well received by those who used it and appreciated for its benefit.
- Users’ experiences’.
- Positive experiences and or benefits of using the system
The system was appreciated as beneficial in improving work-life experiences as highlighted below:
“The phone is very much okay and it is also very easy than carrying papers……it prevents
you from exposing yourself with book. Now the phone has brought….it has become technology we say technology. When you come to someone’s place like this, two minutes, I have a phone, you recognize us in the community. What we do now we are using the phone,’ and it makes the work easier” IDI CHV
“…. it’s very friendly it’s been okay eh…uhm…I’m lacking words to put this, the user friendly of the mobile phone. It’s so reliable by the way and it is like a backup method yeah, information doesn’t get lost any how and a CHV will not tell you ‘the book is lost or I forgot the book.’ They have the phone with them they can report anytime, uh…uh-huh they can report any time….the phone is portable…it’s so friendly” KII CHA
“It makes my work easier because even at night I can just look at my data and view them, it is not a must I go and write them in the office or following them in the community, I can just check through my mobile phone and see what they are doing, yeah.” KII CHA
iii. Negative experiences in using the system
On the other hand the processes surrounding use were a deterrent to effect use as exemplified below:
‘…it has a negative because at the moment, okay there is a time I lost my phone. It was stolen and it had that line of (organisation name) and it took a lot of time 3 months for them to return for me the line, so there is no data I have been checking. Because you cannot check without bundles, that’s one thing because if I check for that one that desktop in the office, that one the bundles you find that it’s not even there. Another thing since they returned for me that line, it was last month I have not been able to access any data because the password I am using and anything it doesn’t open it keeps telling me your password is wrong or your password is wrong every time every time’. KII CHA.
Limited users’ experiences
Among those who failed to effectively use the system were the public health facility and some CHVs.
Type of facility
Here, insufficient human resource and the perception that the application was additional work brought forth by lack of appreciation of ICT were critical issues raised. The facilities that demonstrated this were those run by the government with public resources.
“On the other side on the man power I had one clinician who was trained that clinician stays on the other side. After seeing the clients maybe after some hours it is when she comes and opens the computer this is the computer for [Name of organisation] you see that movement something else to be done. Either one person to be assigned maybe the partner to provide the human resource it was consuming a lot of time for me the facility in fact if it one clinician she cannot manage that. Eh that’s what I can say.” KII Health care worker
CHV attributes
At the beginning of the interventions, CHV who had never used an e-health application, those not accustomed to using smart phone were not able to use the system adequately and these led to some drop out of CHVs. These issues presented challenges in use as demonstrated below:
“At first it was a challenge, ‘because some of them had never used smart phones before. Okay it was excitement; it was (laughing) what do I say, excitement and mmm… anxiety at the same time. We had many when we were starting they were 11 or 13 but they dropped out coz others saw it as a challenge because others had a GPS and someone wants to report in their own house so others dropped out but those who took it they are positive.... the response is good, they are liking it “ KII CHA
Barriers to use:
Several barriers to use of the system emerged. These were categorised into three sub-themes: (a) socio-political environment, (b) attitudes and behaviours of the users, (c) issues related to the system and (d) poor infrastructure.
The socio-political environment
A prolonged industrial action by health workers and the contentious presidential election in the year of implementation affected the use of the technology. As depicted by the excerpt below, the industrial strike affected the use of the system as there was increased pressure and workload on those who remained and also paralysed services:
“[…] we have everything, actually, we have all the commodities it’s only that the nurses’ strike has affected the services…... the challenge we have is only the nurses’ strike which has paralyzed these services”. KII_ Health provider
Attitudes and behaviour
From the observations made during implementation as well as discussion held with various key stakeholders such as health managers, healthcare worker attitudes towards the system limited use. Many development partners have in the past provided extra financial motivation to system users. Without this, the intended users preferred not to use the system. Most of the clinicians at the public facilities saw the system as additional work and not something to improve their work experiences. Unlike the private facilities that already had pre-exiting ICT/mhealth systems, the public facilities had none and this may have further affected the use of the technology. As stated above, the industrial unrest could also have negatively affected the behaviour of the health care workers. In addition, we observed that a number of users lacked basic ICT knowledge and skills which may have contributed to poor attitudes and behaviour. This was evident among the older CHVs (with the smart phones) who had challenges in navigating through the different features of the technology.
“[…] So the health workers definitely we have issues of attitude among the health workers which you know, it change is a slow process. They cannot change overnight but it’s something that the sub-county addressed when they go to for support supervision, staffs attitude, which has a direct implication with referral system”. KII_sCHMT
Issues related to the system
For some users, issues inherent to the system, including network connectivity and the phone model were major sources of concern:
“[…] in the beginning it was very good. I could reach a lot of women more than I could in the past. When the phone has agreed to work, you could be getting out of this house and getting into this other one getting out, and then later they started the problem of hanging. You can go get somewhere and you want to, and it refuses”. FGD CHVs
Poor infrastructure
In general, this being a slum setting, it is affected by the intermittent power supply and the internet coverage was weak in some of the facilities.
“….Like right now we have been having power problems in Gikomba market from the previous fire. Now it is two weeks down the line and they haven’t gotten power coz a transformer busted something major happened ….” KII_CHA
The public health facilities lacked basic electric features and lack of security for gadgets resulted in the computers being kept in a store, inaccessible to a clinician.
[…] for the clinician it was hectic in fact and most of our rooms, you see this is a store it’s not even an office it’s a store so, because of the security that is why I brought the comp here but where the clinicians sits it’s just open the door is just windows are open so security was another issue so if possible where the clinician sits its where this thing is supposed to sit so that when the client comes now the clinician can see that client my opinion.” KII_Health provider
Recommendations to improve the use of the system:
In many of the public health facility rooms that the clinicians used, there were no power sockets. In addition, the public facilities were not securely enforced and as a result, the desktops had to be placed in secure areas of the facilities which were different rooms from the clinician rooms. Participants suggested strategies to improve usage.
First, integrate the system with others in use and make it available on users’ regular phones.
‘If they could send that app to our phones...we just use one phone. Either they just unlock those apps; I can also use my sim card’. FGD CHVs
Second, provide extra financial motivation for users as well as performance based remuneration together with using local languages in the system.
‘Yes! But it will only solve part of the problem, the other part is how do you make them stay? So yes you can make them…you can digitize the referral tool you can digitize the coordination mechanism but how do you make them stay you must pay. So the tool needs…the tool is necessary but the tool will not succeed without additional support, yes.’ KII Sub-County Medical Officer of Health
Thirdly, even though the manual MoH reporting tools are in English language only. There was concern that the system being in English limited its usage by users who are not so conversant with the language. The language concerns were mainly raised by the CHVs as one CHV supervisor reiterates below;
‘…the tool was easily adopted by the CHV’s after subsequent trials that was done but maybe further we can also improve on the language because we work with CHV’s some are very illiterate, semi illiterate and some just never went to school so when you use the system is only in English, it blocks a huge number of people who could have utilized it. So the language barrier issue should also be taken into consideration because there are those aspects that you can easily select which language you want to use whether Kiswahili or English so that everybody is accommodated.’ KII CHA
The health managers also recommended inclusion of a course in the basics of computer use, prior to the introduction of such innovations. It was noted that the CHVs who were very good at their daily work did not possess knowledge and skills to interact with the phone. In addition, some clinicians were not conversant with the use of computers, including powering on the device.
To facilitate adoption of the system, there was a recommendation from both the uses and health managers to provide extra motivation for users, including performance based remuneration.
Table 2: User perspectives on implementing the CHV DST
Theme
|
Categories
|
Codes
|
Variation in use
|
Users’ experiences
|
Positive experiences/benefits of using the system
|
Negative experiences in using the system
|
Limited users’ experiences
|
Type of facility
|
CHV attributes
|
Barriers to use
|
Socio-political environment
|
Infrastructure available
|
Health workers’ strike
|
Electioneering period
|
Attitudes and behaviour
|
Expectations
|
Lack of knowledge and skills-ICT
|
Issues related to the system
|
Network coverage
|
Nature of the gadgets
|
Nature of the system
|
Recommendations to improve the system
|
Suggestions for enhancing usage
|
Integrate the system with others
|
Provide extra motivation for users, including performance based remuneration
|
Provide basic ICT skills for users
|
Strengthen ICT infrastructure
|