Social-demographic details of participants
Twenty-two healthcare workers including three medical doctors, fifteen nurses, three laboratory technicians and one pharmacist from three private hospitals and MRRH TB clinic participated in assessing the initial feasibility and acceptability of the developed mobile app. Healthcare workers were considered because they are the key users to interface with this application while patients receive SMS notifications triggered by the app, so the study capitalized on getting views of healthcare workers towards the application. The majority of the participants were female (n=16) and were nurses (n=15). Their median age was 28 years of age. All the three private hospital facilities that were part of this study refer presumptive TB cases to MRRH as indicated in Table 1.
Table 1: Participants’ demographics
Baseline characteristic
|
Participants
|
N (%)
|
Median Age (IQR)
|
28 (25-29)
|
Gender
|
|
Female
|
16 (73)
|
Male
|
6 (27)
|
Marital status
|
|
Single
|
12 (54.5)
|
Married/partnered
|
10 (45.5)
|
Facility
|
|
Public Hospital
|
4 (18)
|
Private Hospital 1
|
8 (36)
|
Private Hospital 2
|
5 (23)
|
Private Hospital 3
|
5 (23)
|
Highest educational level
|
|
Certificate
|
7 (32)
|
Diploma
|
10 (45)
|
Degree
|
5 (23)
|
Designation
|
|
Nurse
|
15 (68)
|
Doctor
|
3 (14)
|
Lab Technician
|
3 (14)
|
Pharmacist
|
1 (4)
|
Number of years in general medical practice
|
|
1-5
|
12 (54)
|
>5
|
10 (46)
|
The potentials of Tuuka mobile application among healthcare workers
The majority of the participants reported that the application would help them make quicker medical decisions regarding the referred presumptive patient, enhance communication with other healthcare workers about the referred patients, enhance patient follow up and quick TB case notification, facilitate partnership between private and public hospital facilities and was perceived to be a quick and efficient referral system as shown in Table 2 below.
Table 2: The potentials of Tuuka mobile application among healthcare workers
Characteristic (N=22)
|
Agree
|
Strongly Agree
|
Helping me make quicker medical decisions
|
2
|
20
|
Help me communicate with other healthcare workers about the referred patient
|
1
|
21
|
Enhance patient follow up
|
1
|
21
|
Facilitate partnership with other health institutions
|
0
|
22
|
Quick TB case notification
|
1
|
21
|
Quick and efficient referral system
|
2
|
20
|
Acceptability and feasibility findings
The system usability scale (SUS) (Brooke, 1996) was used to explore how the healthcare workers perceived the usability of the application. The SUS is a 5 Likert scale for subjective assessment of system usability. The total mean for all respondents to the SUS score was 98 (SD 1.97) which according to Bangor et al., 2008 would be in the fourth quartile range in the acceptability range. The descriptive scores of responses to the 10 questions of the SUS are presented in Table 3 below.
Table 3: Tuuka usability findings based on the SUS
Characteristic (N=22)
|
Strongly Disagree
|
Disagree
|
Agree
|
Strongly Agree
|
I think that I would like to use Tuuka application frequently
|
0
|
0
|
5
|
17
|
I found the Tuuka application unnecessarily complex
|
22
|
0
|
0
|
0
|
I thought the Tuuka application was easy to use
|
0
|
0
|
3
|
19
|
I think that I would need the support of a technical person to be able to use this application
|
18
|
4
|
0
|
0
|
I found the various functions in this application were well integrated
|
0
|
0
|
0
|
22
|
I thought there was too much inconsistency in this application
|
19
|
3
|
0
|
0
|
I would imagine that most people would learn to use this application very quickly
|
0
|
0
|
4
|
18
|
I found the application very cumbersome to use
|
21
|
1
|
0
|
0
|
I felt very confident using the application
|
0
|
0
|
7
|
15
|
I needed to learn a lot of
things before I could get going with this application
|
22
|
0
|
0
|
0
|
In addition to the SUS, the UTAUT model was utilized to explore how healthcare workers perceived the acceptability of the Tuuka mobile application. Questions were structured according to the four main constructs of the UTAUT model namely; performance expectancy, effort expectancy, social norms, and facilitating conditions. The application was found acceptable and the descriptive scores of responses are presented in Table 4 below.
Table 4: Perceived usefulness, ease of use and social norms of Tuuka Mobile application
Characteristic (N=22)
|
Neither
|
Agree
|
Strongly Agree
|
Tuuka mobile application is useful in following up the referred presumptive TB patients
|
0
|
7
|
15
|
Tuuka mobile application is more useful than the current referral procedures
|
0
|
6
|
16
|
Tuuka mobile application positively affected the way I feel about referring presumptive TB patients
|
0
|
5
|
17
|
Tuuka mobile application would help me in following up the referred patients in time
|
0
|
5
|
17
|
Tuuka mobile application makes it easier to follow up referred patients
|
2
|
5
|
16
|
Perceived ease of use of Tuuka mobile app
|
It would be easy for me to use Tuuka mobile application to refer patients
|
0
|
4
|
18
|
It would easy for me to remember to use Tuuka mobile application
|
0
|
4
|
18
|
It was easy for me to install Tuuka mobile application
|
0
|
5
|
17
|
Social norms about using Tuuka
|
People think I should use Tuuka mobile application to refer patients
|
0
|
6
|
16
|
My friends, workmates think I should use Tuuka mobile application to refer patients
|
0
|
0
|
22
|
Facilitating Conditions for Tuuka mobile application
All participants had smartphones for Tuuka application to be installed, had electricity and cellular network as facilitating factors to the usage of the application.
Qualitative findings
The intervention acceptability results are presented following the UTAUT model (Figure 1) and detail the performance, effort expectancy, social norms, and facilitating conditions associated with the mobile app.
Performance Expectancy
The study participants found Tuuka mobile application useful in notifying both patients to go to the place of referral and the public healthcare workers about the referred patients. They described that the SMS notifications triggered by the Tuuka mobile application at the private health facility remind and force patients to go the place of referral and also enables the healthcare worker at the public health facility to prepare to receive the referred patient.
The application notifies the healthcare worker at the public hospital that a certain patient has been referred from a private hospital and also notifies the patient to go to the place of referral. So if the patient receives this message, he or she will be forced and reminded to go to the hospital where he has been referred. (Female, Nurse, 38 years, Public Hospital).
Tuuka mobile application was reported to enhance communication between facilities. The application was reported to allow healthcare workers at both the private and public health facilities to communicate with each other about the referred patient after receiving an SMS notification which would help to ascertain whether the patient reached the place of the referral or not.
When a healthcare worker at the private hospital refers a patient, and healthcare worker at the place of referral receives a notification about the referred patient and can immediately reply in the application which brings that easy communication across facilities. (Male, Lab technician, 46 years, Private Hospital).
The mobile application was reported to enhance patient-centered care through coordinated patient follow up efforts in both the private and public hospitals by ensuring privacy and confidentiality of patients where they can easily be worked on without lining up since the healthcare workers are made aware in advance about the referred patient.
This application links the referred patients by alerting the public hospitals about their coming and they can be worked on faster by the healthcare workers upon reaching the facility. This makes a patient feel good knowing that he or she is being cared for. (Female, Nurse, 25 years, Private Hospital).
Effort Expectancy
Following the healthcare workers’ initial orientation to use the application, they found it easy to use for referring the presumptive TB cases. The application has an SMS functionality that would notify the healthcare worker at the public facility about the referred patient which would prompt them to do the needful irrespective of where they are.
I think the application does not need a lot of time to operate, it’s just a matter of adding the patients’ details and the public hospital gets notified about the referred patient. (Female, Nurse, 25 years, Private Hospital).
The participants at the referral unit noted that the application functioned well as evidenced by receiving SMS notifications about an incoming patient as soon as the private healthcare worker referred the patient.
The application was working very well because immediately when a patient was referred from the private hospital, I would receive the message on my phone about the incoming patient. (Female, Nurse, 38 years, Public Hospital).
Social Influence
Participants reported positive perception about the intervention by other hospital staff which increases their chances of utilizing the application.
My fellow healthcare workers don’t have any problem with me using the app, actually they feel it’s important in linking up the referred patients. (Female, Nurse, 26 years, Private Hospital).
Facilitating Conditions
Participants noted that the application does not require a lot of space for installation and the internet to be downloaded which was perceived to enhance its acceptability. They reported being repulsive to downloading apps that require a lot of space and internet as it would be expensive in terms of buying internet packages in the long run.
The application didn’t take a lot of internet bundles to download, and, it doesn’t take a lot of storage space on my phone. (Male, Medical Doctor, 26 years, Public Hospital).
However, participants noted that the internet might limit the usability of the application since the application entirely runs on the internet. The SMS notifications sent to healthcare workers were perceived to force the healthcare worker to buy internet and get more information about the patient
You need internet so that every time you receive the SMS notification about the referred patients, you login to see the details about the referred patient. But in case one doesn’t have internet, the SMS notification will still come, one can buy internet bundles and log in the application. (Female, Nurse, 38 years, Public Hospital).
Participants also complained about the lack of time to utilize the application due to the busy schedules in terms of high number of patients to be worked and at times they would forget about the app
I personally would be overwhelmed with meeting patients on ward and by the time I remember using the application it would be too late. (Female, Nurse, 28 years, Private Hospital).