DOI: https://doi.org/10.21203/rs.3.rs-284523/v1
Background: Stroke is known as the second leading cause of death and the main leading cause of long-term disabilities in the world. Self-care applications can be potentially effective in improving chronic conditions. This protocol will be implemented for a study to evaluate the effects of an Android-based self-care application on patients with stroke.
Methods: The first stage will include the development of an android-based application and second stage will be conducted using triple blinded Randomized Clinical Trial (RCT). The sample size will include 60 patients with recent stroke and partial paralysis of limbs (hemiplegia or hemiparesis), who will be divided into two groups of intervention and control through permuted block randomization method. Patients in both groups will receive usual medical care, but those in the intervention group will also use an Android-based self-management application for a period of two months and a total of 40 sessions. Outcomes will be assessed using valid and reliable questionnaires.
Discussion: Assessed outcomes will include stroke severity using National Institute of Health Stroke Scale (NIHSS) score, ability to perform activities of daily living using Barthel Index (BI) score, depression rate using Beck Depression Inventory (BDI-II) score, quality of life using EQ-5D-3L score, medication adherence using Modified Morisky Scale (MMS-8) score, patient satisfaction using Patient Satisfaction Questionnaire (PSQ) score and the number and type of complications in patients into two groups. These outcomes will be assessed at baseline, after two months and after three months from the beginning of the intervention. Intervention effects on the measured variables will also be evaluated using appropriate statistical tests based on the type of variable distribution. Potential consequences of the study might be the improvement of the measured variables in the intervention group compared to the control group. The initial expectations are that the intervention may significantly improve the status of the measured variables in the intervention group compared to that of the control group.
Trial registration: This protocol is registered in the Iranian registration of clinical trial (IRCT) on November 7, 2020 with the code IRCT20201015049037N1. URL: https://irct.ir/trial/51674
Every year, 26 million people worldwide experience stroke, and the disease is the second leading cause of death worldwide and the main leading cause of long-term disabilities [1]. According to the World Health Organization (WHO), of the 56 million deaths that occur worldwide each year, 10.8% are due to stroke [2]. Stroke includes a group of pathological disorders of cerebral arteries characterized by decreased neurological and non-convulsive function due to cerebral ischemia or intracranial hemorrhage [3]. Stroke has a variety of consequences for patients [4] and stroke survivors usually experience a wide range of symptoms related to motor function, speech, swallowing, vision, sensation and perception, and their recovery can be slow and incomplete [5, 6]. These symptoms often lead to limited participation in home and community activities. Rehabilitation procedures for these people are often long-term and require a lot of resources. However, only half of survivors have access to rehabilitation services after discharge [7]. In a qualitative study, Anderson et al. [8] concluded that mobile-based applications could improve self-care in patients with chronic conditions. Other studies have shown the impacts of mobile-based training on improving stroke outcomes [9, 10]. An increasing number of RCTs have evaluated the effectiveness of telerehabilitation interventions. Nevertheless, it is difficult to draw conclusions about the effects of these interventions since the type of interventions and comparisons performed vary greatly from study to study. Some studies have shown the effects of mobile-based applications on improving and enhancing some of the measured outcomes in patients after stroke [11–14] while other studies showed the use of these applications could be ineffective based on the measured outcomes [15, 16]. In addition, the results of a number of studies do not seem to be generalizable and might be at risk of being bias, and accordingly more studies are needed to yield more definitive conclusions [7]. Therefore, in this study, we intend to first develop a mobile-based application and then solve its usability problems by expert-based usability evaluation. Finally, an interventional study will evaluate the effects of this application on patients with stroke.
This Randomized Clinical Trial (RCT) will be done in two stages. The first stage will include the development of an android-based application, with the second stage being the evaluation of the effects of this application on patients with stroke.
Application development will be based on the model presented by Chavez et al. in 2019 [17] (Fig. 1). This model is a combination of iterative and incremental models in system development. According to this model, software development will be done in three different phases, which include the following:
- Determining functional requirements
- Designing a low-fidelity prototype and evaluating its validity
- Designing a High-fidelity prototype and evaluating its usability
In this phase, the functional requirements of the application will be determined.
- Selecting clinical guideline
- Reviewing similar studies and applications
- Needs assessment of patients
- Needs assessment and localization of requirements based on expert opinion
In this phase, based on the existing stroke self-care guidelines, one of the clinical guidelines approved by three neurologists will be selected at first and the functional requirements of this guideline will be extracted by researchers.
In this regard, some systematic review studies have been conducted [7, 18–21] which will also be reviewed by researchers. Needs assessment of patients will be done as the most important stakeholder group of the application. For this purpose, a semi-structured interview will be used with patients who have previously suffered from stroke and partial paralysis and have now partially recovered. These patients are required to have at least a diploma and be able to work with a smartphone. According to similar studies, participants will include three patients [22, 23] who will be selected by convenience sampling method. Finally, all these requirements will be prepared in the format of Lawshe Table and will be given to the experts. At this stage, a questionnaire containing functional requirements and information content of the application will be given to neurologists, occupational therapists and physiotherapists for the purpose of localization. Delphi technique will be used in this step. Moreover, for needs analysis, 15–21 neurologists, physiotherapists and occupational therapists who are faculty members of the country's medical universities and have at least three years of professional experience will be consulted. At this stage, for each requirement, the necessity, appropriateness, clarity and relevance will be evaluated and in terms of necessity (CVR), three levels (essential and useful, useful but unnecessary, non-useful) and in terms of appropriateness, clarity and relevance (CVI) four levels (from very high with a score of four to very low with a score of one) will be defined.
According to CVI, questions that have scores of higher than 0.79 will be approved and scores between 0.7 to 0.79 will be re-reviewed, corrected and returned to the experts and finally those of less than 0.7 will be rejected. This step will be repeated until the final validity of the questionnaire content is confirmed.
Minimum score for accepting each component will be considered as 3.75.
Components with a score of less than 2.5 will also be removed from the application content.
In this phase, based on the feedback and opinions received from experts in the previous step, first the items and how the application works as a conceptual model will be designed and then the low-fidelity user interface (how to display the content of the application and the relationship between humans and smartphones) on android platform will be developed using the appropriate programming language. Then, a primary prototype will be created and its validity will be evaluated. After implementing functional requirements on the prototype for checking validity, six experts will review the application and evaluate the extent to which functional requirements and goals are met by this prototype. These experts will include two neurologists, two physiotherapists and two occupational therapists with at least three years of specialized work experience in the field of treatment and rehabilitation of patients with stroke.
In order to evaluate the usability of the prototype, Cognitive Walkthrough (CW) method will be used based on the method proposed by Polson and Lewis [24]. For this purpose, a certain number of scenarios that represent the most important and frequent application functions will be identified in line with the opinion of three neurologists. For each scenario, the main objective, sub-objectives, sequence of steps to do the tasks and system responses will be prepared and approved by the researchers. Then, the program will be provided to the evaluators. Five individuals will be chosen to do the evaluation through non-probability quota sampling. Evaluators are required to have at least a master's degree in health information technology/management or medical informatics and have 2 years of professional experience in evaluating health information systems. They will independently perform the sequence of steps for each scenario through the program's user interface. Each evaluator puts themselves in the position of the patient and observes the program from the patient's point of view; in case of any problems in performing task steps, it will be expressed by evaluators. This will happen at the presence of the researcher as an observer who will write the following items in data collection forms: evaluator's comments, questions and uncertainties, an explanation of the usability problem identified by the evaluator, location of the problem in the system and the time to perform each scenario. At the end of each evaluation process, each evaluator will review the list of related problems and suggest any solutions they have to solve potential issues. Then, in a meeting, separate lists of evaluators will be compared and all identified problems will be put on the list of main problems. Next, any duplicate problems will be eliminated and the evaluators will be asked to assess the severity of the problems independently. This rating will be based on three criteria including frequency of the problem, impact of the problem and continuity of the problem. Scoring for each problem and criterion will be done in 5 degrees ranging from 0 (no problem) to 4 (severe problem).
Also, in order to confirm the application by users, the Technology Acceptance Model (TAM) will be used and Perceived Ease Of Use (PEOU), Perceived Usefulness (PU), User Satisfaction (US) and Attribute of Usability (AU) questionnaires (20 items in total) will be distributed among 30 users who have previously had a stroke and have been working with the application for a week. The results of users' comments are also given to the designers. This step will be repeated until the application is approved by evaluators. The output of this phase is the final version of the application which will be ready to be implemented in the live environment.
At this stage, the unit test of the final application will be performed by researchers and different modules of the application will be tested separately to confirm correct performance, which can help to eliminate potential any defects. In the next step, application integrity test will be performed by researchers. For this purpose, one researcher will put him/herself in the position of the patient and another researcher in the position of the physician. Feedback on probable defects of the application will be given to application designers.
At this stage, an interventional study with patient blinding, assessor physician and analyst will be conducted to evaluate the effects of the application on patient self-care. The designed application will be installed on patients’ smartphones and the necessary training to use it will be given to the patient and their caregivers. The study population will include patients referring to one of the general hospitals in Kashan where sampling can be done in a convenient way. Patients with hemiplegia or hemiparesis caused by a recent stroke will be chosen for this purpose.
At least 72 hours must have passed since the stroke (Acute phase of the disease must has passed) and patients must have adequate consciousness and hearing and be willing to participate in the study.
- Patients who have some levels of consciousness disorder
- Patients with cognitive disorders such as dementia or memory impairment
- Patients with global aphasia
The formula
with the reliability of 95% and the test power of 90% based on the mean and standard deviation obtained in the same study [25] was calculated as 23 patients, which increased to 30 patients according to the available facilities.
Randomization will be done by block method (Permuted Block Randomization) in a way that first all foursome blocks which include two codes A and B will be prepared (6 blocks) and then, using a random number table, random blocks will be selected by placement (15 blocks). These blocks contain up to 60 codes including A and B, each of which is randomly assigned to either the control or the intervention groups.
For the purpose of blinding, an application will be installed on the smartphones of patients of both intervention and control groups. The program installed for patients in the control group only contains online questionnaires that patients need to complete and submit at specified intervals. Online questionnaires include a number of questionnaires used to measure the target variables.
Patients will not be familiar with the nature and content of the installed program on opposite group’s phones. During program installation, someone other than the assessor physician will install the program for patients or their caregivers. Furthermore, during the assessment process, the same person will record the results of the physician evaluation and the scores related to each patient. Therefore, the assessor physician will not know which group a given patient belongs to. Numeric codes for intervention and control groups will also be used for analysis, and the letters A and B will be used for the control and intervention groups when information is sent to the analyst.
Intervention for patients in the intervention group includes an Android-based application that has all the functional requirements approved by experts in the analysis and software design phases. This application contains audio, video, textual files or games to improve lower and upper limb function, improve activities of daily living, prevent and reduce depression, reduce and manage pain and other possible complications of stroke, medication reminders and whatever playing a role in improving patient outcomes, and has been designed according to experts' opinion. Patients will be advised to use the application 5 days a week and for a period of 1 hour each day. The duration of the intervention will be 8 weeks (40 sessions in total). The application can record the number of times and hours of application use by the user. In order to learn how to use the application, users can contact one of the research team members. A member of the research team will also make weekly phone calls with users to make sure patients know how to use the application.
An application will be installed on the smartphones of these individuals, which lacks the main capabilities of the application and only contains electronic questionnaires. Installation of this application will be done only for blinding purposes. Intervention duration and the time of measuring the outcomes will be the same for both groups. (Fig. 2 shows the flowchart of protocol for interventional trial).
The required data will be collected using valid and reliable questionnaires that are introduced as follows. Data will be collected in three stages: prior to intervention (before the intervention and at the time of discharge), two months after the intervention and three months after the intervention (in the doctor's office or in the hospital outpatient clinic). Data from NIHSS and BI questionnaires and stroke complication checklist will be completed by the attending neurologist and other questionnaires will be completed by patients as self-report. Completion of questionnaires by patients will be done electronically and sent online through the application.
The National Institute of Health Stroke Scale (NIHSS) questionnaire will be used to measure stroke severity.
This questionnaire has 11 items, each of which has 5 options and scores from 0 to 4 (a score of 0 indicates normal performance and a score of 4 indicates a severe defect in performance). Due to the special type of scoring, scores will eventually be obtained between 0 to 42, which will be divided as follows:
0: No stroke symptoms
1–4: Mild stroke
5–15: Medium stroke
16–20: Moderate to severe stroke
21–42: Severe stroke
The validity of this questionnaire was confirmed using clinical predictor validity and its reliability was approved with Cronbach's alpha of 0.95 in Hinkle's study [26]. It should be noted that, in the present study, the original version of this questionnaire will be used by a neurologist.
The Barthel Index (BI) questionnaire will be used to measure activities of daily living (covering the activities section of ICF). This questionnaire includes 10 key activities of daily living including: feeding, bathing, grooming, dressing, bowels, bladder, toilet use, transfers (bed to chair and back), mobility (on level surfaces) and stairs. In each item, scores are: 0 (dependent), 5 (need for major help), 10 (need for minor help) and 15 (independent). Finally, the ranking of people is done as follows:
80–100: independent.
60–79: slightly dependent.
20–39: very dependent
Less than 20: completely dependent [27].
The validity and reliability of the Persian version of this tool were confirmed in a study by Tagharrobi et al. [28] The validity of the questionnaire was confirmed using concurrent validity, comparison of known groups and exploratory factor analysis and the reliability was confirmed using Cronbach's alpha. The Cronbach's alpha coefficient of this instrument was reported as 0.99 in this study.
The final score of the questionnaire is between 0 to 10. The validity and reliability of the Persian version were confirmed in a study done by Dastourani et al. [29] The construct validity and the differential validity were confirmed by testing the predetermined hypotheses and by the method of known groups, respectively. Cronbach's alpha coefficient of this questionnaire was reported as 0.89.
To assess the depression (covering the body structure section of ICF), the BDI-II questionnaire will be used, which includes 21 groups of sentences with a value scale of 0 to 3 expressing the patient’s feelings during the previous 2 weeks. The scores of this questionnaire are between 0 and 63. The validity and reliability of the Persian version of this questionnaire were confirmed in a study done by Hamidi et al. [30] The validity of the questionnaire was confirmed using descriptive and confirmatory factor analysis as well as convergent validity and its Cronbach's alpha was 0.93.
The MMAS-8 questionnaire will be used to assess patients' medication adherence. This questionnaire consists of 8 questions, of which items 1 to 7 are yes/no questions, and item 8 has a 5-point Likert scale. For items 1 to 7, for each no answer, a score of 1 and for each yes answer, a score of 0 will be recorded. For question 8, scores from 0 to 4 (never, rarely, sometimes, often, always) are considered. The final score will be between 0 and 8, with 8 indicating high adherence, 6 and 7 indicating moderate adherence, and less than 6 indicating low adherence. The validity and reliability of the Persian version of this questionnaire were confirmed in a study conducted by Ghanei Gheshlagh et al. [31] The validity was confirmed using the concurrent criterion validity method and reliability. Cronbach's alpha coefficient was reported as 0.72 in this study.
The PSQ questionnaire will be used to measure patient satisfaction with the treatment. This questionnaire includes 11 items with a 5-point Likert scale (from 0 for very poor to 4 for excellent). The total score is a number between 0 and 44. The scores of 0–10 mean poor satisfaction, scores 11–21 mean good satisfaction, scores 22–32 mean very good satisfaction and scores 33–44 mean excellent satisfaction. The validity and reliability of the Persian version of this questionnaire were confirmed in a study done by Yousefi Golafshani et al. [32] The face validity and content validity were confirmed using the opinions of 10 experts in the field of medical education and Cronbach's alpha was reported as 0.98.
To assess the frequency and type of complications in patients, a stroke complication checklist will be used which includes a total of 19 complications eight of which are based on the most common stroke complications from the perspective of the American Heart Association (AHA) and the American Stroke Association (ASA) [33] and 11 of which are based on the most common complications reported in related studies [34–37]. This checklist is prepared by the researchers and the face and content validity of this checklist will be confirmed by 3 neurologists.
Data analysis will be performed using SPSS 22. The data will be first presented in the form of descriptive statistics and frequency distribution tables. The normality of the data will be checked using the Kolmogorov-Smirnov test. In order to determine the relationship between the scores of patients’ activities of daily living, quality of life, depression, medication adherence and patient satisfaction with patients’ group type (control or intervention), an independent t-test will be used. If there is a significant difference between the intervention group and the control group, the effect of the intervention will be specified. Repeated measures analysis of variance (ANOVA) will also be used to analyze multivariate and control the effects of confounding variables on dependent variables. In all tests, a significance level of 0.05 is considered. Pearson or Spearman correlation coefficient (according to the type of variable distribution) will be used to determine the relationship between the usage duration of program and the score of the measured variables. After categorizing the time of application usage, one-way ANOVA or Kruskal-Wallis test (depending on the type of variable distribution) will be used to determine the relationship between the measured variables and the time of application usage. Chi-square test will be used to determine the relationship between the type of complications in both groups. Also, to determine the relationship between the scores of the measured variables before and after the intervention, paired t-test will be used in each group separately. Hypothesis H0 will indicate the absence of correlation and Hypothesis H1 will indicate the existence of correlation between the measured variables.
Various protocols have been designed to evaluate the impact of mobile applications and trainings on the outcomes of patients with stroke [38–41]. However, these studies differ in terms of sample size, number of variables and outcomes to be measured, duration of intervention and protocol design. In Iran, a study in which first an application is designed using expert and patient needs assessments according to a standard guideline and then the impact of designed application on patients with stroke is evaluated has not been done yet. In other foreign studies, less attention has been paid to different aspects of ICF. However, in the present study, we will try to evaluate the outcomes based on valid and reliable questionnaires that are related to different sections of ICF.
Data collection of this study has not yet begun and expected recruitment start date is March to April 2021 and the recruitment will be completed approximately in September 2021.
Ethics approval and consent to participate
This study was approved in Kashan University of Medical Sciences with the ethics code of IR.KAUMS.NUHEPM.REC.1399.055 and its protocol were registered and approved in the Iranian Registration of Clinical Trial (IRCT) with the code of IRCT20201015049037N1.
The recruitment of this study has not started yet and the expected recruitment start date is March 2021. Results of this study have not already been published or submitted to any journal.
Consent for publication
Not applicable
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Competing interests
The authors declare that they have no competing interests.
Funding
This protocol is done for partial fulfillment of the requirements for the degree of Ph.D. dissertation in the field of health information management, which has been approved by the Research Centre for Health Information Management and the Vice Chancellor for Research of Kashan University of Medical Sciences with the research number 99128. This internal funder will be provided part or all of the costs for developing application according to the future contract. The authors do not receive any grants from nonprofit organizations or funding agencies either in public or commercial sectors.
Authors' contributions
HT made substantial contributions to the conception, drafting and design. SAM is the scientific director of the clinical trial and is responsible for assessment of patients. HT, MF, EN are responsible for software development and HA is responsible for recording and analyzing data. All authors have read and approved the manuscript.
Acknowledgements
Special thanks to Research Centre for Health Information Management and Vice Chancellor for Research and Technology of Kashan University of Medical Sciences for their supports.
AHA: American Hospital Association
ANOVA: Analysis of Variance
ASA: American Stroke Association
AU: Attribute of Usability
BDI: Beck Depression Index
BI: Barthel Index
CVI: Content Validity Index
CVR: Content Validity Ratio
CW: Cognitive Walkthrough
EQ-5D-3L: EuroQol group-5 Dimensions-3 Levels
ICF: International Classification of Functioning, disability and health
MMS-8: Modified Morisky Scale-8 items
NIHSS: National Institute of Health Stroke Scale
PEOU: Perceived Ease of Use
PU: Perceived Usefulness
TAM: Technology Acceptance Model
US: User Satisfaction