Development and Usability Evaluation of an Application for Patients With Glaucoma

doi:10.21203/rs.3.rs-270898/v1

Download PDF

Research Article

Development and Usability Evaluation of an Application for Patients With Glaucoma

https://doi.org/10.21203/rs.3.rs-270898/v1

This work is licensed under a CC BY 4.0 License

You are reading this latest preprint version

Introduction

Glaucoma is a progressive optic neuropathy that requires continuous monitoring. The purpose of the study was to develop and evaluate the usability of a mobile application, for iOS and Android platforms, containing functionalities to improve patients’ knowledge about glaucoma and facilitate their treatment.

Methods

The application was developed by a multidisciplinary team using an adapted version of a co-design methodology. Thirty-six volunteers were selected, among patients and patients' relatives, from the Instituto Cearense de Oftalmologia, chosen by rational choice sampling, to answer the System Usability Scale after having prior orientation. The results extracted from the questionnaire were analyzed quantitatively. After grouping by age, a proportions test (z-test) was performed.

Results

It was possible to develop an application for mobile devices named “GlaucoCheck”. Of the 36 interviewees, the average age was 51 (22-69) years old, 56% were women, and 64% had a university degree. The average APP score for usability in the SUS questionnaire was 75.6 (95% CI 74.1-77.2).

Discussion

There was an appropriate acceptance of patients to the “GlaucoCheck”, as it was considered easy to handle, exhibiting interactive and uncomplicated layout. It was possible to develop an application and to register a positive acceptance by the users, encompassing functions that permits better adherence to treatments and additional knowledge about glaucoma.

Ophthalmology

Glaucoma

Mobile Applications

Health Education

Ophthalmology

Telemedicine

Glaucoma is a progressive optic neuropathy, in which the main recognized and modifiable risk factor is high intraocular pressure (IOP). The disease is associated with a progressive loss of visual field as the optic nerve lesion progresses, leading to irreversible vision loss [1]. It is estimated that 60.5 million people were affected by chronic open-angle glaucoma (COAG) and closed-angle glaucoma (CAG) worldwide in 2010, making it the leading cause of irreversible global blindness, with an estimated number of affected people aged 40-80 years worldwide of 111.8 million in 2040 [2]. Because it is a chronic condition, glaucoma requires continuous treatment in order to delay its damage [3]. The incorrect use of eye drops leads to mistreatment and increases therapeutic costs. Such factors are usually obstacles in the patient's adherence to the treatment, leading to therapeutic failure [4, 5].

The technological revolution has brought countless benefits and facilities to humanity, thus mobile phones can configure important allies for patient’s awareness and information. In this context, the creation of health-oriented applications to help patients and doctors has been growing, as they can help managing and treating chronic diseases [6].

The present study aims to develop and evaluated the usability of a mobile application available on iOS and Android platforms, containing functionalities to improve patients’ knowledge about glaucoma and facilitate their treatment.

Study design

This was a transversal and quantitative study divided into two stages. The first stage consisted of creating and developing the application for iOS and Android platforms. The final stage consisted of testing the application, verifying its operation, usability, and acceptance. All the participants signed the informed consent form.

Application development

The “GlaucoCheck”'s entire layout and interface were designed and manufactured to be intuitive, and easy to visualize, as many patients with glaucoma already experience some vision loss, enabling telemedicine functions. Thus, when accessing the application, the patient will be faced with an initial screen, with six options to trigger: "About Glaucoma", "My Eye Drops", "Treatment", "My Exams", "My Pressure" and "Questions”.

The topic "About Glaucoma" consists in recording some quick videos, with themes according to the major doubts and complaints of patients affect by glaucoma and the general population.

In the "My eye drops" section, there is an option to select the medications that the patient currently uses and set the time to use it, including notifications at the exact chosen time. Furthermore, by selecting the "Treatment" option there is the possibility to store information about patients’ surgical treatments (Figure 1).

. "My Exams” enables the registration of performed exams, such as Gonioscopy, Pachymetry, Visual Field, Retinography, and OCT of nerves and fibers (Figure 2).

In the section "My Pressure", the patient can store the values of measured Intraocular Pressure (IOP), enabling the monitoring of the variation during time and automatically generating follow-up graphs.

In "Questions" menu, there are available frequently asked questions (FAQ) among patients with glaucoma, with the respective answers. Beyond that, there is also a telecare option to send e-mails with new questions for the developers, facilitating the communication between patients and professionals.

Mobile application customer feedback

The inclusion criteria were patients suffering from glaucoma who were registered in the Instituto Cearense de Oftalmologia or relatives responsible for those patients who were familiar with iOS ar Android platforms. Participants who did not suffer from glaucoma or did not have a relative with glaucoma, illiterate volunteers, and participants unfamiliar with smartphones and iOS or Android platforms

The volunteers of this research were chosen using a rational choice sample that is justified or not in a non-random way. The choice was intentional or by convenience, considering the study group's characteristics or the researcher's knowledge of what they were investigating [7].

Initially, an informal conversation about the research occurred, clarifying doubts and inviting volunteer's formal invitation to participate and sign the consent form.

After that, the "User Guide" was delivered to the volunteer, which was an explanatory document that clearly shows all the functionality of the application and its tools. Then the volunteer's first contact with the “GlaucoCheck” application occurred through a smartphone base unit with the iOS or Android operating system.

Under the evaluator's supervision, the volunteer was encouraged to explore all the functionalities contained in the application. This whole process occurred with the evaluator's minimum intervention.

Volunteers were finally instructed to fill up a questionnaire containing questions related to their disease and the System Usability Scale, a scale that is characterized as an easy-to-apply method to investigate the system's usability, where each question contains five answer options that follow the 5-point Likert scale (completely disagree, disagree, neutral, agree, and completely agree) [8].

Statistical analysis

The data extracted from the SUS questionnaire answered by the physicians were exported to the Statistical Package for the Social Sciences (SPSS) software version 20.0 for Windows, in which the averages of each item of the SUS questionnaire and the total score of this questionnaire (0-100) were disposed.

36 volunteers were included after following the inclusion and exclusion criteria. There were 20 women (55.5%) and 16 men (44.4%). The average age was 51 years old (22-69). Regarding the educational level, 23 (63.8%) volunteers finished high school, 11 (30.5%) had a university degree, and two (5.5%) were post-graduated.

When asked about the classification of their disease, the majority of the participants were not entirely sure. In addition, 12 (33.3%) volunteers were diagnosed with chronic open-angle glaucoma and five (13.8%) with closed-angle glaucoma. No participant reported suffering from congenital or secondary glaucoma. (Table 1)

Regarding the time of diagnosis, the majority of the volunteers had between six and ten years of illness, 6 (16.6%) had up to five years of illness.. Patients older than 55 years old were diagnosed 6-10 years ago more frequently than patients younger than 55 years old (p=0.026).

When asked about the name of the eye drops, most patients knew the name of the medications. Regarding participants older than 55 years, 34 (94.4%) knew the name of their eye drops, while among patients younger than 55 years 21 (58.3%) knew the name of the eye drops and 15 (41.6%) did not. 16 (44.4%) of the volunteers affirmed that they always use the medications properly, while 20 (55.5%) do not use the eye drops correctly.

21 (58.3%) patients believe they do not have sufficient knowledge about the disease. However, 31 (86.1%) patients stated that they have adequate comprehension about their exams and treatments.

Concerning the SUS questionnaire, there was a separation into groups by age, with no difference in usability between patients under 55 years old or over 55 years old (Table 2).

The application received a fair usability assessment, obtaining an average SUS score of 75.6 (95% CI 74.1-77.2) (Table 3). The “GlaucoCheck” was pointed to arouse the interest in using it frequently among 22 (61.1%) volunteers, while eight (22.2%) were quite interested, demonstrating a level of acceptance of the application of 83.3%. 35 (97.2%)participants considered the application easy to use.

All the volunteers stated that they did not need the support of any technical assistance to use the application. Regarding the integrality of this application's functions, 100% of the participants considered the functions well integrated and the application very consistent, offering no obstacles to use. (Table 4)

According to a survey by the State University of Campinas (Unicamp) and the Thomas Jefferson School of American Medicine in Philadelphia, about half of glaucoma patients have little knowledge about the disease. The results were alarming in both countries: in the United States, 44% of glaucoma patients did not give satisfactory answers about glaucoma, and in Brazil, that number increased to 54% [3,9]. Our results corroborates with the literature, as 58.3% of the patients did not have sufficient knowledge about the disease and 52.7% were not able to classify their glaucoma, highlighting the need and relevance of the "GlaucoCheck" application, as there is great misinformation, which can lead to ineffective treatment. Poor adherence to glaucoma treatment, which varies from 30 to 80%, is related to several factors, such as an incorrect technique when applying eye drops, inadequate dosage, side effects of medications, lack of organization with exams, low confidence in the doctor, ignorance about the severity of the disease and about its treatment [3,4,9,10,11].

Concerning ophthalmology, there are more than 120 mobile applications dedicated to ophthalmological surgery, configuring smartphones as medical tools [12,13]. In this context, applications must be tested and evaluated for a better chance of success in its acceptance [14]. Thus, when patients were asked about their interest in the application's daily use, 61.1% expressed interest in using it frequently, and 22.2% were very interested. These numbers show an application acceptance level of 83.3%, which is a significant level.

When asked about the application's complexity, 83% of patients had a favorable perception of this aspect, showing that “GlaucoCheck” achieved one of its objectives: to be an easy and intuitive application. Moreover, regarding usability, 97% of patients found the app easy to use.

Mobile applications are practical and low-cost tools to help promote the population's health, especially for risk groups, as the target population of this study. In this perspective, some studies have demonstrated the acceptability and the availability of other health applications on a global scale [15,16,17,18]. However, some of these available applications did not assess the users' subsequent usability and their positive health effects, which corroborated with the design and study of “GlaucoCheck”. In addition, one of the main benefits of this type of application is its large-scale reach, which translates into a positive impact on access to health information through the acceptability of using portable technology [19,20,21].

It was possible to develop and confirm the usability of an user-friendly interface application for mobile devices named “GlaucoCheck”, containing functions directed to raise patients' awareness of glaucoma, improve patient’s knowledge about their condition, facilitate the use of eye drops, favor adherence to treatment and enable archiving of exams.

Funding: The application was created and developed by a multidisciplinary team in conjunction with the Technological Innovation Laboratory of the Centro Universitário Christus (Unichristus); there was no funding support in the development of the application and the article

Conflicts of interest/Competing interests: Paula Soares de Mattos Carneiro Valente, Edgar Marçal, and João Crispim Ribeiro have a software registration patent for the Glaucocheck application used in this study. The other authors have no financial or proprietary interest in any material or method mentioned.

Availability of data and material: The applied questionnaires are in possession of the authors.

Code availability: BR 51 2018 052409-5 (Android) and BR 51 2018 052410-9 (iOS).

Authors’ contribution: All authors have contribute equality to this article

Ethics approval: Nº CAAE: 64961516.3.0000.5049, following ethical guidelines of resolution 466/12 of the National Health Commission.

Consent to participate: All volunteers provided an online consent to participate in this study.

Consent for publication: All volunteers provided an online informed consent for the publication.

AKNOWLEDGEMENTS

We want to express our gratitude to the institutions which helped in the development of this research.

Mantravadi AV, Vadhar N. Glaucoma. Primary Care: Clinics in Office Practice. 2015 Sep;42(3):437–49.
Tham YC, Li X, Wong TY, Quigley HA, Aung T, Cheng CY. Global prevalence of glaucoma and projections of glaucoma burden through 2040: a systematic review and meta-analysis. Ophthalmology. 2014;121(11):2081-2090.
Peralta E, Muir KW, Rosdahl JA. Systematic Review of Knowledge Assessments for Glaucoma Patients. Semin Ophthalmol. 2018;33(3):377-388.
Costa VP, Spaeth GL, Smith M, Uddoh C, Vasconcellos JP, Kara-José N. Patient education in glaucoma: what do patients know about glaucoma?. Arq Bras Oftalmol. 2006;69(6):923-927.
Davis SA, Sleath B, Carpenter DM, Blalock SJ, Muir KW, Budenz DL. Drop instillation and glaucoma. Curr Opin Ophthalmol. 2018;29(2):171-177.
Ridder M, Kim J, Jing Y, Khadra M, Nanan R. A systematic review on incentive-driven mobile health technology: As used in diabetes management. J Telemed Telecare. 2017;23(1):26-35.
Armitage P, Berry G, Matthews JNS, editors. Statistical Methods in Medical Research. Blackwell Science Ltd; 2002.
Lewis JR, Sauro J. The Factor Structure of the System Usability Scale. In: Human Centered Design. Springer Berlin Heidelberg; 2009. p. 94–103.
Da Silva MJL, Temporini ER, Neustein I, Araújo MEXS. Knowledge on glaucoma prevention and treatment of patients in a hospital unit. Arq Bras Oftalmol. 2004;67(5):785–790.
Newman-Casey PA, Robin AL, Blachley T, et al. The Most Common Barriers to Glaucoma Medication Adherence: A Cross-Sectional Survey. Ophthalmology. 2015;122(7):1308-1316.
Miguel AI, Fonseca C, Oliveira N, Henriques F, Silva JF. Difficulties of daily tasks in advanced glaucoma patients - A videotaped evaluation. Rev Bras Oftalmol. 2015;74(3):164–170.
Dias FAF, Dias VJF, Carneiro CLB, Bernardes BG, Dutra BAL, Ribeiro JC. A Novel Mobile Application for Preoperative and Intraoperative Assessments of Intrastromal Corneal Ring Segments Implantation for Keratoconus. Cornea, 2020, 39(9):1132-1138.
Dias FAF, Dias VJF, Dutra BAL, et al. Mobile App for Pre- and Intraoperative Assessment of Astigmatism Correction with Toric Intraocular Lenses in Cataract Surgery.J Ophthalmol. 2020;2020:1-7.
Perry GT, Eichler ML, Resende G. Usability evaluation of Mobiteste, an educational application for mobile devices. Brazilian J Inf Des. 2012;9(2):70.
Buller DB, Berwick M, Lantz K, et al. Evaluation of immediate and 12-week effects of a smartphone sun-safety mobile application: a randomized clinical trial. JAMA Dermatol. 2015;151(5):505-512.
Irvine AB, Russell H, Manocchia M, et al. Mobile-Web app to self-manage low back pain: randomized controlled trial. J Med Internet Res. 2015;17(1):e1.
Gajecki M, Berman AH, Sinadinovic K, Rosendahl I, Andersson C. Mobile phone brief intervention applications for risky alcohol use among university students: a randomized controlled study. Addict Sci Clin Pract. 2014;9(1):11.
Laing BY, Mangione CM, Tseng C-H, Leng M, Vaisberg E, Mahida M, et al. Effectiveness of a Smartphone Application for Weight Loss Compared With Usual Care in Overweight Primary Care Patients. Ann Intern Med. 2014 Nov 18;161(10_Supplement):S5
Drongelen A, Boot CR, Hlobil H, Twisk JW, Smid T, Beek AJ. Evaluation of an mHealth intervention aiming to improve health-related behavior and sleep and reduce fatigue among airline pilots. Scand J Work Environ Health. 2014 Nov;40(6):557–68..
Reve EH, Silveira P, Daniel F, Casati F, Bruin ED. Tablet-based strength-balance training to motivate and improve adherence to exercise in independently living older people: part 2 of a phase II preclinical exploratory trial. J Med Internet Res. 2014;16(6):e159.
Kirwan M, Vandelanotte C, Fenning A, Duncan MJ. Diabetes self-management smartphone application for adults with type 1 diabetes: randomized controlled trial. J Med Internet Res. 2013;15(11):e235.

Table 1. Volunteers’ knowledge about the disease.

1. Do you know the classification of your glaucoma?	I’m not sure (53%)	Chronic open-angle glaucoma (33%)	Narrow/closed-angle glaucoma (14%)	Congenital glaucoma (0%)	Secondary glaucoma (0%)
2. How long has it been since you discovered that you have glaucoma?	0-5 years (33%)	6-10 years (47%)	11-20 years (17%)	21-25 years (3%)	>25 years (0%)
3. Do you know all the eye drops you use?	Yes (78%)	No (22%)
4. Do you believe that you know enough about your disease?	Yes (42%)	No (58%)
5. Do you have all your exam results stored?	Yes (33%)	No (67%)
6. Do you drip your eye drops correctly?	Always (44%)	Often (42%)	Sometimes (14%)	Rarely (0%)
7. Have you ever had any treatment without really understanding what it was about?	Yes (14%)	No (86%)

Table 2. Summary of the SUS analysis of groups A and B.

Variable	Group A	Group B
Sample Size	17	19
Mean SUS Score	74.9	76.3
Confidence Interval (95%)	72.8-76.9	73.8-78.8
Margin of Error	2.0	2.5
Standard Deviation	3.9	5.2

SUS: System Usability Scale

Table 3. Application usability review summary (N = 36).

SUS Score	Standard Deviation	Margin of Error	Confidence Interval (95%)
75.6	4.6	1.6	74.1-77.2

N: number of volunteers; SUS: System Usability Scale

Table 4. System Usability Scale.

I think that I would like to use this system frequently.

Strongly disagree

(0%)

Disagree

(0%)

Indifferent

(17%)

Agree

(61%)

Strongly agree

(22%)

I found the system unnecessarily complex.

Strongly disagree

(14%)

Disagree

(83%)

Indifferent

(3%)

Agree

(0%)

Strongly agree

(0%)

I thought the system was easy to use.

Strongly disagree

Disagree

Indifferent

(3%)

Agree

(39%)

Strongly agree

(58%)

I think that I would need the support of a technical person to be able to use this system.

Strongly disagree

(92%)

Disagree

(8%)

Indifferent

(0%)

Agree

(0%)

Strongly agree

(0%)

I found the various functions in this system were well integrated.

Strongly disagree

(0%)

Disagree

(0%)

Indifferent

(0%)

Agree

(11%)

Strongly agree

(89%)

I thought there was too much inconsistency in this system.

Strongly disagree

(75%)

Disagree

(25%)

Indifferent

(0%)

Agree

(0%)

Strongly agree

(0%)

I would imagine that most people would learn to use this system very quickly.

Strongly disagree

(0%)

Disagree

(0%)

Indifferent

(3%)

Agree

(33%)

Strongly agree

(64%)

I found the system very cumbersome to use.

Strongly disagree

(22%)

Disagree

(53%)

Indifferent

(25%)

Agree

(0%)

Strongly agree

(0%)

I felt very confident using the system.

Strongly disagree

(50%)

Disagree

(31%)

Indifferent

(19%)

Agree

(0%)

Strongly agree

(0%)

I needed to learn a lot of things before I could get going with this system.

Strongly disagree

(0%)

Disagree

(29%)

Indifferent

(14%)

Agree

(57%)

Strongly agree

(0%)

Download PDF

Reviews received at journal
28 Feb, 2021
Reviewers invited by journal
26 Feb, 2021
First submitted to journal
23 Feb, 2021
Editor assigned by journal
22 Feb, 2021

You are reading this latest preprint version

Development and Usability Evaluation of an Application for Patients With Glaucoma

Status:

Version 1

Abstract

Figures

Introduction

Materials And Methods

Results

Discussion

Conclusion

Declarations

References

Tables

Status:

Version 1