Development, Validation and Translation of Cardiopulmonary Resuscitation and Automated External Defibrillator Training and Placement Bilingual Questionnaire

doi:10.21203/rs.2.10930/v3

Download PDF

Research note

Development, Validation and Translation of Cardiopulmonary Resuscitation and Automated External Defibrillator Training and Placement Bilingual Questionnaire

https://doi.org/10.21203/rs.2.10930/v3

This work is licensed under a CC BY 4.0 License

Journal Publication

published 21 Oct, 2019

Read the published version in BMC Research Notes →

You are reading this latest preprint version

Objectives: This paper describes the development and translation of a questionnaire purported to measure (1) the perception of the placement strategy of automated external defibrillator, (2) the perception on the importance of bystander cardiopulmonary resuscitation and automated external defibrillator (3) the perception on the confidence and willingness to apply these two lifesaving interventions as well as (4) the fears and concerns in applying these two interventions. For construct validation, exploratory factor analysis was performed using principal axis factoring and promax oblique rotation and confirmatory factor analysis performed using partial least square. Results Five factors with eigenvalue >1 were identified. Pattern matrix analysis showed that all items were loaded into the factors with factor loading >0.4. One item was subsequently removed as Cronbach’s alpha >0.9 which indicates redundancy. Confirmatory factor analysis demonstrated acceptable factor loadings except for one item which was subsequently removed. Internal consistency and discriminant validity was deemed acceptable with no significant cross-loading.

Cardiac & Cardiovascular Systems

Health Economics & Outcomes Research

construct validation

exploratory factor analysis

confirmatory factor analysis

cardiopulmonary resuscitation

automated external defibrillator

forward translation

backward translation

While a number of questionnaire measuring the various dimensions of bystander cardiopulmonary resuscitation (CPR) [1-4] and AED [2-7] have been published, there are few questionnaires that combine both bystander CPR and automated external defibrillator (AED) measurement [8-9]. We reported the development and construct validation (exploratory factor analysis, EFA and confirmatory factor analysis, CFA) of a bilingual (English and local Malay language) questionnaire that comprehensively measures four objectives: (1) the perception of AED placement strategy, (2) the perception on the importance of bystander CPR and AED, (3) the perception on the confidence and willingness to apply these two lifesaving interventions as well as (4) the fears and concerns in applying these two interventions.

Participants

For EFA, 184 administrative employees from Universiti Malaysia Sarawak (UNIMAS) (who were participants of CPR and AED workshops), responded to the questionnaire. Healthcare employees such as doctors, nurses and paramedic staff were excluded from this study. The mean age of the participants was 37.6 years (standard deviations +/- 6.85); and 100 of them (54.3%) were male participants. The number of participants who responded exceeded the estimated sample size according to Costello & Osborne (2005) (i.e., minimum of 5 responses per item) [10]. As there were 22 items to be validated, the estimated sample size was 110 participants. For CFA, 100 medical doctors from the emergency department of Sarawak General Hospital (age range from 28 years to 32 years old) and 122 final year medical students from UNIMAS (age range from 23 to 25 years old) and who had been trained in CPR and AED, responded to the questionnaire. Convenient sampling was applied in recruiting the participants.

Materials

The EFA was performed in Statistical Package for the Social Sciences (SPSS) software using principal axis factoring as the extraction method. For CFA, reflective measurement modelling using partial least square was performed using SMART-PLS software. For translation of the questionnaire from English language into the local Malay language, the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) principles of good translation practice for cultural adaption was adopted as the working framework [11]. According to the ISPOR principles, a good translation has the following steps: (1) forward translation, (2) reconciliation (3) backward translation (4) harmonization [11]. In the forward translation stage, two authors who are fluent in both English and Malay language (SYL, DNK) independently translated the questionnaire into Malay language. After completion of the initial Malay language translation, these 2 authors of this paper then discussed and resolved any discrepancy of the translations (reconciliation). Subsequently, an independent language expert who is fluent in both languages were invited to translate the Malay language version back to English language (backward translation). Finally the original English version and the backward English version would be compared to check for significant discrepancy (“harmonization”).

Procedures

Ethical approval was obtained from the Medical Research and Ethics Committee, Ministry Of Health Malaysia and the study was registered under the Malaysian National Medical Research Register (NMRR, website URL: www.nmrr.gov.my) with the research number of NMRR-16-696-39041. Written informed consent was obtained from all participants prior to their participation in this study.

With regards to the development and construct validation of the questionnaire, a preliminary version of the checklist was first constructed based on previous works [1, 3-9, 12] as well as opinions from four authors of this paper (KSC, SYL, NS and DNK). A modified Delphi method via iterative email communications and face-to-face discussion sessions were conducted. The purpose of these discussions was to come up with a list of the pertinent items purported to measure (1) the perception of the importance of bystander CPR and public access AED, (2) the perception of the confidence and willingness of bystanders to apply these two lifesaving interventions as well as (3) fears and concerns of bystander that may deter their willingness and (4) the perception of the placement strategies of these AED.

Once the preliminary list of items was determined, the participants were asked to rank the items in a Likert scale of four, ranging from “1 = strongly disagree” to “4 = strongly agree”. An initial run of EFA was performed in order to determine the number of factors to be fixed (eigenvalue>1). After fixing the number of factors, re-run of EFA was then performed to determine the factor loadings of the items as well as to identify items that may need to be removed. Promax oblique rotation was again used. In the pattern matrix, factor loading with cut-off value of <0.4 was used as the criteria to determine whether an item was to be removed or not [13]. The communality value, which indicates convergent validity of the items, was set at 0.25. Finally, the Cronbach’s alpha coefficients (with >0.6 cut-off value) were then checked to evaluate the degree of internal consistency of the items in each construct or factor. [13].

With regards to CFA, convergent validity, internal consistency, and discriminant validity were determined using partial least square (PLS). For internal consistency, the composite reliability was determined, whereas for convergent validity, factor loadings and average variance extracted (AVE) were determined [14]. In this regard, factor loading of >0.70 is used as the cut-off point; whereas for item with factor loading between 0.4 to 0,7, the effect of its removal on the overall AVE would be considered. If the removal of the item improves the AVE of the factor, the item would be removed unless the item is a priori determined by the authors to be of critical importance in terms of content validity [14, 15].

With regards to the translation process, two of the authors of this paper (SYL, DNK) independently translated the original English version into the targeted Malay language (“forward translation”) version. These two authors are proficient in both English language and Malay language. SYL is a medical doctor working in the emergency department of Sarawak General Hospital while DNK is a nursing educator from UNIMAS. These 2 authors then compared their versions of the translation with the aim of merging their versions into a single forward translation version (“reconciliation” stage). The backward translation was performed by an independent translator who is proficient in both English and Malay languages and who has vast experience in doing journalistic translation work in two languages. After completion of the backward translation, three authors (SYL, DNK, NS and KSC) then compared the back translated English version with the original English version to check for significant discrepancy (“harmonization”). Any significant discrepancy would be discussed, and revised if deemed necessary. In the unlikely event where there is discrepancy in which the authors could not amicably resolve, an independent language expert who is fluent in both English and Malay languages would be called in.

With regards to the development and construct validation of the questionnaire, the Kaiser-Meyer-Olkin measure of sampling adequacy was 0.79 indicating sampling adequacy for EFA. The p-value for Bartlett’s test of sphericity was <0.001 indicating that there are worthwhile correlations among the items based on the correlation matrix. There are five factors with initial Eigenvalue >1 (also demonstrated in scree plot, see Figure 1). The re-run of EFA using promax oblique rotation showed that the communalities of all items >0.25. Pattern matrix analysis showed that all items were loaded into the factors with factor loading >0.4 (see Table 1 for the detailed factor loadings after the initial run of EFA). The Cronbach’s alpha value for Factor 1 was 0.955 with 6 items loaded into it, suggesting that there are redundant items. When checked for redundancy, it was noted that item “The directions that point to the location of the AED are clear” carries very similar meaning with item “The signage that shows the location of the AED is clear”. Hence, item “The directions that point to the location of the AED are clear” was removed. After removal, the internal consistency of Factor 1 is still good with Cronbach’s alpha of 0.942. The internal consistency for Factor 2, Factor 3, Factor 4 and Factor 5 were also good with Cronbach’s alpha of 0.855, 0.787, 0.914 and 0.893 respectively. The corrected item-total correlation of all items ranged from 0.41 to 0.89. No negative correlation was noted. A re-run of the EFA after deletion of item “The directions that point to the location of the AED are clear” was subsequently performed and showed that the factor loadings are still good.

Based on the items that are loaded into the 5 factors, Factor 1 is labelled as “perception of AED placement strategies”, Factor 2 as “perception of importance of CPR and AED”, Factor 3 as “concerns of injuring victims during CPR and AED”, Factor 4 as “concerns of legality in performing CPR and AED” and Factor 5 as “confidence and willingness to perform CPR and AED”.

With regards to the CFA, the factor loadings of all items ranged between 0.48 to 0.98, except for “formal training” where the factor loading was 0.40. This item was subsequently removed as its removal improved the AVE of the factor from 0.30 to 0.40. The AVEs of the other factors ranged from 0.55 to 0.94. In terms of internal consistency, the composite reliability of all factors ranged from 0.69 to 0.97. In terms of the discriminant validity, there was no significant cross loading, the AVEs of all factors were higher than that of other factors according to Fornell and Lacker’s criterion (1981) [14] and the confidence interval for heterotrait-monotrait ratio (HTMT) for all items did not include the value of 1.0. The final structural model developed from PLS and its measurement results are detailed in Supplementary Figure 1. The forward translation version (after the reconciliation stage) as well as the backward translation version by an independent translator (after the harmonization stage) are tabulated in Supplementary Table 1. The final version of the validated questionnaire is shown in Table 2.

The objective (1) perception of placement strategies of public access AED, was captured in Factor 1, labelled as “perception of AED placement strategies”; objective (2) perception on the importance of bystander CPR and public access AED is captured in Factor 2, labelled as “perception of importance of CPR and AED”; objective (3) perception on the confidence and willingness to apply these two lifesaving interventions is captured in Factor 5, labelled as “confidence and willingness to perform CPR and AED” and objective (4) the fears and concerns in applying these two interventions is captured in Factor 3 “concerns of infection and injuries during CPR and AED” and Factor 4 “concerns of legality in performing CPR and AED”.

To ensure a successful implementation of public access AED program, the preparedness of trained bystanders (with positive attitude and confidence) is as important as the placement of the AEDs itself [16-17]. Whitney-Cashio et al (2012) [10] suggested that AEDs should be placed in highly visible locations (“visibility”) that can be easily accessible (even after working hours) and with the “direction” and “signage” to access the AED should an emergency arises. Besides accessibility and visibility, AEDs should have clear instruction on how to use it and be placed in a secure area (e.g. with surveillance cameras) to minimize the risk of the AEDs being stolen (“security”). The corresponding item to measure each of these criterion in Factor 1 “perception of AED placement strategies” is listed in Supplementary Table 2.

The items in this questionnaire were mainly constructed and culled from published papers. In other words, there could have been other valid dimensions that also measures a specific factor or construct but are missed in our questionnaire. This is especially so in the construct of “concerns of injuring victims during CPR and AED”. In this construct, we merely measured the concerns or fears of injuring victims and contracting infectious diseases that may deter the initiation of bystander CPR and the use of AED. There may have been other fears and concerns that are valid and relevant but are not captured in this questionnaire.

AED = automated external defibrillator

AVE = average variance extracted

CPR = cardiopulmonary resuscitation

EFA = exploratory factor analysis

CFA = confirmatory factor analysis

HTMT = heterotrait-monotrait ratio

ISPOR = International Society for Pharmacoeconomics and Outcomes Research

NMRR = National Medical Research Register

PLS = partial least square

SPSS = Statistical Package for the Social Sciences

UNIMAS = Universiti Malaysia Sarawak

Ethics approval and consent to participate: Ethical approval was obtained from the Medical Research and Ethics Committee, Ministry Of Health Malaysia and the study was registered under the Malaysian National Medical Research Register (NMRR, website URL: www.nmrr.gov.my) with the research number of NMRR-16-696-39041. Written informed consent was obtained from all participants prior to their participation in this study.

Consent for publication: Not applicable.

Availability of data and material: The dataset used and analysed in this study are available from the corresponding author on reasonable request.

Competing interests: No competing of interest declared.

Funding: Not applicable.

Authors' contributions: All authors (KSC, SYL, AZAZ, SSLW, NS, DNK and HCC) were involved in the initial conception of the study design. KSC, SYL, AZAZ, NS, DNK and HCC were involved in the production of the preliminary list of pertinent items to construct the checklist. SYL, NS and DNK were involved in collecting data; SYL, KSC and SSLW were involved in the exploratory factor analysis. SYL and KSC were involved in writing up the draft of the manuscript. SYL, DNK were involved in the forward translation into the Malay language. All authors have read and approved the manuscript.

Acknowledgements: The authors would like to thank Miss Asha Kaushal for help in the backward translation of the Malay version into English version. The authors also would like to thank the employees who were involved in the validation of the questionnaire.

Özbilgin Ş, Akan M, Hancı V, Aygün C, Kuvaki B. Evaluation of Public Awareness, Knowledge and Attitudes about Cardiopulmonary Resuscitation: Report of İzmir. Turkish journal of anaesthesiology and reanimation. 2015;43(6):396-405.
Chien C-Y, Weng Y-M, Hsu S-C, Kuo C-W, Chaou C-H. Effect of population-based training programs on bystander willingness to perform cardiopulmonary resuscitation. Signa Vitae. 2016;12(1):64-9.
Huang PCE, Chiang WC, Hsieh MJ, Wang HC, Yang C-W, Lu TC, et al. Public knowledge, attitudes and willingness regarding bystander cardiopulmonary resuscitation: A nationwide survey in Taiwan. Journal of the Formosan Medical Association. 2019;118(2):572-81.
Chen M, Wang Y, Li X, Hou L, Wang Y, Liu J, et al. Public Knowledge and Attitudes towards Bystander Cardiopulmonary Resuscitation in China. BioMed Research International. 2017;2017:7.
Prina LD, White RD, Atkinson EJ. Automated external defibrillators and first responders: a satisfaction survey. Resuscitation. 2002;53(2):171-7.
Basanta Camiño S, Navarro Patón R, Freire Tellado M, Barcala Furelos R, Pavón Prieto M, Fernández López M, et al. Evaluación del conocimiento y de las habilidades para el uso de un Desfibrilador Externo Automatizado (DEA) por estudiantes universitarios. Un diseño cuasiexperimental. Med Intensiva. 2017;41:270-76.
Perkins GD, Smith CM, Khan MO, Lim Choi Keung SN, Arvanitis TN, Hartley-Sharpe C, et al. Barriers and facilitators to public access defibrillation in out-of-hospital cardiac arrest: a systematic review. European Heart Journal - Quality of Care and Clinical Outcomes. 2017;3(4):264-73.
Ong ME, Yap S, Chan KP, Sultana P, Anantharaman V. Knowledge and attitudes towards cardiopulmonary resuscitation and defibrillation amongst Asian primary health care physicians. OA Emerg Med. 2009;1:11-20.
Lee KP, Kwong BM, Chan SD, Wong KD, Lam TP. Attitudes and confidence towards cardiopulmonary resuscitation and use of the automated external defibrillator among family physicians in Hong Kong. HK Pract. 2015;37(84-92).
Costello AB, Osborne JW. Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment Research & Evaluation. 2005;10(7).
Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of Good Practice for the Translation and Cultural Adaptation Process for Patient-Reported Outcomes (PRO) Measures: report of the ISPOR Task Force for Translation and Cultural Adaptation. Value Health. 2005;8(2):94-104.
Whitney-Cashio P, Sartin M, Brady WJ, Williamson K, Alibertis K, Somers G, et al. The introduction of public access defibrillation to a university community: The University of Virginia Public Access Defibrillation Program. Am J Emerg Med 2012;30(6):e1-e8.
Hair Jr JF, Black WC, Babin BJ, Anderson RE. Multivariate Data Analysis. Upper Saddle River, NJ: Prentice Hall; 2010.
Hair Jr JF, Hult GTM, Ringle CM, Sarstedt M. A primer on partial least squares structural equation modeling (PLS-SEM). 2nd ed. Los Angeles, USA.: Sage; 2017.
Hulland J. Use of partial least squares (PLS) in strategic management research: a review of four recent studies. Strategic Management Journal. 1999;20(2):195-204.
Mosesso VN, Jr., Davis EA, Auble TE, Paris PM, Yealy DM. Use of Automated External Defibrillators by Police Officers for Treatment of Out-of-Hospital Cardiac Arrest. Annals of emergency medicine. 1998;32(2):200-7.
White RD, Hankins DG, Bugliosi TF. Seven years’ experience with early defibrillation by police and paramedics in an emergency medical services system. Resuscitation. 1998;39(3):145-51.

Table 1 showing the factor loadings with pattern coefficient values after the initial run of exploratory factor analysis

Item	Factor
Item	1	2	3	4	5
The AED is clearly visible	.911
The directions that point to the location of the AED are clear.*	.896
The signage that shows the location of the AED is clear.	.936
The AED is located in a location that is easily accessible at all times (including after office hours).	.896
The steps in the AED instructional poster on how to use the AED are easy to follow.	.848
The AED is located at a secure site.	.819
CPR & AED are important in saving life.		.724
It is important for an AED to be available in the place where I work.		.880
Using an AED is important on any unresponsive victims.		.774
Person who handles an AED requires formal training.		.691
AED practice drills should be performed on a regular basis.		.609
I am concerned in getting infection from the victim when performing CPR.				.500
I am concerned in injuring the victim when performing CPR.				.499
I am concerned in injuring myself when performing CPR.				.801
I am concerned in injuring the victim if I use an AED device during CPR.				.525
I am concerned in injuring myself if I use an AED device during CPR.				.770
I am concerned that I might be sued if I perform emergency CPR inappropriately.					.909
I am concerned that I might be sued if I used an AED inappropriately.					.948
I am confident to perform CPR.			.842
I am confident to use an AED.			.884
I am confident in recognizing victim with no signs of life.			.743
I will not hesitate to do CPR and to use an AED on an unresponsive victim.			.849

Note: Extraction Method: Principal Axis Factoring. Rotation Method: Promax with Kaiser Normalization.

*this item was removed in the final version of the questionnaire.

Table 2 showing the finalized version of the bilingual questionnaire to measure the perception and confidence towards cardiopulmonary resuscitation and automated external defibrillator training and placement strategy

Cardiopulmonary Resuscitation and Automated External Defibrillator Training and Placement Bilingual Questionnaire

Perception of AED placement strategies

	Strongly disagree (1)	Disagree (2)	Agree (3)	Strongly agree (4)
The AED is clearly visible. (Peralatan AED jelas kelihatan.)
The signage that shows the location of the AED is clear. (Papan tanda yang menunjukkan lokasi AED dipamerkan dengan jelas.)
The AED is located in a location that is easily accessible at all times (including after office hours). AED terletak di lokasi yang mudah diakses pada setiap masa (termasuk selepas waktu pejabat).
The steps in the AED instructional poster on how to use the AED are easy to follow. (Poster AED mempamerkan cara-cara menggunakan AED yang senang diikuti.)
The AED is located at a secure site. (AED terletak di lokasi yang selamat.)

Perception of importance of CPR and AED

	Strongly disagree	Disagree	Agree	Strongly agree
CPR & AED are important in saving life. (CPR & AED penting untuk menyelamatkan nyawa.)
It is important for an AED to be available in the place where I work. (Adalah penting supaya adanya AED di tempat kerja saya.)
Using an AED is important on any unresponsive victims. (AED penting untuk digunakan ke atas mangsa yang tidak responsif.)
AED practice drills should be performed on a regular basis. (Latihan mengendalikan AED harus dilakukan sebagai rutin tetap.)

Concerns of injuring victims during CPR and AED

	Strongly disagree	Disagree	Agree	Strongly agree
I am concerned of getting infection from the victim when performing CPR. (Saya risau akan dijangkiti penyakit daripada mangsa ketika melakukan CPR.)
I am concerned of injuring the victim when performing CPR. (Saya risau jika tercederakan mangsa ketika melakukan CPR.)
I am concerned of injuring myself when performing CPR. (Saya risau jika tercederakan diri sendiri ketika melakukan CPR.)
I am concerned of injuring the victim if I use an AED device during CPR. (Saya risau jika tercederakan mangsa apabila saya menggunakan AED semasa CPR.)
I am concerned in injuring myself if I use an AED device during CPR. (Saya risau jika tercederakan diri sendiri apabila saya menggunakan AED semasa CPR.)

Concerns of legality in performing CPR and AED

Strongly disagree

Disagree

Agree

Strongly agree

I am concerned that I might be sued if I perform emergency CPR inappropriately.

(Saya risau kemungkinan disabit kesalahan jika saya melakukan CPR secara tidak betul.)

I am concerned that I might be sued if I used an AED inappropriately.

(Saya risau kemungkinan disabit kesalahan jika saya menggunakan AED secara tidak betul.)

Confidence and willingness to perform CPR and AED

	Strongly disagree	Disagree	Agree	Strongly agree
I am confident to perform CPR. (Saya yakin untuk melakukan CPR.)
I am confident to use an AED. (Saya yakin untuk mengendalikan AED.)
I am confident in recognizing victim with no signs of life. (Saya yakin dapat mengenalpasti tanda-tanda tiada nyawa pada mangsa.)
I will not hesitate to use an AED on an unresponsive victim. (Saya tidak teragak-agak untuk menggunakan AED ke atas mangsa yang tidak responsif.)

File name: Supplementary Table 1.docx

Title of data: Forward translation and backward translation of the validated questionnaire

Description of data: This data describes the forward translation from the original English version to the finalized Malay language version (after the reconciliation stage where the two authors who translated it independently had discussed, resolved any discrepancy and reached a consensus) as well as the backward translation from the translated Malay language version back to the English version by another independent translator.

Download PDF

Journal Publication

published 21 Oct, 2019

Read the published version in BMC Research Notes →

Submission checks completed at journal
06 Nov, 2019
Editorial decision: Accept
30 Sep, 2019

You are reading this latest preprint version

Development, Validation and Translation of Cardiopulmonary Resuscitation and Automated External Defibrillator Training and Placement Bilingual Questionnaire

Status:

Journal Publication

Version 3

Abstract

Figures

Introduction

Methods

Results

Discussion

Limitations

Abbreviations

Declarations

References

Tables

Supplementary Files

Supplementary Files

Status:

Journal Publication

Version 3