Examining validity and reliability of Objective Structured Clinical Examination for evaluation of clinical skills of midwifery undergraduate students: a descriptive study

doi:10.21203/rs.2.10419/v2

PDF

Research article

Examining validity and reliability of Objective Structured Clinical Examination for evaluation of clinical skills of midwifery undergraduate students: a descriptive study

https://doi.org/10.21203/rs.2.10419/v2

This work is licensed under a CC BY 4.0 License

Journal Publication

published 31 Mar, 2020

Read the published version in BMC Medical Education →

You are reading this latest preprint version

BACKGROUND: Clinical evaluation is one of the main pillars of medical education. The Objective Structured Clinical Examination is one of the commonly adopted practical tools to evaluate clinical and practical skills of medical students. The purpose of the study is to determine validity and reliability of Objective Structured Clinical Examination for evaluation of clinical skills of midwifery undergraduate students. METHODS : Seven clinical skills were evaluated in this descriptive correlative study using a performance checklist. Census method was used for sampling. Thirty-two midwifery students performed the skills at seven stations each monitored by an observer using an evaluation checklist. Criterion validity was obtained through determining the correlation between the clinical and theoretical courses point and the Objective Structured Clinical Evaluation score. The collected data was analyzed in SPSS (v.20) and logistic regression test. RESULTS: The correlation score of Objective Structured Clinical Examination was significantly related to the mean score of clinical course “Normal and Abnormal delivery I” (0.399, p=0.024) and the mean score of clinical course “gynaecology “ (0.419, p=0.017). There was no significant correlation between OSCE scores and the mean score of theoretical courses (0.23, p=0. 200). The correlation between the total score and mean score of students at the stations showed that out of the seven stations, the correlations of the stations three (communication and collecting medical history) and four (childbirth) were not significant. CONCLUSION: Although, it appeared that Objective Structured Clinical Examination was one of the effective and efficient ways to evaluate clinical competencies and practical skills of students, the tool could not evaluate all the aspects.

Educational Philosophy and Theory

Clinical Evaluation

Validity

Reliability

Midwifery

Midwifery profession has a critical role in providing care to infants and mothers before and after childbirth (1). A midwife should be equipped with critical thinking skills and making this happen needs a revolution in education and evaluation systems. About 50% of the midwifery education program is concentrated on clinical education (2), which is implemented as apprenticeship and internship courses. These courses play a key role in development of major and professional skills in midwifery students (3, 2).

Clinical evaluation methods and techniques to evaluate students’ skills and capabilities are highly important (4). Evaluation of clinical competency in midwifery students is one of the toughest responsibilities of faculty board members and instructors of health programs (5, 6). In addition, evaluation of clinical skills and competency in midwifery students is a challenge for education programs (7). Different evaluation methods are needed to evaluated performance in nurses and midwives (8). One of the most reliable and trusted methods to evaluate medical techniques is Objective Structured Clinical Examination (OSCE), which is mainly designed to evaluate clinical competency (9). The point is that the traditional written and oral tests only measure the clinical knowledge while OSCE evaluates both the knowledge and skill (10). In addition, the available clinical knowledge are not free from validity and reliability limitations. Structured practical methods can cover some of these limitations and OSCE is one of the most common structured practical tools (11).

The most important thing about implementation of OSCE test in midwifery and before internship is that this stage is a pivotal stage of practical trainings of midwives. At this stage, students are supposed to achieve the academic objectives of their program (12, 13). The OSCE was first introduced by Harden and Dr. Glisone (1979) in Scotland to evaluate scientific information of students. Since then, the tools has been used in different countries (7, 14) and it has been established as one of the main methods of clinical competency assessment in medical education (15). The well-designed and implemented OSCE can provide students with essential interpersonal, interviewing, problem-solving, and teaching assessment skills. The OSCE enables students to use basic clinical knowledge (16). It empowers students to become active participants rather than the theory involved in coping with real-world situations. The OSCE engages students and enables them to understand the important factors involved in the nursing decision-making process. It also enables the students to perform advanced thinking and avoid errors in case-handling ( 17). The OSCE, if implemented correctly, can have an effective role in completing the teaching-learning process and it can lead to an advanced training process (18). The OSCE approach is an effective way of achieving educational goals that can reduce costs and promote clinical and practical education (19). Moreover, throughout the test, the participants need to demonstrate specific clinical skills at different stations. Another feature of the test is that all students need to perform the same task at each station and there is a standard scoring system to evaluate the participants. The participants move from one station to another and deal with a specific clinical scenarios at each station (20). The OSCE properly evaluates comprehensive capabilities and competencies so that the participants are given the chance to demonstrate different skills at different situations (11, 21).

The OSCE is currently used as a method to evaluate clinical skills and it has been adopted by Kermanshah School of Nursing and Midwifery since 2015. All midwifery students are evaluated using OSCE in terms of clinical competency before entering internship. Taking into account the importance of using valid tests to evaluate midwifery students, present study was conducted to determine the validity and reliability of OSCE for evaluation of clinical skills of midwifery undergraduate students before entering internship in 2018. The results of the study can be a step towards better evaluation methods in the education process.

Study aim: To determine the validity and reliability of OSCE for evaluation of clinical skills of midwifery undergraduate students.

Study setting and design:

For developing the checklist, the issue was discussed at the department of midwifery, the faculty board members undertook to find women and midwifery-related references needed to design the stations of OSCE tests.

The deadline for brining in the references was one week. At the same time, the head of department and a member of faculty board visited the clinical skills training space of the school. The physical space and the available equipment were examined. The head of department coordinated the faculty board members to prepare a list of professional procedures and clinical performance needed in OSCE test to evaluate skills of the midwifery students. The deadline for preparing the list was one month. Then the head of department and other members of the faculty board determined the items of OSCE test. After that, the items were discussed at the department to determine the key stations of the test. Finally, seven stations, based on course topics, midwifery reference books and clinical skills requirements, including establishing open vein, serum therapy, measuring blood pressure; working with resuscitation equipment; communicating and collecting medical history skills; childbirth; episiotomy; speculum and bimanual exam, and visual questions was developed (Table1). Overall the content of the test, the number of its stations, the time of each station (five minutes), and the scoring system was decided by the faculty members of midwifery groups. Then checklists and a report of the objectives of study were provided to four experts and their feedbacks were used in the design of the final version of the test.

Before the test, the head of department sent the list of 32 participants to the head of education affairs department to determine and notify the time and place of the test. The education department issued examination entrance card and delivered them to the students. In addition, the list of equipment needed for each station was given to the clinical skills education department. Five stations used Moulage, one used patient role playing, and one used a computer. The patient role was played by one of the experienced members of the faculty board.

The required scenario for each station was codified by the members of the board of faculty and affixed at the entrance of each partition. In addition, 80 visual question slides and 20 midwifery cases were prepared to examine the scientific level of the students. Two slides (displayed using a computer) and one written midwifery case were prepared for each student. After designing and preparing the stations, the OSCE was held for one day. In terms of ethics, an explanatory brief session was done one week before the exam by the head of department and the students were informed about the OSCE goals, the process, the time required for each station, and the order of attending each station. Moreover, a test guide pamphlet was given to the students.

In the exam day, the 32 students were grouped into four groups of seven members and one group of four members and the evaluation process was carried out. The students’ cellphones were collected before initiation of the test; then the students were allowed to enter the stations. To prevent students from exchanging viewpoints an examiner was in charge of controlling the students entering and leaving each station. In addition, the students were quarantined in two rooms before and after the test so that the students had no contact with each other.\

Performance of each participant at each station was examined using the checklist of that stations by the instructors including researchers. After the exam, the students were given feedback. Then the checklists were collected and the students’ grades were determined for each station. The reliability of the assessors was calculated by determining the correlation between the scores reported by two observers at the station " Communication and collecting medical history skills", due to the subjective of this station.

Sampling techniques:

Census method was used for sampling. This methodological study was done on 32 undergraduate midwifery students in the 6^th semester at the Nursing and Midwifery School of Kermanshah University of Medical Sciences in 2018. Inclusion criteria were being in pre-internship
stage, passing all theoretical and clinical courses, and no experience with the OSCE test.

Data collection:

The data collection tool was a clinical skill checklist, including seven procedures (seven stations) (Table1). Each procedures constituted of several practical skills. The checklists covered the procedures step by step and each step had a specific score. The questions of checklists were scored as failed (0), low (1), moderate (2), good (3), and excellent (4). The procedure, “diagnosis and knowledge” were scored as failed/successful diagnosis or correct/wrong answer. The score for each station was calculated by dividing the total obtained score by the number of items in the related checklist and the total score was the sum of scores of all the seven stations.

Data analysis:

The Kolmogorov Smirnov (KS) test was used to determine the normality of the data. The data were
analyzed using Pearson correlation test, Spearman Correlation test and Cronbach’s alpha test in SPSS (v.16) (P=0.05) .

Data analysis showed that the mean age of the students was 22.78±1.40 and the age range was 21-26 years. Moreover, 22.2% of the participants were unmarried. Total mean scores of theoretical courses was 15.98±1.07. The evaluated skills based on different stations are listed in Table 1.

The face validity of the checklist was confirmed using the clinical experience of the instructors of practical skills. Content validity was approved by providing the content of the test to the faculty members of midwifery groups and using feedbacks by four experts about the Content.

To determine the criterion validity, the mean scores of clinical courses recorded in the students’ files was used and the correlation between these scores and total OSCE score was obtained.

In addition, the correlation of the mean of theoretical courses with the total score of OSCE was taken into account.

The results indicated that the correlation of OSCE scores with the mean score of clinical course “Normal Pregnancy I”, the mean score of clinical course “Normal and Abnormal delivery I”, and the mean score of clinical course “gynaecology” was 0.319 (p=0.075), 0.399 (p=0.024), and 0.419 (p=0.017) respectively. Moreover, there was no significant correlation between OSCE scores with the mean score of theoretical courses (table 2).

To determine internal consistency, the correlation of the total scores of the test and the scores of each station was obtained. The Pearson Correlation test showed that there was a significant correlation between OSCE score (total score) and the scores of stations 1, 2, 5, 6, and 7 (p<0.05). In addition, the Spearman Correlation test showed no significant relationship between OSCE score (total score) and the scores of stations 3 and 4 (p>0.05) (Table 3). Finally, to determine reliability of the test, Cronbach’s alpha was calculated with an emphasis on internal consistency. The results of the assessors’ reliability and the correlation between the observers’ scores in the station " Communication and collecting medical history skills ", showed that the agreement between the observers of assessor was desirable(P<0.001 r=0.)

The validity and reliability of the OSCE held for pre-internship midwifery students at Kermanshah University of Medical Sciences in 2018 were supported. This finding is consistent with other studies in medical fields (8, 22, 23). Villegas et al. (2016) showed that OSCE was a reliable method to evaluate clinical competency and they recommended using it as a part of educational curriculum (24). Michael and Villegas (2014) used OSCE test to prepare undergraduate midwifery students in Australia using stations like examining C-section infants, and post-delivery monitoring. Based on the midwifery students’ comments, OSCE had a positive effect on their self-confidence and performance (25). Smith et al. (2012), showed in a review study that clinical competency of nursing and midwifery students was improved using OSCE test for skills like midwifery emergencies, pharmacology, drug prescription, breastfeeding, and supplementary nutrition in infants. They argued that the test was a valuable strategy to evaluate clinical competency and improving knowledge of students. In addition, the test was a motivating factor to create diversity in midwifery students’ education (26). Omu (2016), stated that OSCE test was a golden standard evaluation method and it was recommended for the evaluation of clinical competency and psychomotor skills (27). Despite differences between the mentioned studies in terms of the skills under study, their results about the strengths and weaknesses are consistent.

According to our results, face validity was appropriate, which was consistent with other studies in this field (28, 29).

In this study, content validity was approved by providing the content of the test to the faculty members of midwifery department and using feedbacks of four experts about the content and design of the final version of the test. Setyonugroho et al.(2016) believed that skill assessment checklists in objective structured tests and the development of comprehensive scenarios according to the station’s context represent the content validity of the test’ (30).

Criterion validity results showed a positive and significant relationship between the total score of OSCE and clinical courses (clinical course “Normal and Abnormal delivery I” and clinical course “gynaecology). Therefore, the criterion validity was desirable and consistent with our study, Moatari et al. (2007) showed that there was a significant and positive relationship between OSCE scores and nursing clinical courses scores (8). Moreover, Farajzadeh et al. (2012) used stepwise multivariate regression test to determine predictability OSCE score using clinical and theoretical courses scores. The results showed that the clinical courses scores can be used to determine OSCE score, while there was no relationship between theoretical courses scores and OSCE score (4). A positive and significant relationship between the clinical courses and the OSCE is expected so that the simulated environment can be combined with actual environment to enhance student learning. Contrary to our results, Sabzi et al. (2018) found a low correlation between the mean score of clinical courses and the OSCE score. They stated that this may be due to the difference between the real and the simulated environments, because working with a real patient gives people more motivation than the simulated environments. On the other hand, usually general assessment sheets are used to assess students in clinical field environments; while in the OSCE each procedure is assessed separately and in full detail(28).In addition, our results showed no significant correlation between OSCE scores and the mean score of theoretical courses. Consistent with our results, Raj et al. (2007) reported no significant correlation between Rheumatology written exam score (hand section) and total OSCE score (22). Moatari et al. (2007) also reported that there was a positive and weak relationship between OSCE scores and nursing theoretical courses scores (8). According to Gray (2010) students might possess a wide theoretical knowledge and good theoretical scores; however, this does not necessarily translated into good performance in the clinical environment’ (31). The gap between theoretical and practical courses has always been an educational challenge, and the low correlation between OSCE test and theoretical courses supports existence of this gap (8). Alami and Safari (2014) proposed not to design stations in OSCE test based on written scenarios and recommended using stations based on patient role play, moulage, and mannequin. The reason for these recommendations is that using written scenarios concentrate the tests on the sections that are measured by pre-apprenticeship test (32). Contrary to results of present study, Gerrow et al. (2003) tried to examine criterion validity of OSCE test through evaluating the dentistry practical skills based on written board exam scores of 2317 senior students in five years. They showed a positive and significant relationship between the written exam scores and OSCE results (33). Sabzi et al. (2018), found the higher correlation between theoretical score and OSCE score compared to clinical score and OSCE score (28). Moattari (2013) argued that in spite of all the works on objective tests in the fields of knowledge, skills, and attitudes, theoretical tests are better in measuring the qualifications and competence of individuals (34).

To examine internal consistency, the correlation between total OSCE test and mean score of each student at each station was computed. The results showed that out of seven stations, the correlation coefficient was not significant for two stations (No. 3 & 4). In this way, internal consistency of the test is approved, which is consistent with the studies of other researchers (28, 29).

The significant correlation between the majority of stations and total score of OSCE indicates that the participants gained the required skills during the pre-internship courses. Hosseini et al. (2013) reported that out of ten stations, correlation coefficients of two stations (8 and 10) were not significant (23). Taghva et al. (2007), studied psychology skills and reported that out of nine stations, correlation coefficient of only one was insignificant (35). Moreover, Moatari et al. (2009), evaluated nursing skills and reported that out of 10 stations, only two had low internal consistency (9). Differences between these studies can be explained based on the design of stations, the way of holding briefing sessions of OSCE test, and complicacy of the instructions. Wilkinson et al.(2000) and Tudiver et al. (2009) stated that the correlation between the skill stations scores and the total score indicates the construct validity (36 ,37).

The reliability of the OSCE and the total score of Cronbach’s alpha supported internal consistency (α >0.7), which was consistent with other studies (23, 38, 39,40). Bould et al. (2009), reported a Cronbach’s alpha coefficient in 0.8 and 1 range, which indicates a good reliability of the tool under study (41). Metsamuronen et al. (2006) reported that the minimum acceptable Cronbach’s alpha was 0.7 (42). Specified criteria for skill scoring and training of the students were some of reliability factors of the tests, which were used in the present study.

Study limitation:

As to limitations of the study, tiredness of the evaluators and the students’ concerns about their probable negative impression on instructors due to their poor performance are notable. The number of students was small (n=32) which makes the statistics 'unstable.' Considering the low R², the explaining variability of the correlations presented questionable and can't be changed due to the limited number of students in the studied cohort. The reliability of the tool was not examined in this study, and future studies may consider examining the reliability of the tool. Moreover, future studies may implement OSCE test in different occasions including immediately, one day, 72hrs, and two months after later in another study.

Although, it seems that OSCE test is an effective and efficient way to measure clinical competencies and practical skills of students, it did not cover all the aspects. Effectiveness of the tool depends on factors like experienced evaluators, access to references and equipment, adequate time to design and implement the test, accurate planning, availability of a proper space to hold the test, and suitable measurement tools.

Objective Structured Clinical Examination (OSCE)

Ethics approval and consent to participate

The written consent was obtained from study participants and study was approved by the Ethical Committee of the Kermanshah University of Medicine Science (approval number IR.KUMS.REC.1397.474)

Consent for publication

Not applicable.

Availability of data and material

The datasets used and/or analyzed during the current study can be provided by the first author on a reasonable request.

Competing interests

The authors declare that they have no competing interests

Funding

Funded by Kermanshah University of Medicine Science. No role in the design of the study, collection, analysis, and interpretation of data and in writing the manuscript.

Authors' Contributions

SH contributed to the design, participated in most of the study steps .SH and MK prepared the manuscript, statistical analysis. ME assisted in designing the study, and helped in the, interpretation of the study. All authors have read and approved the content of the manuscript.

Acknowledgements

The article is mentorship project of Student Research Committee, under ethics code IR.KUMS.REC.1397.474, Kermanshah University of Medical Sciences. The authors wish to express their gratitude to all the officials of the university and all the participants for their supports.

1.Fleming V, Luyben A. Establishing a Master’s for Europe a transnational model for higher education. Midwifery2016;33:52‑4.

2.Malakooti N, Bahadoran P, Ehsanpoor S. Assessment of the midwifery students' clinical competency before internship program in the feld based on the objective structured clinical examination. Iranian J Nursing Midwifery Res 2018;23:31-5.

3.Carter AG, Creedy DK, Sidebotham M. Development and psychometric testing of the Carter Assessment of Critical Thinking in Midwifery. Midwifery 2016;34:141‑9.

4.Farajzadeh Z, Saadatjoo SA, Tabiee SH, Hosseini MR. Reliability and Validity of OSCE in Evaluating Clinical Skills of emergency Medicine Students of Birjand university of Medical Sciences. Journal of Birjand University of Medical Sciences. 2012; 18(4): 312-319.

5.Sheykh Aboomasoodi R, Moghimian M, Hshemi M, Kashani F, Karimi T, Atashi V, et al. Comparison the effects of Objective Structured Clinical Examination (OSCE) by direct and indirect supervision on nursing students’ examination anxiety. Nurs EDUC 2015;4;1‑8.

6-Noohi E, Motsadi M, Haghdoost A. Clinical teachers viewpoints towards objective structured clinical examination in Kerman university of medical science. Iran J Med Educ. 2008; 8 (1) 113-119.

7.Devine RD. Evaluation of Undergraduate Students Using Objective Structured Clinical Evaluation. Research Briefs 2007;46:76.

8.Moattari M, Abdollah-zargar S, Mousavinasab M, Zare N, Beygi Marvdast P. Reliability and validity of OSCE in evaluating clinical skills of nursing students. J Med Educ . 2009; 13 (3): 79-85.

9.Saboori A, Dastjerdi V, Mahdian M, Farazi Fard M. Examining outlook of postgraduate students of Dental Faculty of Medical Sciences of Shahid Beheshti university about objective structure clinical (Osce examination). Journal of Dental School Shahid Beheshti University of Medical Sciences 2010;28:88‑94.

10.Bhatnagar KR, Saoji, VA, Banerjee AA. (). Objective structured clinical examination for
undergraduates: is it a feasible approach to standardized assessment in India? Indian J Ophthalmol 2011; 59(3), 211-4.

11- Bolhari J. [OSCE Instructional Guideline in Psychiatry]. 1st ed. Teh-ran: Arjomand publication; 2011.

12.Moosavi P, Montazeri S, Poorghayoomi S, Farahnaz CH. Determining minimum learning in neonatal units, maternal and child health, family planning, and it’s administrative obstacles from the perspective of midwifery students. Journal of Medical Education Development Center Jundishapur 2015;6:123‑30.

13.Moosavi P, Montazeri S, Poorghayoomi S, Farahnaz CH. Determining minimum learning in The clinic and gynecology unitsand it’s administrative obstacles from the perspective of midwifery students. Journal of Medical Education Development Center Jundishapur 2013;3:71‑80.

14-Harden RM, Gleeson FA. Assessment of clinical competence using an objective structured clinical examination (OSCE). Med Educ 1979; 13 (1) 41-54.

15-Gormley G (2011) Summative OSCEs in undergraduate medical education. Ulster Med J80(3): 127–32

16.McWilliam P, Botwinski C (2010) Developing a successful nursing ObjectiveStructuredClinicalExamination. J Nurs Educ49(1): 36–41. doi:
10.3928/01484834-20090915-01

17-Ahmad C, Ahmad N& Abu Baker R.(2009) Assessing Nursing Clinical Skills Performance Using Objective Structured Clinical Examination (OSCE) for Open Distance Learning Students in Open University Malaysia. International Conference on Information; Kuala Lumpur, 12-13 August.

18- Young I, Montgomery K, Kearns P, Hayward S, Mellanby E. The benefits of a peer-assisted mock OSCE. Clin Teach. 2014;11(3):214–8.

19.Selim AA, Ramadan FH, El-Gueneidy MM, Gaafer MM. Using objective structured clinical examination (OSCE) in undergraduate psychiatric nursing education: is it reliable and valid? Nurse Educ Today. 2012;32(3):283–8

20. Eftekhar H, Labaf A, Anvari P, Jamali A, Sheybaee-Moghaddam F. Association of the preinternship objective structured clinical examination in final year medical students with comprehensive written examinations. Med Educ Online. 2012;17

21- Rasoulian M, Taghva A , Panaghi L, ZahiroddinA , Salehi M , Ghalebandi M. Qualitative assessment of the first objective structured clinical examination (OSCE) in psychiatry in Iran. IJPCP2007. 13 (1) 12-16.

22- Raj N, Badcock LJ, Brown GA, Deighton CM, O'Reilly SC. Design and validation of 2 objective structured clinical examination stations to assess core undergraduate examination skills of the hand and knee. J Rheumatol 2007 . 34 (2) 421-4.

23- Hosseini S, Vartanoosian J, Hosseini F, Farzin Fard F. Validity & reliability of OSCE/OSPE in assessing biochemistry laboratory skills of freshman nursing students of Shahid Beheshti University of Medical Sciences. Journal of Nursing and Midwifery Faculty Shahid Beheshti University of Medical Sciences & Health Services,2013,23(8): 34-43.

24.Villegas N, Cianelli R, Fernandez M et al. Assessment of breastfeeding clinical skills
among nursing students using the Objective Structured Clinical Examination (OSCE). Investigación en Educación Médical
2016;5:244‑52

25.Mitchell ML, Jeffrey CA, Henderson A et al. Using an Objective Structured Clinical
Examination for Bachelor of Midwifery students’ preparation for practice. Women Birth 2014;27:108‑13.

26.Smith V, Muldoon K, Biesty L. The Objective Structured Clinical Examination (OSCE) as a strategy for assessing clinica competence in midwifery education in Ireland: A critical review. Nurse Educ Pract 2012;12:242‑7.

27-Omu FE. Attitudes of Nursing Faculty Members and Graduates towards the Objective Structured Clinical Examination (OSCE). Open Journal of Nursing 2016;6:353‑64.

28-Sabzi Z, Modanloo M , Yazdi Kh, Kolagari Sh , Aryaie M. The Validity and Reliability of the Objective Structured Clinical Examination (OSCE) in Pre-internship Nursing Students. Journal of Research Development in Nursing & Midwifery. 2018;15(1):1-9.

29-Wilkinson TJ, Frampton CM. Comprehensive undergraduate medical assessments improve
prediction of clinical performance. Medical Education. 2004;38(10):1111-6.

30-Setyonugroho W, Kropmans T, Kennedy KM, Stewart B, van Dalen J. Calibration of communication skills items in OSCE checklists according to the MAAS-Global. Patient Education and Counseling. 2016;99(1):139-46.

31-Gray M, Donaldson JH. National Approach to Practice Assessment for Nurses and Midwives
Literature review exploring issues of service user and carer involvement in the assessment
of students’ practice. Final report. 2010; 1.

32- Allami A, Saffari F. Correlation of OSCE and Pre-Internship Examination Results. JMED, 2014, 7(13): 57-63.

33.Gerrow JD, Murphy HJ, Boyd MA, Scott DA. Concurrent validity of written and OSCE components of the Canadian dental certification examinations. J Dent Educ.2003; 67 (8) 896-901.

34-Moattari M. Reliability and validity of OSCE in evaluating clinical skills of nursing
students. Journal of Medical Education. 2013;13(3) .[Persian]

35.Taghva A, Rasoulian M, Panaghi L et al.Validity and reliability of the first objective structured clinical examination (OSCE) in psychiatry in Iran. IJPCP 13 (1) 17-24.

36. Wilkinson TJ, Newble DI, Wilson PD, Carter JM, Helms RM. Development of a threecentre simultaneous objective structured clinical examination. Medical Education. 2000;34(10):798-807.

37. Tudiver F, Rose D, Banks B, Pfortmiller D. Reliability and validity testing of an evidencebased medicine OSCE station. Family Medicine. 2009;41(2):89-91

38- Sahebalzamani M, Farahani H, Jahantigh M. Validity and reliability of direct observation of procedural skills in evaluating the clinical skills of nursing students of Zahedan nursing and midwifery school. Zahedan J Res Med Sci (ZJRMS) 2012; 14(2): 76-81.

39. Al-Naami MY. Reliability, validity, and feasibility of the Objective Structured Clinical Examination in assessing clinical skills of final year surgical clerkship. Saudi Medical Journal. 008;29(12):1802-7.

40. Weller J, Jolly B, Misur M, Merry A, Jones A, Crossley JM, et al. Mini-clinical evaluation exercise in anaesthesia training. British Journal of Anaesthesia. 2009;102(5):633-41.

41-Bould MD, Crabtee NA, Naik VN. Assessment of procedural skills in anesthesia. Br J Anaesth 2009; 103(4): 472-83.

42. Metsamuronen J, Tarjome-Kamkar SH, Asraie A. Mabaniye nazari azmoon va azmoonsazi .Tehran: Behineh Press; 2006.

Table 1- Evaluated skills at different stations of OSCE test

Evaluated skill	Station
Establishing open vein, serum therapy, measuring blood pressure	1
Working with resuscitation equipment	2
Communication and collecting medical history skills	3
Childbirth	4
Episiotomy	5
Speculum and bimanual exam	6
Visual questions	7

Table 2- Correlation between the scores of clinical courses, “Normal and Abnormal delivery I, Normal Pregnancy I , gynecology and total average scores and OSCE score

Variable	Total score
Variable	Mean ± SD	R	P-value
clinical course “Normal Pregnancy I”	16.46±0.26	0.319	0.075
clinical course “Normal and Abnormal delivery I”	16.13±0.60	0.399	0.024
clinical course “gynecology	17.86±0.33	0.419	0.017
“total average scores”	07/1±98/15	0.23	0.200
Total OSCE score	11.53±1.74	1	-

Table 3- Correlation coefficients between the scores of different stations and the total score

Variable	Total score
Variable	Mean ± SD	R	P-value
Station 1	1.24±0.41	0.726	0.001
Station 2	1.29±0.34	0.394	0.026
Station 3	1.54±1.02	0.340	0.057
Station 4	1.47±0.26	0.291	0.106
Station 5	1.92±0.16	0.387	0.029
Station 6	1.97±0.26	0.501	0.003
Station 7	2.57±1.06	0.805	0.001
Total score	11.53±1.74	1	-

PDF

Journal Publication

published 31 Mar, 2020

Read the published version in BMC Medical Education →

Editorial decision: Accept
23 Mar, 2020
Review #1 received at journal
27 Jan, 2020
Reviewer #1 agreed at journal
09 Jan, 2020
Editor assigned by journal
06 Jan, 2020
Reviewers invited by journal
06 Jan, 2020
Submission checks completed at journal
05 Jan, 2020
Editor invited by journal
05 Jan, 2020

You are reading this latest preprint version

Examining validity and reliability of Objective Structured Clinical Examination for evaluation of clinical skills of midwifery undergraduate students: a descriptive study

Status:

Journal Publication

Version 2

Abstract

Background

Methods

Results

Discussion

Conclusions

Abbreviations

Declarations

References

Tables

Status:

Journal Publication

Version 2