Simulation Training Program for Vacuum Application to Improve Technical Skills in Vacuum-Assisted Vaginal Delivery

doi:10.21203/rs.3.rs-121770/v1

PDF

Research Article

Simulation Training Program for Vacuum Application to Improve Technical Skills in Vacuum-Assisted Vaginal Delivery

https://doi.org/10.21203/rs.3.rs-121770/v1

This work is licensed under a CC BY 4.0 License

You are reading this latest preprint version

Objective

creation of an assessment scale to evaluate technical skills of the operators during the obstetrical device application for operative vaginal delivery, named kiwi-cup

Methods

35 residents in obstetrics and gynecology of the University of Pisa, Italy were recruited and evaluated with an assessment scale on technical skills from 0 to 55 points. They performed various operative vaginal delivery simulations with kiwi-cup and were evaluated at time 0 by a tutor. After 8 weeks, simulation training was repeated and trainees were re-evaluated by the same tutor.

Results

after 8 weeks from the first simulation session, trainees have been shown to increase technical skills (46.27 ± 4.6 with p-value <0.0001), the successful application rate (85.71% with p-value 0.0161).) and to reduce the time to complete the procedure (86.2 ± 29.9 sec with p-value <0.0001)

Conclusion

simulation training on operational vaginal delivery significantly increases technical skills, improves successful rate, and reduces the time taken to complete the procedure.

Clinical trial registration

not applicable

Maternal & Fetal Medicine

Vacuum-Assisted

kiwi-cup

gynecology

obstetrics

Operative vaginal delivery (OVD) is an obstetrical procedure used to expedite birth after full cervical dilatation when a rapid expulsion of the fetus is required. The rate of OVD changes worldwide. In the US the rate of OVD is around 3.3% [1], in the UK, OVD is performed in 15% of vaginal deliveries. In other countries, the rate is lower (between 3.4 and 5.1% in Italy) [2]. Among OVDs we recognize two types of procedures: vacuum and forceps. In the US, obstetricians prefer to use vacuum in about 82% of the cases [3 9463].

However, these procedures require complex skills which include accurate diagnosis, understanding of the anatomy, continuous communication with colleagues, and finally the capacity to perform the correct application of the instrument.

The acquisition of the skills for vacuum application depends on the exposure of junior obstetricians to situations in which they can learn the procedure and train themselves, under the supervision of senior operators. The experience of trainees is therefore directly proportional to the number of operative deliveries that take place on patients in the structure where the training takes place. Obviously, this is ethically unacceptable and this teaching system was such standardized in the past that some guidelines had to insert training as "relative contraindication to execute OVD". This is probably an emblematic and unique case in the history of medicine [4 9448]. However, according to a recent survey carried out in Germany, even senior obstetricians still require specific and continuous training on performing OVD which obviously goes beyond just on-site professional experience [5 9449].

It is important to remark that OVD is a life-saving procedure for the fetus and mother but also potentially dangerous. The main indications are the shortening of the second stage and the suspected fetal compromise. Additionally, there are other indications such as obstructed labor, maternal exhaustion, or medical condition requiring shortening of the second stage of labor which remain a major cause of maternal and neonatal mortality and morbidity across the world. Overall such complications are responsible for 4 to 13% of maternal deaths in Africa, Asia, Latin America, and the Caribbean, and obstructed labor alone accounted for 0.4 deaths per 100,000 women worldwide in 2013 [6]. Consequently, the most difficult applications, where even the experience gained would be greater, are performed only by highly qualified personnel and rarely during the training.

From an educational point of view, these elements can constitute a significant bug in the training of operators. For this reason, the Royal College of Obstetricians and Gynecologists has developed a structured training course to ensure the provision of OVD skills to the junior trainees during their training, the RCOG Operative Birth Simulation Training course, (ROBuST). In 2017, the ROBuST course was introduced as a mandatory part of the specialty training curriculum for junior obstetricians in the UK [7].

However, the UK education system is different from most European countries. Subsequently, European realities do not permit this type of training and certification.

The purpose of this study is to verify how the activation of a simulation program on the application of the vacuum, together with the creation of an evaluation scale, could help the trainees in the correct application of the vacuum.

In this study, 35 residents in obstetrics and gynecology of the University of Pisa were recruited. Residents participated in a series of simulations on physiological birth, breech presentation, shoulder dystocia, and postpartum hemorrhage. The present data were obtained by extrapolating the records of 2 separate simulation sessions on OVD performed 8 weeks apart, by using “Lucy and her Mum” (the MODEL-med®) and all interested residents gave their consent to participate.

Several sessions of simulation on OVD with different scenarios were performed (at least 5 for a session) but the evaluation of residents was performed only for a specific scenario at the beginning of sessions 1 and 2. This was decided to avoid possible errors. The first simulation on session 1 was to verify the initial background of residents and the first simulation of session 2 was to verify the effects of simulation training on OVD technical skills after 8 weeks. At the beginning of each evaluation test, residents had to fill out a self-evaluation test (fig. 1). In this form, it was possible to verify the competence of the resident to perform an obstetric evaluation before using the vacuum but also to quantify the grade of stress on performing OVD with specific questions about the capacity to afford this type of situation with a rate from 1 to 5.

During the simulation test, an expert tutor valued the performance of residents with a specific tab (fig. 2).

The resident had to follow the exact sequence in the OVD application by making the correct moves. To verify specific aspects which could be misevaluated by external observers, some tricks were used. For example, to evaluate the correct evaluation of the point of flexion or the point of kiwi-cup application, we used washable ink on the top of the gloves or of the kiwi-cup system. In this way, we evaluated if the position was correct.

The time needed to complete the operation was measured and the number of applications of the vacuum, the number of tractions needed to carry out the birth, and the ability to interact with the woman were considered.

If the resident did not perform all the necessary maneuvers, or some of them were incorrect, the scenario was not interrupted. Following fig 1, a tutor gave a vote for each phase from 1 to 5, where the minimum was 1 and the maximum score was 5. The whole tab is divided into 11 questions, for a total of 55 points.

After that, simulation session 1 continued with other OVD scenarios (at least 5 for each resident) to consolidate the technical skills acquired during the training.

After 8 weeks, a new simulation session was repeated (session 2). At the beginning of this session, the same scenario of the evaluation of session 1 was repeated. Residents filled out self-assessment and their performance was re-considered

Scenario design

Residents were instructed about the need to face the scenario as if it were a real situation. Before entering in the simulation room, each trainee received information regarding the patient: a 31-year-old woman, Caucasian, nulliparous, local anesthesia, in the second stage of labor with fetus in cephalic presentation, with no apparent risk factors.

The patient was at full cervical dilatation from around 2 hours, and she started to push from 1 hour. Resident was called because patient presented a pathological cardiotocographic (CTG) trace.

After the obstetric evaluation, on the basis of the CTG recording, each trainee was asked to develop the safest and fastest strategy to allow the woman to give birth, guaranteeing the safety of the fetus. The correct obstetric evaluation was: no asynclitism, level of presentation part +1 (fetal station), Demelin sign positive [8], occiput-anterior position.

Statistical Analysis

Statistical analysis was performed using GraphPad Prism 7 (GraphPad Software). Continuous variables were presented as means ± standard deviations. D'Agostino & Pearson normality test was used to determine the normality of data distribution. A paired T-test two-tail or Wilcoxon matched-pairs signed-rank test was used to study general scores and time analysis outcomes between the first and second session. In addition, ordinary one-way ANOVA was performed followed by Tukey; multiple comparison tests were used when residents were divided into two groups: junior (1st, 2nd, 3rd year) and senior (4th, 5th year). For the improvement of the successful rate with training simulation Chi-Q Fisher's exact test was used, and the categorical variables were presented with percentages. Values of p<0.05 were considered significant (*p<0.05; **p<0.01; ***p<0.001).

Assessment scale to evaluate technical skills in OVD application.

In literature, there is not a standardized assessment scale to evaluate the correct application of the vacuum. Usually, it is a post-procedure evaluation: number of detaches, tractions, directions. We created a checklist considering the most important aspects to reach an optimal application of kiwi-cup (fig. 1).

Training with simulation improves technical skills

The use of simulation for OVD training significantly increases general technical skills in residents (fig.3a). Before the training start, in session 1, the total score was 34.2 ± 8.8. After the simulation training session, 8 weeks later, in the same scenario, the total score was 46.27 ± 4.6 with a p-value <0.0001.

Training with simulation improves successful rate

Simulation improves technical skills but also the overall successful rate of OVD. We considered an OVD successful if the baby head gets out with kiwi-cup detaches less than 3 times and within 3 contractions/pushes of the mother. The use of simulation for OVD training significantly increases the successful rate (fig.3b). Before the training start, in session 1, the successful rate was 20 out of 35 attempts (57.14%). After the simulation training session, 8 weeks later, with the same scenario, the successful rate was 30 out of 35 attempts (85.71%). This increase was statistically significant (p-value 0.0161).

Training with simulation reduces the time of vacuum application

The use of simulation for OVD is important not only to increase competency in vacuum application and successful rate but also to reduce the time to complete the procedure (fig. 4). Before the training start, in session 1, the time to complete the procedure was 140 ± 44.5 sec. After the simulation training session, 8 weeks later, in the same scenario, the time to complete the procedure was 86.2 ± 29.9 sec with p-value <0.0001.

Training with simulation improves technical skills both in junior and senior residents.

Most of the criticisms about the use of simulation in training are it is useful only in pre-trained trainees. In our study, simulation for OVD significantly improves technical skills both in junior and senior residents. At the beginning of session 1, junior residents presented a total score of 28.01 ± 6.0 and after 8 weeks, they improved to 43.01 ± 4.0. In the same way, senior residents presented a total score of 37.86 ± 8.3 at the beginning of session 1, and they improved their scores to 48.2 ± 3.8 after session 2 (fig. 5)

Simulation training significantly modifies self-assessment of trainees.

Another aspect of simulation training, highly debated, is the lack of realism. For this reason, before starting the scenario, trainees received a specific questionnaire to evaluate their self-concern and their management based on their clinical evaluation (Fig 2).

Before the training start, in session 1, the total score of self-assessment was 21.97 ± 5.1. After the simulation training session, 8 weeks later, the total score was 26.6 ± 4.5 with p-value <0.0001 (fig. 6a). It is very interesting to note that this improvement was statically significant both in the self-evaluation queries (1-4) (fig. 6b) than self-management queries (5-7) (fig.6c).

In this study, we developed an evaluation scale to evaluate the correct application of the obstetric vacuum called kiwi-cup. We demonstrated that the use of simulation for the application of this instrument is pivotal in the process of learning and acquisition of technical skills. Simulation training plays an important role not only because it provides operators with the technical skills to carry out the application of the kiwi-cup correctly but also and above all because the awareness of having certain skills improves the safety of operators in doing the right things at the right time.

Much has been written in the literature in recent years about strategies to increase the accuracy and safety of OVD with specific attention to simulation [9] [10].

Although there is a general approval on the use of the simulation to improve maternal and fetal outcomes after OVD, there is not a standardized assessment scale for the application of the kiwi-cup. Beyond the successful rate, it is not possible to evaluate the technical skills of the trainee during the application of the kiwi-cup which allows the completion of the birth.

On the other hand, the successful rate does not automatically correspond to a correct application of the kiwi-cup. In clinical practice, this is important because simulation training improves maternal and fetal outcomes even if it does not increase the successful rate [11]. The correct application of the cup limits iatrogenic damage but if the tractions are not performed correctly, it can be detached anyway. Previous papers use the successful rate as a unique and exclusive reference and even in the last large study (STROBE), the primary outcome is to evaluate failed operative vaginal birth with the first intended instrument with no consideration about the used techniques [7]. In a recent systematic review of 30,813 articles about simulation training for operative vaginal delivery, only eight papers evaluated the effects of simulation on technical skills [12]. Among those, only one regarded the application of kiwi-cup and it evaluated an overall "improved knowledge" [13].

It is, therefore, necessary to establish an assessment scale to evaluate whether the operator performs the necessary procedures and whether the improvement of the successful rate (which we also have in our study) does not depend on greater confidence of the operator with the mannequin but rather from a real acquisition of technical skills. At the same time, this evaluation scale allows us to establish exactly which technical skills are lacking and how we can improve the performance of each operator by correcting them.

For this reason, we have idealized an evaluation scale based on the indications directly exposed by Vacca [14].

Among these parameters, the time factor is essential. The duration of OVD is associated with adverse obstetric and neonatal outcomes [15]. We tried to consider even this important element even if, without a doubt, in simulation training, many parameters can differ from the clinical reality: the number of pushes, maternal contractions, psychological pressure, etc. However, in our study, we demonstrated a significant reduction in the duration of operative vaginal delivery.

Also, to make the simulation more likely and to bypass the exclusively technical aspects, a specific scenario was built. Trainees, also bases on their technical skills acquired and beyond their success rates, showed to have a different attitude with the vacuum application procedure. The operator's experience therefore would not only be important to reduce maternal [16] and neonatal [17] adverse outcomes but also to modulate the decision-making skills of the operators themselves.

This issue constitutes the second original element compared to previous studies. For the first time, the concept of operator experience and, above all, the self-confidence on vacuum application is addressed as a pivotal issue in the decision-making process.

This point of view is innovative compared to literature. Even if the technical skills of each operator play an important role in carrying out the procedures and in doing it with confidence, however, the use of simulation can improve the overall performance even in less experienced operators.

After 8 weeks, the simulation training determines a statistically significant improvement on all the performance of the trainees, including the successful rate and the time taken to complete the procedure.

The choice to evaluate trainees directly at 8 weeks and not after the first training session is not causal. Many studies confirm that the importance of simulation as a type of learning is in the immediate but, above all, in the "knowledge retention" which diminishes with time especially with traditional teaching [13]. In our work, we demonstrate a statistically significant improvement in the technical skills of operators that remains at high levels after about 2 months from the training.

However, our work presents some limitations. For the simulation session, we used a simulator called "Lucy and her Mum". This model was born with the aim of teaching and allowing to learn the correct application of the kiwi-cup, and it is the same used by Prof. Vacca in his exhibitions. In our humble opinion, it has technical characteristics that partially influence the pelvic-perineal evaluation, which is instead possible in other models. Even the same quantity of lubricant used can interfere with the correct application and the successful rate. These elements are well known for those who do simulation and can be easily overcome in a common training session. However, in our case, since we used a very accurate evaluation scale, data may only partly be affected by these small details. For this reason, it would be desirable that this evaluation scale could be validated with other types of mannequins and in a different scenario to truly develop a standardized evaluation scale beyond the system used.

In conclusion, our work supports the use of simulation for learning the correct procedures for applying kiwi-cup. Besides, it provides a significant step towards introducing specific scales of evaluation in training sessions to standardize the assessment of individual technical skills of trainees.

Ethics approval and consent to participate: following our IRB (Comitato Etico Regionale per la Sperimentazione Clinica della Regione Toscana), this study does not require any ethical approval because this is simulation study performed on mannequins. However, all experiments were performed in accordance with relevant guidelines and each participant approved and freely decided to participate.
Consent for publication: informed consent was obtained from all subjects for study participation. Informed andwritten consent was requested to participate
Availability of data and materials: all data generated or analyzed during this study are included in this published article
Competing interests: none
Funding: none
Authors' contributions: Paolo Mannella is the PI of the study. He designed, elaborated and wrote the paper, Mario Giordano collected data, Maria Magdalena Montt Guevara analyzed data and performed statistics, Andrea Giannini collected data and collaborated with simulation sessions, Eleonora Russo collected data and collaborated with simulation sessions, Federica Pancetti developed and coordinated the project , Tommaso Simoncini revised the project and the paper.
Acknowledgments: none

Martin JA, Hamilton BE, Osterman MJ, Curtin SC, Matthews TJ: Births: final data for 2013. Natl Vital Stat Rep 2015, 64(1):1-65.
Plevani C, Incerti M, Del Sorbo D, Pintucci A, Vergani P, Merlino L, Locatelli A: Cesarean delivery rates and obstetric culture - an Italian register-based study. Acta obstetricia et gynecologica Scandinavica 2017, 96(3):359-365.
Merriam AA, Ananth CV, Wright JD, Siddiq Z, D'Alton ME, Friedman AM: Trends in operative vaginal delivery, 2005-2013: a population-based study. BJOG 2017, 124(9):1365-1372.
O'Grady JP, Pope CS, Patel SS: Vacuum extraction in modern obstetric practice: a review and critique. Current opinion in obstetrics & gynecology 2000, 12(6):475-480.
Hamza A, Lavin JP, Radosa JC, Abou-Dakn M, Peitz I, Gerlinger C, Meyberg-Solomayer G, Stroder R, Juhasz-Boss I, Solomayer EF et al: Vaginal operative delivery in Germany: a national survey about experience and self-reported competency. The journal of maternal-fetal & neonatal medicine : the official journal of the European Association of Perinatal Medicine, the Federation of Asia and Oceania Perinatal Societies, the International Society of Perinatal Obstet 2020:1-7.
Filippi V, Chou D, Ronsmans C, Graham W, Say L: Levels and Causes of Maternal Mortality and Morbidity. In: Reproductive, Maternal, Newborn, and Child Health: Disease Control Priorities, Third Edition (Volume 2). edn. Edited by Black RE, Laxminarayan R, Temmerman M, Walker N. Washington (DC); 2016.
O'Brien S, Lenguerrand E, Jordan S, Cornthwaite K, Burden C, Timlin L, Siassakos D: Simulation TRaining for Operative vaginal Birth Evaluation: study protocol for an observational stepped-wedge interrupted time-series study (STROBE). BMC Pregnancy Childbirth 2019, 19(1):109.
Desurmont S, Houze de l'Aulnoit A, Brabant G, Houze de l'Aulnoit D: Assessment of fetal head engagement with transperineal ultrasound: Searching for the cutoff level. J Gynecol Obstet Hum Reprod 2018, 47(7):317-324.
Ramphul M: "Strategies to increase the accuracy and safety of OVD" (Clinical assessment skills and role of ultrasound, simulation training and new technologies to enhance instrument application). Best Pract Res Clin Obstet Gynaecol 2019, 56:35-46.
Eskander R, Beall M, Ross MG: Vacuum-assisted vaginal delivery simulation--quantitation of subjective measures of traction and detachment forces. The journal of maternal-fetal & neonatal medicine : the official journal of the European Association of Perinatal Medicine, the Federation of Asia and Oceania Perinatal Societies, the International Society of Perinatal Obstet 2012, 25(10):2039-2041.
Cheong YC, Abdullahi H, Lashen H, Fairlie FM: Can formal education and training improve the outcome of instrumental delivery?European journal of obstetrics, gynecology, and reproductive biology 2004, 113(2):139-144.
Bligard KH, Lipsey KL, Young OM: Simulation Training for Operative Vaginal Delivery Among Obstetrics and Gynecology Residents: A Systematic Review. Obstetrics and gynecology 2019, 134 Suppl 1:16S-21S.
Vadnais MA, Dodge LE, Awtrey CS, Ricciotti HA, Golen TH, Hacker MR: Assessment of long-term knowledge retention following single-day simulation training for uncommon but critical obstetrical events. The journal of maternal-fetal & neonatal medicine : the official journal of the European Association of Perinatal Medicine, the Federation of Asia and Oceania Perinatal Societies, the International Society of Perinatal Obstet 2012, 25(9):1640-1645.
Vacca A: Vacuum-assisted delivery. Best Pract Res Clin Obstet Gynaecol 2002, 16(1):17-30.
Miller ES, Lai Y, Bailit J, Reddy UM, Wapner RJ, Varner MW, Thorp JM, Jr., Leveno KJ, Caritis SN, Prasad M et al: Duration of Operative Vaginal Delivery and Adverse Obstetric Outcomes. Am J Perinatol 2020, 37(5):503-510.
Bergendahl S, Lindberg P, Brismar Wendel S: Operator experience affects the risk of obstetric anal sphincter injury in vacuum extraction deliveries. Acta obstetricia et gynecologica Scandinavica 2019, 98(6):787-794.
Wirapornsawan U, Suwanrath C, Pinjaroen S: The effect of vacuum operator's experience on Apgar scores. Archives of gynecology and obstetrics 2012, 286(6):1413-1417.

PDF

Editorial decision: Major revision
26 Mar, 2021
Reviews received at journal
27 Jan, 2021
Reviewers agreed at journal
16 Jan, 2021
Reviewers agreed at journal
07 Jan, 2021
Reviewers invited by journal
23 Dec, 2020
Editor assigned by journal
23 Dec, 2020
Editor invited by journal
22 Dec, 2020
Submission checks completed at journal
22 Dec, 2020
First submitted to journal
04 Dec, 2020

You are reading this latest preprint version

Simulation Training Program for Vacuum Application to Improve Technical Skills in Vacuum-Assisted Vaginal Delivery

Status:

Version 1

Abstract

Figures

Introduction

Materials And Methods

Results

Discussion

Declarations

References

Status:

Version 1