Active Surveillance of Adverse Events After COVID-19 and Other Vaccinations: a Feasibility Study as Part of the CoVaKo Project

doi:10.21203/rs.3.rs-1004262/v1

PDF

Research

Active Surveillance of Adverse Events After COVID-19 and Other Vaccinations: a Feasibility Study as Part of the CoVaKo Project

https://doi.org/10.21203/rs.3.rs-1004262/v1

This work is licensed under a CC BY 4.0 License

You are reading this latest preprint version

Background: The Corona-Vakzin-Konsortium project (CoVaKo) analyses the efficacy and safety of COVID-19 vaccines in a real-world setting and breakthrough infections in Bavaria, Germany. A subproject of CoVaKo aims to identify adverse events of the COVID-19 vaccine and to compare these to adverse events of other vaccines in an online survey. A prior feasibility study was conducted to test study materials for comprehensibility, visual design and motivation to participate and secondly, to test practical implementation and realization in primary care practices and vaccination centres.

Methods: A mixed-methods design was used. Three focus groups with general population participants were performed to evaluate the study materials and survey. Second, a test-roll-out was conducted in vaccination centres and primary care practices, which involved implementation and quantitative evaluation of the online survey. Third, interviews were conducted with participating general practitioners and heads of vaccination centres four weeks after the test-roll-out.

Results: Parts of the study information and registration form proved incomprehensible in the recruitment material and/or online survey. For example, headings were misleading since the COVID-19 vaccination was overemphasized in the title as compared to other vaccinations. Participants requested more information on the procedure and completion time. In 31 days, 2199 participants who received either a COVID-19 vaccination (99 %) or at least one of the control vaccinations (1 %) registered for the study. Participants (strongly) agreed that the registration process was easy to understand, that all relevant information was provided, the completion time was reasonable and technical framework manageable. Physicians and heads of the vaccination centres perceived the study as easy to integrate into their workflow and most of them were willing to participate in the main study.

Conclusions: Our study indicated that capturing adverse events after vaccinations with an online survey is feasible. Testing of materials and surveys provided valuable improvements. Participation of health professionals is important to ensure practicality of the procedures. Flexible adaptation of the study organization to changing structures and requirements is necessary for a successful implementation, especially due to dynamic changes in COVID-19 vaccination strategies.

Trial registration:

The trial was retrospectively registered at “Deutsches Register Klinischer Studien” (DRKS-ID: DRKS00025881) on Oct 14, 2021.

Internal Medicine

COVID-19

vaccination

adverse events

online survey

healthcare staff

vaccination centres

general practitioners

1) What uncertainties existed regarding feasibility?

It was uncertain whether a sufficient number of vaccinated individuals could be recruited for an online survey, especially in case of control vaccinations, older and/or not technologically savvy individuals. There were uncertainties whether staff from vaccination centres and physician practices would be willing to distribute recruitment materials without monetary compensation.

2) What are the key feasibility findings?

Due to the dynamic COVID-19 vaccination recommendations, flexibility in the study procedure proved to be important. With the current focus on COVID-19 there were difficulties in recruiting individuals after a control vaccination. Successful implementation and integration of the study into existing processes and procedures of health care institutions can succeed if done with as little effort for them as possible.

3) What are the implications of the feasibility findings for the design of the main study?

In terms of the online survey, built-in self-checks (vaccination, gender, age) are useful to increase the quality of the data. To reach individuals after a control vaccination, more primary care practices and company physicians are to be recruited and announcements through newspapers and radio could be useful. Concerning recruitment of healthcare providers, the study procedure has to be easy to implement and needs to be adaptable for possible amendments in vaccination strategy.

The COVID-19 pandemic is affecting everyone, forcing people into lockdown and to socially distance themselves. Vaccines are a promising remedy against this. Up to now COVID-19 vaccines from BioNTech/Pfizer, Moderna, AstraZeneca and Johnson & Johnson have been authorized by the European Medicines Agency (EMA). The pivotal studies have shown high efficacy and safety [1-3]. As efficacy and safety of a vaccine has a significant impact on its acceptance in the population [4, 5], effective monitoring systems are important to ensure a safe and successful vaccination campaign. A reliable estimation of adverse events, especially of severe events affording medical attendance, is required. Given the rapid implementation of the COVID-19 vaccine, an active surveillance of side effects of COVID-19 vaccines is needed, including comparison with other commonly used vaccines to reduce the risk of bias. In Germany, as of Oct. 19, 2021 54,7 million people are fully vaccinated against COVID-19 [6].

The Corona-Vakzin-Konsortium project (CoVaKo) analyses the efficacy and safety of COVID-19 vaccines and breakthrough infections in Bavaria, Germany [7, 8]. One part of the project, the CoVaKo safety study, aims to capture adverse events in a real-world setting using an online survey. The observation group is planned to include participants after COVID-19 vaccination. The control group is planned to include participants after common other vaccinations, e.g. vaccinations against influenza, shingles or pneumococcus. Posters, flyers and leaflets will be used to recruit participants at vaccination centres and primary care practices. People aged 18 and older who have been vaccinated recently will be asked to register for the study on a secure website using REDCap (Research Electronic Data Capture), hosted at Universitätsklinikum Erlangen [9, 10]. When registering, participants will be asked about sociodemographic characteristics, for information about the vaccination as well as about comorbidities using a modified German version of the Self-Administered Comorbidity Questionnaire (SCQ-D) [11-13]. Up to five times in 18 weeks after vaccination, participants will be asked to complete an online survey about perceived adverse events and side effects, especially events leading to (in- or outpatient) medical consultation, medication intake and/or sick leave.

With a preceding feasibility study, we aimed to determine whether an online survey to capture adverse events after vaccination is practicable. The aim was, to (1) test the recruiting material for comprehensibility, visual design and motivation to participate, (2) to evaluate the online survey for comprehensibility, visual design, relevance of questions and technical implementation and (3) to assess practical implementation and realization in vaccination centres and primary care practices.

Study design and procedure

A mixed-methods design was used to combine elements of qualitative and quantitative research approaches in order to analyse the study’s strengths and weaknesses, opportunities and threats (SWOT). Initially, the recruitment materials and the online survey were evaluated qualitatively. During test-roll-out the online survey was evaluated quantitatively and the feasibility both quantitatively and qualitatively.

The reporting of the study is based on the STROBE (Strengthening the Reporting of Observational studies in Epidemiology) recommendations [14], the Consolidated Standards of Reporting Trials (CONSORT) statement [15] and on the COREQ-Checklist (COnsolidated criteria for REporting Qualitative research) [16].

The procedure of the different project steps are explained in the following (Table 1).

Table 1 Overview of the study procedure with mixed-method design

	Methods & objectives
To be evaluated:	Qualitative approach	Quantitative approach
Recruiting materials	Method: Focus groups with (vaccinated) persons Objective: comprehensibility, visual design, motivation to participate	N.A.
Online survey	Method: Focus groups with (vaccinated) persons Objective: comprehensibility, visual design, relevance of questions, technical correctness	Method: Online survey with vaccinated persons Objective: comprehensibility, visual design, relevance of questions
Feasibility through test-roll-out	Method: Interviews with GPs and heads of vaccination centres Objective: practicability of implementation/realization	Method: Online survey with an additional textbox with vaccinated persons Objective: recruitment and participation rates

Note. N.A. = Not available

Qualitative evaluation of recruiting materials and online survey

Before the test-roll-out, the recruitment materials and the online survey were qualitatively evaluated. In March 2021, three online focus groups (each 120 min) were performed by NL and MS, two female researchers at the Institute of General Practice who have profound knowledge in qualitative research. The only inclusion criterion was defined as a minimum age of 18 years. Inclusion was independent of vaccination status, as this was not relevant for the evaluation. Exclusion criteria were lack of written informed consent and/or mental or cognitive impairments. Participants were recruited in the MVZ Eckental, a primary care practice associated with our institute (Institute of General Practice, Universitätsklinikum Erlangen). Snowball sampling was used to reach further participants (convenience sample). NL and MS did not know the participants before data collection. The participants received all versions of flyers, leaflets and posters as well as the study information before the focus groups. In the focus groups, materials were discussed and questions were asked about comprehensibility and readability, attractiveness of the visual design and whether materials triggered interest and motivation to participate. The participants were given the opportunity to complete the online survey using different case vignettes (Supplementary Material). They evaluated the survey for technical errors, visual design, and readability on different devices (mobile phones, tablets and laptops) and different common internet browsers. We also discussed whether the study design and procedure as well as the inclusion criteria specified on the materials were understandably described. The focus groups were audio recorded, additionally field notes were taken. After each focus group, the results were summarised. Based on the findings, adjustments were made to the materials and the online survey, which were then presented to the third focus group.

Quantitative evaluation of the online survey

The study was tested across primary care practices and vaccination centres and was evaluated quantitatively. The online survey on adverse events was followed by a number of evaluation questions. Questions were asked about the registration process, the structure of the survey, comprehensibility, completeness and importance of the questions. Also, the technical implementation and way of recruitment were assessed. Items were answered using a 5-point Likert Scale from 1 = strongly disagree to 5 = strongly agree. The evaluation form included a textbox for further comments. The test-roll-out and data collection for the evaluation form started on 17 April 2021 and ended on 14 July 2021.

Quantitative data were also collected on the participation rates of vaccinated individuals. The targeted minimum recruitment rate for the feasibility study was 50 participants/group. If we can reach this target in four weeks, we estimate that 3.000 participants/group can potentially be recruited within 9 months of the large-scale main study.

Qualitative evaluation of the practicability of the implementation

Feasibility was qualitatively evaluated via interviews with General Practitioners (GPs) and heads of COVID-19 vaccination centres (May 2021). Vaccination centres in Central Franconia, a part of Bavaria, were recruited via direct email contact. Primary care practices were contacted through BayFoNet, a Bavarian Practice Based Research Network (https://bayfonet.de/en/). The centres and practices did not receive any monetary or non-monetary compensation. The centres’ and practices’ staff were asked to hand out the leaflets to patients after a vaccination. No further explanation by the staff was necessary. Posters and flyers could be used to raise more attention. A qualitative evaluation was conducted with the GPs and heads of the vaccination centres four weeks after the test-roll-out via telephone interviews (30 min) by NL and LW (female doctor in training/ researcher at the Institute of General Practice). Field notes were taken during the interviews. Questions were asked on the distribution of the material (e.g. who distributed and when, time consumption) and on patients’ reaction (e.g. curiosity, aversion, lack of interest, etc., to adjust material if necessary). We also discussed study organisation, contact frequency to study centre, their motivation to participate in the main study and suggestions for recruitment of other practices/vaccination centres.

Data analysis

Qualitative evaluation. Focus groups were summarized in writing. NL and MS then used the method of mapping to structure and visualise the statements. Categories of the focus groups were comprehensibility and readability, visual design, technical errors and motivation to participate. Changes for the recruitment material and the surveys were then derived.

The field notes of the interviews were categorised into distribution of the material, patients’ reaction, organisation, motivation to participate, recruitment of other practices/vaccination centres. The results were discussed in the project team, not with participants.

Quantitative evaluation. The email addresses were checked for duplicates. If the same email address was entered in two different registrations, it was reviewed whether one person registered twice for the same vaccination, or whether the person and/or vaccination differed. In the first case, the datasets were synthesised. In case of different vaccinations or different persons with the same email address, both datasets were considered individually. Various plausibility tests were used to check whether the participants correctly understood the questions and the given answer format. Data were checked for implausible answers, e.g. only participants with an interval between first and second dose of COVID-19 vaccination of 14 to 91 days were included due to the vaccination strategy recommendations. In order to detect possible errors in sending out the invitation links for the subsequent surveys, it was checked whether the time corridor between vaccination and answer time was correct and whether the interval between two surveys was at least seven days. Sociodemographic characteristics, information about the vaccines and comorbidities are reported as proportion of all patients with a valid registration form. A drop-out rate over the observation period was estimated by the amount of fully completed surveys in relation to the sent email invitations to the participants remaining after data selection and preparation process. Comorbidity in form of a modified SCQ-D was calculated [12]. Data preparation, analyses and figures were performed using R Statistical Software (version 4.1.0, R Foundation for Statistical Computing, Vienna, Austria).

The first evaluation form of each participant was considered for the analysis. The comments in the textbox were categorised in MAXQDA Plus 2020 by NL and MS. Categories were content, organisation and technical implementation. The results were discussed in the project team, not with participants.

Qualitative evaluation of recruiting materials and online survey

Study population. Fourteen participants took part in three focus groups (Table 2), two participants dropped-out due to personal reasons that were not related with the study. About equal numbers of women and men participated. Almost all of them were employed and had a university degree. One participant did not speak German as her native language.

Table 2 Sociodemographic characteristics of focus group participants

Baseline characteristics	0n	00%
N	14	100
Gender
Female	08	057
Male	06	043
Diverse	00	000
Year of birth
1995 - 2003	00	000
1996 - 1980	10	071
1981 - 1960	00	000
1961 and older	04	029
Employment
Employed	10	072
In education	02	014
Unemployed	02	014
Retired	00	000
Other	00	000
Not specified	00	000
Education
No degree	00	000
Lower certificate	00	000
Intermediate certificate	01	007
Complete apprenticeship	01	007
High school diploma	02	014
University degree	10	072
Not specified	00	000

Note. Focus group participants were divided into three groups.

Evaluation of recruiting materials. A leaflet in size of the vaccination certificate was rated most positively and practical as compared to posters and flyers. Fig. 1 shows two (out of five) different leaflets that were demonstrated to the participants and the final adjusted leaflet for the primary care practices.

In general, headlines were misleading because we only referred to COVID-19 vaccination but not the control vaccinations. Participants wanted headings to be more reader friendly, e.g. larger font. They were confused by the study acronym, CoVaKo, and preferred not to mention it in the title. Some participants also preferred the masculine form of language compared to gender-neutral language that uses the asterisk (e.g. Teilnehmer instead of Teilnehmer*innen; eng. participants). They also favoured the wording vaccine side effects instead of vaccine reaction or vaccine damage since it is most commonly known and/or perceived as more objective.

Study information should be listed as bullet points one below the other as opposed to alternating between left and right columns. Some participants preferred one image over two images on a page. Participants appreciated the information on data protection, but found it too long. Some would want to know what will happen to the results and how data will be analysed. The options to register and access more information on the study via QR-Code or URL were evaluated practical by most participants. However, older participants stated they would not know how to use the QR-Code.

Final versions of the posters, leaflets and flyers were created based on the feedback. We opted for two different versions: One version for vaccination centres that pointed to COVID-19 vaccination only and one version for primary care practices that targeted a variety of vaccinations. We included most of the feedback but decided to still use gender-neutral language. COVID-19 is now written in lowercase and placed at the bottom of the list to avoid too much focus on that vaccination. Information on data protection is now shortened with reference to a more detailed version on our study website. The adjusted version was used for the study test-roll-out.

Evaluation of online survey. Parts of the study information and registration form proved to be incomprehensible. More specific information was requested regarding procedure and participating time, e.g. survey completion time in minutes. When asked about the vaccination received, they tended to report all the vaccinations received in the past (Fig. 2). The response options "Several/None" have been separated as this simplified the response decision. Originally, participants should only be recruited in the last two weeks after vaccination. As it later proved more practical to include participants at a later time as well, the time reference in the question about vaccination was adjusted accordingly.

Some buttons of the survey were in English (e.g. next page, submit) due to the software we used; here the participants expressed the wish that they were in German. When filling out the survey, it became apparent that not all termination criteria were correctly stored; no other technical problems occurred. We incorporated the majority of the feedback. We were not yet able to implement the German system language.

Also, before the test-roll-out we adapted the study procedure strategy. Initially, participants should register within 14 days after their first dose in order to collect data at all survey times. In the test-roll-out participants could register up to 124 days after their first or single dose, in order to receive at least one follow-up survey and to not lose too much information due to the vaccination pace.

Quantitative evaluation of the survey and feasibility

Study population. In 31 days, 2199 participants registered and received either a COVID-19 vaccination (99 %) or at least one of the control vaccinations (1 %) in the last 124 days. Few participants were born before 1951 (7 %) and 10.1 % were from medium sized towns. The distribution between rural areas, small towns and cities was balanced. The majority was employed (69 %) and had a university degree (48 %).

Most participants received BNT162b2 (BioNTech/Pfizer) or ChadOx1 (AstraZeneca) as first COVID-19 vaccination (60 %, 28 %). For the second COVID-19 vaccination, BNT162b2 (BioNTech/Pfizer) and mRNA-1273 (Moderna) were administered most (68 %, 21 %). In five cases, the second dose was cancelled. Named reasons were pregnancy, SARS-CoV-2-infection after first dose, intolerance of first dose or illness at date of second dose. Information on the second dose is missing in 446 cases due to missing information from the follow-up surveys. The mean body mass index was 26.2 (SD = 5.8). Morbidity assessed with the mSCQ-D was in mean 1.6 (SD = 2.4) (Table 3).

Table 3 Sociodemographic characteristics, vaccination types, comorbidities and completion rate for each survey

Baseline characteristics	n	%
N	2199	100
Gender
Female	1233	56
Male	0965	43
Diverse	0001	01

Year of birth
1991-2003 (approx. 18-30 years)	0419	19
1971-1990 (approx. 31-50 years)	0772	35
1951-1970 (approx. 51-70 years)	0859	39
1933-1950 (approx. 70-88 years)	0149	07

Residence
Rural area¹	0618	28
Small town²	0642	29
Medium-sized town³	0223	10
City⁴	0716	33

Employment
Employed	1525	69
In education	0228	10
Unemployed	0050	02
Retired	0336	15
Other	0040	02
Not specified	0020	01

Education
No degree	0002	01
Lower certificate	0055	02
Intermediate certificate	0273	12
Complete apprenticeship	0321	15
High school diploma	0459	21
University degree	1047	48
Not specified	0042	02

Vaccination
Control group	0024	01
Covid-19	2175	99
First vaccination COVID (n = 2175)
BNT162b2 (BioNTech/Pfizer)	1313	60
mRNA-1273 (Moderna)	0253	12
ChadOx1 (AstraZeneca)	0609	28
Ad26.COV2.S (Johnson & Johnson)	0000	00

Second vaccination COVID (n = 1753)
BNT162b2 (BioNTech/Pfizer)	1200	68
mRNA-1273 (Moderna)	0375	21
ChadOx1 (AstraZeneca)	0141	08
Ad26.COV2.S (Johnson & Johnson)	0000	00
Cancelled	0005	01
Not planned	0032	02
NA	0422

Health status
No Pre-existing diseases	0832	38
Allergies	0598	27
Hypertension	0408	19
Backpain	0331	15
Lung Disease	0187	9
Rheumatism/Autoimmune disease	0172	8
Depression	0153	7
Osteoarthritis	0142	6
Gastrointestinal disease	0135	6
Heart disease	0117	5
Diabetes	0094	4
Cancer	0072	3
Coagulation Problems	0044	2
Kidney Disease	0040	2
Liver Disease	0034	2
Anemia	0028	1
	*Mean*	SD
mSCQ-D (n = 2199)⁵	0001.6	02.4
BMI (n = 2176)⁶	0026.2	05.8

Note. ¹Rural area = < 5.000. ²Small town = 5.000 to approx. 20.000. ³Medium-sized town = 20.000 to approx. 100.000. ⁴City = 100.000 or more inhabitants. ⁵mSCQ-D = Modified German version of the Self-Administered Comorbidity Questionnaire. ⁶BMI = Body Mass Index.

Most participants (58 %) registered in the week of their first dose or single dose, respectively. In the sixth week after first/single dose registered nine percent and in the ninth week twenty percent.

The estimated recruitment rate in the test-roll-out was 7 % (2199 participants with 303050 distributed leaflets). Overall response rate of the surveys was very high with 84 %.

Evaluation. About 92 % of 1993 participants became aware of the study at a vaccination centre. The others heard about it at a physician’s practice, their friends/family or on the internet (3 %, 3 % and 1 %, respectively). About 10 % did not fill out an evaluation form.

Most participants (strongly) agreed that the registration process was well structured, easy to understand that all relevant information was asked and all questions were important. Regarding the study process, most participants (strongly) agreed that the registration process was easy, the completion time was reasonable and the technical framework was manageable (Fig. 3).

Note. If a participant filled out several evaluation forms, first answer was considered. Counts of observations in the bars are reported if n was > 50.

Optional feedback in the comment section. Suggestions in terms of organisation, technical implementation and content were made. After the registration, participants expected to receive an invitation link or a confirmation email immediately or shortly after their vaccination. For confidentiality and technical reasons, we did not send confirmation emails, but an information was added during the feasibility study at the end of the registration. The Redcap system language being English resulted in some participants getting an automatic and poor German translation of the survey in certain Internet browsers, although the survey was developed in German. A software update after the test-roll-out could solve this problem.

Concerning the content, some participants wished for a more differentiated list of symptoms and to specify the duration and onset of their symptoms. The item asking for personal perception of the link between vaccination and the complaints was difficult for some. Few participants suggested to add the answer option "I don't know".

As some participants shared an email address or registered twice, we implemented a disclaimer at the beginning of each survey with their personal information on type and date of vaccine, year of birth and gender. With this information participants could also give us feedback if their entered information was incorrect and/or could register again.

Qualitative Evaluation of the feasibility

Study population. Eleven primary care practices and two large-scale vaccination centres, were recruited to distribute leaflets after vaccinations. In total three interviews with GPs and two interviews with vaccination centres staff were performed.

Evaluation. A total of 1600 leaflets were sent out to primary care practices and 28750 leaflets to the vaccination centres. The leaflets were distributed at different times, e.g. directly after the vaccination by physicians or in the waiting area. Participating partners said that the study is easy to integrate into the regular workflow. All preferred the small leaflets over flyers and posters. Posters were not desired due to lack of space, especially from GPs. One GP reported a greater interest when leaflets were distributed by physicians instead of medical assistants. Physicians reported mostly positive reactions from vaccinated persons. Some reported little additional work due to questions from patients, but overall the questions did not intervene with their tight schedule. According to participants, almost all leaflets were distributed. Physicians suggested to recruit more GPs through mailing lists and by offering compensation.

Nine GP practices and both vaccination centres said they were willing to participate in the main project.

Our study showed that capturing adverse events after vaccinations with an online survey is feasible. The qualitative evaluation of the recruiting materials led to some adjustments, e.g. adjusting the wording or designing two different recruiting materials for vaccination centres and primary care practices. After evaluation of the online survey self-checks (vaccination, gender, age) and feedback were built, so participants for example are informed that the survey will not be send out immediately after registration. The greatest challenge laid in recruiting individuals after a control vaccination.

The focus groups showed the relevance of testing the recruitment material to reduce misunderstandings. Despite adaptation of the study material following the focus groups, misinterpretation still occurred during the test-roll-out. Public attention is currently focused on COVID-19. This made it easy recruiting patients after COVID-19 vaccination but potentially led to difficulties in reaching the targets of participants for the control group. Additionally, few other vaccines were administered at that time. The evaluation of the recruiting materials and the survey showed that it is important to relocate the current general focus on COVID-19 to all vaccinations of the target group. Reading instructions carefully is often problematic for participants in studies [17]. Therefore, to accomplish the focus relocation using unambiguous and clear formulations is even more important.

We aimed at 50 participants in each group for the feasibility study. We overachieved this for the COVID-19 vaccination group but barely anyone participated in the control group. Since recruiting participants for the control group proved to be more difficult, greater emphasis will need to be placed on the recruitment strategy for this group during the main study. Possible solutions for the main study are recruiting more primary care practices and company physicians as well as announcements through newspapers and radio for example right before the influenza vaccination season.

The administrative burden of any study is a barrier to participation [18]. A successful implementation and integration of a study into existing processes and procedures of health care institutions might succeed by imposing as little effort as possible for the participants. The interviews with the participating GPs and heads of the vaccination centres showed that the study easily fits into the workflow. Although GP practices participated without compensation in the feasibility study we would tend to monetarily acknowledge their cooperation in the main study. The reason is that in the main study the duration of the data collection will be longer and financial reward might motivate to recruit for the control group. Another way to motivate physicians might be to better explain them why the control group is methodologically necessary for the main question of the study for which recruiting participants turned out to be easy.

Noticeable in the recruiting was also that only a small proportion of the participants in the test-roll-out were older than 70 years; probably due to the vaccine recommendations and prioritisation [19]. Using an online survey might also be another reason, as older people are less confident in their use of emails and the internet [20, 21]. However, other studies show no group differences in age or gender when comparing different recruitment strategies [22]. In these studies, the online option was more likely to be chosen by better educated participants.

Due to the dynamic of COVID-19 vaccination recommendations, flexibility in the study procedure proved to be important. Recommendations like the heterologous vaccination regime or changes in intervals between the two doses had to be considered in the survey [1-3, 19, 23-26]. The survey-question on the COVID-19 vaccination brand name and lot number was therefore adapted and repeatedly asked in the follow-up surveys. Automatically sent invitations and the survey itself had to be customizable. Initially it was planned to assess data from vaccinated persons after the first or single dose of COVID-19, respectively. However, with this procedure a lot of information would have been lost, especially as our study started when 3,436,080 doses had already been administered to about 19.5 % of the Bavarian population [27]. We therefore adapted the strategy before the test-roll-out so that participants could register up to 124 days after their first or single dose, in order to receive at least one follow-up survey. Data of adverse events even if only assessed after the second dose are a valuable complement to the real-world evidence. For example, several weeks after recommendation of the heterologous vaccination regime in Germany there is still only little real-world evidence on safety of this regime [28-30].

Limitations

Due to the urgent implementation and limited financial resources of the study, other data collection methods such as postal or telephone survey were not tested. Because of the time constraints caused by COVID-19 vaccinations already starting in practices, we could not lead more interviews with GPs. Data saturation could not be achieved because regular adjustments would have required continuous focus groups and interviews. COVID-19 vaccination prioritization of certain population groups, the study population of the test-roll-out might not be representative of the entire population in age, sex or educational background. In the progress of the vaccination campaign, quite different groups of people will be targeted over time. During the feasibility study, participants probably had higher grades of multimorbidity and were older or were predominantly medical personnel. These biases cannot be diminished whether now nor in the main study.

Testing of materials and surveys before implementation of a study is essential. Participating with health professionals, vaccination centres and physicians’ practices, and incorporating their suggestions not only helps to reach many patients quickly, but also to ensure the practicality of the study procedures. For a successful implementation of the main study during the pandemic, flexible adaptation of the study organization to dynamic changing structures and requirements proved to be essential. Recruitment of the control group will be the greatest challenge for the main study.

CoVaKo: Corona-Vakzin-Konsortium

COVID-19: Corona-virus-disease 2019

GP: General Physicians

Ethics approval and consent to participate

The Ethics Committee of the Friedrich Alexander University approved the study (01.03.2021, 47_21 B).

Consent for publication

Not applicable.

Availability of data and materials

The data that support the findings of this study are available from the corresponding author, NL upon reasonable request.

Competing interests

The authors declare that they have no competing interests.

Funding

The authors received funding from the Bavarian Ministry of Science and Art (grant number: 152821006).

Authors' contributions

All authors designed the study. NL, LW, SU, MS analysed and interpreted the data and drafted the manuscript. All authors reviewed the manuscript and approved it for submission.

Acknowledgements

We thank Christine Gall and Isabelle Kaiser for consultation and support during designing and analysing the data. We thank Carolin Nürnberger for preparation of figures and tables and preparing the qualitative data.

Vygen-Bonnet SK, Judith; Bogdan, Christian; Harder, Thomas; Heininger, Ulrich; Littmann, Martina; Meerpohl, Joerg; Meyer, Heidi; Mertens, Thomas; Michaelis, Kai; Terhardt, Martin; Überla, Klaus; van der Sande, Marianne; Wichmann, Ole; Wicker, Sabine; Wiedermann, Ursula; Wild, Verina; von Kries, Rüdiger: Beschluss der STIKO zur 8. Aktualisierung der COVID-19-Impfempfehlung und die dazugehörige wissenschaftliche Begründung. Epid Bull 2021, 27:14-31.
Vygen-Bonnet SK, Judith; Bogdan, Christian; Harder, Thomas; Heininger, Ulrich; Kling, Kerstin; Littmann, Martina; Meerpohl, Joerg; Meyer, Heidi; Mertens, Thomas; Michaelis, Kai; Schmid-Küpke, Nora; Scholz, Stefan; Terhardt, Martin; Treskova-SSchwarzbach, Marina; Überla, Klaus; van der Sande, Marianne; Waize, Maria; Wichmann, Ole; Wicker, Sabine; Wiedermann, Ursula; Wild, Verina; von Kries, Rüdiger: Beschluss der STIKO zur 5. Aktualisierung der COVID-19-Impfempfehlung. Epid Bull 2021, 19:24-36.
Vygen-Bonnet SK, Judith; Bogdan, Christian; Harder, Thomas; Heininger, Ulrich; Kling, Kerstin; Littmann, Martina; Meerpohl, Joerg; Meyer, Heidi; Mertens, Thomas; Schmid-Küpke, Nora; Scholz, Stefan; Terhardt, Martin; Treskova-Schwarzbach, Marina; Überla, Klaus; van der Sande, Marianne; Wichmann, Ole; Wicker, Sabine; Wiedermann, Ursula; Wild, Verina; von Kries, Rüdigger: Beschluss der STIKO zur 1. Aktualisierung der COVID-19-Impfempfehlung. Epid Bull 2021, 2:3-71.
Kaplan RM, Milstein A: Influence of a COVID-19 vaccine’s effectiveness and safety profile on vaccination acceptance. Proceedings of the National Academy of Sciences 2021, 118(10):e2021726118.
Kreps S, Prasad S, Brownstein JS, Hswen Y, Garibaldi BT, Zhang B, Kriner DL: Factors Associated With US Adults’ Likelihood of Accepting COVID-19 Vaccination. JAMA Network Open 2020, 3(10):e2025594-e2025594.
Impfdashboard [https://impfdashboard.de/]
Sebastiao M: CoVaKo: Active recording of adverse events after COVID-19 vaccination. In: Deutsches Register Klinischer Studien German Clinical Trials Register. 21.05.2021 edn. Köln: Bundesinstitut für Arzneimittel und Medizinprodukte; 2021.
Überla K: CoVaKo-Durchbruchsinfektionen: Verlauf von COVID-19 bei geimpften und nicht geimpften Personen. In: Deutsches Register Klinischer Studien German Clinical Trials Register. 04.03.2021 edn. Köln: Bundesinstitut für Arzneimittel und Medizinprodukte; 2021.
Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O'Neal L, McLeod L, Delacqua G, Delacqua F, Kirby J et al: The REDCap consortium: Building an international community of software platform partners. Journal of Biomedical Informatics 2019, 95:103208.
Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG: Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics support. Journal of Biomedical Informatics 2009, 42(2):377-381.
Streibelt D, Schmidt C, Brünger M, Spyra K: Komorbidität im Patientenurteil – geht das? Der Orthopäde 2012, 41.
Sangha O, Stucki G, Liang MH, Fossel AH, Katz JN: The self-administered comorbidity questionnaire: A new method to assess comorbidity for clinical and health services research. Arthritis Care & Research 2003, 49(2):156-163.
Stolwijk C, van Tubergen A, Ramiro S, Essers I, Blaauw M, van der Heijde D, Landewé R, van den Bosch F, Dougados M, Boonen A: Aspects of validity of the self-administered comorbidity questionnaire in patients with ankylosing spondylitis. Rheumatology 2014, 53(6):1054-1064.
von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP, Initiative S: Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. BMJ 2007, 335(7624):806-808.
Eldridge SM, Chan CL, Campbell MJ, Bond CM, Hopewell S, Thabane L, Lancaster GA: CONSORT 2010 statement: extension to randomised pilot and feasibility trials. Pilot Feasibility Stud 2016, 2:64.
Tong A, Sainsbury P, Craig J: Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. International Journal for Quality in Health Care 2007, 19(6):349 – 357
Brosnan K, Babakhani N, Dolnicar S: “I know what you’re going to ask me” Why respondents don’t read survey questions. International Journal of Market Research 2019, 61(4):366-379.
Rosemann T, Szecsenyi J: General practitioners' attitudes towards research in primary care: qualitative results of a cross sectional study. BMC Fam Pract 2004, 5(1):31.
Vygen-Bonnet SK, Judith; Bogdan, Christian; Harder, Thomas; Heininger, Ulrich; Kling, Kerstin; Littmann, Martina; Meerpohl, Joerg; Meyer, Heidi; Mertens, Thomas; Michaelis, Kai; Schmid-Küpke, Nora; Scholz, Stefan; Terhardt, Martin; Treskova-Schwarzbach, Marina; Überla, Klaus; van der Sande, Marianne; Waize, Maria; Wichmann, Ole; Wicker, Sabine; Weidermann, Ursula; Wild, Verina; von Kries, Rüdiger: Beschluss der STIKO zur 4. Aktualisierung der COVID-19-Impfempfehlung. Epid Bull 2021, 16:3-78.
Cantuaria ML, Blanes-Vidal V: Self-reported data in environmental health studies: mail vs. web-based surveys. BMC medical research methodology 2019, 19(1):238-238.
Fitzgerald D, Hockey R, Jones M, Mishra G, Waller M, Dobson A: Use of Online or Paper Surveys by Australian Women: Longitudinal Study of Users, Devices, and Cohort Retention. J Med Internet Res 2019, 21(3):e10672.
Cornesse C, Felderer B, Fikel M, Krieger U, Blom AG: Recruiting a Probability-Based Online Panel via Postal Mail: Experimental Evidence. Social Science Computer Review 2021:08944393211006059.
Vygen-Bonnet S, Koch J, Bogdan C, Harder T, Heininger U, Kling K, Littmann M, Meerpohl J, Meyer H, Mertens T et al: Beschluss und Wissenschaftliche Begründung der Ständigen Impfkommission (STIKO) für die COVID-19-Impfempfehlung. Epid Bull 2021;2:3-63 2020, 2:3-63.
Vygen-Bonnet SK, Judith; Berner, Reinhard; Bogdan, Christian; Harder, Thomas; Heininger, Ulrich; Hummers, Eva; Littmann, Martina; Meerpohl, Joerg; Mertens, Thomas; Meyer, Heidi; Neufeind, Julia; Schmid-Küpke, Nora; Scholz, Stefan; Terhardt, Martin; Überla, Klaus; van der Sande, Marianne; Waize, Maria; Wichmann, Ole; Wicker, Sabine; Widders, Gudrun; Wiedermann, Ursula; Wild, Verina; Zepp, Fred; von Kries, Rüdiger: Beschluss der STIKO zur 6. Aktualisierung der COVID-19-Impfempfehlung. Epid Bull 2021, 23:3-32.
Vygen-Bonnet SK, Judith; Bogdan, Christian; Harder, Thomas; Heininger, Ulrich; Kling, Kerstin; Littmann, Martina; Meerpohl, Joerg; Mertens, Thomas; Schmid-Küpke, Nora; Scholz, Stefan; Terhardt, Martin; Treskova-Schwarzbach, Marina; Überla, Klaus; van der Sande, Marianne; Wichmann, Ole; Wicker, Sabine; Wiedermann, Ursula; Wild, Verina; von Kries, Rüdiger: Beschluss der STIKO zur 2. Aktualisierung der COVID-19-Impfempfehlung und die dazugehörige wissenschaftliche Begründung. Epid Bull 2021, 5:3-79.
Vygen-Bonnet SK, Judith; Berner, Reinhard; Bogdan, Christian; Harder, Thomas; Heininger, Ulrich; Kling, Kerstin; Littmann, Martina; Meerpohl, Joerg; Meyer, Heidi; Mertens, Thomas; Schmid-Küpke, Nora; Scholz, Stefan; Terhardt, Martin; Treskova-Schwarzbach, Marina; Überla, Klaus; van der Sande, Marianne; Wichmann, Ole; Wicker, Sabine; Wiedermann, Ursula; Wild, Verina; von Kries, Rüdiger: Beschluss der STIKO zur 3. AKtualisierung der COVID-19-Impfempfehlung und die dazugehörige wissenschaftliche Begründung. Epid Bull 2021, 12:3-15.
RKI Impf-Archive [https://github.com/ard-data/2020-rki-impf-archive/blob/master/data/1_parsed/impfquotenmonitoring-2021-04-17-07-40-04.json]
Shaw RH, Stuart A, Greenland M, Liu X, Nguyen Van-Tam JS, Snape MD: Heterologous prime-boost COVID-19 vaccination: initial reactogenicity data. Lancet 2021, 397(10289):2043-2046.
Borobia AM, Carcas AJ, Pérez-Olmeda M, Castaño L, Bertran MJ, García-Pérez J, Campins M, Portolés A, González-Pérez M, García Morales MT et al: Immunogenicity and reactogenicity of BNT162b2 booster in ChAdOx1-S-primed participants (CombiVacS): a multicentre, open-label, randomised, controlled, phase 2 trial. Lancet 2021, 398(10295):121-130.
Schmidt T, Klemis V, Schub D, Mihm J, Hielscher F, Marx S, Abu-Omar A, Schneitler S, Becker SL, Gärtner BC et al: Immunogenicity and reactogenicity of a heterologous COVID-19 prime-boost vaccination compared with homologous vaccine regimens. MedRxiv 2021061321258859 [Preprint] June 15, 2021 [cited Aug 17, 2021] https://doi.org/10.1101/2021.06.13.21258859

04SupplementaryMaterial.docx

PDF

Reviews received at journal
28 Jan, 2022
Reviewers invited by journal
26 Oct, 2021
Editor assigned by journal
25 Oct, 2021
Submission checks completed at journal
24 Oct, 2021
Editor invited by journal
24 Oct, 2021
First submitted to journal
21 Oct, 2021

You are reading this latest preprint version

Active Surveillance of Adverse Events After COVID-19 and Other Vaccinations: a Feasibility Study as Part of the CoVaKo Project

Status:

Version 1

Abstract

Figures

Key Messages Regarding Feasibility

Introduction

Methods

Study design and procedure

Qualitative evaluation of recruiting materials and online survey

Quantitative evaluation of the online survey

Qualitative evaluation of the practicability of the implementation

Data analysis

Results

Qualitative evaluation of recruiting materials and online survey

Quantitative evaluation of the survey and feasibility

Qualitative Evaluation of the feasibility

Discussion

Limitations

Conclusion

Abbreviations

Declarations

Ethics approval and consent to participate

Consent for publication

Availability of data and materials

Competing interests

Funding

Authors' contributions

Acknowledgements

References

Supplementary Files

Status:

Version 1