2.1 Basic information of trainees
The trainees were aged 36.91±6.74 years. Their basic information such as gender, work experience, educational background and titles are listed in Table 1.
2.2 Reliability and validity test
Consistency reliability is considered reliable when Cronbach-α coefficient is >0.7[22]. In the present study, the coefficient of the scale was >0.8, indicating good internal consistency reliability (Table 2). The Cronbach-α coefficient was not calculated for the teaching effect since it only contained one item.
Questionnaires were reviewed by several pharmacy experts such as pharmacy education experts and directors of pharmacy department of grade-3 hospitals in Shanxi Province. Of these, eight experts were asked to score each item and evaluate the relevance of the item to its dimension. There were four levels for each item, from weaker to stronger correlation. The ratio of items scored 3 or 4 points by all experts to the total number of items (S-CVI) reflected the content validity of the scale. In the present study, the S-CVI of the scale was 0.91, which could be considered good content validity. The structural validity of the questionnaire was measured using KMO and Bartlett sphere test values. Statistical analyses showed that the KMO was 905, which was >0.8, and the chi-square value by Bartlett sphere test was 10169.46 (p<0.001), which indicated good validity, and prompted the feasibility of factor analysis.
2.3 Satisfaction analysis
2.3.1 Overall satisfaction From the personal satisfaction data of the respondents, 135 trainees had a satisfaction score of ≥4 points, accounting for 90%, 13 trainees indicated dissatisfaction (<3 points), accounting for 8.7%, and two trainees shared basic satisfaction (3 points), accounting for 1.3 %. The mean score was 4.51, which was higher than the theoretical score of satisfaction (4 points), and indicated that trainees were satisfied with the training.
2.3.2 Item satisfaction The composition ratio and average value of satisfaction of each item were analyzed. The results are shown in Table 3. The trainees showed different satisfaction levels for various aspects of the training. They were most satisfied with the services of the staffs and professional skills of the lecturers, and were least satisfied with the amount of training assignment and one-day course for each training.
2.3.3 Influence of educational background of pharmacist on satisfaction Trainees were divided into subgroups according to their educational background. The analysis showed that the influence of educational background on D2, D10, D12 and D13 was statistically significant (p<0.05). The trainees below undergraduate background showed low satisfaction with one-day per training, and were dissatisfied with the short course of 33 classes and 1.65 hours for each class. They recommended that each class should be longer than 3.13 hours. Meanwhile, the trainees with undergraduate background showed low satisfaction with the assignment and mode of submitting assignment. The higher the trainees’ educational background, the higher was their satisfaction with the professional skills of the lecturers (Table 4).
2.3.4 Factor analysis for training satisfaction In order to further explore the potential relationship among the 13 items except the overall satisfaction, the satisfaction evaluation data were subjected to factor analysis. After oblique rotation (Tables 5 and 6), the cumulative variance contribution of each factor was 73.78% (factors corresponding to eigenvalue >1 were included), and the commonality of the 13 variables over the three factors exceeded 0.5, which indicated that these three potential factors better summarized the meaning of the 13 items, that is, the 13 indicators actually measured the three dimensions reflecting the training satisfaction.
As shown in Table 5, each indicator shows a high factor load on the corresponding factor. Factor 1 is mainly demonstrated by D1, D2, D3, D4 and D5, which reflects the organization and effectiveness of the training. Factor 2 is mainly demonstrated by D6, D7, D9, D11 and D13, which reflects the teaching mode. Factor 3 includes D8, D10 and D12, which reflects the solidification and assessment of knowledge gained. These results indicated that the training can be mainly focused on the above-mentioned three factors to improve the overall satisfaction, in order to improve the quality of training.
2.4 Assessment results
A total of 20 courses were included in the training, all of which had a total score of 100 points. The average score of all courses was 89.21±2.62, of which essential points of prescription-checking for cerebrovascular diseases scored highest (average 93.63 points)( Table 7), and essential points of prescription-checking for antibacterial drugs (average 77.63 points) scored lowest.
2.5 Self-evaluation of prescription-checking competency At the time of enrollment, the trainees were asked whether they were qualified for prescription-checking, 90% of trainees believed they were not qualified, and self-evaluated a score below 60 points. Meanwhile, after the training, the trainees self-evaluated an average score of 70.21 points, and 73.33% of them believed they were qualified for prescription-checking (Figure 1).
Multivariate regression was performed by considering the three potential factors in the satisfaction factor analysis as independent variables, and the self-evaluation of prescription-checking competency as dependent variables, which was statistically significant (F=2.715,p=0.047), with the equation y=70.267+3.736X1-1.055X2+2.105X3. This result indicated that the prescription-checking training should focus on organization and development of the training, as well as consolidation and assessment of knowledge.
2.6 Abilities that need improvement for prescription-checking Notably, 48% of the trainees felt a need to improve their ability to be competent in prescription-checking, especially to improve clinical expertise and practical capability, as well as communication skills and ability to search English literature, etc.
2.7 Demand for training knowledge Analysis of demand for training knowledge showed that trainees had highest demand for clinical expertise, and lowest demand for pharmacy basics (Table 8). Relevant analysis of needs for each category with the score of corresponding item showed that the correlation of subject 1-4 (prescription-checking for drugs that require skin test, r=0.163,p=0.047) with subject 1-5 (prescription-checking for off-label drugs, r=-0.161,p=0.049) was statistically significant, which indicates that trainees with a higher need for training in these two categories should strengthen their knowledge in these two categories.
2.7.1 Evaluation of offered courses Trainees were asked to score the 20 offered courses according to their perceived importance of the courses. The results are listed in Table 7. The correlation analysis of the importance of courses with the trainees’ scores revealed that the course 1-6 (i.e. tools and application of literature search) was statistically significant (r=0.026,χ2=0.184), which suggested that underestimating the importance of the course led to a low score in this course.
Work experience affected evaluation of the importance of the courses. All 10 courses, including prescription-checking related regulations, basic elements, essential points of prescription-checking for high-alert drugs, drugs requiring skin test, off-label drugs, common pediatric drugs, anti-cancer drugs, antibacterial drugs, chronic senile drugs and drugs for arrhythmia were greatly affected by work experience, while the other courses did not show statistical significance (Table 9).
2.7.2 Demand of new courses In addition to the above-mentioned courses, 38.67% of the trainees believed the following knowledge needs to be added in the training: perioperative administration, rheumatism and immunology, nephropathy, microorganism, respiratory disease, liver disease, narcotic drugs, psychoactive drugs, estrogen, oculopathy, dermatologic disease, enteral and parenteral nutrition, gynecological drugs, mental disease, analgesics, ancillary drugs and other drugs for specialized diseases.
2.8 Preferences for teaching organization The trainees favored face-to-face training, which showed a very high average score. Notably, 94.66% of the trainees preferred this mode of teaching, and 63.33% of the trainees liked this teaching mode very much (Table 10).
2.9 Needs for trainers Trainees felt the greatest need for the trainer’s professional skills and believed it was the most important, followed by teaching attitudes, methods or means, organization, teaching style and appearance (Table 11).