In addition to 25 dissertations, other pharmacoeconomic evaluation literatures on TCM were published in 172 domestic and foreign medical journals, among which 106 were Chinese core journals criterion, 4 were journals of Science Citation Index (SCI) and 133 other core journals. China Pharmacy (36 articles), China Journal of Pharmaceutical Economics (14 articles), Evaluation and Analysis of Drug-Use in Hospitals of China (13 articles), China Practical Medicine (12 articles), China Pharmaceuticals (12 articles), Strait Pharmaceutical Journal (12 articles), China Health Care Nutrition(10 articles), Chinese Journal of Pharmacoepidemiology (8 articles), Journal of Medical Theory and Practice (6 articles), Guide of China Medicine (6 articles) and Journal of Clinical Rational Drug Use (6 articles) published more articles in Chinese. Journals included in SCI published the articles in English were Journal of Alternative and Complementary Medicine (2 articles), Evidence Based Complement Alternative Medicine (2 articles), Trials (1 articles) and Chinese Journal of Integrative Medicine (1 articles).
First authors and their affiliations
More than 81.16% of the pharmacoeconomic evaluation literatures on TCM were carried out by the first author from medical institutions, and the rest literatures’ first authors came from universities, research institutions or enterprises. The distribution of the first authors from medical institutions was dispersed. the first authors from universities was more concentrated in Beijing University of Chinese Medicine published 7 articles, Guangxi Medical University and China Pharmaceutical University published 6 articles respectively.
Funding
There were 364 literatures without indicating the source of funds (84.65%), and only 66 (15.35%) were marked with funding support, which included 9 state projects, 22 provincial and ministerial funded projects, 22 municipal funded projects, 4 University funding projects, 4 funding projects of the authors’ units, 3 project supported by the foundation, and 2 Enterprise funded projects.
Disease
According to the International Classification of Diseases (ICD-10), the 430 published literatures ranged over 148 kinds of diseases’ treatments, among which the top five kinds of disease included nervous system, cardiovascular system, respiratory system, gynecology and digestive system,as noted at Figure 3.
Medicines for treatment
The medicines treatment involved in the studies were complex and diverse, which included Chinese medicine v.s. Chinese medicine (164 studies), Chinese medicine v.s. Western Medicine (170 studies); the comparison of combined drug schemes includes Chinese medicine plus western medicine v.s. Western Medicine (76 studies), Chinese medircine plus western medicine v.s. Chinese medicine plus western medicine (20 studies), and the evaluation of Chinese medicine prescriptions (15 studies), Chinese medicine plus western medicine v.s. Chinese medicine (3 studies).
There were 262 kinds of Chinese patent medicines and 70 kinds of traditional Chinese medicine prescriptions (such as prescription, pieces decoction, powder, extraction, tincture, pills) in the studies. In 433 studies, the most Chinese patent medicines studied were Xuesaitong Tablet (20 studies), Fufang Danshen Tablet / Dropping Pill (17 studies), Shuxuening Injection ( 16 studies), Danhong Injection (15 studies), Qingkailing Injection (15 studies), Shuxuetong Injection (13 studies), Xiyanping Injection ( 13 studies), Fufang Danshen Injection (12 studies), Danshen Chuanxiongqin Injection (12 studies), Ciwujia Injection (11 studies), Shenmai Injection (10 studies), Xueshuantong Injection (10 studies), Tanreqing Injection ( 9 studies), Yinxingdamo Injection ( 9 studies), Yanhuning Injection ( 9 studies), Aidi injection ( 8 studies), Reduning Injection (8 studies), Rupixiao tablet (12 studies).
study design and comparators
Study design used in the 433 studies included randomized clinical intervention (235 studies), retrospective study (162 studies), prospective study (12 studies) and decision tree model (16 studies). In addition to 12 studies without marking the research time horizon, and 13 studies that got parameters through literature or model simulation, other studies’ research time horizon ranged from half a day to two years (Table 1).
Table 1. Research Time Horizon
research time
|
Numbers of study
|
Percentage
|
Less than 14d
|
158
|
41.62%
|
15d to 30d
|
100
|
26.18%
|
1m to 3m
|
99
|
25.92%
|
4m to 6m
|
11
|
2.88%
|
7m to 12m
|
9
|
2.36%
|
12m to 24m
|
4
|
1.04%
|
Note: “d” represents day, “m” represents month
Nearly half studies compared between two interventions; other half compared three and four interventions; a few other studies compared more than five interventions.186 studies did not describe the reason for the comparators.
Sample size and perspective
Expect 21 studies extracting parameters from other literatures, the sample size of other studies ranged from 38 to 2820 subjects, which was shown in Figure 4. The age of subjects was from 0 to 90 years old. 376 (86.84%) studies did not clearly define the perspective of their pharmacoeconomic evaluations. 24 of the remaining studies were from the perspective of medical institutions, 13 from the patients, and 11 from the whole society, 11 from the payers, 7 from the patients, and 2 from health system.
Evaluation techniques
More than 82% of the studies chose cost-effectiveness analysis (CEA), and the others study used at least one method of cost analysis, such as Cost Minimization Analysis (CMA), Cost Benefit Analysis (CBA), and Cost Effectiveness Analysis (CUA). In the 28 studies, the above methods were used in combination with the Decision Tree (DT) model for short-term predictions or Markov model for long-term predictions (Table 2).
Table 2 Evaluation Techniques Details
Evaluation Methods
|
Numbers of Studies
|
Percentage
|
CEA
|
354
|
81.76%
|
CEA+DT
|
18
|
4.16%
|
CMA
|
16
|
3.70%
|
CEA+CUA
|
15
|
3.46%
|
CEA+CMA
|
10
|
2.31%
|
CBA
|
7
|
1.62%
|
CUA
|
3
|
0.67%
|
CMA+DT
|
3
|
0.69%
|
CUA+Markov model
|
3
|
0.69%
|
CEA+Markov model
|
3
|
0.69%
|
CUA+DT
|
1
|
0.23%
|
Cost scope and identification
Costs of those pharmacoeconomic evaluation studies could be generally classified as direct cost and indirect cost. 356 studies (83.22%) integrated direct cost into the studies; 50 studies (11.55%) integrated direct cost and indirect cost into the studies; 27 studies (6.24%) did not clearly define their cost scope.
Table 3. Cost Identification
Cost
|
Numbers of Studies
|
Percentage
|
direct cost
|
356
|
82.22%
|
direct cost + indirect cost
|
50
|
11.55%
|
Not clearly define
|
27
|
6.24%
|
Direct costs in the studies and frequency of respective occurrence were drug fee (384 studies), examination fee (157 studies), treatment fee (78 studies), hospitalization fee (42 studies), nursing fee (42 studies), bed fee (41 studies), registration fee (31 studies), dispensing fee (27 studies), adverse reaction treatment fee (23 studies), material fee (16 studies), meal fee (11 studies), surgery fee (9 studies), disposal cost (6 studies), consultation fee (1 studies), blood transfusion fee (1 studies), instrument loss (1 studies) and other expenses (54 studies). Indirect costs in the studies and frequency of respective occurrence were time cost (22 studies), compensation (fee) for one's absence from work (18 studies), labor loss (3 studies), and death cost (1 studies).
Health outcomes
Among 433 pharmacoeconomic evaluation studies, 225 studies used single end-point, 156 studies used double end-points, 26 studies used three end-points, and the other 26 studies used four or more end-points at the same time.
90.76% (393) studies used the final end-points as the health outcomes, which specifically included clinical efficiency/improvement rate (263 times), adverse reactions rate (132 times), efficiency rate of TCM syndromes (47 times), recurrence rate (11 times), and disease or drug withdrawal rate (16 times), death rate (5 times), Quality-adjusted Life Year (18 times). 14.09% (61) studies used the intermediate end-points as the health outcomes, which included score/index scale (41 times), biochemical indicators (22 times), physiological indices (9 times), and imaging indices (9 times). 11 studies (2.5%) used health utility as the health outcomes. One studies used net benefit as the health outcomes.
Uncertainty analysis and generalizability
66.51% the studies (288) carried out uncertainty analysis, and the main uncertainty analysis variables were shown in Table 4. Uncertainty analysis of 219 (76.04%) studies were assessed by using one-way sensitivity analysis with reducing drug prices by 10% - 20%. 69 (23.96%) studies used multi-way sensitivity analysis for uncertainty.
Table 4. Uncertainty analysis variables of the studies
Uncertainty analysis
|
studies
|
percentage
|
drug prices
|
190
|
65.97%
|
drug prices and other cost (such as examination fee, examination fee, bed fee, treatment fee, nursing fee, compensation (fee) for one's absence from work etc.)
|
67
|
23.26%
|
drug prices and health outcome (such as efficiency rate etc.)
|
19
|
6.06%
|
other cost (such as examination fee, examination fee, bed fee, treatment fee, nursing fee, compensation for one's absence from work etc.)
|
7
|
2.43%
|
Other variables (such as course of medication, discount rate)
|
5
|
1.74%
|
101 articles (23.33%) discussed the limitations of the results, and 12 articles discussed the generalizability of the results. Although 66 studies took children under 18 as the sample, none of them made mention of the ethical issues of the study.
Quality assessment of pharmacoeconomic evaluation literatures on TCM
In this study, we used guideline for authors and peer reviewers of economic submissions to the BMJ, developed by Drummond M.F. and Jefferson T.O. to evaluate the quality of the literature. This guideline set up 35 evaluation items with 10 sections under three headings including study design, data collection, and analysis and interpretation of results. In this study, the following scoring rules were set up.
If the evaluation result of each item was marked as "yes", 1 point would be scored. If the evaluation result is marked as "no" or "unclear", 0 point would be scored.
Each study was scored based on the proportion of items it should have met according to the guideline of BMJ, the maximum score of which was 1. The overall quality score of a pharmacoeconomics evaluation researches on TCM was the average score of each study. If the score is greater than 0.90, it indicated that the literature quality was high [6]. And we also calculated the score of every item in guideline of BMJ. The specific quality evaluation scoring results were shown in Table 6.
Table 6 Quality Evaluation Scoring of Pharmacoeconomic Research on TCM
Evaluation items
|
1/study
|
0 /study
|
Average score
|
Study design
|
Study Question
|
The research question was stated
|
433
|
0
|
1
|
The economic importance of the research question was stated
|
313
|
120
|
0.723
|
The viewpoint(s) of the analysis were clearly stated and justified
|
62
|
371
|
0.143
|
Selection of Alternatives
|
The rationale for choosing the alternative programmes or interventions compared was stated
|
243
|
190
|
0.561
|
The alternatives being compared were clearly described
|
391
|
42
|
0.903
|
Form of Evaluation
|
The form of economic evaluation used was stated
|
433
|
0
|
1
|
The choice of form of economic evaluation was justified in relation to the questions addressed
|
433
|
0
|
1
|
Data collection
|
Effectiveness Data
|
The source(s) of effectiveness estimates used were stated
|
220
|
213
|
0.508
|
Details of the design and results of effectiveness study were given (if based on a single study)
|
260
|
58
|
0.818
|
Details of the method of synthesis or meta-analysis of estimates were given (if based on an overview of a number of effectiveness studies)
|
22
|
3
|
0.880
|
Benefit Measurement and Valuation
|
The primary outcome measure(s) for the economic evaluation were clearly stated
|
433
|
0
|
1
|
Methods to value health states and other benefits were stated
|
1
|
432
|
0.002
|
Details of the subjects from whom valuations were obtained were given
|
397
|
36
|
0.917
|
Costing
|
Productivity changes (if included) were reported separately
|
44
|
389
|
0.102
|
The relevance of productivity changes to the study question was discussed
|
57
|
376
|
0.132
|
Quantities of resources were reported separately from their unit costs
|
2
|
431
|
0.005
|
Methods for the estimation of quantities and unit costs were described
|
408
|
25
|
0.942
|
Currency and price data were recorded
|
422
|
11
|
0.975
|
Details of currency of price adjustments for inflation or currency conversion were given
|
0
|
433
|
0
|
Modelling
|
Details of any model used were given
|
24
|
4
|
0.857
|
The choice of model used and the key parameters on which it was based were justified
|
26
|
2
|
0.929
|
Analysis and interpretation of results
|
Adjustments for Timing of Costs and Benefits
|
Time horizon of costs and benefits was stated
|
432
|
1
|
0.998
|
The discount rate(s) was stated
|
10
|
423
|
0.023
|
The choice of rate(s) was justified
|
10
|
423
|
0.023
|
An explanation is given if costs or benefits were not discounted
|
18
|
415
|
0.042
|
Allowance for Uncertainty
|
Details of statistical tests and confidence intervals were given for stochastic data
|
28
|
405
|
0.065
|
The approach to sensitivity analysis was given
|
288
|
145
|
0.665
|
The choice of variables for sensitivity analysis was justified
|
288
|
145
|
0.665
|
The ranges over which the variables were varied are stated
|
287
|
146
|
0.663
|
Relevant alternatives were compared
|
433
|
0
|
1
|
Presentation of Results
|
Incremental analysis was reported
|
273
|
53
|
0.837
|
Major outcomes are presented in a dissaggregated as well as aggregated form
|
433
|
0
|
1
|
The answer to the study question was given
|
433
|
0
|
1
|
Conclusions followed from the data reported
|
433
|
0
|
1
|
Conclusions were accompanied by the appropriate caveats
|
83
|
350
|
0.192
|
The results showed that the overall quality score of 433 pharmacoeconomics studies on TCM was 0.62 according to the evaluation standard of BMJ guidelines. The highest mark was 0.85 and the lowest mark was 0.38. Scores of majority studies were concentrated in 0.5-0.7. The distribution was showed in Table 7 ranking according to marks.
Table 7. Distribution of score of pharmacoeconomics studies on TCM
Score
|
Number of studies
|
Percentage
|
0.3-0.4
|
1
|
0.23%
|
0.4-0.5
|
19
|
4.39%
|
0.5-0.6
|
147
|
33.95%
|
0.6-0.7
|
200
|
46.19%
|
0.7-0.8
|
62
|
14.32%
|
0.8-0.9
|
4
|
0.92%
|
Among them, items of “stating methods to value health states and other benefits”, “reporting quantities and their unit costs of resources separately”, “adjustment details of currency of prices for inflation or currency conversion”, “the choice of rate(s)”, “the discount rate(s)”, “an explanation without being discounted”, and “details of statistical tests and confidence intervals for stochastic data” scored below 0.1. Items of “perspective/viewpoints”, “productivity change reporting”, “Time horizon”, and “conclusions accompanied by the appropriate caveats” also scored low. And items on the rationale stating for choosing the alternative programmes or interventions compared, source(s) stating of effectiveness estimates did not score high.
When calculating separately, the average quality score of the 6 literatures in English was 0.73. The results showed better quality of pharmacoeconomics research literatures on TCM from SCI journals, especially in the items of research perspective and discounting. However, uncertainty analysis and productivity measurement of the study remained to be improved.