Participants
In total, 65 HCPs consented to participate and completed the initial survey. Table 1 shows the demographics of the sample. A total of 60% (n=39) of respondents were from the conventional healthcare community, 33% (n=21) were from the integrative or naturopathic community, and 7% (n=5) were integrative oncology researchers. Age distribution was diverse, with most respondents in the 40 to 49-years group. Only 18 respondents completed the follow-up survey after accessing KNOW, with profession and age distributions similar to that of the larger initial group surveyed at baseline.
Table 1
Sample Demographics at Baseline and Follow-up
|
Baseline (n=65)
|
Follow-up
(n=18)
|
Profession
|
|
|
Medical oncologist
|
22 (33.8)
|
6 (33.3)
|
Naturopathic physician
|
15 (23.1)
|
4 (22.2)
|
Nurse practitioner
|
6 (9.2)
|
1 (5.6)
|
Integrative medical doctor
|
5 (7.7)
|
2 (11.1)
|
Integrative oncology researcher
|
5 (7.7)
|
2 (11.1)
|
Radiation oncologist
|
3 (4.6)
|
-
|
Registered nurse
|
3 (4.6)
|
1 (5.6)
|
Pharmacist
|
2 (3.1)
|
1 (5.6)
|
Physician assistant
|
2 (3.1)
|
1 (5.6)
|
Oncology fellow
|
1 (1.5)
|
-
|
Other
|
1 (1.5)
|
-
|
Age Group (Years)
|
|
|
20-29
|
3 (4.6)
|
1 (5.6)
|
30-39
|
10 (15.4)
|
3 (16.7)
|
40-49
|
26 (40.0)
|
5 (27.8)
|
50-59
|
17 (26.2)
|
6 (33.3)
|
60-69
|
7 (10.8)
|
3 (16.7)
|
70+
|
2 (3.1)
|
1 (5.6)
|
Obtaining Information on Natural Health Products
The frequency of accessing information on NHPs varied between conventional and integrative HCPs (Table 2). Amongst conventional HCPs, 44.7% (n=17) reported gathering information daily or weekly, while the other 55.3% reported doing so monthly or less than monthly. Amongst integrative HCPs, 95.2% (n=20) reported seeking information daily or weekly, while only one person (4.8%) reported doing so monthly.
Table 2
Frequency of Gathering Information about NHPs at Baseline
Baseline
|
Conventional HCPs (%)
n=38*
|
Integrative/
CAM HCPs (%)
n=21
|
Researchers (%)
n=5
|
Daily
|
5 (13.1)
|
13 (61.9)
|
-
|
Weekly
|
12 (31.6)
|
7 (33.3)
|
-
|
Monthly
|
9 (23.7)
|
1 (4.8)
|
2 (40.0)
|
Less than monthly
|
12 (31.6)
|
-
|
3 (60.0)
|
*Conventional provider missing n=1 |
Abbreviations: CAM, complementary and alternative medicine; HCPs, health care providers; NHPs, natural health products.
Table 3 shows the ways through which HCPs reported accessing information on NHPs. A total of 86.2% (n=56) of respondents stated they used a website to obtain information, with 78.5% (n=51) reporting they specifically used PubMed to search for information. Other top websites included Memorial Sloan Kettering Cancer Center, Up to Date, the National Cancer Institute, Natural Medicines Research Collaboration, and Beyond Conventional Cancer Therapies (see Supplementary Table 1). Amongst the integrative HCP community, PubMed (95.2% integrative vs. 66.7% conventional) and conferences (71.4% integrative vs. 43.6% conventional) were more frequently used compared to within the conventional HCP community. Websites not including PubMed, in general, saw more usage in the conventional HCP community compared to the integrative HCP community (94.9% conventional vs. 76.2% integrative). All other methods were used approximately the same between groups.
Table 4 shows the ways HCPs preferred to gather information on NHPs. Websites were the most preferred source (81.5%; n = 53). There were, however, large differences in actual versus preferred means of obtaining information with regards to: PubMed (78.5% actual vs. 47.7%
Table 3: Frequency of Actual NHP Information Resources Used
Resources Used
|
Conventional Providers (%)
(n=39)
|
Integrative/CAM
HCPs (%)
(n=21)
|
Research Staff (%)
(n=5)
|
TOTAL (%)
(n=65)
|
Websites
|
37 (94.9)
|
16 (76.2)
|
3 (60.0)
|
56 (86.2)
|
PubMed Search
|
26 (66.7)
|
20 (95.2)
|
5 (100.0)
|
51 (78.5)
|
Conferences
|
17 (43.6)
|
15 (71.4)
|
2 (40.0)
|
34 (52.3)
|
Webinars or Podcasts
|
16 (41.0)
|
13 (61.9)
|
1 (20.0)
|
30 (46.2)
|
Google
|
15 (38.5)
|
9 (42.9)
|
3 (60.0)
|
27 (41.5)
|
In-House Expert
|
22 (56.4)
|
8 (38.1)
|
1 (20.0)
|
21 (32.3)
|
Email Updates
|
9 (23.1)
|
10 (47.6)
|
-
|
19 (29.2)
|
Smartphone Apps
|
6 (15.4)
|
3 (14.3)
|
1 (20.0)
|
10 (15.4)
|
E-Textbooks
|
3 (7.7)
|
6 (28.6)
|
-
|
9 (13.8)
|
Abbreviations: CAM, complementary and alternative medicine; NHP, natural health product preferred), conferences (52.3% actual vs. 16.9% preferred) and Google (41.5% actual vs. 7.7% preferred). These discrepant results may indicate a reliance on non-preferred sources of information (i.e., PubMed, conferences, Google), whereas HCPs would prefer websites for information about NHPs.
Table 4: Frequency of Preferred NHP Information Resources
Preferred Resources
|
Conventional
Providers (%)
(n = 39)
|
Integrative/CAM
HCPs (%)
(n = 21)
|
Research Staff (%)
(n = 5)
|
TOTAL (%)
(n = 65)
|
Websites
|
34 (87.2)
|
17 (81.0)
|
2 (40.0)
|
53 (81.5)
|
Email Updates
|
20 (51.3)
|
14 (66.7)
|
3 (60.0)
|
37 (56.9)
|
Webinars/Podcasts
|
14 (35.9)
|
16 (76.2)
|
5 (100.0)
|
35 (53.8)
|
In-House Expert
|
22 (56.4)
|
8 (38.1)
|
2 (40.0)
|
32 (49.2)
|
PubMed Search
|
23 (59.0)
|
8 (38.1)
|
-
|
31 (47.7)
|
Smartphone Apps
|
15 (38.5)
|
2 (9.5)
|
-
|
17 (26.2)
|
Conferences
|
5 (12.8)
|
5 (23.8)
|
1 (20.0)
|
11 (16.9)
|
E-Textbooks
|
5 (12.8)
|
3 (14.3)
|
-
|
8 (12.3)
|
Google
|
2 (5.1)
|
3 (14.3)
|
-
|
5 (7.7)
|
Abbreviation: CAM, complementary and alternative medicine; NHP, natural health product
Barriers to Accessing Information on NHPs
HCPs were asked to rate the barriers they experienced in obtaining information about NHPs on a scale of 0-5, where 0 is no barrier and 5 is a strong barrier. The strongest barriers according to mean intensity level were: time limitations (3.4/5), accessibility of data at point-of-care (3.1/5), credibility of sources (3.0/5), and lack of in-house experts to consult (2.2/5). Table 5 shows the full data on these four barriers. Other individual barriers identified included; lack of evidence, lack of detailed information on some products, cost and the organization and searchability of data.
Table 5: Barriers to Accessing NHP Information
Rating
|
Time (%)
|
Credibility
of Sources (%)
|
Accessibility
at POC
|
Lack of in-house
expert
|
0 (No Barrier)
|
2 (3.1)
|
5 (7.7)
|
3 (4.6)
|
20 (30.8)
|
1
|
5 (7.7)
|
5 (7.7)
|
7 (10.8)
|
7 (10.8)
|
2
|
6 (9.2)
|
7 (10.8)
|
8 (12.3)
|
9 (13.8)
|
3
|
20 (30.8)
|
27 (41.5)
|
20 (30.8)
|
8 (12.3)
|
4
|
16 (24.6)
|
12 (18.5)
|
19 (29.2)
|
9 (13.8)
|
5 (Strong Barrier)
|
16 (24.6)
|
9 (13.8)
|
8 (12.3)
|
12 (18.5)
|
Mean
|
3.4/5
|
3.0/5
|
3.1/5
|
2.2/5
|
n = 65. Abbreviation: POC, point-of-care; NHP, natural health product
Impact of Accessing KNOW
Of the 18 post-survey respondents, 50% (n=9) stated that accessing the KNOW platform changed their clinical practice. Of the nine HCPs who felt their practice had changed, 77.8% (n=7) said that accessing the website made their clinical decision more evidence based, 44% (n=4) felt more confident answering questions related to natural products, 44.4% (n=4) had a greater understanding about herb/supplement-drug interactions, and 44.4% (n=4) felt more comfortable recommending natural products they had not previously recommended.
Recommended Improvements to KNOW
Recommendations for improvements to the KNOW platform fell into several categories, the most common being technical (i.e., search engine optimization, user interface and development of a smartphone app), integration into other resources (i.e., existing web-based health resources, linking to other internet-based resources), and expansion of scope (i.e., new topics, herb-drug interactions). Three-quarters of HCPs noted they would like to “add clinical tips” to the KNOW website and 38% suggested the KNOW developers “create an app”. Finally, 12.5% wanted additional information, such as NHP dosing and interaction with drugs (with links to supporting studies), and the mechanism of action of select NHPs.
With regards to the format in which studies are summarized, over 50% of respondents said they would be happy with a simple language summary of each research study with a hyperlink link to the study online. However, in the KNOW platform, features like full extractions of research studies that include details on population, intervention, comparator and outcome (PICO) as well as the Cochrane quality/risk assessment tool11 were rated as important or very important by 75% of respondents.
Satisfaction with KNOW
The majority of follow-up survey respondents (88.9%; n = 16) said they would recommend KNOW to a colleague or to their professional organization. Participants noted that the website was practical, helped save time, was comprehensive, and that it helped fill an unmet need as a resource for evidence-based integrative oncology recommendations. One respondent noted they did not think that it was more useful than PubMed. All qualitative feedback can be found in the Supplementary Material 3.