The current systematic review and meta-analysis focused on the level of evidence and impact MEN MR has on exercise capacity and performance. The methodology used to select MEN MR studies revealed that there is a low level of scientific evidence suggesting that a MEN MR does not significantly (SMD = 0.16; 95% CI: -0.07, 0.38; p = 0.13, Fig. 2) improve exercise performance from a group standpoint.
4.2 Menthol Mouth Rinse Effects on Capacity and Performance
The results from this meta-analysis demonstrate that MEN MR did not significantly improve exercise capacity and performance; however, improvements seemed to be greatest during endurance exercise. Despite most individual studies showing a significant improvement, the overall mean change was not significant. This is in contrast to the meta-analysis by Jeffries and Waldron (2) which reported that MEN significantly improved performance. However, it should be noted that the meta-analysis by Jeffries and Waldron (2) analyzed both included both internal and external application of MEN, and exhibited greater effects with application internally (Hedges’ g = 0.40, 95% CI 0.04 to 0.76, p = 0.03). Furthermore, while the present meta-analysis reported a SMD = 0.16, the meta-analysis of Jeffries and Waldron (2) reported a SMD = 0.33, a value more than 2 times greater than what was reported in the current review. This difference between the two meta-analyses may be due to number of studies included in the meta-analyses (current review, n = 10; Jeffries and Waldron (2), n = 13), methodological differences across investigations, as well as result from the inclusion of 5 studies in the present review that were not available in that of Jeffries and Waldron (2). From a methodological perspective, while the present review only included articles in which the comparator was either a control (no MR) or a placebo (non-caloric, water, or non-mint containing), the meta-analysis by Jeffries and Waldron (2) included all studies in which MEN was compared to anything without the containment of MEN (e.g. inclusive of carbohydrate content etc). Additionally, Jeffries and Waldron (2) included all published studies on MEN, inclusive of sedentary and active participants, whereas the present review used active participants only. Given that work by Foster et al. (29) and Hibbert et al. (30) suggests that current fitness levels and experience can impact the reliability of outcomes, one may conclude that the study inclusion criteria and participant population had influence over the strength of the results, possibly explaining the difference between the two reviews.
Our findings demonstrate that there was no relationship between MEN concentration, swilling duration, or mean environmental temperature during the tests. While no study has directly compared any of the aforementioned factors with menthol, we can postulate that the present results are in agreement with work by James et al. (31). To illustrate, published work by James et al. (31) reported that there was no dose-response effect of carbohydrate MR concentration of 7 and 14% maltodextrin on 1h cycling time trial performance (7%, 57.3 ± 4.5 mins; 14%, 57.4 ± 4.1 mins, p = 0.737). Similarly, while the present study observed no impact of swilling duration and performance improvement, in carbohydrate MR swilling duration work by Sinclair et al. (32) analyzing the difference between 5 and 10-sec during a 30-min self-selected time trial, was able to show that 10-sec of swilling was significantly more effective than 5-s (20.4 ± 2.3-km, vs. 19.2 ± 2.2-km; p < 0.01). While this is the only carbohydrate MR study which compared the differences in swilling duration, work by Stevens et al. (6) suggests that the same trend could be observed with MEN MR. In the study, Stevens et al. (6) compared ice-slurry ingestion and MEN MR during a running time trial. The authors observed no significant improvement with the ice-slurry ingestion but a positive effect with the MEN MR. Given that the ice-slurry ingestion and MEN MR would activate the same thermoreceptors (TRPM8) located in the oral cavity, this suggests that exposure time of the MEN MR may influence performance.
In addition, the present meta-analysis observed no relationship between environmental temperature and MEN MR relative to physiological performance. Given that limited MEN MR research has been done in thermoneutral conditions (< 22°C; n = 1 study (14)) with 3 primary outcomes (Table 1), it is hard to determine whether MEN MR is more beneficial in thermoneutral or hot environments. Although Best et al. (15) showed a significant improvement between MEN MR and the familiarization session, the comparison between the control and MEN MR was unclear. Moreover, it is important to note that the humidity was not reported and could have a significant impact on total body heat strain (33). Independent of the work done by Best et al. (15), the present review displayed environmental conditions between 30.0–40.2°C and 40–70 % RHwith 8 of the studies between ~ 30.0–35.0°C, and 1 at 40.0°C. As such, it is hard to determine the overall influence environmental conditions have on MEN MR given the paucity of research in the area, and the fact that most athletes and teams use MEN MR in hot and humid conditions.
4.3 Methodological Aspects
Certain aspects of the present review should be acknowledged. Firstly, we decided to only include original studies that used MEN MR and measured exercise capacity or performance. Although we tried to ensure homogeneity of the articles in this review, exercise modality was not accounted for and could have influenced the results. Secondly, given that anything “mint” or “menthol” flavoured stimulates the TRPM8 receptors, a “true” placebo is not attainable and could have impacted the results. Given that work by Saunders et al. (34) showed that belief in a productmay lead to positive improvements in exercise performance, this suggests that pre-trial preference could have impacted the results. Another factor that could have impacted outcomes is exercise protocol. In the present meta-analysis, protocols differed among each study which may describe the differences associated with MEN MR. We decided to include all modes of exercise given the relevance and applicability of supplementation in all types of activity (35); however, it is unclear as to whether MEN MR would have a greater effect between modes as the number of controlled studies on MEN MR across modes of exercise is limited.
Moreover, another methodological factor of the current review is that we only analyzed data from cross-over design studies. In some respects, the duration of time from one trial to the next differed among each study and may be considered as a confounding variable. In addition, no research has analyzed the washout period or whether certain nutrition strategies influence the beneficial effects of MEN MR. Although work by Best et al. (36) looked at thermal perception and the time course following a MEN MR, no work has been done on thermoreceptors and brain activity. Assuming the MEN MR effects are dependent on time, one may suggest that a washout period and control of habitual MEN uses (i.e. menthol toothpaste, chewing gum) may influence the magnitude of the effect of MEN MR. Also, since the number of included outcomes was relatively small, it is unclear whether enough statistical power was reached for each of the sub-analyses performed (V̇O2peak, n = 9; swilling duration, n = 15; MEN concentration, n = 14; number of swills, n = 12; type of control, n = 12; mean room temperature, n = 15).
4.4 Level and Quality of Evidence Reviewed for Publication Bias
Overall, the analysis indicated a high risk of bias as the majority of studies did not use a familiarization trial or double-blinding procedures when working with the MEN MR. While the studies by Mundel and Jones (12), Flood et al. (10), Gavel et al. (7), and Crosby et al. (16) used a subject single-blinded design, the researchers involved with the procedures were aware of the MR allocation and substance rinsed in each trial. Furthermore, based on the current meta-analysis, it must be acknowledged that no MEN MR study has disclosed whether researchers involved with data analysis were blinded to manipulation and the risk of detection bias. As such, given the absence of information regarding outcome assessments, future MEN MR research should take this into account as it could negatively affect the assessment of outcomes and detection bias (21).
Another factor that could contribute to the high risk of bias is the lack of “true” placebo (37). Given that studies did not describe how the purpose of the study was communicated to the participants, one could suggest that the lack of blinding could have impacted performance and be correlated with performance improvements. For example, in short-duration high-intensity cycling time-trial work by Mears et al. (38) investigating the effect of a semisolid breakfast containing carbohydrate verses a taste- and texture-matched placebo or water, it was shown that the performance was completed more quickly when subjects perceived that they had consumed breakfast. As such, it is hard to determine whether the improvement with MEN MR caused a true physiological change, or the improvement came from the participants knowing the purpose of the study. Future research should explore this speculation.
4.5 Future direction and research considerations
Based on the current evidence available, MEN MR seems to be most useful in endurance sport. The results of this meta-analysis demonstrate the need for more high-quality research on MEN MR to elucidate the true effect of MEN MR. Given that a high number of studies did not include a familiarization trial, were not double-blinded, and failed to include information regarding outcome assessments, future work should follow the framework of Betts et al. (2020) for Proper Reporting of Evidence in Sport and Exercise Nutrition Trials.
Furthermore, once methodological quality and study design have improved, other areas of future work includes the need to understand the mechanisms of action, to establish the dose (concentration)-response of MEN, single versus repeated dose effects on performance measures, the best timing of use of MEN in an endurance event (pre, during, later stages), the repeatability of the effect of MEN for a given exercise test and the effect across various endurance tests (i.e., steady-effort vs. stochastic in nature). and intra- and inter-individual variability as a function of MEN habituation, along with exploring the wash-out period needed. Moreover, although some research does exist (39), future work should also look at the efficacy of MEN MR in combination with other products.
4.6 Conclusions
In summary, using the present methodology to review randomized crossover design MEN MR studies using a placebo or control trial with the outcome being exercise performance or capacity, this meta-analysis provides evidence that a MEN MR does not generally improve performance across all exercise modalities and study designs. However, it should be noted that MEN appears unlikely to harm performance, and at best, may have a small positive influence during endurance exercise. Thus, athletes may wish to systematically test this product in training to determine its efficacy for them. As such, MEN MR should be taken with caution until further research elucidates the optimal conditions in which one might benefit from MEN MR.