The most important predictor of male reproductive success in the enclosures was urinary protein concentration, which is mainly composed of MUPs6. The intensity of HMH, a volatile male pheromone, was also correlated with male RS, and thus, the production of non-volatile and volatile pheromones both correlated with male RS. The second most important predictor of male RS was social status, and social status was associated with differences in the excretion of both urinary protein and VOCs. Therefore, the effects of pheromone production on RS could have been through direct male-male competition, female mate choice, or both. MUP excretion may have deterred rival males from entering dominant males' territories22, thereby reducing agonistic interactions and mate-competition. MUP excretion may have attracted females to males' territories, or increased female attraction and sexual receptivity by controlling the release of HMH and other pheromones that influence female reproductive physiology and behavior.
Our findings corroborate results from previous studies on social status in wild-derived mice living in seminatural conditions (reproductive success17 and pheromone expression24). Social status did not correlate with body mass, which also confirms results from a previous study in seminatural conditions on mice from this population24, but contrary to a result on group-housed laboratory strains29. Males that obtained a territory significantly increased urinary protein excretion within four weeks after release in the enclosures, whereas subordinate males did not show any changes in protein excretion over time. There were no differences in pheromone production between dominant and subordinate males before their release into the enclosures, and therefore, acquisition of social status influenced pheromone regulation, rather than vice versa. The increased protein excretion of dominant males was revealed only after controlling for urine concentration using creatinine levels (PC ratio), and social status had no effect on the total protein concentration. The rate of creatinine production is reportedly consistent for animals of similar body mass2, yet a significant drop in creatinine concentration in dominant males was found in the present study and in a study on domesticated male mice in social housing23. It is not known whether urinary creatinine is used as a signal of social status, and to our knowledge there are no studies on its olfactory detection. Low creatinine concentrations can indicate that dominant males excrete higher volumes of urine per day30.
Although we did not measure daily urine production, dominant males that upregulated the excretion of MUPs and VOCs may have also increased their urinary scent mark deposition in the enclosures. Indeed, previous studies found that dominant males produced more urine31 and scent marks compared to subordinates32; and male scent-marking is correlated with RS when females can select their mates33. We also investigated hepatic Mup20 gene expression of males, as high levels of MUP20 excretion have been reported for dominant males24, but found no correlations with social status or RS. This negative result is not definitive, however, because males were not sampled until 14 days after terminating the enclosure phase and differences in protein excretion between dominant and subordinate males have been found to disappear after removal from seminatural conditions (≤ 28 days24).
Social status also correlated with the intensity of VOCs in male urine, and analyses of the full MS-data were better at discerning dominants from subordinates than the candidate MS-data. This finding indicates that social status affected the expression of several unidentified VOCs in male urine. Some volatile pheromones (HMH and 4-methyl-6-hepten-3-one) were differentially expressed in the urine of dominant males, but others were not (DHB, SBT, and farnesene). The urine of dominant, territorial males was also found to have higher intensities of HMH than subordinates in a previous study of wild-derived mice in seminatural conditions24. HMH is androgen-dependent and a female attractant, but only when combined with DHB and SBT34. The expression of DHB, SBT and farnesene were not upregulated in dominant males, and these volatile compounds were excreted by all males (before and during the enclosures). Therefore, it is possible that they help to elicit reproductive receptivity in females when combined with other chemosensory compounds to form a multicomponent pheromone4. The signaling functions of 4-methyl-6-hepten-3-one are not well-studied, though it has been found to be upregulated (along with DHB and SBT) in the urine of aged males (15–20 mo), and is preferred by females in olfactory assays over the urine of younger adults (3–8 mo35). Furthermore, the VOC expression in male urine does not sufficiently discriminate dominants from subordinates before the mice were released into the enclosure, indicating that social status regulates VOC production, and not vice versa.
Because pheromone production (urinary proteins and VOCs) and social status were both correlated with male RS, we investigated their independent effects. Unexpectedly, we found that male VOC expression in intact urine was correlated with RS of subordinate but not dominant males. This finding is largely influenced by low HMH and high TMA expression from non-reproductive subordinate males, since subordinate sires had expression levels similar to some dominant males. Therefore, subordinate males may increase their ability to attract females via HMH expression, despite being non-territorial. We found that TMA was also upregulated in subordinate males and negatively correlated with RS. TMA is a bacterial metabolite and not a known MUP ligand36. Detected by specialized trace amine-associated receptors (TAARs) in the main olfactory organ37, TMA is informative for sex and species recognition38. Mice show an aversion to urine with high TMA concentrations (≥ 1000 mM), whereas they show an attraction to low concentrations39. Our findings indicate that high urinary TMA provides a signal of subordinate social status, and if females use TMA intensity to recognize subordinate males, then this could help to explain why subordinate males with high TMA had such low reproductive success. Since TMA also provides an indicator of parasitic infection (Schistosoma40 and Cryptosporidium41), this compound may be a quality signal of male health and condition42, as well as social status.
There was no correlation between female RS and urinary protein or VOC expression. Furthermore, females showed no correlation between social status and either VOC expression or total protein concentration (or PC ratio; confirming one previous study24 but not another one25). We confirmed that female RS was correlated with social status43, and also body mass, but the latter was undoubtedly due to pregnancy (initial mass showed no such correlation and several females were visibly pregnant during urine collections). Based on these findings and our behavioral observations, we propose that dominant females deterred subordinate females from mating through direct agonistic interactions, and not through pheromonal excretion of estrus-inhibitors or mate-attractants in urine. Notably, we did not definitively measure female reproductive state, and periodic fluctuations of urinary compounds coincide with stage of estrus27 or pregnancy26. Closely monitoring for such effects in seminatural conditions would increase the frequency of handling the mice, and we opted to minimize human disturbance, as it potentially affects their social behavior44.
We confirmed sex differences in urinary protein and volatile excretion of house mice, and also that these well-established sex differences in standard housing are dramatically reduced in competitive, seminatural conditions24. We confirmed that baseline levels of urinary PC ratio in standard housing conditions applies to subordinate males, but not to dominant males or females24. Our findings suggest that the relatively low variation among males and large sex differences in laboratory studies are artifacts due to artificial conditions. We did not observe the consistent sex differences in urinary VOC expression reported in studies of laboratory mice9,10,21. Sex differences of VOC expression depended on housing conditions and protein conformation, and these findings challenge previous suggestions that DHB, HMH, SBT, and α-/β-farnesene are always male-specific volatiles in mice45.
In contrast to a previous study24, total protein concentration of intact urine did not correlate with TIC intensity for either sex during the enclosure phase. However, our statistical analyses differed from this previous study, as OPLS models of urinary protein concentration in relation to VOC expression control for sex, housing condition, and protein conformation. Despite our attempts to minimize confounding factors, we observed inconsistent expression of VOCs associated with RS, social status, urinary protein, housing conditions, and sex differences depending on whether the GC-MS data is derived from intact or denatured urine. Disparities in VOC expression are likely due to the affinity of ligands to the MUP binding cavity despite protein denaturation8. These results raise additional caveats for studying chemical signals of rodents in standard colony conditions.
Our results show that the production of specific pheromones correlated with the reproductive success of wild-derived male house mice living in competitive conditions. Males regulated the production of these chemosensory compounds depending upon their social status. Female RS was associated with social status based on agonistic interactions, but not urinary chemosensory compounds. To our knowledge, these findings are the first to describe the relationship between pheromone expression and reproductive success in any mammal. Future studies are needed to examine the biochemical pathways and neuro-endocrine mechanisms through which males regulate chemosensory signals and experimentally test whether pheromones affect RS under competitive conditions. Furthermore, chemosensory compounds are found in lachrymal, mammary, salivary, and vaginal secretions of mice46,47, and though it would require invasive sampling, future studies are needed to incorporate more of the emanations that mice use for chemical communication. Our results suggest that the 'normal' or 'baseline' levels of pheromones found in the laboratory are not ecologically relevant and are more indicative of studying mice in cages. Therefore, efforts to understand the mechanisms and functions of chemical signals require studying animals under more natural social contexts.