Participants completed three separate sessions of our fMRI experiments, which were performed on different days. In each session, participants performed a numerosity bisection task (Fig. 1a). During each trial, a visual dot array was presented at the center of the screen for 0.4 s, and participants judged whether the number of dots was smaller or larger than the average numerosity of preceding trials. Following an inter-stimulus interval (ISI; jittered between 3.0–6.0 s), a response cue appeared, indicating the spatial correspondence between the judgments (‘S’ for smaller, ‘L’ for larger) and the position of the response key (left or right button). This design helped to isolate fMRI responses associated with numerosity processing, distinct from motor planning and execution which were not the focus of the present study. The numerosity of the visual dot arrays was sampled from one of the three sets of partially overlapping, logarithmically spaced, four numerosities (Fig. 1b): small (8, 10, 12, 15), medium (12, 15, 18, 22), and large (18, 22, 26, 32). Each set was assigned to a different fMRI session in a counter-balanced manner across participants.
Comparable task performance across numerosity ranges
Task performance was in line with our expectations. First, for each of the three numerosity ranges, the bisection points derived from individually fitted psychometric functions (Fig. 1c and Supplementary Fig. 1), closely matched the mean of each range (Fig. 1d) (small: MSE = 0.017 ± 0.010, 95% CI = [-0.003, 0.037], t(29) = 1.771, p = 0.087, BF10 = 0.777; medium: MSE = -0.002 ± 0.010, 95% CI = [-0.023, 0.018], t(29) = -0.212, p = 0.833, BF10 = 0.199; large: MSE = -0.020 ± 0.010, 95% CI = [-0.041, 7.416e-5], t(29) = -2.038, p = 0.051, BF10 = 1.182), confirming minimal systematic bias in task performance. Secondly, the estimated slopes of the psychometric curves (Fig. 1d), which reflect the precision of numerosity judgments, were comparable across all three sets (F(1.591, 46.136) = 0.731, p = 0.458 with Greenhouse-Geisser correction, BF10 = 0.176). This consistency supports Weber-Fechner’s law in numerosity perception10,11. Consequently, these results suggest that the subsequent fMRI results are not likely influenced by any biases or precisions in task performance specific to certain numerosity sets.
Relative coding of numerosity distributed across visual and frontoparietal cortices
We identified the neural locus of the relative numerosity coding through a region-of-interest (ROI) based multivariate pattern analysis (MVPA). The ROIs were predetermined based on cortical parcellation methods19,20 (Table 1, Supplementary Fig. 2). First, we employed a general linear model (GLM) to obtain event-related multivariate activity patterns for each numerosity with each stimulus set. We then trained a four-class classifier (linear support vector machine; linear SVM) using the multivariate activity patterns of selected 500 voxels per ROI. The primary objective was to identify the ROI that exhibited relative coding. To achieve this, we tested the classifier’s ability to accurately decode the relative position of numerosity in the other two numerosity sets (Fig. 2).
Table 1
The ROIs for the ROI-based MVPAs.
ROI Label | Functional Network | Laterality | Anatomical Location |
Vis | Visual | – | |
SomMot | Somatomotor | – | |
DA lFEF + lPrCv | Dorsal Attention | left | Frontal eye fields + Precentral ventral |
DA rFEF + rPrCv | Dorsal Attention | right | Frontal eye fields + Precentral ventral |
DA Post | Dorsal Attention | – | Posterior |
VA lPFCl | Ventral Attention | left | Lateral prefrontal cortex |
VA lParOper | Ventral Attention | left | Parietal operculum |
VA rTempOcc + rPar | Ventral Attention | right | Temporal occipital + Parietal |
VA lFrOper + lIns | Ventral Attention | left | Frontal operculum + Insula |
VA rFrOper + rIns | Ventral Attention | right | Frontal operculum + Insula |
VA Med | Ventral Attention | – | Medial |
Fp lTemp | Frontoparietal | left | Temporal |
Fp rTemp | Frontoparietal | right | Temporal |
Fp pCun | Frontoparietal | – | Precuneus |
Fp lPar | Frontoparietal | left | Parietal |
Fp rPar | Frontoparietal | right | Parietal |
Fp PFCmp+Cing | Frontoparietal | – | Medial posterior prefrontal cortex + Cingulate |
Fp lPFCl | Frontoparietal | left | Lateral prefrontal cortex |
Fp rPFCl | Frontoparietal | right | Lateral prefrontal cortex |
Df rPFCv | Default | right | Ventral prefrontal cortex |
Df rPar | Default | right | Parietal |
Df rTemp | Default | right | Temporal |
Df pCun + PCC | Default | – | Precuneus + Posterior cingulate cortex |
Df lPar + lTemp | Default | left | Parietal + Temporal |
Df PFC | Default | – | Prefrontal cortex |
All the ROI labels stem from those in a preceding study that utilized the same cortical parcellation20. In general, all the labels were in the form of “<Functional Network > < Laterality > < Anatomical Location>.” “<Functional Network>” was one of the abbreviated labels of functional networks: Vis (Visual), SomMot (Somatomotor), DA (Dorsal Attention), VA (Ventral Attention), Fp (Frontoparietal), and Df (Default). When an ROI spanned both hemispheres, “<Laterality>” was excluded. Otherwise, “<Laterality>” was either “l” or “r,” indicating the left or right hemisphere. “<Anatomical Location>” was an abbreviated anatomical label. |
Classification performance above-chance level was notably present across various ROIs, including the parietal, lateral prefrontal, medial prefrontal areas, and the early visual cortex (Fig. 3). Within the frontoparietal regions, we observed a progressive increase in classification performance, starting from the parietal areas (DA Post, VA lParOper, Df rPar, Fp lPar, and Fp rPar) and moving towards the lateral prefrontal areas (VA lPFCl, Fp lPFCl, Fp rPFCl, and Df PFC). The performance reached its peak in the medial prefrontal areas (VA Med and Fp PFCmp+Cing). This trend suggests that the neural representation of the relative magnitudes of numerosity was emphasized along these frontoparietal regions. In contrast, classification performance in the temporal areas was comparatively lower and generally lacked statistical significance (VA rTempOcc + rPar, Fp rTemp, Df lPar + lTemp, and Df rTemp). In the somatomotor ROI (SomMot), the classification performance was not significant, likely due to these areas being primarily associated with motor execution and somatosensory functions, rather than with numerosity processing.
While our ROI-based classification approach effectively revealed the hierarchical emergence of relative numerosity coding across cortical areas, it had a limitation in spatial specificity due to the feature selection procedure, which could select any distant voxels in the relatively large ROIs. To address this issue, we conducted a supplementary searchlight-based classification analysis using a small, moving sphere. The results were largely aligned with those of the ROI-based analysis; Clusters where classification performance exceeded chance level were predominantly found around the visual cortex and frontoparietal regions (Fig. 4a). Notably, the statistically significant clusters identified in the searchlight-based analysis largely overlapped with the ROIs that showed statistically significant classification performance in the ROI-based analysis (Fig, 4b). This overlap suggests that the results of our ROI-based classification were not unduly influenced by the way we defined the ROIs.
Relative versus absolute coding of numerosity
Our ROI- and searchlight-based classification analyses demonstrated the existence of a relative coding of numerosity within the visual and the frontoparietal regions. Crucially, the results revealed that the relative coding evolves along the numerosity processing hierarchy. This raises a question: Is the absolute coding of numerosity similarly distributed across cortices, and which form of coding, relative or absolute, predominates in each ROI?
To address these questions, we examined whether the activity patterns in each brain region better represent absolute or relative numerosity (or a combination of both) using our LMM–RSA. This involved measuring the dissimilarity in the brain activity patterns between pairs of numerosities and constructing a representational dissimilarity matrix (data RDM) for each ROI (Fig. 5a). These data RDMs were then subjected to regression analysis against a combination of hypothetical dissimilarity matrices, employing linear mixed-effect modeling (Fig. 5b). A model selection approach was adopted to determine the most parsimonious and best fitting model for each ROI, considering all possible combinations of regressors.
Our key regressors included three hypothetical RDMs, treated as fixed-effects: absolute magnitude-, relative magnitude-, and relative category-based RDMs. The absolute magnitude-based RDM represented differences in the absolute numerosity magnitude. In contrast, the relative magnitude-based RDM anchored on deviation from the mean numerosity in each set, reflecting differences in relative numerosity magnitude. Additionally, the relative category-based RDM was defined as the difference in numerosity categories, namely, whether numerosities were smaller or larger than the set’s mean. Note that, due to their collinearity, the relative magnitude- and category-based RDMs were mutually exclusive in every candidate model (Supplemental Fig. 3). To control for the potential influences of task difficulty and experimental sessions, another hypothetical RDM based on the numerical distance between numerosity pairs was included, along with random intercepts for session pairs (see the Methods for details).
Significant regression coefficients, indicating non-zero weights for the relative magnitude, were found in the frontoparietal cortex. This includes the parietal regions (VA lParOper and DA Post), lateral PFC (VA lFrOper + lIns, VA rFrOper + rIns, VA lPFCl, Fp lPFCl, Fp rPFCl, Df rPFCv, and Df PFC), medial PFC (VA Med and Fp PFCmp+Cing), and motor-related regions (DA lFEF + lPrCv and DA rFEF + rPrCv). The upward trend in these regression coefficients was noted, beginning in the parietal regions and reaching a peak in the medial PFC (Fig. 6 and Supplementary Table 1). These results align well with the findings from our earlier classification analysis (Fig. 3). The relative category-based RDM showed a non-zero coefficient exclusively in a lateral prefrontal region (VA lPFCl), suggesting a focal representation of the relative category of numerosity. In contrast to the relative representations, absolute coding was significant only in a limited number of ROIs: visual and prefrontal ROIs (Vis, VA lFrOper + lIns, DA lFEF + lPrCv, and DA rFEF + rPrCv). We did not observe any clear increasing or decreasing trends in the regression coefficients along the information processing hierarchy.
While our multivariate approach revealed brain regions exhibiting distinct multivariate activity patterns for varying numerical magnitudes, it does not completely discount the possibility that these regions might encode numerical magnitudes through a simpler mechanism, such as monotonic increase or decrease in activity corresponding to the rise in numerosity. To explore this further, we assessed whether changes in average activity within each ROI were linked to either the absolute or relative magnitude of numerosity (Supplementary Fig. 4–5). Employing this additional univariate method, we found a significant correlation exclusively in the visual cortex ROI (Fig. 7); the mean activities positively correlated with the absolute magnitude of numerosity (two-sided Wilcoxon signed-rank test: median \(\rho\) = 0.377, 95% CI = [0.095, 0.528], W = 393.5, p = 0.024). There was also a weaker correlation with the relative magnitude of numerosity (two-sided Wilcoxon signed-rank test: median \(\rho\) = 0.203, 95% CI = [0.038, 0.311], W = 362.5, p = 0.044); however, the difference in these correlations was not statistically significant (two-sided Wilcoxon signed-rank test: median \({\Delta }\rho\) = 0.119, 95% CI = [-0.015, 0.266], W = 321, p = 0.070). This result supports the notion that the visual cortex may represent numerosity through monotonic neural responses, and it reinforces our multivariate findings that highlight the dominance of absolute numerosity coding in the visual cortex.