Methods
Participants
Ninety-eight students from Carleton University participated in the study (68 females, 22 males, 4 other, and 4 not disclosed) where the size of this sample is three-to-four times larger than the typical sample used to study SNARC effects in the past. The average age was 21.0 years (SD = 3.40 years, range: 17–45 years) and 91 of the participants were right-handed (with 2 left-handed and 5 ambidextrous). Seventy-eight participants self-reported as being native English speakers with the remaining 20 claiming full proficiency in English. Of those participants, 5 were Middle-Eastern, 9 were Asian/Chinese, 3 were European/Caucasian, 1 was Latino, and 2 did not disclose. The study was approved by Carleton University Ethics committee. All participants were students in Introductory Psychology and Methods and were rewarded .5% course credit for participating in this study. There were no exclusion criteria for recruitment.
Stimuli and Apparatus
The study was run online using experimental software programmed in Gorilla (a cloud software platform specifically for the behavioural sciences; Anwyl-Irvine et al., 2019). Stimuli were 420 names taken from a set of size norms for 576 animals/objects etc. developed by Shoben et al. (1989). These norm values range from − 8.875 for “Bacteria” to 8.804 for “Dinosaur” and the 420 name stimuli used for the present study were drawn evenly across this range by attempting to choose those that were most likely to be familiar to the participants (e.g., with names like Silkworm and Belfry regarded by the authors as likely to be unfamiliar). The full stimulus set is provided in the Appendix.
Procedure
At the beginning of the experiment, participants were given a link to do the experiment online. First, informed consent was given and the participants were instructed to click on a button to give their consent to continue. Next, they were asked to indicate their gender, age, handedness, and also whether English is their first language. They were then asked to complete four blocks of 100 experimental trials along with two practice blocks of 10 trials (one before Block 1 and the other before Block 3). The names used in each of Blocks 1, 2, 3, and 4 (and the corresponding practice blocks) were kept the same for all participants but were randomized differently within each block for each participant. Each name was presented in the center of the computer screen in standard font (with the first letter capitalized) and used only once during the experimental session.
Over the first two blocks, half of the participants were instructed to press the “Q” key on the computer keyboard with their left index finger if the presented name referred to something that was smaller than a “chicken” or otherwise press the key “P” with their right index finger if the presented name referred to something that was larger than a “chicken”. This reference had a normed size value of -1.16 that was very close to the middle of the set of normed values given the presence of slightly more negative then positive values in that set. For the last two blocks, the previous mapping of smaller and larger things to left and right keys was reversed (with the order of these mappings counterbalanced across participants). Each trial started with a blank screen for 2 seconds, followed by the presentation of the name, followed by a manual response (at which point the name disappeared). Participants were asked to respond as quickly as possible while still trying to stay accurate. They were given the opportunity to take breaks between each block and at the end of the four blocks participants were given a debriefing sheet. The whole study took about 30 minutes to perform.
Results
Data was collected from 98 participants, some of whom responded with the mapping of left-smaller and right-larger in the first two blocks which was then switched in the last two blocks. The others started off with the left-larger and right-smaller response mapping and then switched to the reverse mapping in the last two blocks. No data from practice trials was used. One participant was dropped for making a third of their responses before 200 ms and nine more were dropped for having an accuracy rate below 60% (42%, 47%, 47%, 51%, 50%, 52%, 56%, 56%, and 59%, respectively) leaving 45 and 43 participants for each mapping order, respectively. For the remaining 88 participants, two had accuracy rates between 65–69%, two had accuracy rates between 70–74%, and five had accuracy rates between 75–79%. The mean accuracy rate for these 88 participants was 88%. 35,200 RTs were collected from these participants (88 participants x 400 trials). 870 RTs (2.5%) were initially cut for being either below 200 ms or above 7 seconds (with 5 and 10 seconds also having been considered but deemed by the authors to be too strict and too lenient, respectively). 3,926 more RTs (11.2%) for incorrect responses were then also cut. Finally, 696 of the remaining RTs (2.0%) that were outside the interval ± 3 SD around each participant’s mean RT were further trimmed.
A mixed regression model with participants as a random factor was run in SPSS on the trimmed raw RT data (all of the data and syntax for these analyses can be found at https://osf.io/7pkst/?view_only=14cf067b0ff34534bdffab3dd4d14cf5). For this analysis, side of response was dummy coded as 0 for left-hand responses and 1 for right-hand responses. The Shoben et al. (1989) normed sizes values corresponding to each stimulus were used as the size predictor with the cross-multiplied interaction of response side and size also added to the regression model. For such an analysis, the regression coefficient for response side indexes the overall RT difference between the right and left sides. The coefficient for size indexes the linear relation between size values and RTs for left-hand responses with the coefficient for the interaction indicating how much the slope of this relation changes for right-hand responses. If smaller stimuli are responded to faster with the left hand than are larger stimuli, the size coefficient should be positive. If this relation switches for right hand responses the corresponding slope and, therefore, the coefficient for the interaction should be negative. Hence, a significant interaction term signals a significant SNARC-like effect. In this analysis, however, the coefficient for response side was not significant (b = -9.77 [95% C.I: -27.40, 7.85], t = -1.10, p < .273), the coefficient for size was not significant (b = 2.69 [95% C.I: -1.17, 6.56], t = 1.39, p < .169), and the coefficient for the interaction was also not significant (b = -5.15 [95% C.I: -11.55, 1.24], t = -1.60, p < .113)1. Figure 1 plots the relation between both left-side and right-side mean RTs (i.e., averaged over participants) with size.
In order to determine whether these relations were consistent for each mapping order, it was effect coded as − .5 for the small-left/large-right first order and .5 for the large-left/small-right first order. This variable was then added to the mixed regression model along with the interactions corresponding to its cross-multiplication with each of the other three variables (response side, size, and their two-way interaction). In this analysis, mapping order interacted with size (b = -9.79 [95% C.I: -17.32, -2.26], t = -2.58, p < .011) indicating that the slope of the relation between size and RT for left-handed responses differed across mapping orders. As well, it also interacted with both size and response side (b = 14.53 [95% C.I: 1.99, 27.07], t = 2.31, p < .024) indicating that the change in the slope of the relation between size and RT for right-handed responses in comparison to left-handed responses differed across mapping orders. Namely, for the small-left/large-right first mapping order the slope of the relation between size and correct RT was b = 7.57 for left-hand responses and b = -4.93 for right-hand responses. On the other hand, for the large-left/small-right first mapping order the slope of the relation between size and correct RT was b = -2.36 for left-hand responses and b = -0.21 for right-hand responses.
To corroborate this result, regressions for each individual separately were then run with RT as the outcome variable and response hand, size rating, and their interaction as the predictors Note that because each stimulus was only presented once in a session it was not possible to obtain right hand minus left hand difference RTs (but if they could have been obtained and were regressed against size directly that slope would have had the same value as the coefficient for the above response hand by size interaction). Interaction coefficient values from these regressions for each participant were entered in an SPSS data file. A one sample t-test was then run on these interaction coefficient values to determine whether their mean of -5.26 differed from 0. It did not (t [87] = -1.35, p < .179, d = − .14, BF01 = 3.52; with the Bayes Factor computed from http://pcl.missouri.edu/bf-one-sample).
However, an examination of the individual coefficients revealed one with a value of -189.9 that turned out to be more than 5.05 SDs below the mean and, hence, could absolutely be regarded as an outlying coefficient value (with this individual having done the small-left, large-right mapping order first). When this value is omitted and the one sample t-test analysis re-ran, the mean interaction coefficient value is now − 3.14 (t[86] = -0.95, p < .343, d = − .10, BF01 = 5.49). Moreover, when the linear mixed model mentioned above was re-ran with this participant omitted, the coefficient for response side was again not significant (with b = -8.19 [95% C.I: -25.81, 9.42], t = -0.93, p < .358), the coefficient for size was again not significant (with b = 1.58 [95% C.I: -1.63, 4.79], t = 0.98, p < .332), and the coefficient for the interaction was again also not significant (with b = -3.03 [95% C.I: -8.08, 2.02], t = -1.19, p < .236). For the small-left/large-right first mapping order, the slope of the relation between size and correct RT was reduced to b = 5.43 for left-hand responses and b = -2.93 for right-hand responses by omitting this participant.
Discussion
When judging the sizes of animals, objects, etc. taken from a large “infinite” set whose names were each presented only once during the course of the experimental session, the response hand by stimulus size regression coefficient signaling the presence of a potential SNARC-like association effect between size and left-right responding was not significant. As discussed earlier, if it had been significant, doubt would have been cast on the positional-based underpinnings of the SNARC effect given that the long-term conceptual representation of the sizes of such stimuli is not likely to be positional in nature. Moreover, the fact that each stimulus was presented only once was not very amenable to the formation of a temporary positional-based representation of the sizes of the stimuli in WM. Hence, the lack of a SNARC effect in the current Experiment 1 affords the conclusion that SNARC is indeed likely to be positional based because such an effect does not seem to occur under conditions for which the possibility of an underlying positional-based long- or short-term memory representation of stimuli size is precluded. As also discussed earlier, such a finding would also be consistent with the view of Abrahamse et al. (2016) who assume that SNARC effects arise from a mapping of ordered numerical magnitude information from long-term memory onto temporary spatial templates in working memory.