Study 1 and Study 2 tested the differences in the perception of favourable and unfavourable candidates whose features were presented as a set of dimensions. In Study 3, we wanted to test whether the same effect would hold if candidates were described in a narrative form. So we designed narrative descriptions of eight candidate profiles that differed in the number of positive and negative features that characterized them. We divided the candidates into more favourable and unfavourable ones and organized them in pairs, so that one of the candidates had always either two positive or negative features more than the other one. By doing that, we were able to test how the same positive or negative features added to the description of differently valenced candidates influenced their perception. Thus, we were able to directly test not only Hypothesis 1 and 3, but also Hypothesis 2.
1. Method
1.1. Participants
One hundred twenty participants, aged 18 – 54 (M = 24.41, SD = 5.449) took part in the experiment. The sample (57% female) was moderately interested in politics (M =4.33, SD = 2.696, on a 11-point scale) and was neither extremely left- or right-wing oriented (M = 4.42, SD = 1.943, on a 11-point Likert scale, as measured on the same scale as in the two previous studies).
1.2. Procedure
Each participant was asked to read and evaluate the descriptions of two political candidates. Each candidate was evaluated individually and the order of the presentation was randomized.
1.3 Materials
Eight descriptions of political candidates were used. Each participant evaluated two candidates – one positive and one negative. The questionnaires were designed in such a way that both evaluated candidates had the same proportion of features but they differed in the extent of their positivity/ negativity. For instance, a participant would evaluate a candidate profile characterized by seven positive and two negative features and the other profile characterized by two positive features and seven negative features. The order of presentation was randomized. In total, eight different versions of questionnaires were prepared. One hundred twenty participants provided in total 240 evaluations of candidate profiles which were treated as independent measures due to randomization.
The candidates differed in the proportion of positive and negative features that described them. The number of features characterizing each candidate is presented in Table 4. The candidates are ordered from the most to the least favourable.
Table 4: Candidate profiles used in Study 3 organized from the most to the least favourable. Image favourability is calculated as follows: the number of positive features divided by the number of all features characterizing a candidate.
Candidate
|
Positive features
|
Negative features
|
Image favourability
|
A
|
9
|
2
|
0.82
|
B
|
7
|
2
|
0.78
|
C
|
9
|
4
|
0.69
|
D
|
7
|
4
|
0.64
|
E
|
4
|
7
|
0.36
|
F
|
4
|
9
|
0.31
|
G
|
2
|
7
|
0.22
|
H
|
2
|
9
|
0.18
|
The features were selected based on prior research in which we generated features characteristic for the category of an ideal and bad politician. We made sure that each favourable candidate had the same seven positive (cares for citizens, ensuring security, competent, good public speaker, stable in beliefs, consistent, ambitious) and two negative features (disloyal, greedy). Such a profile was treated as the base profile and it could differ from other favourable candidate profiles by either additional two positive (well-educated, committed) or negative features (lacking culture, not keeping election promises). The same rule applied to the unfavourable candidate profile, with seven negative (quarrelsome, lazy, greedy, populist, despotic, nepotistic, disloyal) and two positive (cares for citizens, ensures country security) features. If a candidate possessed two additional positive or negative features, they were the same as for favourable candidates. Additionally, in a pilot study we made sure that the image of favourable and unfavourable candidate (i.e. 7+2- vs 2+7-) did not differ when measured in absolute values when it comes to its image favourability (on a scale -10 to +10), F(1, 120) = 3.105, p = 0.098, η² = 0.172. Similarly, there were no differences between additional two positive and negative features, F(1, 120) = 2.04, p = 0.173, η² = 0.120
1.4 Measures
Each participant evaluated a candidate in relation to five dependent variables. Similarity to an ideal and bad politician, affective evaluation and voting intention were measured as in Study 2. Additionally, participants were asked to rate candidate image favourability (On a scale from -10 to + 10 how would you rate candidate image favourability?, with -10 extremely unfavourable to +10 extremely favourable).
2. Results and Discussion
Table 5 presents the means for dependent measures tested in Study 3.
Table 5: The means for affective evaluation, similarity measures and voting intention of candidates analysed in the study. Column ‘candidate profile’ summarizes the number of positive features (+) and negative features (-) used in their description.
Candidate profile
|
Affective evaluation
|
Similarity to an ideal politician
|
Similarity to a bad politician
|
Voting intention
|
Image favourability
|
|
M
|
SD
|
M
|
SD
|
M
|
SD
|
M
|
SD
|
M
|
SD
|
9+ 2-
|
6.2
|
1.584
|
5.73
|
2.016
|
3.53
|
1.943
|
6.13
|
2.224
|
3.70
|
4.061
|
7+ 2-
|
5.72
|
2.153
|
5.55
|
2.063
|
4.03
|
2.163
|
5.86
|
2.356
|
3.86
|
3.378
|
9+ 4-
|
4.63
|
2.341
|
4.2
|
2.483
|
4.97
|
2.498
|
4.07
|
2.728
|
1.17
|
5.299
|
7+ 4-
|
4.48
|
2.204
|
3.90
|
2.119
|
5.00
|
2.236
|
3.94
|
2.065
|
0.67
|
4.566
|
4+ 7-
|
3.23
|
2.432
|
3.06
|
2.658
|
6.06
|
2.516
|
3.06
|
2.620
|
-1.61
|
5.142
|
4+ 9-
|
2.87
|
1.978
|
2.17
|
1.733
|
6.93
|
2.273
|
2.30
|
1.968
|
-2.97
|
4.586
|
2+ 7-
|
2.55
|
1.901
|
2.17
|
1.583
|
6.62
|
2.441
|
2.10
|
1.896
|
-3.76
|
3.961
|
2+ 9-
|
2.47
|
1.961
|
2.03
|
2.042
|
7.53
|
2.255
|
1.83
|
1.967
|
-4.70
|
4.779
|
The results of one-way ANOVA conducted separately for favourable and unfavourable candidates showed that the evaluation of favourable candidates was more differentiated than that of unfavourable ones. The effect was visible for all dependent variables, showing significant differences between favourable candidates in affective evaluation, F(3, 116) = 4.817, p = .002, η² = 0.111, similarity to an ideal politician, F(3, 116) = 5.486, p = .001, η² = 0.124, similarity to a bad politician, F(3, 116) = 3.194, p = .026, η² = 0.076, voting intention F(3, 116) = 7.299, p < .001, η² = 0.159, and image favourability F(3, 116) = 4.275, p = .007, η² = 0.101. However, no differences between unfavourable candidate profiles were found in any of the dependent variables, for affective evaluation, F(3, 116) = .833, p = .479, η² = 0.021, similarity to an ideal politician, F(3, 116) = 1.622, p = .188, η² = 0.041, similarity to a bad politician, F(3, 116) = 2.030, p = .114, η² = 0.050, voting intention F(3, 116) = 1.867, p = .139, η² = 0.046, and image favourability F(3, 116) = 2.408, p = .071, η² = 0.059. Thus, the results provided evidence for Hypothesis 1.
Furthermore, in order to test which of the features – positive or negative – have a greater effect on candidate perception, we organized candidate profiles in pairs, so that the other candidate from the pair had two additional positive or negative features more than the first candidate. The first column in Table 6 presents how candidates were organized in pairs. In order to test the predicted effects, we conducted a series of 2×4 between-subject ANOVAs, separately for an increase in positive and negative features. The number of features was the first factor and the compared pair (two pairs for unfavourable profiles and two pairs for unfavourable ones; described below as candidate favourability) was the second factor. The results for all main and interaction effects are presented in Appendix 1. Here we will focus on the results of planned comparisons that tested the predictions of Hypothesis 2 and Hypothesis 3. In Table 6 we present effect sizes for the effect of additional positive and negative features for selected candidate pairs.
Table 6: Effect sizes for the effect of additional positive and negative information items for candidate pairs analysed in Study 3. Significant differences in evaluations are marked by an asterisk.
|
|
Affective evaluation
|
Similarity to the ideal
|
Similarity to the bad
|
Voting Intention
|
Image favorability
|
Additional features
|
Pair
|
d
|
d
|
d
|
d
|
d
|
Positive
|
2+ 9- vs 4+ 9-
|
0.203
|
0.074
|
-0.265
|
0.239
|
0.369
|
2+ 7- vs 4+ 7-
|
0.31
|
0.404
|
-0.226
|
0.418
|
0.466
|
7+ 4- vs 9+ 4-
|
0.066
|
0.13
|
-0.013
|
0.054
|
0.101
|
7+ 2- vs 9+2-
|
0.255
|
0.088
|
-0.243
|
0.118
|
-0.043
|
Negative
|
2+ 7- vs 2+ 9-
|
-0.041
|
-0.076
|
0.388
|
-0.14
|
-0.214
|
4+ 7- vs 4+9-
|
-0.162
|
-0.394
|
0.362
|
-0.326
|
-0.279
|
7+ 2- vs 7+4-
|
-0.569*
|
-0.789*
|
0.441
|
-0.866*
|
-0.796*
|
9+ 2- vs 9+ 4-
|
0.788*
|
-0.678*
|
0.645*
|
-0.829*
|
-0.537*
|
Note: * marks confidence intervals significant at 95% level.
The results show that whereas additional positive features did not change candidate evaluation in any of the pairs, additional negative features decreased the evaluation of favourable candidates (i.e. candidates who had seven or nine positive features and two or four negative features) as can be visible in significant and large effect sizes. The only exception was the effect of additional negative features on similarity to a bad politician, where no difference between candidates 7+2- and 7+ 4- was found. The lack of the effect seems to be, however, an exception to a general rule and fit well the results of Study 1 and 2 where typically no differences between candidate profiles were found for similarity to a bad politician as a dependent variable. Thus, the results generally provided evidence for Hypothesis 2 (although the effect was restricted to positive and not negative features) but refuted the predictions of Hypothesis 3, which anticipated that additional positive features would increase evaluation of already favourable candidates.
Overall, Study 3 again provided evidence for a better differentiation between favourable candidate profiles than the unfavourable ones. Additionally, the findings corroborated the negativity effect, showing negative features to be stronger than their positive counterparts. However, as predicted, the effect was limited to favourable candidate profiles. No effect of positive features was found, showing that additional positive information did not affect candidate evaluation, regardless of candidate image favourability. On the one hand, the finding is in line with ratio difference principle and contrast effects but on the other runs against the results of Study 1 and 2. This discrepancy between studies may be attributed to differences in candidate presentation. Perhaps, additional two positive adjectives carried less diagnostic information than their negative counterparts. If so, the effect follows the predictions of density hypothesis but it seems to be limited to linguistic attributes and not information presented in a numeric manner.