The study group consisted of 680 people (80.3% were women). Most of the surveyed people were between 18 and 30 years of age (72.2%). The mean age in the group was M = 28.01 (SD = 9.76). The youngest person surveyed was 18 years old, and the oldest was 68. The most significant part of the group were people with higher education (43%) and, in turn, people undergoing studies (39%). The demographic data of the respondents are presented in Table 2.
The research estimated how the correct bodyweight of the respondents was shaped using the BMI index. Most of the examined people had an average body weight (65.7%), 18.1% were overweight. The percentage of underweight people was 11.2%.
Table 2. Characteristics of the research group.
Variable
|
Number of responses
|
N%
|
Women
|
546
|
80,3%
|
Male
|
134
|
19,7%
|
Age (year)
|
|
|
18-30
|
491
|
72,2%
|
31-40
|
106
|
15,6%
|
41-50
|
47
|
6,9%
|
51-60
|
29
|
4,3%
|
>61
|
7
|
1,0%
|
Educational level
|
|
|
College graduation
|
290
|
42,6%
|
During studies
|
262
|
38,5%
|
High school graduation
|
103
|
14,1%
|
Professional (vocational) school graduation
|
25
|
3,8%
|
Table 3. Characteristics of the studied group in terms of BMI.
Variable
|
Number of responses
|
N%
|
BMI
|
|
|
Underweight
|
76
|
11,2%
|
Norm
|
447
|
65,7%
|
Overweight
|
123
|
18,1%
|
Obesity
|
34
|
5,0%
|
Scale validation results
The discriminant power of each item was verified relating to specific TOS subscales. Almost all items achieved a satisfactory value of discriminant power >0.3 (Table 4). Item 10 had too low discriminatory power, but it was decided not to remove it from further analyses.
Table 4. Correlation of each test item with the overall score of a given subscale - estimate of the discriminant power.
Item
|
Discriminating power
|
Item
|
Discriminating power
|
Item
|
Discriminating power
|
TOS He
|
1
|
0,59
|
2
|
0,61
|
3
|
0,67
|
6
|
0,72
|
7
|
0,57
|
8
|
0,71
|
11
|
0,45
|
13
|
0,62
|
15
|
0,55
|
TOS Ne
|
4
|
0,61
|
5
|
0,48
|
9
|
0,36
|
10*
|
0,05
|
12
|
0,64
|
14
|
0,54
|
16
|
0,64
|
17
|
0,57
|
|
|
Annotation. The "*" symbol indicates items with a discriminatory power not higher than 0.3.
The subsequent step in the analysis was to test the reliability of both subscales and to detect any items that underestimated this reliability (Table 5). The TOS He scale obtained the reliability equal to 0.87 (high reliability), and the TOS Ne – 0.77 (good reliability). In the TOS He scale, no item lowered the reliability of the entire scale. In TOS Ne, the only test item lowering the full scale was item 10. In further research, it is worth considering removing or correcting the content of item 10.
Table 5. Reliability analysis of both subscales and subscales after removing each item.
Item
|
α after deleting an item
|
Item
|
α after deleting an item
|
Item
|
α after deleting an item
|
TOS He
|
α for the entire subscale = 0.87
|
1
|
0.86
|
2
|
0.86
|
3
|
0.85
|
6
|
0.85
|
7
|
0.86
|
8
|
0.85
|
11
|
0.87
|
13
|
0.86
|
15
|
0.86
|
TOS Ne
|
α for the entire subscale = 0.78
|
4
|
0.73
|
5
|
0.75
|
9
|
0.76
|
10*
|
0.82
|
12
|
0.72
|
14
|
0.74
|
16
|
0.72
|
17
|
0.74
|
|
|
Annotation. Items that underestimated the reliability of the scale were marked with the symbol "*". α - Cronbach's alpha value.
It was also verified which test items in both subscales obtained the highest and the lowest mean responses. The results are shown in Table 6. The lowest mean response was observed in the TOS He scale for item 15. ("I am trying to convince people around me to follow my eating habits.") — 2.27. It means that the respondents somewhat disagreed with this statement. The test item on the TOS He scale with the highest average response was the first item ("I feel at peace with myself when I eat healthily.") — 3.91. The respondents claimed that this statement applied to them instead. The item with the lowest mean on the TOS Ne scale was item 17. ("Constantly thinking about healthy eating prevents me from concentrating on other tasks.") — 1.61. On average, the respondents disagreed with this statement. The highest average on the TOS Ne scale was achieved by position 10 ("I am worried about the possibility of eating unhealthy things.") — 2.73. It was a result located almost in the middle of the scale of answers, which means that, on average, the respondents neither disagreed nor agreed with this statement.
Table 6. Mean response to each statement in both TOS subscales.
Item
|
Average
|
Item
|
Average
|
Item
|
Average
|
TOS He
|
1
|
3.91
|
2
|
2.73
|
3
|
3.08
|
6
|
2.77
|
7
|
2.82
|
8
|
3.46
|
11
|
2.90
|
13
|
3.16
|
15
|
2.27
|
TOS Ne
|
4
|
2.46
|
5
|
1.63
|
9
|
2.58
|
10
|
2.73
|
12
|
2.17
|
14
|
1.95
|
16
|
2.17
|
17
|
1.61
|
|
|
The distributions of the results of both TOS subscales were analyzed (Table 7). Due to the significant result of the Shapiro-Wilk test and the standardized kurtosis values for He and skewness for Ne greater than two (zk1 = 2.42 and zs1 = 7.55), it was decided to consider the distributions of both variables inconsistent with the normal ones. The mean response for He was 27.09 and for Ne 17.29. The minimum TOS He score was 9.00, and the maximum was 44.00. In TOS Ne, the minimum score was 8.00, and the maximum score was 40.00.
Table 7. Characteristics of each of the TOS subscales.
Subscale
|
M [CI]
|
SD
|
Min
|
Max
|
S
|
K
|
W
|
p
|
He
|
27.09 [26.50; 27.67]
|
7.77
|
9.00
|
44.00
|
-0.042
|
-0.453
|
0.990
|
< 0.001
|
Ne
|
17.29 [16.84; 17.74]
|
5.97
|
8.00
|
40.00
|
0.710
|
0.229
|
0.995
|
< 0.001
|
Annotation. CI - confidence intervals 95% (confidence intervals), Min - minimum result obtained, Max - maximum result obtained, S - skewness; K - kurtosis, W - value of the Shapiro-Wilk test statistic.
The mean result in the group of people with healthy orthorexia was 42.81, and in the group with unhealthy orthorexia - 31.94 (Table 8). None of the distributions were normal – p was <0.001 for all variables, values of skewness or kurtosis for people with healthy and unhealthy orthorexia were greater than one, and standardized kurtosis values for the group without healthy orthorexia (zk = 2.57) and standardized skewness and kurtosis for the group without unhealthy orthorexia (zs = 3.19, zk = -4.81) exceeded the range from -2 to 2.
Table 8. Characteristics of the distribution of results in the group of people with and without healthy orthorexia, with and without unhealthy orthorexia.
Variable
|
M [CI]
|
SD
|
Me
|
S
|
K
|
W
|
p
|
Healthy orthorexia
|
42.81 [42.44; 43.20]
|
0.85
|
43.00
|
0.377
|
-1.540
|
0.770
|
< 0.001
|
Lack of healthy orthorexia
|
26.56 [26.00; 27.13]
|
7.34
|
27.00
|
-0.169
|
-0.488
|
0.987
|
< 0.001
|
Orthorexia nervosa
|
31.94 [30.76; 33.11]
|
3.20
|
31.00
|
1.031
|
0.009
|
0.842
|
< 0.001
|
Lack of orthorexia nervosa
|
16.59 [16.20; 16.99]
|
5.12
|
16.00
|
0.306
|
-0.924
|
0.961
|
< 0.001
|
Annotation. CI - confidence intervals 95% (confidence intervals), Me - median, S - skewness, K - kurtosis, W - Shapiro-Wilk test statistic value.
The authors of the Polish version of the TOS scale decided to set a cut-off point for both subscales of the TOS (Table 9). The cut-off point in both cases was considered to be the 95th percentile. People who scored more than 41 points on the TOS He scale were qualified to people with healthy orthorexia. People who scored more than 28 points on the TOS Ne scale were qualified to the group of people with unhealthy orthorexia. Half of the people had a TOS He result no greater than 27, and TOS Ne no greater than 16.
Table 9. Percentiles in the distribution of TOS scores.
Percentiles
|
5
|
10
|
25
|
50
|
75
|
90
|
95
|
TOS He
|
13.05
|
16.00
|
22.00
|
27.00
|
32.00
|
37.00
|
41.00
|
TOS Ne
|
9.00
|
10.00
|
13.00
|
16.00
|
21.75
|
25.00
|
28.00
|
The last step of the analysis was to assess the tool's accuracy by correlating the results of both subscales with the ORTO-15 scale and its factors, which was treated as the so-called gold standard. All correlations, except for TOS Ne and the third factor of the ORTO-15 scale, turned out to be statistically significant. These were compounds with very weak (not exceeding 0.20) or weak (<0.40) strength, inversely proportional. It is consistent with the assumptions of both scales – higher results on the ORTO scale meant a lower risk of orthorexia, higher results on the TOS scale meant higher intensity of a given type of orthorexia. The most substantial relationship was observed for the TOS He and ORTO-15 scales – tau-b = -0.36. The higher the severity of healthy orthorexia, the higher the risk of orthorexia as measured by ORTO-15 (Table 10).
Table 10. Validity analysis - correlation of the results obtained in TOS He and TOS Ne with the results obtained in ORTO-15 and with the given factors of this scale.
Variable
|
ORTO-15
|
Factor 1
|
Factor 2
|
Factor 3
|
TOS He
|
-0.36***
|
-0.33***
|
-0.12***
|
-0.24***
|
TOS Ne
|
-0.19***
|
-0.16***
|
-0.25***
|
-0.01
|
Annotation. *** p <0.001.