3.1. Measures
The questionnaire can be divided into two parts. (1) The essential personal information items (including age, gender, education and occupation). (2) As the variable measurement part, mainly includes three aspects: social media overload, social media fatigue and disaster anxiety. The questionnaire items used to measure variables in this study are all from existing studies. On social media overload, the measurement of information overload uses the scale of the research by Chen et al (49), the measurement of communication overload uses the scale of the research by Karr-Wisniewski and Lu (45), and the measurement of social overload uses the scale of the research by Maier et al (34). The measurement of social media fatigue uses the research scale by Lee et al (42). The measurement of disaster anxiety uses the scale of the research by Brooks and Schweitzer (50). Each variable measurement item is measured according to the Likert scale (From 1="strongly disagree" to 5="strongly agree").
We invite an English expert to translate the English version into Chinese. Moreover, we enlist the help of a risk communication research expert and a communications expert to improve the questionnaire questions according to the rainstorm situation to ensure that the questionnaire is easy to understand for respondents. In order to make the formal survey more effective, this study carries out a small-scale preliminary survey and distributes 20 preliminary survey questionnaires (the respondents include teachers, college students, corporate employees, and government workers). According to the preliminary survey data, the Cronbach's α values of all variables are higher than the threshold value of 0.6. The data obtained from the pre-survey is not used in the final data analysis.
3.2. Data Collection
This study is carried out utilizing an online questionnaire survey. First, enter the questionnaire into the professional survey website (https://www.wenjuan.com/) to get the questionnaire link. Then, share the questionnaire with people living in Henan on social media through the interpersonal network of relatives and friends. Third, invite those who have experienced rainstorms lasting for more than 24 hours in the past month to fill in the questionnaire. The survey period is from August 10 to 30, 2021. In the end, there are a total of 789 questionnaires. According to the rules for users of https://www.wenjuan.com/, this study do not have any participants below 16 years of age. Excluding invalid questionnaires with obviously contradictory answers within 30 seconds of filling time, we get 547 valid questionnaires. Of all respondents, 55.21% were female and 44.79% were male. The age group between 18-29 years old accounted for 69.29% of the respondents; 30-39 years old accounted for 23.03%, 40-49 years old accounted for 5.12%, under 18 years old accounted for 1.46% of the total number of respondents, and the smallest proportion of people over 50 years old was 1.10%. More than half of the respondents had a university or college degree, accounting for 56.31% of the total number of respondents, followed by 36.93% with a postgraduate degree and 6.76% with a high school (including secondary school or technical) degree or less. In terms of the distribution of respondents' positions, students occupied the largest group, accounting for 34.37%; of the remaining positions 33.82% are staff; 17% are government employees; 4.75% are freelancers; 2.56% are unemployed and the remaining 7.5% are in other occupations. The distribution of the participants is presented in Table 1.
Table 1. Demographic profile of participants (n = 547).
Characteristic
|
Count
|
%
|
Gender
|
Male
|
245
|
44.79
|
Female
|
302
|
55.21
|
Age
|
under18
|
8
|
1.46
|
18-29
|
379
|
69.29
|
30-39
|
126
|
23.03
|
40-49
|
28
|
5.12
|
50 and above
|
6
|
1.10
|
Education
|
Senior high school or equivalent
|
37
|
6.76
|
Undergraduate and College Degree
|
308
|
56.31
|
Postgraduate
|
202
|
36.93
|
Occupation
|
Student
|
188
|
34.37
|
Government employee
|
93
|
17.00
|
Staff
|
185
|
33.82
|
Freelancer
|
26
|
4.75
|
Unemployed
|
14
|
2.56
|
Others
|
41
|
7.50
|
3.3. Data Analysis
This study uses the Partial Least Squares Structural Equation Modeling (PLS-SEM) method for data analysis and model building (51). The reason is that PLS-SEM method is suitable for exploratory research and small-sample research. The analysis software is SmartPLS 3.3.9.
3.3.1 Measurement Model
The part of measurement model testing is mainly about testing the reliability and validity (convergent and discriminant validity).
Reliability analysis adopts Cronbach’s α and Composite Reliability (CR). The Cronbach's α of all variables in this study are between 0.770 and 0.903, which are all higher than the threshold value of 0.6 (51). Moreover, all of the CR is between 0.866 and 0.936, higher than the threshold value of 0.7. It shows that each variable has good composite reliability and internal consistency reliability (51). See Table 2 for details.
Table 2. The reliability and convergent validity of the constructs.
Constructs
|
Items
|
Loading
|
α
|
CR
|
AVE
|
Information overload
|
IO1: I am often distracted by the amount of information on multiple channels/sources about the rainstorm.
|
0.812
|
0.770
|
0.866
|
0.683
|
IO2: I am not certain that the information about the rainstorm on social media fits my needs well to make better decisions
|
0.789
|
IO3: I am overwhelmed by the amount of information that I process these days about the rainstorm.
|
0.876
|
Communication overload
|
CO1: I feel like I have to send many more messages to friends through SNS than I would want to send.
|
0.887
|
0.863
|
0.915
|
0.782
|
CO2: I receive too many messages from friends (or acquaintances) through SNS.
|
0.893
|
CO3: I often feel overloaded with communication from SNS.
|
0.872
|
Social overload
|
SO1: I take too much care of the well-being of my friends on social media.
|
0.901
|
0.897
|
0.936
|
0.829
|
SO2: I deal with my friends' problems on social media too much.
|
0.921
|
SO3: I care for my friends on social media too often.
|
0.909
|
Social media fatigue
|
SMF1: I find it difficult to relax after continually using social media.
|
0.855
|
0.903
|
0.932
|
0.774
|
SMF2: After a session of using social media, I feel really fatigued.
|
0.893
|
SMF3: Due to using social media, I feel rather exhausted.
|
0.897
|
SMF4: During social media use, I often feel too fatigued to perform other tasks well.
|
0.873
|
Disaster anxiety
|
DA1: How nervous did you feel while facing the related information about rainstorm on social media?
|
0.887
|
0.884
|
0.920
|
0.743
|
DA2: How anxious did you feel while facing the related information about rainstorm on social media?
|
0.792
|
DA3: How apprehensive did you feel while facing the related information about rainstorm on social media?
|
0.894
|
DA4: How worried did you feel while facing the related information about rainstorm on social media?
|
0.871
|
1 Note: α, Cronbach's α; CR, composite reliability; AVE, average variance extracted.
Convergent validity is assessed by examining the Average Variance Extracted (AVE) and the Factor Loadings (52). As shown in Table 2, the AVE values of each variable are between 0.683 and 0.829, all higher than the threshold value of 0.5. Furthermore, the Factor Loadings values of each factor are more significant than the threshold value of 0.7, indicating good convergence validity.
Discriminant validity is the Fornell-Larcker metric (51) and the Heterotrait-Monotrait Ratio of Correlations (HTMT) for evaluation (53). Based on Fornell-Larcker’s measure, the square root of the AVE of a variable should be greater than the correlation coefficient between the variable and other variables, and each variable’s discriminant validity is satisfactory. See Table 3 for details. The HTMT value among all variables is between 0.38 and 0.612, as shown in the parentheses in Table 3, which are all less than the threshold value of 0.85, thus the discrimination validity is gratifying.
Table 3. Discriminant validity of the constructs (Fornell-Larker criterion and HTMT criterion)
|
CO
|
DA
|
IO
|
SMF
|
SO
|
CO
|
0.884
|
|
|
|
|
DA
|
0.411(0.460)
|
0.862
|
|
|
|
IO
|
0.501(0.601)
|
0.392(0.467)
|
0.826
|
|
|
SMF
|
0.553(0.383)
|
0.397(0.385)
|
0.448(0.490)
|
0.880
|
|
SO
|
0.567(0.611)
|
0.353(0.442)
|
0.512(0.527)
|
0.464(0.527)
|
0.910
|
1 Note: CO, communication overload; DA, disaster anxiety; IO, Information overload; SMF, social media fatigue; SO, social overload. 2 Note: Diagonal elements in bold are the square root of the AVE. The HTMT value is in parentheses.
3.3.2. Structural model
We run the PLS algorithm to generate path coefficient values (β Value) and model explanatory power (R2), then runs Bootstrapping method (subsamples=5000) in order to analyse the statistical significance and interpretation rate of the relationship among variables in the structural model. The structural model test results are shown in Figure 2. There is a positive relationship between information overload and social media fatigue (β= 0.170; P<0.001), the discussion of H1a is correct. There is a positive correlation between communication overload and social media fatigue (β= 0.374; P<0.001). Therefore, hypothesis H1b is true. And H1c is true because there is a positive relationship between social overload and social media fatigue (β= 0.165; P<0.01). There is a positive correlation between social media fatigue and disaster anxiety (β= 0.166; P<0.01), and H2 is well founded. The variance explanation rate of social media fatigue on information overload and communication overload. social overload is 37.8%, and the variance explanation rate of disaster anxiety on social media fatigue is 25.7%.
3.3.3. Mediation Effect Test
The indirect effect test uses the Bootstrap method (51). H3b (Indirect Effects =0.062**, t = 2.677, VAF=40.52%) is true, social media fatigue will play a partial mediating role between communication overload and disaster anxiety. H3a (Indirect Effects =0.028*, t = 2.370, VAF=14.58%) and H3c (Indirect Effects =0.027*, t = 2.115, VAF=12.11%) are groundless, the mediation role of social media fatigue in information overload, social overload and disaster anxiety is not significant.Table 4 shows the results of the mediation effect test.
Table 4. The results of the mediation effect analysis.
Hypotheses
|
Independent Variable
|
Intermediary
Variable
|
Dependent Variable
|
Direct Effects (T)
|
Indirect Effects
(T)
|
Total Effects
|
VAF
|
Results
|
H3a
|
IO
|
SMF
|
DA
|
0.164 * *(2.819)
|
0.028 *(2.370)
|
0.192
|
14.58%
|
Not Supported
|
H3b
|
CO
|
0.091 * *(1.558)
|
0.062 * *(2.677)
|
0.153
|
40.52%
|
Supported
|
H3c
|
SO
|
0.196 ns(2.665)
|
0.027 * (2.115)
|
0.223
|
12.11%
|
Not Supported
|
1 Note: IO, information overload; CO, communication overload; SO, social overload; SMF, social media fatigue; DA, disaster anxiety. 2 Note: *p<0.1,**p<0.01,***p<0.001,ns:Non-significant. 2 Note: NO Mediation: VAF<20%, Partial mediation:20%<VAF<80%, Full mediation:80%<VAF.