Design
Descriptive statistics pertaining to self-stigma, conformity to masculine norms, mental health status, ethnicity, level of study, degree faculty, age, and previous help-seeking were used to analyse the types of students who engaged with the interventions. The acceptability of the three interventions was analysed to explore whether a particular intervention was more or less acceptable to male students. Lastly, a pre-post design was implemented across the three interventions to analyse changes in help-seeking attitudes, behaviours, and mental health status.
Measures
The measures utilised within this investigation comprised of acceptability (including uptake), conformity to masculine norms, self-stigma, help-seeking attitudes and behaviour, and mental health status. These are detailed below.
Theoretical Framework of Acceptability Questionnaire.
The Theoretical Framework of Acceptability Questionnaire (TFAQ) was used to evaluate the acceptability of the interventions [38]. The TFAQ contains 9 items evaluating eight distinct domains that relate to acceptability, including general acceptability, affective attitude, burden, ethicality, intervention coherence, opportunity costs, perceived effectiveness and self-efficacy [39]. Each domain includes one item except for perceived effectiveness where two items are included to capture the perceived effectiveness for help-seeking and mental health outcomes. All of the items are rated on a Likert scale ranging from 1 to 5, where higher scores indicate better acceptability. One item also provides a textbox allowing for participants to provide qualitative feedback. Items 3 and 8 (burden and opportunity costs) are reversed coded, where lower scores represent greater acceptability.
As intervention 3 (Man Cave) was an informal drop-in, the uptake, total number of students attending, and the number of students consenting was recorded to further evaluate acceptability.
Conformity to Masculine Norms Inventory and Self-Stigma of Seeking-Help Scale.
The Conformity to Masculine Norms Inventory (CMNI-46) [40] and the Self-Stigma of Seeking-Help scale (SSOSH) [41] were completed at baseline as both conformity to masculine norms and self-stigma are barriers to help-seeking for male students [14-17, 19, 20, 42].
The CMNI-46 contains 46 items measuring the degree of conformity to nine traditional masculine norms including, winning, emotional control, primacy of work, risk-taking, violence, heterosexual self-presentation, playboy, self-reliance and power over women [40, 43] . Items are rated on a 4-point Likert scale from strongly disagree (0) to strongly agree (3) and a score for each domain can be calculated by taking the mean score of the respective items for each domain. Furthermore, a mean score across all items is used to generate a total conformity to masculine norms score, whereby higher scores represent greater conformity to masculine norms [40, 43]. The CMNI-46 has good internal consistency (α=0.78 – 0.89) [43].
The SSOSH scale includes 10 items rated on a 6-point Likert scale ranging from strongly disagree (0) to strongly agree (5). A total self-stigma score is obtained where higher scores indicate greater concern that seeking mental health support would negatively affect one’s satisfaction with oneself, self-confidence, and overall self-worth. The SSOSH scale has strong internal consistency (α=0.86 – 0.90) and moderate test-retest reliability (0.72) [41].
Attitudes Towards Seeking Professional Psychological Help Scale and The Actual Help-Seeking Questionnaire.
To evaluate help-seeking attitudes and behaviours the Attitudes Towards Seeking Psychological Help-Scale – Short Form (ATSPPH-SF) [44] and the Actual Help-Seeking Questionnaire (AHSQ) [45, 46] were used. The ATSPPH-SF contains 10 items rated on a 4-point Likert scale ranging from disagree (0) to agree (3). A total score for mental health help-seeking attitudes is obtained, whereby higher scores represent more favourable help-seeking attitudes. The ATSPPH-SF has moderate internal consistency (α=0.77 – 0.84) and good test-retest reliability (0.80) [44, 47]. Alongside help-seeking attitudes, the AHSQ contains 10 items measuring behavioural help-seeking (e.g. presenting to a service or speaking to friends and family) in the past 2-weeks. Similarly, the AHSQ has moderate internal consistency (α=0.70 – 0.85) and good test-retest reliability (0.86 – 0.92) [45] .
Warwick-Edinburgh Mental Well-Being Scale.
Mental health status was measured via the Warwick-Edinburgh Mental Well-Being Scale (WEMWBS), a 14-item questionnaire containing positively phrased items measuring positive affect, psychological functioning, and personal relationships. Items are rated on a 5-point Likert scale ranging from none of the time (0) to all of the time (5). Scores are summed with higher scores representing greater overall well-being [48]. The WEMWBS has good internal consistency (α=0.89) and test-retest reliability (0.83) [48].
The ATSPPH-SF, AHSQ, and WEMWBS were completed at baseline for all interventions, post-intervention for interventions 1 and 2 and at both 2-week and 4-week follow up for all three interventions. Post intervention data for intervention 3 (Man-Cave) was not collected due to the informal, drop-in nature of the intervention, whereby the number of sessions and duration of participant intervention was not fixed.
Interventions
Ethical approval was granted for each intervention by the universities local Research Ethics Office. The content included within the three interventions was identified from a systematic review and focus groups conducted with male students [29, 30]. A theoretical framework specifically tailored towards male students outlines the development of the interventions [11]. The intervention’s content was initially operationalised through the use of Behaviour Change Techniques (BCTs) [49, 50] stemming from the systematic review. These BCTs are listed within a taxonomy (BCTTv1) outlining a range of techniques that represent an intervention’s active ingredients that promote behaviour change, in this case help-seeking [51]. Table 1 summarises the intervention content, BCTs utilised, and what this looked like in practice. By describing the development and active ingredients (i.e. BCTs) of each intervention in explicit detail, it enables other researchers or healthcare/education providers to replicate or build on the current findings. To further aid replication, a framework for developing interventions specifically for male students [11], the Template for Intervention Description and Replication (TIDieR) checklist (Additional file 1) and the Consolidated Standards of Reporting Trials (CONSORT) extension statement for reporting pilot or feasibility trials (Additional file 2) have been followed [52-54].
Additionally, focus group recommendations on how best to disseminate the interventions included: not to label them as a ‘mental health’ intervention, to provide an incentive for attending, to promote through student-led societies, and to deliver such initiatives during orientation week and exams [29].
Recruitment for each intervention lasted a duration of 4 weeks. This time frame was held consistent to highlight if one intervention was more acceptable than another. All three interventions were delivered face-to-face by a PhD student (ISO, male) with the support of a medical student (VT, male).
Table 1. Summary of the intervention content, BCTs utilised, and the delivery method across the three gender-sensitive interventions.
Intervention Content
|
BCT(s) embedded within the intervention
|
Delivery method
|
Delivery of mental health information regarding depression, anxiety and alcohol misuse.
|
5.1. Information about health consequences
5.3. Information about social & environmental consequences
5.6. Information about emotional consequences
|
Group presentation for intervention 1 and 2 outlining what mental health is, stressors at university, symptoms associated with excessive low mood, excessive worry, and excessive alcohol use. Highlighting how many symptoms and when their duration is cause for concern. Case study examples/vignette’s where students have to identify the symptoms. Intervention 3 included a leaflet about mental health symptoms, what they look like and when their duration is cause for concern.
|
Information on available mental health services, the treatment structure and its effectiveness.
|
3.2. Social support (practical)
5.1. Information about health consequences
5.3. Information about social & environmental consequences
|
Listing different types of support in both interventions 1 and 2 including: friends and family, online support, university services, and professional services in the NHS. Emphasising that they have the choice to engage with any service they feel is appropriate. Presentation of a ‘road map’ regarding how long referrals, assessments, treatment duration, and the effectiveness of medication and cognitive behavioural therapy (CBT). Same information provided within a leaflet in intervention 3.
|
Use of videos and photos of male celebrities who have experienced mental health help-seeking.
|
6.2. Social comparison
9.1. Credible source
|
Group discussion on photographs of male celebrities from a range of professions who have openly discussed issues relating to mental health (e.g. Prince William and UK rapper Stormzy) and a short video from YouTube where male celebrities talk about their mental health struggles (Interventions 1 and 2 only).
|
Emphasis placed on taking responsibility for your mental health.
|
3.2. Social support (practical)
13.2 Framing/Re-framing
|
Interventions 1 and 2 included a presentation highlighting that taking responsibility and finding appropriate support is a positive. Support can extend to friends, family, and professional support. Group discussion on why men find it difficult to ask for help. Intervention 2 and 3 labelled as ‘improving psychological strength for men’ and ‘man-cave’ to align with male stereotypes.
|
Delivering a male-only space whilst facilitating social support
|
3.1. Social support (unspecified)
|
Group based interventions specifically for male-students. Games console activity after interventions 1 and 2 as part of the honorarium given. Intervention 3 provided an informal drop in space to meet other male students by providing a series of social activities (games console, board games, arts and crafts, and table tennis).
|
Highlighting active problem solving/self-help techniques such as problem-solving, mindfulness, time management and action planning.
|
1.2. Problem solving
1.4. Action planning
11.2. Reduce negative emotions
|
Interventions 1 and 2 includes information and practice activities for relaxation techniques (5-minute YouTube activity on mindfulness), solving a novel problem (e.g. how to make £1million in 6 months), time management (a case study/vignette on how to improve a student’s poor time management), and action planning where student’s identify 3 key problems and 3 potential solutions that can be completed in the next month. Intervention 2 had additional information about behavioural activation, how to identify negative cycles and patterns of behaviour and how to change them as well as setting and monitoring goals.
|
Mental health self-assessment as part of a ‘self-check’ to evaluate one’s current difficulties.
|
2.1 Monitoring of behaviour by others without feedback
2.2. Feedback on behaviour
2.3. Self-monitoring of behaviour
|
Completion of the Warwick-Edinburgh Menta Well-Being Scale (WEMWBS) as a ‘self-check’ exercise for interventions 1 and 2. Repeated again in session 2, with the addition of calculating total scores and what ‘healthy’ or average scores (i.e. 50) look like – if substantially lower participants were reminded of the content addressed such as finding support and self-help techniques. Intervention 3 included the WEMWBS as a ‘self-check’ within a leaflet.
|
Intervention 1: Men-Tality
Prior to recruitment, a survey was sent to 20 male students to identify a title for a mental health intervention. The preferred name for the intervention was ‘Men-Tality: A Mental Health Workshop for Male Students’. The intervention was promoted during orientation week at the university welcome fair where university societies can show-case extra-curricular activities [29]. Additionally, posters and the fortnightly university e-mail circular that is sent to all students was used to promote the intervention.
Intervention 1 was a psycho-educational intervention designed to improve knowledge of mental health problems and what they could do to help themselves as well as what help they could seek. It was delivered in a room located in the student union and was divided into two 2-hour group sessions. In session 1, information on mental health symptoms (depression, anxiety, and alcohol misuse) and how to recognise them, available mental health services, treatment structure, treatment effectiveness, videos/photos of male celebrities who have experienced mental health difficulties to frame help-seeking within a masculine narrative, and greater emphasis placed on taking responsibility for your mental health were addressed (Table 1). In the following week, session 2, a video of male celebrities discussing mental health difficulties and help-seeking was shown before exploring a range of skills including problem-solving, mindfulness, time management, and action planning. Lastly, a mental health self-assessment (i.e. WEMWBS) was completed individually for students to do a ‘self-check’ within the session. Responses were used to privately evaluate one’s current difficulties and participants were reminded of the available services and self-management techniques that were addressed in sessions 1 and 2 (Table 1).
Intervention 2: Psychological Strength for Men
Intervention 2 was titled ‘Improving Psychological Strength for Men’ to provide a more ‘positive masculine’ image, enabling male students to engage with a mental health intervention without contradicting their perceived sense of self/masculinity (i.e. ‘being weak’). The aim and content embedded within intervention 2 differed from intervention 1 as it focused more on problem-solving and solution focused techniques – discussing them in the first session, whilst also placing greater emphasis on positive masculine stereotypes (e.g. responsibility and psychological strength) (Table 1). As before, mental health labels were deliberately avoided to help engage more male students [29]. The phrasing of ‘psychological’ was chosen to avoid mental health related terms, and information relating to depression, anxiety, and alcohol misuse were labelled as ‘low mood’, ‘worries/stress’ and ‘excessive drinking’, respectively. Posters and the fortnightly e-mail circular were used to promote the intervention to all students.
Intervention 2 was also divided into two 2-hour group sessions. Session 1 focused on skills such as behavioural-activation, action-planning, mindfulness, goal setting and monitoring, problem-solving, and time management techniques. The following week, session 2 emphasised one’s responsibility to look after their mental health before providing information around available mental health services, identifying mental health symptoms, treatment structure, and treatment effectiveness. Lastly, mental health self-assessments (i.e. WEMBWS) were completed to obtain personal feedback about their current mental health status (Table 1).
Intervention 3: Man Cave
Intervention 3 was designed to be informal and offer a group drop-in for male students. It was based on previous focus group results, indicating that male students also have a preference for informal and fun settings [29]. Intervention 3 was titled ‘Man Cave’ to emphasise a male-only group and was hosted on the ground floor within the student union in close proximity to the student café. This ensured a more opportunistic setting, unlike interventions 1 and 2 where pre-registration/sign up was required. As before, intervention 3 was advertised via posters and across the fortnightly e-mail circular to all students. Students were invited to sign up once they entered.
Intervention content was delivered through leaflets that were placed on an information desk within the room. There were two researchers (ISO and VT) available to answer any questions they might have. Students were free to discretely collect leaflets that were relevant to them without prompt or discussion with anyone. Specially adapted leaflets containing information about available mental health services, mental health symptoms, and a self-assessment scale (i.e. WEMBWS) were provided. Additional leaflets addressing physical health, local doctor’s surgeries, smoking cessation, and university gyms were provided (Table 1). Various social activities such as board games, video gaming, table tennis, and snacks were stationed around the room to shift the focus away from mental health with the intention to be more inviting to male-students (Table 1). Drop-in sessions ran weekly for 4 hours for a series of 4 weeks. Students were free to attend for any time period and attend as many sessions as they liked.