Research aims and objectives
The research aimed to develop a questionnaire that could be used to evaluate educational psychologists’ work contexts (e.g., independent psychologist compared with local Authority based), work patterns (e.g., part-time, full-time, time spent on tasks), and work-based motivations (e.g., desiring a change of work context, planning for a sabbatical). The questionnaire was developed to be one of a series of measures for a second study exploring educational psychologists’ workplace stress, burn out, reports of compassion fatigue/ satisfaction, and relationship of these to work-place contexts, patterns and motivations (Sewell, Coley, Gossman & Park, UNDER REVIEW). The research objectives for the present study were to:
-
RO1: Create a series of questionnaire items with face validity for gathering educational psychologists’ self-report of their work context(s), work patterns, and work-based motivations (content validity).
-
RO2: Analyse item internal validity, revise questionnaire items accordingly, and develop questionnaire sub-scales (construct validity).
-
RO3: Collect data from a sample of educational psychologists to produce descriptive and correlational analyses of reports of work contexts, patterns, and motivations.
-
RO4: Report development and findings of the questionnaire, highlighting limitations and opportunities for improvement, as an open resource for maturation by educational psychologists and researchers (criterion validity)
Participants
Participants were recruited to the research via an advert that was shared on researchers’ social media networks and a recruitment email that was sent to existing contacts with the request to share more widely, as appropriate. A demographic questionnaire was completed by all participants. The sample can be appraised as relatively representative of the EP workforce which has a high ration of female to male employees (83% females) and the age average falling between 35–54 years of age (Lyonette, Atfield, Baldauf & Owen, 2019). Participants were 201 practicing, HCPC registered educational psychologists. 92.5% of participants reported their gender as Female and 7% reported their gender as Male. The mean participant age was 43, with a standard deviation of 11. 6.5% of the sample considered themselves disabled. Geographic distribution centered on England (89.1%) followed by Scotland (5%), Wales (4%) and outside of the UK (0.5%).
The primary reported ethnicity was ‘White: English, Welsh, Scottish, Northern Irish, or British’ (80.6%) with the following ethnicities also represented in the sample:
-
‘White: Any other White background’ (9%)
-
‘White: Irish’ (2%)
-
‘Mixed or multiple ethnic groups: White and Asian’ (1.5%)
-
‘Mixed or multiple ethnic groups: White and Black Caribbean’ (1%)
-
‘Asian/ Asian British: Indian’ (1%)
-
‘Asian/ Asian British: Pakistani’ (1%)
-
‘Asian/ Asian British: Chinese’ (0.5%)
-
‘White: Gypsy or Irish traveler’ (0.5%)
-
‘White: Roma’ (0.5%)
Table One below reports further demographic data of professional level and time active in profession since qualifying with HCPC.
<Table One Here>
Table One: Demographic data
Questionnaire item design
Content validity was enacted through methods adopted for questionnaire item design. The first step was to identify common work contexts and patterns for educational psychologists. The research team independently generated statements of common work contexts and patterns based on their own practice experience, and consultation of the existing EP literature. These statements were then combined and refined resulting in the following contexts:
-
Local Authority
-
Self-employed / independent psychologists
-
National Health Service
-
Third sector (e.g., employed by a charity)
-
Private sector (e.g., employed by a business)
-
School/Academy trust (employed as member of staff, not as an independent/self-employed EP)
-
Academic/University tutor
-
Research position (university)
-
Research position (private sector)
-
Other (with option to specify)
This process also yielded the following identified work practices:
-
Work in one context
-
Work across multiple contexts
-
Number of hours contracted to work per week in one context
-
Number of hours contracted to work per week across multiple contexts
-
Number of hours (on average) estimated actually worked per week in one context
-
Number of hours (on average) estimated actually worked per week across multiple contexts
-
Estimation of number of cases (children, families, adult assessments) supported each academic year
-
Estimation of number of reports written per year (not including psychological advice for EHCPs)
-
Estimation number of number of assessments and reports for EHCPs completed each year
-
Estimate of length of average school visits
-
Estimate of length of average home visit
These formed Part A of the questionnaire, to gain a self-report of each participant’s current work context(s) and pattern(s). Part B of the questionnaire was developed to explore motivation and intention to change current workplace context(s) and patterns(s). Items mirror Part A, following the same production method of generation and refinement of statements, leading to the following:
-
Change of job/career
-
Pursuit of a complementary career
-
Career break
-
Secondment
-
Retirement
-
Reduction of work hours
-
Increase of work hours
-
Stay working as an EP but move to a different work context (e.g., from LA to independent practice)
The development of Part B questionnaire items relating to intention to change working practices or contexts, was based on change theories from the field of MI (Miller and Rollnick, 2013). The theory posits that when people are thinking about and discussing change, their language tends to fall into two (typically sequential) categories (Miller and Rollnick, 2013). The ‘MI Hill’ model (Figure One) illustrates how ‘preparatory change talk’ (uphill) consists of the person’s initial motivations for change but does not (yet) include intent or commitment to the change. Subsequently, ‘mobilizing change talk’ (downhill) includes implied intent or action towards change. Miller and Rollnick (2013) argue that we move from thinking about change (contemplation), to preparing for change and then toward action. The current study’s questionnaire is designed to afford sensitivity in distinguishing between these different levels of motivation for- and action toward- change, from preparatory stages (beginning to think about change) to mobilizing stages (taking steps and committing to a plan).
<Figure One Here>
Figure One: The ‘Motivational Interviewing Hill’ model (Adapted from: Miller and Rollnick, 2013, p. 164)
The application of Motivational Interviewing lead to three types of question (all repeated in relation to each of the above-listed topics):
-
‘Over the past 6 months, I have had thoughts about…’
-
‘Over the past 6 months, I have actively taken steps towards...’
-
‘In the next 6 months, I plan to…’
In summary, Based on Miller and Rollnick’s (2013) theory that ‘preparatory change talk’ relates to the person’s initial motivations for change that do not include intent or commitment to the change, questionnaire items including the wording ‘thoughts about [change]’ are intended to capture these earlier stages of ‘preparatory change talk’ over the last six months. The theory also posits that ‘mobilizing change talk’ includes implied intent or action towards change. Questionnaire items with the wording ‘actively taken steps towards’ are designed to capture the activation language of participants, signaling their commitment to and/or intent for change, over the last six months. Finally, Miller and Rollnick (2013) suggest that commitment language (such as ‘I will’ or ‘I intend to’) implies likelihood of action: people are more likely to act upon their intentions when they begin to use such mobilizing change talk. Participant commitment language is explored through items with the wording ‘in the next 6 months, I plan to…’
Version 2, consisting of both Part A and Part B, was made available for participants using JISC online and can be viewed in full in Appendix Two.
Construct validity
To analyse construct validity Cronbach's alpha was applied to all 25 items from Part B of Version One (Appendix One). The reliability coefficient for a whole scale will range from zero to one. The closer a scale coefficient value is to one, the more closely all items are deemed to be related to each other, and construct validity is taken to be strong (Smith, 2005). A zero score would indicate that scale items are not related to each other and there is minimum construct validity (Smith, 2005). A coefficient score between 0.7 and 0.8 is deemed to be sufficient when whole scale items number 10 or more (Smith, 2005) Item-total correlations were computed using Pearson’s product moment coefficient to assess which items were not as closely related to each other, resulting in removal of three items to improve construct validity of the scale (these items were B13, B14, B15, see ‘Results’ section for further explanation).
Cronbach's alpha was also applied to the development of subscales that could be said to have construct validity. If subscale items number less than 10 then a coefficient of 0.4 is deemed to be sufficient for construct validity to be implied (Smith, 2005). Potential combinations of items per sub-scale are shown in Table Two (item numbers correspond with those in Appendix One):
Criterion validation and dissemination plan
Criterion validation posed a challenge for the current study as to the best of the researcher’s knowledge no other measure exists that is specifically designed to explore EPs workplace motivations regarding their work context(s) and practice(s). As such, Version 2 of the EPWM and a dissemination plan designed to allow for future analysis of criterion validation. Criterion validity can be established if high correlation occurs with another established measure of EP workplace experiences and behaviours. Through the dissemination plan outlined below, it is hoped that researchers and EPs in the field will make use of the open access publication of the EPWM to develop and compare against other such questionnaire generative studies:
-
Publication of EPWM Version 2 open access via University of Worcester, Worcester Research and Publications (eprints.worc.ac.uk).
-
Presentation at EP practice conference highlighting open access and call for generation and comparison of further measure(s)
-
Circulation of open access on social media channels
EP sample analysis
The 201 (add in extent sample is representative here when completed above) sample presented an opportunity for analysis of educational psychologists’ self-reported workplace contexts and practices, motivations for work-based change, and the relationship of these to different variables. Descriptive statistics were calculated for each item of Part A. For Part B they were calculated for the whole scale and then for each sub-scale, to give a broad picture of reported work contexts and practices.
Pearson’s product moment was calculated to analyse the relationship between variables. These included the following from the demographic questionnaire;
-
age
-
time in profession
-
professional level,
and variables from Part A of the EPWM of;
-
contracted work hours
-
hours estimated actually worked
-
estimated number of cases per academic year
-
estimated number of reports produced per academic year
-
estimated number of EHCP assessments completed per academic year
-
estimated time of average school visit
-
estimated average time of home visit
As well as all Part B subscales.
The demographic data categories of disabled/not disabled, gender, and ethnicity were excluded from the analysis as they all represented skewed variables. This is advisable as if the distribution of data within a variable is highly skewed it can lead to spurious correlations, with variables appearing to be correlated when they are not (Bardsley, 2014).
Ethics
Ethical approval for the study was obtained from the University of Worcester Research Ethics Committee