Development of the FABIANA-Checklist
The study has been registered (NCT03713541) and ethical approval was obtained prior to recruitment (PV5108). Instrument and item generation were based on a recommended procedure for mixed-methods studies [31]. Key facilitators and barriers of treatment initiation were identified based on 22 qualitative interviews with AN- patients, their relatives and referring health care professionals (sub-study 1 [32]). From this pool, items for the FABIANA-Checklist were derived based on prototypical illustrating quotes from the interviews. Items were considered when they had been 1) mentioned in at least ten interviews, 2) rated as being significant factors for treatment initiation by the patients and 3) were considered as potentially modifiable by preventive interventions. The latter rating was provided by four researchers, consisting of a professor of psychosomatic and psychotherapy, two post-doctoral clinical psychologists and one clinical psychologist.
For the cognitive pretests, a preliminary sample of 30 items was presented to nine female AN-patients (mean age= 22.8 years, SD= 5.6). Items were rated on a 5-point Likert rating scale, ranging from 1 =does not apply to 5 = does fully apply, according to the patient’s experiences during the period between the onset of the AN to the start of the first psychotherapy.
We used a comprehension probing and information retrieval probing [33] to evaluate the items comprehensibility and recallability. After the cognitive pretests, five items were excluded and another seven items were excluded after statistical item and reliability analysis. Exclusion was based both on statistical parameters, such as low item-total correctedcorrelation, low variance, skewness or kurtosis of the item, redundancy and parameters of relevance and modifiability. A total of 18 items were included in the further analyses.
Dimensionality
On one hand, in creating the checklist, we aimed to capture factors influencing treatment initiation as differentiated and as specific as possible using a multi-informant bottom-up approach. On the other hand, the use of a differentiated checklist in further statistical analysis is associated with the risk of α-error accumulation. For the latter reason (e.g. the planned analysis of the predictive effect of FABIANA-Checklist items on the DUI), a reduction of dimensionality is desirable. For this reason, we decided to subject the checklist to an exploratory factor analysis before proceeding to investigate potential predictors of the DUI (sub-study 3).
Hypotheses on validity
We expected correlations of the FABIANA-Checklist items with perceived support from health care providers, the social environment and general societal factors. Assumptions for construct validation were made for each item separately. For items related to experienced support for treatment initiation by the health care system (items 8-16), we hypothesized correlations with subjectively perceived collaborative care. Correlations with perceived social support were expected for items which include concern or concrete help from relatives or the social environment (items 1-2 and 4-7). For the FABIANA-Checklist items relating to societal factors (items 3, 17-18), as the influence of printed or social media or stigmatization, we assumed relations to factors of illness perception, mainly illness representations and the perceived control. Correlations were assumed to be positive, for items that were negatively poled, polarity was reversed. A single negative correlation was expected in relation to item 18 and the mention of media influence as a cause of illness.
The instruments used to operationalize the constructs are listed under measures.
Data collection
Data were collected between July 2018 and June 2019 in 11 cooperating in- and outpatient centers who provide specialized psychotherapeutic treatment for eating disorders. Inclusion criteria were an age at or above 14 years, female gender and typical or atypical anorexia nervosa diagnosis. We included patients who were either currently in their first AN treatment or who sought their first psychotherapeutic AN treatment within the last 12 months. Psychotherapeutic treatments were defined by a minimum duration of seven days in inpatient care or five consecutive sessions in an outpatient setting.
After obtaining written informed consent from the patients or their legal guardians, eligible patients received the assessment battery with the indication to refer to their first psychotherapeutic AN treatment. Concerning memory effects (e.g. recall biases) especially in self- reported utilization of health care services, literature provides no sufficient evidence on the optimal recall period [34]. However, it is recommended to use periods of three or six months periods when frequently used services are surveyed while salient visits and rarely used medical care services seem to be accurately reported over a longer period [34]. We assume the commencement of a psychotherapeutic treatment to be a salient and rarely event, justifying the use of a 12-months-period for our study purposes.
Measures
We assessed sociodemographic and clinical data as AN subtypes, comorbid diagnosis and Body Mass Index (BMI, kg/m²), date and age of onset and treatment data as setting, date of treatment initiation. The date and age of onset were assessed in a semi-structured clinical interview (SCID-5-CV [35]). The aim was to explore when the criteria for AN according to DSM-V were fully met for the first time. With the help of anchor examples and a timeline the patients were supported in giving as precise information as possible about their weight history and the other symptoms of AN.
We operationalized our hypothesis on construct validity of the FABIANA-Checklist by using the following measures.
The PatientAssessment of Chronic Illness Care questionnaire (PACIC-5A [36] is a brief self-administrated instrument to assess whether the patients were provided with patient-centered collaborative care prior to their psychotherapy. The PACIC-5A relates to the chronic care model [37] and measures the extent to which professionals tried to induce behavioral changes in patients [36]. The 5A approach is evidence-based, has achieved widespread acceptance and is considered the most appropriate and psychometrically robust instrument assessing patient experience with chronic disease care [38]. The global sore includes the assessment of present behavior (Assess), patient counselling (Advise), collaborative agreement with the patient about realistic goals (Agree), assisting the patient during her lifestyle changes (Assist), and frequent follow-ups (Arrange).
The short version of the Social Support Questionnaire [39] measures patients perceived and anticipated social support. It assesses the social support that patients experienced in the period between diagnosis and the start of the AN-treatment on a scale from 0 = did not apply to 4 = did fully apply. The unidimensional short version with 14 items shows good psychometric properties and a good internal consistency (Cronbach's α = .94).
The Brief Illness Perception Questionnaire (BIPQ [40]) assesses the patients’ illness representations, including cognitive dimensions such as the degree of understanding of the illness, the perceived personal control and treatment control, the experience of symptoms as well as emotional aspects such as e.g. concerns about and emotional affection by the illness. Items of the short Version of the IPQ can assume values from 0-10. For item validation, we considered personal control, treatment control, illness comprehensibility and subjective illness causes. In addition, we included the open-ended B-IPQ item which records the three major causes of illness (in our case for AN) perceived by the patient. Since we are particularly interested in the influence of media, we included weather respective answers were given in the open-ended item of the B-IPQ (Yes/No).
Data analysis
To analyze the dimensionality of the FABIANA-Checklist we performed Principal Component Analysis (PCA). Polarity of negatively poled items (1,11, 16,17,18) was reversed. Data suitability test included the Kaiser-Meyer-Olkin (KMO) criterion and Bartlett’ test for sphericity. We considered components with eigenvalues ≥ 1 [41] and tested for varimax, quartimax and equamax rotation on data. We considered and reported factor loadings of >.30. In the case of cross-loadings on multiple components, we considered the loading that showed the best interpretability.
For item analysis, we considered descriptive data, graphical distributions of the raw values, difficulty, and discriminatory power analysis, skewness, kurtosis and reliability analysis. Internal consistency was evaluated by Cronbach’s α and values >0.70 were considered satisfactory. For Item-total correlation we used Pearsons’s product-moment correlation coefficient (rit), i.e. the correlation between each item and the respective principal component. The internal consistency of the remaining items (α) indicates the value if the selected items are deleted from the total score.
Construct validity was tested with bivariate correlations. Polarity of negatively poled items (1,11, 16,17,18) was reversed. Correlation coefficients were interpreted based on Cohen’s d with d= < .30 as a small, d=.30-50 medium and d>.50 as large [42]. Given that correlations coefficients represent effect sizes, we focused on the magnitude of the correlations in the validity analyses. We additionally report p values (one-tailed testing, α < .05). DUI is calculated as the difference between the date of illness onset and the date of first treatment initiation. DUI and Age of Onset (AOO) are reported in years. Comparisons between adults and adolescents regarding DUI and AOO are calculated using simple t-tests with F-value and p-value, given. All calculations were performed with SPSS 27.