The present study reports the development and validation of the SPAS, a new tool to quantitatively measure individual differences in tic-related sensory phenomena. Concur with our hypotheses, the SPAS demonstrated good psychometric properties.
The final version of the SPAS was developed through literature search, and Delphi expert consultation. The overall framework of the SPAS appeared to be reasonable for assessing sensory symptoms associated with TD in children and adolescents. Some reasons supporting the reasonableness of the framework were as followed.
On the one hand, the SPAS has been designed to be an observer-rated scale. Previous scales(15, 18, 19) used to assess PU or sensory symptoms were all self-reported, with the exception of I-PUTS(17). The SPAS and I-PUTS were clinician-rated scale, which might avoid the interference of subjectivity from patients. A meta-analysis(30) indicated that clinician-rated instruments resulted commonly enjoy significantly higher effect sizes than their self-reported counterparts. Though another study(31) stated that both self-report scales and clinician-rated scales were irreplaceable and complement to each other.
On the other hand, the two-part structure of SPAS, with a symptom list and a severity assessment, was a well-thought-out design. The symptom list captured the variety of sensory phenomena associated with tic disorders, while the severity assessment quantified the intensity and impact of these symptoms on the child's daily life. The severity assessment part of the SPAS included items such as number, frequency, tensity, degree of transformation, and functional impairment. Given that I-PUTS evaluated PU only by three dimensions (number, frequency, and intensity), the SPAS may serve as a more comprehensive tool for assessing PU in tic disorder.
The SPAS demonstrated satisfactory performance in terms of these reliability and validity. The one-month test-retest reliability assessment of SPAS revealed highly significant correlations (p < 0.01), with a correlation coefficient of 0.987. Our findings affirm the stability and reliability of the measurement instrument, meeting the prescribed criteria for reliability. Strong reliability for both the younger population, under 10 years of age, and the older group comprising children and adolescents aged 10 years and above. Furthermore, this observation compensates for the less than satisfactory reliability exhibited by the previous tool PUTS when applied to TS patients under the age of 10(32). Evidence suggested that the incidence of PU in TD patients increases with age(33). The reason for this may involve a growing physiological awareness (or body-awareness) with age. This also made older children more aware of the presence of PU. Other studies have suggested that this body awareness was negatively related to inhibitory function(34), and PU seemed to be related to inhibitory function(35), so we hypothesized that the incidence of PU increases with age, possibly because of increased body awareness. This also made it difficult for younger children (especially under the age of 10) to understand the meaning of the items when they complete the self-rating questionnaire (because they may never be aware of the intuitive feeling).
Subsequently, the validity analysis had factor loadings greater than 0.5 after exploratory factor analysis, indicating that these items together contribute to one dimension – the severity of PU. The unidimensional scale has demonstrated benefits in clinical settings due to its simplicity for clinical assessors, straightforward administration, and the ease with which results can be shared for clinical reference.
We then selected PUTS, YGTSS, and CY-BOCS as criteria for calculating criterion validity. The total score of SPAS exhibited a significant positive correlation with the total score of PUTS (p < 0.001). However, there was no observed correlation between the total score of SPAS and the total score of YGTSS and CY-BOCS. These findings suggest that SPAS demonstrates robust criterion validity, primarily assessing the severity of PU (as indicated by its lack of correlation with YGTSS and CY-BOCS total score), rather than other measures such as tic symptoms and obsessive-compulsive symptoms. However, in most prior investigations of the PUTS(15), PUTS-R(16), and I-PUTS(17), a least moderate significant correlation with the YGTSS was presented. The reason for our inconsistency with previous results may be that our sample was only TD patients aged 6-16 years with PU. A larger sample size and more age-stratified TD patients (such as young adults) may be needed in the future to explore the correlation between the results of SPAS scale and other scales.
Our study bears several limitations. Firstly, for convenient access, our sample comprised of children and adolescents exclusively. Future investigations should include adults with TD for gaining comprehensive insight. Secondly, while we employed the YGTSS, the PUTS, and the CY-BOCS as concurrent validity measures, alternative scales such as the University of São Paulo Sensory Phenomena Scale (USP-SPS)(20), specifically designed for PU assessment, might offer alternative result. Lastly, this study did not establish a cut-off value, which may impede the practical use of SPAS. Future research might benefit from addressing this issue and exploring potential cut-off values for clinical application.