The incidence of cognitive impairment increases with age. The Chinese society is currently at the stage of rapid aging; thus, cognitive impairment is expected to become a serious social problem [18]. Cognitive impairment places a heavy burden on patients, the society, and the country [19, 20]. Early recognition facilitates timely diagnosis, thereby guiding treatment and improving the quality of life [21–23]. Therefore, longitudinal monitoring of cognitive function is particularly important.
Current screening for cognitive function mainly depends on neuropsychological scales such as MMSE and MoCA. Although these scales are verified to have good sensitivity and specificity for cognitive impairment [24–26], they are still beset by problems. First, the professional threshold is high, and the evaluation needs to be conducted by professional doctors or therapists who have received systematic training. The number of qualified physicians in China is seriously insufficient to conduct a large-scale screening [27]. Second, the evaluation conditions require subjects to be physically present at the designated medical place. This can be problematic for older people who would be hindered by distance or inconvenient movement, forcing them to give up the opportunity to get cognitive screening [28]. Third, a fixed form and content create a practice effect with repeated or long-term use, resulting in deviations in assessment results and inapplicability to long-term cognitive monitoring [29, 30]. To address this, Professor Andrey Vyshedskiy et al. developed the BOCA scale as an online self-test tool for longitudinal cognitive assessment, which can be remotely accessed across multiple devices, such as mobile phones, tablets, and computers. The test presents nonrepetitive tasks randomly selected to minimize the practice effect.
Foreign studies have suggested that the BOCA scale is an effective and reliable cognitive evaluation tool that can comprehensively analyze cognitive characteristics and effectively screen for cognitive disorders. In 2021, Dov et al. [15] used the BOCA scale to assess 43 outpatients at a neuropsychological clinic in eastern Massachusetts using the TICS as the calibration, providing a preliminary basis for the reliability and effectiveness of the BOCA scale as a screening tool for mild neurocognitive impairment diseases. In 2022, Andrey et al. [16] enrolled 50 patients with cognitive impairment and 50 healthy control participants recruited from Geriatrics and Memory Clinics in eastern Massachusetts and Washington, D.C., to further verify the reliability and validity of the BOCA scale in a larger group using the MoCA as the calibration. Ferguson et al. [31] evaluated the psychometric characteristics of BOCA and found that age was an important predictor of the total BOCA score. No relevant studies on BOCA have been conducted with Chinese study populations. This is the first research report that used the BOCA scale to evaluate a Chinese cohort.
In this study, the subjects were grouped according to age and length of education to compare the differences in BOCA scores between groups, and then analyzed the correlations between BOCA scores and age or length of education. The results showed significant differences in BOCA scores among different age groups, and a moderate negative correlation was observed between age and BOCA score. The possible causes identified were as follows: brain capacity decreases with age [32], age-related brain structure accelerates degradation [33], the effectiveness of dopamine neurotransmission decreases, and the responses in the dominated brain functional area are delayed [34], leading to different degrees of cognitive decline and, thus, lower cognitive function scores. Significant differences in BOCA scores were also observed among groups with different lengths of education, with a moderate positive correlation between the length of education and BOCA scores, which could be due to several possible reasons. First, higher educational levels can help improve individual cognitive reserve [35, 36], which can effectively stimulate neural ability and improve individual tolerance to neuropathological changes [37, 38], thereby delaying cognitive aging. Second, the completion of the scale requires basic literacy skills. A lengthier education enables individuals to receive more systematic education, which in turn increases their accuracy of comprehension of the test questions. In addition, the BOCA scale is accessed by operating mobile phones, tablets, computers, and other compatible devices. A longer education enriches a person’s skills in operating technology, which in turn improves test performance.
The overall Cronbach’s α coefficient of the BOCA scale was 0.774, indicating that the scale had good internal reliability. In comparison, the Cronbach’s α coefficient in the Dov et al. study was 0.81, while that in the Andrey et al. study was 0.87. The values obtained in the present study were slightly lower than those obtained in the studies with Dov and Andrey, which could be due to population heterogeneity. The language of the original system for scale development was English, and the mother tongue of the subjects in the previous studies was English, which facilitated their understanding of the test questions. In contrast, the subjects in the present study all spoke Chinese as their mother tongue, and the BOCA scale was translated for them. Some translational deviations from the original semantic expressions may have occurred, which would have affected the subjects’ understanding of the test questions, leading to measurement errors.
Forty subjects were randomly selected in the study. After 1 month, the participants were evaluated again. The results showed that the overall test–retest reliability was good, with an intra-group correlation coefficient of 0.796.
The content validity was assessed by analyzing the correlations between each item and the total score. The results showed a moderate to strong correlation between the item and the total score except for a weak correlation between the total score and the mental arithmetic and orientation subscales, indicating that the content validity was good. The mental arithmetic subscale consists of four difficult-to-easy calculation questions. The scoring standard is 1 point for every correct answer, and the highest possible total score is 4 points. The questions are shown on the computer. Due to the slow broadcasting speed of the questions, some patients became impatient and hastily performed the calculations, causing them to become careless and choose the wrong answers, resulting in a low correlation between the mental arithmetic score and the total score. The orientation subscale consisted of three questions. The subjects were asked about the year, month, and week, and one correct answer was scored 1 point, totaling three points. The question design highly coincided with the time-oriented question in MMSE. Since the BOCA and MMSE scales were only completed within an interval of 24–48 h between each other, and the MMSE scale was completed before the BOCA scale, some subjects would ask about the orientation results after completing the MMSE scale and would thus be told the correct answers. Consequently, this affected the authenticity of the scores of the orientation questions in the BOCA scale and further affected the correlation between the orientation score and the total score.
The MMSE scale was used as the calibration scale to verify the calibration validity of the BOCA scale. The correlation between the total scores of the BOCA scale and the calibration total scores was moderate, while the correlation between the scores of the BOCA and MMSE sub-cognitive domains was also moderate, indicating that the scale had good calibration validity.
The disadvantages of this study lie in that the research subjects were all healthy people without diseases that affect cognition, and the research participants were monotonous. Hence, subsequent clinical studies involving patients with stroke, cerebral trauma, and other neurological diseases should be conducted to further verify the effectiveness of the BOCA scale.