The present study aimed to develop automated methods for measuring the complexity of infantile spontaneous movements, and to identify the relationship between the quantified complexity and motor development in high-risk infants. From the video images of spontaneous movements in very preterm or very low birth weight infants at term-equivalent age, the complexity of the upper and lower-limb movements was automatically quantified using deep learning-based pose estimation models and SE. The results revealed that SE values at most of the upper- and lower-limbs during spontaneous movements in infants with MDD were significantly lower than those without MDD. The SE values were also significantly correlated with the composite scores of the motor domain in the BSID-III in infants at 9 months of corrected age.
Our emphasis in this study was to identify novel endpoints that are calculated in an automated manner and exhibit significant associations with motor developmental outcomes rather than predicting the results of conventional evaluation methods such as GMA for newborns. Deep learning-based pose estimation algorithms were used to automatically transform video images of infantile spontaneous movements obtained using smartphone cameras into time-series data at multiple joints, including bilateral shoulders, elbows, hips, and knee joints. Complexity was determined as the main target to be analyzed because it is one of the most important characteristics associated with motor developmental delay or cerebral palsy and related to abnormal neurological outcomes in terms of the Hammersmith Infant Neurological Examination at 4 months of corrected age in our previous study [15]. To analyze the complexity of infantile spontaneous movements as time-series kinematic data, the SE was utilized as a time-independent measure considering the slightly variable time length of video images in the current study. Consequently, the current study expanded the results of our previous studies in that the obtained SE values at all joints showed significant or nearly significant associations with motor developmental outcomes at 9 months of corrected age, which may suggest that SE might be utilized as a feature variable in developing machine learning-based automatized models to predict developmental outcomes for determining early intervention in future studies.
The linear relationship between the complexity of early infantile movements in terms of SE and later motor development was evident in very preterm or very low birth weight infants in this study. The associations between movement complexity and motor development in high-risk infants are not surprising given that complexity is considered one of the most important characteristics in clinical evaluation methods such as GMA [16, 17]. Infantile spontaneous movements are considered to provide a window for the early detection of developmental disorders: less variable and fluent movements with low spatial and temporal diversity during movements at the neck, trunk, arms, and legs may indicate a poor prognosis for development [16, 26]. One of the main contributions of this study was to identify and demonstrate SE as a novel kinematic parameter to reflect the complexity of infantile spontaneous movements. Each limb movement was transformed into changes in the joint angle and joint angular velocity over time, which could be quantitatively measured by the degree of regularity using SE.
This study adopted writhing movements at term-equivalent age as the analysis target of importance because the complexity is strongly associated with MDD [2, 4, 27]. Infantile spontaneous movements may show spatiotemporal characteristics analogous to spontaneous activity in the neocortex of the developing brain (e.g. subplate) and possibly contribute to the acquisition of coordinated behavior through temporal sensorimotor learning without an explicit task or purpose [27, 28]. According to the GMA, abnormal infantile spontaneous movements during the writhing period including poor repertoire, cramped synchronized, or chaotic movements at less than 2 months of corrected age may indicate the later occurrence of MDD or cerebral palsy [2, 4, 29]. Decreased complexity of infantile spontaneous movements is one of the major findings in these abnormal writhing movements and might be associated with impaired neural activity in the developing brain [4, 27]. Whereas abnormalities in fidgety movements at 3–5 months of corrected age have higher predictive values than those in writhing movements, which were usually observed until 2 months of corrected age in previous studies [2, 4], it is clinically beneficial to analyze writhing movements when establishing management and therapeutic strategies at an earlier age. Additionally, tracking and analyzing writhing movements can have a technical advantage in that these are usually exhibited as a larger amplitude than fidgety movements, which are usually shown with a small amplitude and variable acceleration of small limb movements that might be too small to be analyzed.
Several previous studies have quantitatively analyzed infantile movements using different methodologies: inertial sensors with linear and/or nonlinear analyses [30–32], kinematic analyses of lower-limb movements in video images (e.g. frequency, amplitude, phase duration) [33–35], and SE of infantile movements based on inertial sensors [19] or the center of pressure using force plate [32, 33]. Particularly, SE is a commonly used method along with approximate entropy to quantify the complexity of physiological data including human movements by mathematically measuring the regularity of the degree of time-series data [25]. The results of this study showed that SE values of the bilateral upper- and lower-limb movements were lower in infants with MDD than in those without MDD. Because lower values of SE indicate more regular or repetitive patterns in time-series data, the results can be interpreted as more monotonous spontaneous movements of the bilateral upper and lower limbs in infants with MDD, possibly attributable to injuries of neural substrates [19]. These findings are generally consistent with those of previous studies which showed a low complexity of infantile movements, in terms of sample or approximate entropy, was closely related to poor developmental outcomes [19, 36]. The low complexity of spontaneous lower-limb movements measured by multiple wearable sensors and postural sway in early sitting evaluated with a force plate was observed in infants with developmental delay in these previous studies.
There were several limitations in this study. First, the sample size of infants with MDD was relatively small compared to that of infants without MDD. Normative values of SE values in high-risk infants were not investigated due to the small sample size, especially for infants with MDD. Larger cohort studies of neonatal populations are warranted to demonstrate the normative values to differentiate high-risk infants who are candidates for early intervention. Second, the motor developmental outcomes of infants were assessed at 9 months of corrected age, which may be relatively young to identify their actual motor skill competence. However, because motor developmental delay was defined as low scores on the BSID-III along with clinical judgments on the need for rehabilitation in this study, it might be sufficiently indicative of determining early intervention. It is necessary to investigate whether the complexity of infantile spontaneous movements is associated with long-term developmental outcomes in future studies.