From the search with English keywords, we obtained 507 titles, with Spanish keywords, 97 titles, and with Portuguese keywords, 37 titles, adding up to 641 references.
Of the 641 references retrieved, there were 222 excluded duplicates. One paper was added from an external source. Of the 420 articles screened, 328 were excluded based on title and abstract. Of the 92 studies selected for full-text review, 31 were included in the study and selected for extraction. The main reasons for exclusion were that the study was not in an LMIC and it was not possible to isolate an effect in preschoolers, and written in a language other than English, Spanish, or Portuguese (either Chinese Mandarin, Arabic, Persian, or Turkish). (See Fig. 1).
General Characteristics of the Studies
The 31 studies were classified according to their WHO region (Organization, 2017): the Americas, Africa, European, and Western Pacific. No studies from the Eastern Mediterranean region or the Southeast Asia region were selected (see Appendix 1).
The region of the Americas had the largest proportion of studies selected (45%). The country with the majority of included studies was Brazil (19%). Most of the papers (74%) were written in the last ten years. Notably, the number of studies would have been greater if studies in Mandarin Chinese or Turkish had been included (respectively, five and four studies were selected). We also found that the large majority (80%) of studies used versions of the CBCL even if the instrument was not validated for use in their study population. This means that based on validation efforts, only xx of the studies worked with a validated More than 30% of the studies had small samples of fewer than 100 people recruited in a single preschool/institution or small areas. The small sample sizes may represent a specific geographic area, and the studies could be of good quality but may not allow for the extrapolation of results to similar populations.
One study examining internalizing problems in preschoolers in 24 countries(Rescorla et al., 2011) found that the six with the highest mean internalizing scores were Singapore, Iran (LMIC), Romania (LMIC), Lithuania, Turkey (LMIC), and Chile, and reported that the estimated means of internalizing problems in these six countries did not differ significantly from each other.
For a detailed description of all the findings, see Tables 1 to 4.
Region of the Americas
Seven of the fourteen studies in the Americas were written in Spanish, five in English, and two in Portuguese. Four of the five studies in English were conducted in Brazil, (six, or 43% of the studies in this region). Eleven studies were cross-sectional, and only three were longitudinal. Regarding sample size, six studies (43% of the studies in this region) had samples of fewer than 100 participants. The studies with larger samples were all conducted in Brazil. The majority (57%) were of fair quality based on the Quality Assessment tool(National Heart & Institute, 2014) and the PRISMA checklist.(Liberati et al., 2009)
Prevalence of Internalizing problems and syndromes in the region
Only two studies (Matijasevich et al., 2014; Santos et al., 2015), both conducted in Brazil with representative samples of a city (one in Pelotas, Rio Grande, in 2004 (n = 3,750), and one in Salvador, Bahía, in 2001 (n = 349), described the prevalence of internalizing problems in preschoolers. Their estimates were 7.8%(Matijasevich et al., 2014) and 9.7%(Santos et al., 2015). respectively. Other studies(El Rafihi-Ferreira et al., 2016; Lacunza, 2011; Lins & Alvarenga, 2015) described the prevalence of internalizing problems but had fewer than 100 participants, or they were not representative samples.
The study conducted in Pelotas compared two cohorts and reported a significant increase of 10% in the internalizing problem scores over eleven years (between 1993 and 2004) (Matijasevich et al., 2014), but not in the prevalence of clinically significant cases (from 5.6 to 7.8%). One study conducted in Mexico City(Gil Rodríguez et al., 2018) with 60 dyads of mothers and their children found a mean score of internalizing problems of 56.38 (SD = 9.08) on the CBCL. Assuming a normal distribution, about 16% of the children may have internalizing problems in the clinical range (≥ 64).
Three studies(Markovic et al., 2016; Montoya Arenas et al., 2014; Santos et al., 2015) described the most frequent internalizing syndromes in preschoolers; they included two in Brazil with representative samples (Markovic et al., 2016; Santos et al., 2015) and one study in Colombia with a small sample (n = 20)(Montoya Arenas et al., 2014). The two Brazilian studies found that the most common internalizing problem was being withdrawn. The other study, conducted in Colombia (n = 20), found that based on parental reports, the most common internalizing problem in preschoolers was somatization, but based on teacher reports, the most common internalizing problem was depression(Montoya Arenas et al., 2014).
The remaining studies did not provide mean scores or prevalence estimates of internalizing problems or syndromes. Instead, their focus was to make comparisons and estimate associations, as described below.
Risk factors studied in the region of the Americas
Studies in this region focused on examining the risk of internalizing problems according to child characteristics and the home environment. The child’s characteristics examined were: deficits in social skills(Lacunza, 2011) and sleep disturbance(El Rafihi-Ferreira et al., 2016) as well as persistent difficulties in the child’s ability to respond, lack of involvement in activities, and .diminished general emotional availability (Gil Rodríguez et al., 2018). The home environment characteristics examined were: maternal age, paternal age, number of siblings(Lins & Alvarenga, 2015), maternal psychopathology, absence of father(Santos et al., 2015), socioeconomic status (SES)(Matijasevich et al., 2014), early adversity(Corapci et al., 2006), and bed-sharing(Santos et al., 2017).
Significant relationships with the child’s characteristics were in the expected direction; general internalizing problems were associated with a deficit in social skills(Lacunza, 2011), sleep disturbance(El Rafihi-Ferreira et al., 2016), difficulties in child’s ability to respond, child’s involvement in activities, and child’s general emotional availability (Gil Rodríguez et al., 2018). Child’s ability to respond was protective against the anxious/depressed syndrome, and child’s emotional availability was protective against the withdrawn syndrome (Gil Rodríguez et al., 2018).
Significant relationships were also in the expected direction with respect to the home environment variables, such that risky exposures were associated with high internalizing problem scores (e.g., controlling criticism in the mothers, lower maternal education (Lins & Alvarenga, 2015), absent father (Santos et al., 2015), dyadic emotional availability (Gil Rodríguez et al., 2018)). Persistent and early onset bed-sharing were associated with increased odds of internalizing problems(Santos et al., 2017). One study(Santos et al., 2015) found a significant association between maternal psychopathology and externalizing problems, but not with internalizing problems. Regarding specific syndromes, there were negative relationships between maternal age and somatic complaints (Lins & Alvarenga, 2015), maternal education and withdrawn(Lins & Alvarenga, 2015), and between SES and anxious/depressed syndrome(Matijasevich et al., 2014).
Assessment of Confounding
In most of the selected studies, there was no assessment of confounding, or it was not reported. Only four studies (29% in the region) (Matijasevich et al., 2014; Pearson et al., 2019; Santos et al., 2017; Santos et al., 2015), conducted in Brazil, described the assessment of confounding and/or provided adjusted estimates. Included confounders were family income (Pearson et al., 2019; Santos et al., 2017; Santos et al., 2015), marital status (Matijasevich et al., 2014; Pearson et al., 2019), maternal age (Pearson et al., 2019; Santos et al., 2015), child’s age(Matijasevich et al., 2014; Santos et al., 2017), schooling, skin color, depressive symptoms, smoking during pregnancy, type of delivery (Santos et al., 2017), number of children under five in the home, number of persons per room, and level of mother-child interaction(Santos et al., 2015), other parental and socioeconomic characteristics, (Pearson et al., 2019) age at the time of testing, family socioeconomic position, maternal parity, maternal smoking during pregnancy, child’s low birthweight, multiple pregnancies, maternal employment, and maternal psychiatric problems.(Matijasevich et al., 2014)
Mediators and Moderators
Two studies in Brazil examined mediators or moderators of the relationship between internalizing problems and their potential predictors. One study (Pearson et al., 2019) examined mediation of the relationship between the grandmother’s and child’s internalizing problems, finding partial mediation of mother internalizing problems. Another study examined the moderating role of verbal IQ in the relationship between early adversity and internalizing problems in early childhood and early adolescence (Corapci et al., 2006), finding that verbal IQ moderated this relationship in early adolescence but not in early childhood.
Differences by Sex and Age of Preschoolers
Differences by sex and age in scores of internalizing syndromes were explored in four studies. A study in Brazil(Matijasevich et al., 2014) found that girls had higher scores of anxiety/depression than boys and an increase in number of somatic complaints over the course of ten years. In Mexico, a study(Albores-Gallo et al., 2016) found that the scores for somatic complaints had higher internal consistency for boys than for girls. Studies in Argentina and Peru found no significant differences by sex in behavioral inhibition (Lacunza, 2011) or anxiety/withdrawn syndrome (based on the SCBE)(Bárrig Jó & Alarcón Parco, 2017).
Studies on the Measurement of Internalizing Problems
Three studies in the Americas examined the validity of the tests used to measure internalizing problems. A study in Mexico(Albores-Gallo et al., 2016) using the CBCL 1.5-5, concluded that anxiety and depression had better consistency when grouped. A study in Colombia (Cano et al., 2018) examined the criterion validity of the Early Childhood Screening Assessment, concluding that internalizing and externalizing symptoms load on more than one factor. A study in Argentina(Reyna & Brussino, 2009) examined the psychometric properties of the Preschool and Kindergarten Behavior Scales, finding that behavioral problems were explained by two factors: internalization and externalization.
European Region
All ten studies were written in English. Turkey had the highest number of studies in this region (four, or 40% of the studies). Regarding study type, seven were cross-sectional, two were longitudinal, and one was a randomized control trial. None of the cross-sectional studies (Hesapcioglu et al., 2017) had samples of fewer than 100 people. The studies in this region with samples smaller than that were longitudinal. The quality of the majority of studies was good (60%).
Prevalence of Internalizing Problems and Syndromes in the region
One study(Markovic et al., 2016), conducted in Serbia, estimated the prevalence (17%) of internalizing problems in a representative sample of preschoolers in one city. One study in Turkey(Erol et al., 2005) estimated the prevalence of behavioral problems at 11.9%, but the estimate for internalizing problems could not be teased out. A study in Romania reported that internalizing disorders were the most prevalent psychiatric disorders in preschool children(Zeanah et al., 2009).
Only the study in Serbia described the prevalence of internalizing syndromes. They found that the most common internalizing symptom was withdrawal (9.3%), and the least common (2.4%) was somatic complaints. One study in Turkey (Karabekiroglu et al., 2009) estimated the mean score of internalizing problems in the CBCL 2–3 to be 6.85 (normal scores). A study conducted in 24 countries(Rescorla et al., 2011) found that Turkey was the second highest-scoring country on the anxious/depressed syndrome and the fourth or fifth highest on the other three internalizing syndromes. Romania and Turkey were among the six countries with the highest mean scores on total internalizing problems in preschoolers.
Risk factors studied in the European region
Studies in this region focused on the relationship of internalizing problems with characteristics of the environment and with adverse events, emphasizing the effects of maternal psychopathology.
The risk factors significantly associated with internalizing problems were: maternal psychological problems (Hesapcioglu et al., 2017; Ruchkin et al., 2008; Yurdusen et al., 2013), alcohol use during pregnancy(Ruchkin et al., 2008), prenatal smoking(Wasserman et al., 2001), early effortful control(Kozlova et al., 2019), lifetime lead exposure(Wasserman et al., 2001), family dysfunction (Ruchkin et al., 2008), compromised postnatal condition of the child(Ruchkin et al., 2008), effective emotion regulation strategies (Ştefan & Avram, 2017), attachment security(Ştefan & Avram, 2017), institutionalization(Zeanah et al., 2009), urban residence(Erol et al., 2005), mother’s rejection of home-making role (Yurdusen et al., 2013).
The harmful exposures mentioned above, e.g., maternal psychopathology, low effective emotional reactivity strategies, all had a positive association with internalizing problems.
Regarding other exposures, one study(Erol et al., 2005) found that children from urban areas obtained significantly higher scores on internalizing problems than children from suburban and rural residences. Another study(Zeanah et al., 2009) found that children removed from institutions and placed in foster families were less likely to have internalizing disorders than those who continued care as usual (22.0% versus 44.2%).
Assessment of Confounding
Of the ten selected studies, three reported an assessment of confounding and adjusted estimates(Ruchkin et al., 2008; Ştefan & Avram, 2017; Wasserman et al., 2001). The confounders were: child’s age(Ruchkin et al., 2008; Ştefan & Avram, 2017; Wasserman et al., 2001), child’s sex, ethnicity, language spoken at home, acceptance, and maternal education(Wasserman et al., 2001), SES(Ruchkin et al., 2008).
Mediators and Moderators
A cross-sectional study in Russia (Ruchkin et al., 2008) found that continued maternal/family dysfunction and compromised postnatal condition of the child mediate the effects that alcohol use during pregnancy and maternal psychopathology have on child internalizing symptoms. Another cross-sectional study in Romania(Ştefan & Avram, 2017) found that effective emotion regulation (problem-solving) in the child fully mediated the relationship between attachment security and internalizing problems.
Moderation by the sex of the child was examined in this region, as discussed below.
Differences by Sex and Age of Preschoolers
Half of the studies in this region examined differences in internalizing problems by sex.
Two studies, one in Serbia(Markovic et al., 2016) and another in the former Yugoslavia (Wasserman et al., 2001), examined differences in internalizing problems by sex. One of the studies(Markovic et al., 2016) compared the mean scores of boys and girls on internalizing CBCL syndromes in Serbia with the mean scores of boys and girls in the United States (US). Serbian girls had significantly higher scores on total internalizing problems than Serbian boys (2.2 vs. 1.8). In the Caregiver Teacher Report Form (CTRF), both Serbian boys and girls had significantly higher mean somatic complaints than boys and girls in the US (3.8 vs. 3.6, and 1.2 vs. 0.7)(Markovic et al., 2016). The study in the former Yugoslavia (Wasserman et al., 2001) found that the only statistically significant interaction with sex was for somatic problems, where scores for somatic problems in girls differed across maternal smoking status.
A study in Romania (Zeanah et al., 2009) examined children reared both in institutions and who had never been institutionalized. Boys had more internalizing symptoms than girls, regardless of institutionalization history. Also, unlike girls, the total number of psychiatric symptoms of institutionalized boys was not reduced after being placed in foster care.
A study (Karabekiroglu et al., 2009) in Turkey found that the mean total internalizing scores of boys and girls were not significantly different. Regarding syndromes, another study in Turkey (Erol et al., 2005) found that girls had higher scores than boys on the anxious/depressed score. These same two studies in Turkey examined differences in internalizing problems by age. One found no significant differences by age (Karabekiroglu et al., 2009). The other found that two and three-year-olds had more somatic complaints than older children.(Erol et al., 2005)
Studies on the Measurement of Internalizing Problems
One selected study (Karabekiroglu et al., 2009), conducted in Turkey, assessed the validity and reliability of a scale to measure internalizing and externalizing problems in preschoolers (The Brief Infant-Toddler Social and Emotional Assessment (Briggs-Gowan et al., 2004)). The total score of this scale is correlated with internalizing and externalizing scores in the CBCL, but does not differentiate between the two dimensions.
Western Pacific Region
According to the WHO, the Western Pacific Region includes some Asian countries. Only five studies from this region, all from China, were included. The five studies selected were published in English, and they were rated as being of good quality. Four of these studies were longitudinal measures, and only one was cross-sectional. One of the longitudinal studies(Liang et al., 2019) had a sample of fewer than 100 people.
Only one study(Liu et al., 2013) estimated the prevalence of internalizing problem scores, at 18%, obtained from a representative sample of preschoolers in the city of Jintan.
Risk factors studied in China
The risk factors in the studies conducted in China were: Parenting stress(Liu & Wang, 2015), environmental tobacco smoke exposure during pregnancy (ETS)(Liu et al., 2013), micronutrient deficiency(J. Liu et al., 2014), blood lead concentration (Jianghong Liu et al., 2014), and infant withdrawal(Liang et al., 2019). Except for parenting stress in fathers and ETS, these risk factors were significantly associated with internalizing problems in preschoolers in the expected direction. For specific syndromes, an increase in blood lead concentration was associated with increased odds for anxious/depressed and emotionally reactive, as well as with increased odds for DSM oriented anxiety (J. Liu et al., 2014).
Assessment of Confounding
Four of the five selected studies reported adjusted estimates or assessments of confounding. The confounders were: child’s sex (J. Liu et al., 2014; Liu et al., 2013; Jianghong Liu et al., 2014), parental education(J. Liu et al., 2014; Liu et al., 2013; Jianghong Liu et al., 2014), occupation(Liu et al., 2013; Liu & Wang, 2015), school area (city, suburban or rural), and psychopathologic problems; maternal age during pregnancy; father’s current (postnatal) smoking status(Liu et al., 2013), family size, house size(J. Liu et al., 2014), residence, parents’ marital status, single child, IQ(Jianghong Liu et al., 2014), previous internalizing and externalizing problems(Liang et al., 2019).
Mediators and Moderators
Only one study (Liu & Wang, 2015) examined mediation. This study found that psychological aggression by mothers partially mediated the relationship between parenting stress and children’s internalizing behaviors. No significant direct effects or indirect effects of aggression by fathers were found though they were explored.
Differences by Sex and Age
One study examined sex and age differences. In boys, there was a slight negative association between blood lead concentration and internalizing problems at age 4. At age 5, blood lead concentration and internalizing problems were positively associated in both boys and girls. There were no studies in China on the measurement of Internalizing Problems identified in this review.
African Region
For this region, only one study conducted in South Africa (Rotheram-Fuller et al., 2018) met inclusion criteria. The study had good quality based on the PRISMA checklist. The study was a randomized controlled trial to examine the effect of an intervention on maternal depression during pregnancy and described the consequences of maternal depression on children’s problem behaviors in the first three years of life. They examined differences in direct symptom scores and differences in clinically significant scores (internalizing score deviant). Regarding symptom scores, children of mothers who had been depressed postnatally, antenatally, or both, had higher mean scores than chidlren of never depressed mothers. On the measure of internalizing score deviant, children of mothers who had been depressed postnatally, antenatally, or both, had a higher probability of symptoms than children of never depressed mothers.
Confounders
The confounders included in this study were maternal HIV status, alcohol use, food insecurity, and baseline education.