Child characteristics and early intervention referral and receipt of services: a retrospective cohort study

This was a retrospective cohort study linking primary care electronic health record data from Denver Health, a large, integrated safety net health system in Metro Denver, and administrative data from Rocky Mountain Human Services Early Intervention Program (RMHS) EI records. The cohort included children with developmental delay or disability who received at least one Denver Health well-child visit between 10/1/2014–6/30/2016. Denver Health includes a 477-bed hospital and 8 Federally Qualified health centers serving approximately 50,000 low-income children annually (35% of Denver children). Their database includes children’s clinical information, EI referral status, and sociodemographics. Previous research utilizing this database described service delivery gaps in pediatric obesity, [18] vaccines, [19] and developmental screening [20].

RMHS, located in Metro Denver, serves approximately 1000 families annually, including all Denver Health-referred patients. The RMHS database includes service use and functional outcomes. All children referred to RMHS between 10/1/14–9/30/16 (i.e., a three-month lag from Denver Health data collection) were included, allowing us to include at least a 3-month time lag between EI referral and EI access to account for the federal mandate requiring an IFSP is written within 45 days of EI referral.

The cohort included children less than 35 months of age with a diagnosed condition or developmental delay (described in Explanatory variables). Children were linked via first and last names and dates of birth across the Denver Health and EI databases using the reclink2 algorithm in Stata [21]. Observations were kept as acceptable matches if the resultant probability of an exact match was 85% or greater [22].

The Colorado Multiple Institutional Review Board approved this study and the Institutional Review Board at the Massachusetts Department of Public Health approved this study and the investigators’ access to the data.

The primary dependent variables were EI referral (Aim 1), IFSP receipt (Aim 2), and EI service type and number of services used (Aim 3). EI referral was ascertained from the Denver Health record. At Denver Health, EI referrals are entered by a provider, electronically documented, and sent directly to RMHS through a HIPAA-compliant portal. IFSP receipt was collected from the RMHS EI database. EI service type was assessed from the RMHS EI data based on receipt of any PT, OT, ST, or DI. Total number of EI services received from EI was categorized as 1, 2, and 3 or more. Of note, the vast majority of EI services occur in the child’s home.

Covariates Ascertained from Denver Health. Child’s race and ethnicity was categorized as white, non-Hispanic (WNH); black, non-Hispanic (BNH); Hispanic; and other race, non-Hispanic (ONH; includes Asian, Pacific Islander and more than one race). Annual household income (less than $20,000 or $20,000 or more) reflects the Federal Poverty threshold for a family of three [23]. We included infant birthweight (less than 1500 g, 1500–2500 g, and greater than 2500 g).

We also included measures of child’s condition type and severity. Data was pulled from Denver Health based on children having the required ICD-9 codes for the study, which we then split into two condition types: diagnosed condition and developmental delay. ICD-9 codes corresponding to diagnoses in the EI-Colorado Established Condition Database indicated a diagnosed condition. Common diagnosed conditions included Down syndrome, autism, cerebral palsy, and extremely low birth weight [24]. Developmental delay was indicated by ICD-9 code 315 (generalized developmental delay) without a co-occurring diagnosed condition, which is typically attributed to children with a failed developmental screening. In Colorado, children are eligible for EI if they show a 25% delay in one or more developmental areas [25]. Of note, in 2012 Denver Health’s information technology system underwent a major transformation allowing utilization of patient health records to provide tailored care, staff resources, and care-management services [26]. Simultaneously, electronic EI referrals for presumably EI-eligible children were implemented. Thus, ascertainment of condition type (i.e., diagnosis or delay) and EI referral are based upon validated processes.

Severity was categorized according to a clinically actionable 4-Tier severity algorithm employed by Denver Health based on published predictive models and front-line clinical judgement [26]. The four Tiers are comprised of (1) no chronic condition and age appropriate health service utilization; (2) mild condition requiring minimally elevated health service utilization; (3) moderate condition necessitating moderately elevated health service; and (4) severe chronic condition requiring high health service utilization. Due to clinical presentation heterogeneity, condition type and severity sub-groups do not overlap perfectly, however, the majority of Tier 1 and many Tier 2 children had a developmental delay only whereas the large majority of children in Tiers 3 and 4 had a diagnosed condition (such as cerebral palsy or Down syndrome).

Covariates Ascertained from RMHS. We included measures of child’s sex (male/female), primary language spoken at home (English vs a language other than English), insurance type (private or public [includes Medicaid and Children’s Health Insurance Program]) and age at EI entry (less than 12 months, 12–24 months, or 25–35 months). EI providers collect functional outcomes data at EI entry and exit for mandated reporting to the Office of Special Education Programs [27] in the form of Child Outcomes Summary (COS) scores. COS has been shown to have high clinical utility [28‐30] and measures children’s function in 1) Social-Emotional, 2) Acquiring and Using Knowledge and Skills (cognition), and 3) Adaptive/Self-Care skills. Each domain score is a composite of parent and provider report and formal assessment comparing the child’s function to that of typically developing peers on a 7-point scale [1=“very early skills” (i.e., child does not use any immediate foundational skills related to this outcome) to 7=“all skills expected” (i.e., no concerns about the child’s function)] [31]. More specifically, EI-CO developed age-anchored developmental tasks [32] to address each COS domain. Information to assess the acquisition of these developmental tasks can be ascertained from a combination of parent report, functional assessment results (e.g., EI-CO uses the Batelle Developmental Inventory-2 [BDI-2]), and provider clinical judgement. All CO-EI providers receive extensive training in the administration, scoring, an interpretation of BDI-2 and COS scores [33]. Yet, currently, RMHS does not have mechanisms in place to ensure routine COS collection, therefore there is not 100% compliance.

To describe the association between child characteristics and the number of EI services received in Aim 3, we estimated adjusted ordinal logit regression models due to the ordered nature of service use categories. We estimated the marginal effects and 95% CI of receiving each service use category (i.e., relative to the others) for each child characteristic. Marginal effects are interpreted as probabilities and estimate the associations between child characteristics and service use category. Compared to odds ratios, they are more intuitive and are not affected by extremely common or rare events [34, 35]. All analyses were conducted in Stata v14.2 [21].

The cohort included 14,710 children with either a developmental delay or a developmental disability. Of the 14,710 children, 2746 (18.7%) were referred to EI and of those referred, 722 (26.3%) received an IFSP (Fig. 1, Table 1). Of those with an IFSP, 571 initiated EI services, and of those, 448 had complete COS information (Fig. 1, Table 2). Children with and without complete COS information did not differ by clinical or sociodemographic characteristics (results not shown). Among children EI-referred and with an IFSP, 12.3% had a diagnosed condition, over 90% had an annual family income of less than $20,000, 73.7% were Hispanic, 15% were white, non-Hispanic (WNH), and 13% were black, non-Hispanic (BNH); 62.0% were under 12 months of age, and 70.6% had no chronic condition (n = 1).

Mean (SD) entry COS scores were 3.7 (1.5) for Acquiring and Using Knowledge and Skills, 4.3 (1.7) for Adaptive/Self-Care, and 4.6 (1.8) for Positive Social Emotional function. Twenty-one percent of the EI sample received PT, 17.3% received OT, 74.4% received ST, and 49.4% received DI (Table 2).

Children who had a diagnosis versus a developmental delay were 4.6% less likely (ME = -0.046 [− 0.087, − 0.005)] to be EI-referred. Normal birthweight (> 2500 g), and low birthweight (1501–2500 g) infants were 26.9% (ME = -0.269 [− 0.365, − 0.174) and 17.6% less likely (ME = -0.176 [− 0.276, − 0.077]) than very low birthweight (< 1500 g) infants to be referred. One-year olds were more likely to be EI-referred [ME = 0.023 [0.006, 0.041]) and 2-year olds were less likely to be EI-referred [ME = − 0.042 [− 0.058, − 0.025]) than infants. BNH children were 2.9% less likely than WNH children (ME = -0.029 [− 0.054, − 0.004]) to be referred. Children with severe, moderate, and mild conditions were 33.4% (ME = .334 [0.249, 0.420]), 33.8% (ME = 0.338 [0.314, 0.461]), and 9.8% (ME = 0.098 [0.070, 0.127]), respectively, more likely than children with no special health care condition to be referred (Table 3).

Children with severe, moderate, and mild conditions were 15.6% (ME = 0.156 [0.088, 0.223]), 15.4% (ME = 0.154 [0.095, 0.213]), and 2.4% (ME = 0.024, [0.008, 0.040]), respectively, more likely than children with no special health care condition to receive an IFSP. One-year olds were more likely [ME = 0.014 [0.004, 0.025]) and two-year olds were less likely to receive an IFSP [ME = − 0.031 [− 0.039, − 0.023]) than infants (Table 3).

Children with diagnosed conditions were 22.5% more likely to receive PT (ME = 0.225 [0.104, 0.347]), 21.4% more likely to receive OT (ME = 0.214 [0.091, 0.337]), and 22.4% more likely to receive DI (ME = 0.224 [0.088, 0.360]) than children with a developmental delay (Table 4), and were also more likely to receive three or more services (ME = 0.319 [0.199, 0.440]; Table 5). Low-income children were 13.6% less likely to receive PT (ME = -0.136 [− 0.201, − 0.071]) and 10.4% less likely to receive OT (ME = -0.104 [− 0.197, − 0.011]) than higher income children. Compared to children with birthweights less than 1500 g, children in other birthweight groups were more likely to receive PT. One-year olds were 11.4% less likely (ME = -0.114 [− 0.213, − 0.016]) and 2-year olds were 23.4% (ME = -0.234 [− 0.400, − 0.086]) less likely to receive DI than infants (Table 4).

Children with higher baseline Social-Emotional function were 5% more likely to receive PT (ME = 0.054 [0.026, 0.082]) and 7.3% less likely to receive DI (ME = -0.073 [− 0.112, − 0.034]. Children with higher baseline cognitive function were 3.9% more likely to receive PT (ME = 0.039 [0.010 0.068]) and 4.9% less likely to receive ST (ME = -0.049 [− 0.086, − 0.011]). Children with higher baseline Adaptive/Self-Care function were 5.1% less likely to receive OT (ME = -0.051 [− 0.078, − 0.025]), 5.1% less likely to receive ST (ME = -0.051 [− 0.078, − 0.025]), and 5.8% more likely to receive DI (ME = 0.058 [0.027, 0.090]) (Table 4).

A main finding of this study is that BNH children were less likely than their WNH counterparts to be EI-referred. While the reasons behind racial differences in EI referral are not explored in this study, these disparities in access have been reported [3]. A recent systematic review [36] of such research suggests that racial differences in care stem, in part, from differences in provider behavior. Providers tend to dismiss parental developmental concerns and abnormal developmental screening results and attribute them to social rather than clinical risk for BNH families compared to WNH, which could translate to fewer EI referrals.

The second main finding of this paper is that children with diagnosed conditions were less likely than their peers with a developmental delay to be EI-referred after accounting for condition severity. It may be that children with diagnosed conditions are being referred to specialty clinics more often and receiving care outside of EI [37]. In fact, one study found that half of birth to 3 year olds with a developmental condition receive clinic-based therapy services [38]. Additionally, children with more severe conditions are more likely to receive an EI referral regardless of their condition type. These findings highlight the clinical complexity of EI-eligible children and suggest that children most likely to receive an EI referral are those whose condition aligns with federal and CO-EI eligibility (e.g., developmental delay, extremely low birth weight, and high need special healthcare conditions).

The third main finding of this paper is that, compared to infants, 2-year olds are less likely to receive an IFSP. While this study cannot examine causality and there are limited comparable findings, it suggests caregivers of 2-year olds with developmental concerns need tailored support to navigate the EI system, especially since they typically interface less with primary care and have a shorter time window to access EI.

While we have limited comparisons for EI access findings, one study found that 30–50% of EI-referred children receiving care in urban pediatric practices received an EI evaluation, [11] fitting with 31% in our sample (Fig. 1). Moreover, we found that children with greater condition severity were more likely to access EI and that the majority of our cohort had a developmental delay (versus established condition), also consistent with previous literature [5, 36].

Reasons for access gaps may be numerous, and have been explored in previous studies [15, 16]. Future research should engage EI stakeholders (pediatricians, EI providers and parents) to understand EI enrollment barriers as previous research suggests that increasing family engagement [15] and implementing cross-system strategies such as centralized referrals and patient navigators can bolster EI enrollment [16].

We found EI service use gaps among the poorest cohort children. In this safety net population, higher income may be a marker for greater economic resources, knowledge, or capacity to advocate for PT and OT and future research should explore EI therapy barriers and facilitators.

We also found that having a diagnosed condition (versus developmental delay) was associated with higher likelihood of receiving a greater breadth of EI services. While having a diagnosis seems to trigger an EI referral less often, once these children access EI they receive a greater breadth of services than their peers with developmental delays. Future research should focus on therapy use among EI-enrolled children as previous literature is mixed with regard to service type disparities [39].

This study also examined the association between routinely collected global measures of children’s function and EI service use. Baseline functional skills were associated with core EI service use in expected directions, suggesting baseline COS scores may be a good marker of EI therapy need. For example, children with higher social-emotional function likely have less need for DI, which focuses, in part, on promoting social skills.

The data were ascertained from one health system and EI program. However, Denver Health serves as medical home to 50,000 low-income children in Metro Denver and RMHS serves approximately 2/3 of Metropolitan Denver EI-eligible children. Thus, although results may not be generalizable to the general EI-population, they are applicable to lower-income, urban, EI-eligible children; and in fact, nearly 50% of EI-enrolled children nationally are low-income [5]. Related, the prevalence rate of children with developmental conditions in this sample (14,710/50,000 = 29.4%) is comparable to national estimates of low-income infants and toddlers with or at risk for developmental delays [40]. We were unable to examine reasons for EI referral (i.e., beyond a diagnosis), EI care quality, parental concerns, or capacity to navigate or advocate within the EI system. Previous research suggests that low EI enrollment rates can be explained, in part, by families who refuse services or do not follow up on EI referrals, [15] and families play an integral role in accessing EI services. Finally, we assume that children who received diagnostic code consistent with EI-eligible conditions in CO are, in fact, EI-eligible. However, we have no way to confirm this among the children who did not receive an EI evaluation. Yet, if pediatricians document a developmental delay in a child’s medical record, it seems plausible that developmental follow-up or referral is warranted. Additionally, Colorado eligibility for EI stipulates that a child has a 25% or greater delay in one or more developmental areas [25], and in this study we found that very few children who received an EI evaluation were found ineligible (Fig. 1). Future research should conduct qualitative interviews with providers and parents to understand care quality, including shared decision-making, and EI service gaps.

To our knowledge, this is the first study to link pediatric primary care and EI records to examine EI service use among a low-income EI-eligible cohort. We found differences in receipt of EI therapy services by condition type, income, and baseline function. These findings have important implications for EI providers, program directors, and policy makers for improving outreach and care planning. The methods of this study can serve as a model for leveraging electronic health data to examine EI service use gaps with an eye toward improving access, service use patterns, and functional outcomes.

Our findings of the prevalence of developmental delays is well aligned with national estimates of the prevalence of children at risk for developmental delay in low-income settings [40]. We also found that most children receiving EI services are doing so because of a developmental delay, rather than a diagnosed condition, which also matches previous findings [41] and bolsters the validity of our results. Moreover, our EI-referral rate of 18.7% is consistent with previous literature examining developmental follow-up for urban children with a failed developmental screening, [10] suggesting generalizability to similar populations.