Manuscript Detail

View Revisions

Spieker, S. J., Oxford, M. L., Kelly, J. F., Nelson, E. M., & Fleming, C. B. (2012). Promoting First Relationships: Randomized trial of a relationship-based intervention for toddlers in child welfare. Child Maltreatment, 17(4), 271-286.

Manuscript screening details
Screening decision Screening conclusion HomVEE procedures and standards version
Passes screens Eligible for review Version 2
Study design details
Rating Design Attrition Baseline equivalence Compromised randomization Confounding factors Valid, reliable measure(s)
High Randomized controlled trial Low

Not assessed for randomized controlled trials with low attrition

No

No

Yes, details reported below for findings on valid, reliable outcomes

Notes:

The findings for the immediate post-intervention follow-up received a high evidence rating. The findings measured at six months post-intervention received a low evidence rating because attrition was high, and the findings did not satisfy the baseline equivalence requirement. The authors’ analyses controlled for whether the child experienced multiple removals from the birth home, for the caregiver type (biologically-related or foster), and for the age of the child. The authors’ analyses also controlled for the baseline measures of the following findings: caregiver sensitivity, support, commitment, understanding of toddlers, parenting stress, child's attachment security, engagement, competence, and problem behavior. Some findings in the manuscript were not eligible for review because they measured growth from the immediate post-test to the six-month follow-up and did not measure the impact of the intervention. Information that demonstrated the reliability of the outcome measures and baseline equivalence of the intervention and comparison groups was based on correspondence with the authors.

Study characteristics
Study participants Study participants were caregiver and child dyads residing in and recruited from one county in Washington State. The study authors recruited eligible dyads through referrals from the Department of Child and Family Services. To be eligible, the child in the dyad had to be between the ages of 10 and 24 months with a court-ordered placement that resulted in a change in primary caregiver within the prior 7 weeks. The caregivers all spoke English, and caregivers were foster parents or biological parents (or adult kin). More than one-quarter (27 percent) of the caregivers were biological parents, 31 percent were other kin, and 42 percent were foster parents. Of 427 dyads contacted to participate in the study, 210 were eligible and randomly assigned to either the Promoting First Relationships – Home Visiting Intervention Model (105 dyads) or to the comparison group (105 dyads). Some children (29 in total) had a placement change within 4 months of study enrollment. However, these children and their caregivers remained in the intervention condition to which they were first assigned. The study sample at the immediate post-intervention follow-up included 175 dyads: 86 in the PFR group and 89 in the comparison group. Children were an average of 18 months old at the time of enrollment. Most caregivers and children were White (77 percent of caregivers and 57 percent of children); 10 percent of caregivers and 14 percent of children were Black and 9 percent of caregivers and 10 percent of children were Hispanic or Latino. About one-quarter of dyads reported household incomes less than $20,000 per year. Caregivers reported an average of 13 years of education.
Setting The study took place in one county in Washington State.
Intervention services Promoting First Relationships – Home Visiting Intervention Model consisted of 10 weekly sessions, each lasting 60 to 75 minutes. The home visit content was informed by attachment theory and aimed to increase parenting sensitivity. All sessions took place in the families' homes. During weekly home visits, home visitors covered the activities and instructional content in the Promoting First Relationships manual, tailoring the pace of delivery for each caregiver. Home visitors videotaped five caregiver-child interactions; they reviewed these videos with the caregivers and guided a discussion about the strengths demonstrated by the caregiver and the caregiver’s interpretation of the child's cues. Additional activities during the home visits included the review of handouts on topics related to attachment theory.
Comparison conditions The comparison group members were not offered intervention services through Promoting First Relationships. Dyads assigned to the comparison group received Early Education Support, which consisted of three monthly 90-minute home visits conducted by home visitors with bachelor’s degrees. The home visitor helped connect families to resources such as Early Head Start, early intervention, housing, mental health services, and child care; and suggested activities to promote the child's growth and development.
Subgroups examined This field lists subgroups examined in the manuscript (even if they were not replicated in other samples and not reported on the summary page for this model’s report).

There were no subgroups reported in the manuscript.

Funding sources This research was supported by Award Number R01 MH077329 from the National Institute of Mental Health and Award Number P30 HD02274 from the National Institute of Child Health and Human Development.
Author affiliation The authors are affiliated with the Barnard Center at the University of Washington, which sponsors Promoting First Relationships. Monica Oxford, one of the authors of the manuscript, is the executive director of Promoting First Relationships. Jean F. Kelly, another author, is a developer of the Promoting First Relationships model.
Peer reviewed Yes
Study Registration:

Clinicaltrials.gov Identifier: NCT00339365. SocialScienceRegistry.org Identifier: None found. Registry of Efficacy and Effectiveness Studies Identifier: None found. Study registration was assessed by HomVEE for Clinicaltrials.gov beginning with the 2014 review, and for other registries beginning with the 2021 review.

Findings that rate moderate or high

Child development and school readiness
Rating Outcome measure Effect Sample Timing of follow-up Sample size Intervention group Comparison group Group difference Effect size Statistical significance Notes
High

Attachment security: Toddler Attachment Sort-45 (TAS45, modified version of Attachment Q-Sort, using trilemmas)

FavorableUnfavorable or ambiguousNo Effect

PFR vs. EES, one county in Washington state, 2007-2010, full sample

Post-intervention

175 children Not reported Not reported Not reported Not available

Not statistically significant, p= >0.10

Finding estimated with hierarchical linear model (HLM).

High

Attachment security: Toddler Attachment Sort-45 (TAS45, modified version of Attachment Q-Sort, using trilemmas)

FavorableUnfavorable or ambiguousNo Effect

PFR vs. EES, one county in Washington state, 2007-2010, full sample

Post-intervention

175 children Adjusted mean = 0.58 Adjusted mean = 0.54 Mean difference = 0.04 Study reported = 0.16

Not statistically significant, p= 0.41

High Competence: Brief Infant Toddler Social and Emotional Assessment (BITSEA, 11 item subscale)
FavorableUnfavorable or ambiguousNo Effect

PFR vs. EES, one county in Washington state, 2007-2010, full sample

Post-intervention

175 children Not reported Not reported Not reported Not available

Not statistically significant, p= >0.10

Finding estimated with hierarchical linear model (HLM).

High

Competence: Brief Infant Toddler Social and Emotional Assessment (BITSEA, 11 item subscale)

FavorableUnfavorable or ambiguousNo Effect

PFR vs. EES, one county in Washington state, 2007-2010, full sample

Post-intervention

163 children Adjusted mean = 17.35 Adjusted mean = 16.38 Mean difference = 0.97 Study reported = 0.42

Statistically significant, p= 0.03

High

Problem behavior: Brief Infant Toddler Social and Emotional Assessment (BITSEA, 31 item subscale)

FavorableUnfavorable or ambiguousNo Effect

PFR vs. EES, one county in Washington state, 2007-2010, full sample

Post-intervention

163 children Adjusted mean = 10.81 Adjusted mean = 10.72 Mean difference = 0.09 Study reported = -0.02

Not statistically significant, p= 0.92

High

Problem behavior: Brief Infant Toddler Social and Emotional Assessment (BITSEA, 31 item subscale)

FavorableUnfavorable or ambiguousNo Effect
PFR vs. EES, one county in Washington state, 2007-2010, full sample

Post-intervention

175 children Not reported Not reported Not reported Not available

Not statistically significant, p= >0.10

Negative effect is favorable to the intervention. Finding estimated with hierarchical linear model (HLM).

Maternal health
Rating Outcome measure Effect Sample Timing of follow-up Sample size Intervention group Comparison group Group difference Effect size Statistical significance Notes
High

Stress-Difficult Child: Parenting Stress Index-Short Form (PSI-SF, Difficult Child subscale, 12 items)

FavorableUnfavorable or ambiguousNo Effect

PFR vs. EES, one county in Washington state, 2007-2010, full sample

Post-intervention

175 caregivers Adjusted mean = 10.45 Adjusted mean = 9.50 Mean difference = 0.95 Study reported = -0.22

Not statistically significant, p= 0.22

High

Stress-Difficult Child: Parenting Stress Index-Short Form (PSI-SF, Difficult Child subscale, 12 items)

FavorableUnfavorable or ambiguousNo Effect

PFR vs. EES, one county in Washington state, 2007-2010, full sample

Post-intervention

175 caregivers Not reported Not reported Not reported Not available

Not statistically significant, p= >0.10

Negative effect is favorable to the intervention. Finding estimated with hierarchical linear model (HLM).

High

Stress-Dysfunctional Interaction: Parenting Stress Index-Short Form (PSI-SF, Parent-Child Dysfunction subscale, 11 items)

FavorableUnfavorable or ambiguousNo Effect

PFR vs. EES, one county in Washington state, 2007-2010, full sample

Post-intervention

175 caregivers Adjusted mean = 6.13 Adjusted mean = 5.65 Mean difference = 0.48 Study reported = -0.13

Not statistically significant, p= 0.48

High

Stress-Dysfunctional Interaction: Parenting Stress Index-Short Form (PSI-SF, Parent-Child Dysfunction subscale, 11 items)

FavorableUnfavorable or ambiguousNo Effect

PFR vs. EES, one county in Washington state, 2007-2010, full sample

Post-intervention 175 caregivers Not reported Not reported Not reported Not available

Not statistically significant, p= >0.10

Negative effect is favorable to the intervention. Finding estimated with hierarchical linear model (HLM).

Positive parenting practices
Rating Outcome measure Effect Sample Timing of follow-up Sample size Intervention group Comparison group Group difference Effect size Statistical significance Notes
High

Commitment: This Is My Baby (TIMB)

FavorableUnfavorable or ambiguousNo Effect

PFR vs. EES, one county in Washington state, 2007-2010, full sample

Post-intervention

169 caregivers Not reported Not reported Not reported Not available

Not statistically significant, p= >0.10

Finding estimated with hierarchical linear model (HLM).

High

Commitment: This Is My Baby (TIMB)

FavorableUnfavorable or ambiguousNo Effect

PFR vs. EES, one county in Washington state, 2007-2010, full sample

Post-intervention

169 caregivers Adjusted mean = 4.10 Adjusted mean = 4.21 Mean difference = -0.11 Study reported = -0.17

Not statistically significant, p= 0.35

High

Engagement: Indicator of Parent-Child Interaction (IPCI, 9 item subscale)

FavorableUnfavorable or ambiguousNo Effect

PFR vs. EES, one county in Washington state, 2007-2010, full sample

Post-intervention

173 children Adjusted mean = 2.08 Adjusted mean = 2.15 Mean difference = -0.07 Study reported = -0.15

Not statistically significant, p= 0.39

High

Engagement: Indicator of Parent-Child Interaction (IPCI, 9 item subscale)

FavorableUnfavorable or ambiguousNo Effect

PFR vs. EES, one county in Washington state, 2007-2010, full sample

Post-intervention

173 children Not reported Not reported Not reported Not available

Not statistically significant, p= >0.10

Finding estimated with hierarchical linear model (HLM).

High

Sensitivity: Nursing Child Assessment Teaching Scale (NCATS, without 6 items on child distress)

FavorableUnfavorable or ambiguousNo Effect

PFR vs. EES, one county in Washington state, 2007-2010, full sample

Post-intervention

167 caregivers Adjusted mean = 13.26 Adjusted mean = 11.76 Mean difference = 1.50 Study reported = 0.41

Statistically significant, p= 0.02

High

Support: Indicator of Parent-Child Interaction (IPCI, 15 items)

FavorableUnfavorable or ambiguousNo Effect

PFR vs. EES, one county in Washington state, 2007-2010, full sample

Post-intervention

173 caregivers Not reported Not reported Not reported Not available

Not statistically significant, p= >0.10

Finding estimated with hierarchical linear model (HLM).

High

Support: Indicator of Parent-Child Interaction (IPCI, 15 items)

FavorableUnfavorable or ambiguousNo Effect

PFR vs. EES, one county in Washington state, 2007-2010, full sample

Post-intervention

173 caregivers Adjusted mean = 2.18 Adjusted mean = 2.14 Mean difference = 0.04 Study reported = 0.11

Not statistically significant, p= 0.49

High

Understanding of toddlers: Raising a Baby (RAB, 16 items)

FavorableUnfavorable or ambiguousNo Effect

PFR vs. EES, one county in Washington state, 2007-2010, full sample

Post-intervention 175 caregivers Not reported Not reported Not reported Not available

Statistically significant, p= <0.01

Finding estimated with hierarchical linear model (HLM).

High

Understanding of toddlers: Raising a Baby (RAB, 16 items)

FavorableUnfavorable or ambiguousNo Effect

PFR vs. EES, one county in Washington state, 2007-2010, full sample

Post-intervention

175 caregivers Adjusted mean = 52.16 Adjusted mean = 50.92 Mean difference = 1.24 Study reported = 0.36

Statistically significant, p= 0.04