Methods and standards

Federal Register notice about HomVEE version 2 procedures and standards

August 2020

This Federal Register notice, published in 2020, details clarifications and updates that HomVEE proposed to its procedures and standards. The notice preceded publication of the HomVEE Version 2 handbook, where final procedures and standards are now documented.

Federal Register notice about HomVEE definition of home visiting model and model versions

August 2020

This Federal Register notice, published in 2020, details definitions, rules, and procedures to guide how HomVEE handles home visiting model versions (commonly referred to in the home visiting research literature as adaptations and enhancements) in the review. The notice was released in advance of publishing the final HomVEE Version 2 handbook, where final definitions, rules, and procedures are now documented.

HomVEE fact sheet

February 2018

HomVEE systematically reviews the research on early childhood home visiting models that serve pregnant women or families with children up to kindergarten entry. It determines which models have enough rigorous evidence to be considered evidence-based according to criteria defined by the U.S. Department of Health and Human Services (HHS). This 3-page fact sheet describes how HomVEE evaluates home visiting programs and provides stakeholders with an overview of how evidence-based home visiting models are identified through a four step evaluation process.

Addressing Attrition Bias in Randomized Controlled Trials: Considerations for Systematic Evidence Reviews

July 2015

This paper is focused on attrition and the HomVEE attrition standard in particular. The paper begins by defining attrition and explaining why the bias that attrition introduces into randomized controlled trials can be problematic when interpreting research results. HomVEE uses an attrition standard adapted from the Department of Education’s What Works Clearinghouse (WWC), another systematic evidence review. HomVEE’s population of interest includes pregnant women, and families with children age birth to kindergarten entry; the population is different than the school-age children whose test scores were the basis of the attrition standard for the WWC. This paper describes findings testing the sensitivity of the assumptions underlying the HomVEE standard using data about parents and young children.

What Isn’t There Matters: Attrition and Randomized Controlled Trials

August 2014

A randomized controlled trial (RCT) offers a highly credible way to evaluate the effect of a program. But a strong design can be offset by weaknesses in planning or execution. One common problem that weakens the conclusions of RCTs is attrition, or missing data. This brief describes what attrition is, why it matters, and how it factors into the study ratings in the HomVEE review.

On Equal Footing: The Importance of Baseline Equivalence in Measuring Program Effectiveness

August 2014

To understand the effects of a program, researchers must distinguish effects caused by the program from effects caused by other factors. This effort typically involves comparing outcomes for two groups. The similarity of the two groups before program services begin is referred to as baseline equivalence. This brief explains the role of baseline equivalence when measuring a program’s effectiveness.