Methods and standards
Home Visiting Evidence of Effectiveness (HomVEE) Systematic Review Handbook of Procedures and Evidence Standards: Version 2.1
The revised HomVEE Handbook (Version 2.1) has been updated to reflect how the HomVEE review applies standards and criteria from the U.S. Department of Health and Human Services to single-case design (SCD) research in the home visiting field. Revisions are primarily found in Appendix D: Standards and Reporting Procedures for Single-Case Design Research.
Single-Case Design Research Methods
This brief was developed following responses to the Federal Register notice about HomVEE’s approach to reviewing single-case design (SCD) research (available on this page). The brief is intended to provide general information about what an SCD is and how SCDs can be used to conduct rigorous research. It defines an SCD, illustrates common types of designs, and details the benefits and drawbacks of conducting SCD research.
Home Visiting Evidence of Effectiveness Review’s Model Prioritization Process
This updated prioritization brief describes how HomVEE determines which models to review. It provides hypothetical examples to illustrate the prioritization criteria. The update reflects changes introduced in the HomVEE Version 2 handbook.
Federal Register notice about HomVEE approach to reviewing single-case design research
This Federal Register notice, published in 2021, details clarifications and changes HomVEE proposed to make to procedures and standards related to single-case design research. The final clarifications and changes that HomVEE adopted are available in the Version 2.1 Handbook of Procedures and Standards elsewhere on this site.
Issue Brief: Response to Comments from the Public on Revised HomVEE Procedures and Standards
For the first time since its inception, HomVEE has substantially revised several of the evidence review's procedures and standards. These revisions were released in the Version 2 Handbook of the Procedures and Evidence Standards, which was published in December 2020 (see below). To inform the revisions, HomVEE solicited feedback through a public comment period announced in two simultaneous Federal Register notices (FRNs) published on August 5, 2020. This new brief summarizes HomVEE's approach to addressing key comments from the public and expert consultants in the final Version 2 Handbook.
Home Visiting Evidence of Effectiveness (HomVEE) Systematic Review Handbook of Procedures and Evidence Standards: Version 2
This handbook describes the methods used by the Home Visiting Evidence of Effectiveness (HomVEE) review to review existing research and report the findings. It is designed for use by researchers, policymakers, and other stakeholders. For the first time since its inception, HomVEE has substantially revised several procedures and standards for its review. HomVEE consulted with methodological experts and other federal evidence reviews to refine and update the procedures and standards in this document. These changes bring HomVEE generally into alignment with procedures and standards for other federally sponsored systematic evidence reviews, and they address critical topics in the evolution of the home visiting field. HomVEE will apply these procedures and standards beginning with the 2021 annual review.
Home Visiting Evidence of Effectiveness (HomVEE) Systematic Review Handbook of Procedures and Evidence Standards: Version 1
This document describes the original process and standards HomVEE used to review research from impact studies. (In 2020, HomVEE released its Handbook of Procedures and Standards: Version 2.0; those updated procedures and standards are available elsewhere on this page.)
HomVEE updated reporting guide for study authors
The author reporting guide, which has been updated from the 2016 version, provides evaluators guidance about how to describe randomized controlled trials and matched comparison group design studies, and report their findings clearly so that systematic reviews can use their results. Reporting the information described in this guide is considered a best practice in general, and the information can help HomVEE reviewers assess the appropriate rating to assign to the study. The latest update clearly identifies the information that HomVEE seeks from evaluators, which will help the project assign prioritization points that determine which early childhood home visiting models are reviewed.
Flowchart illustrating non-experimental comparison group design standards
This flowchart shows HomVEE’s process for rating matched comparison group studies, along with definitions of key concepts the HomVEE team considers when rating studies. Users of this flowchart may also read more about producing study ratings elsewhere on the HomVEE website
Flowchart illustrating randomized controlled trial standards
This flowchart shows HomVEE’s process for rating randomized controlled trials, along with definitions of key concepts the HomVEE team considers when rating studies. Users of this flowchart may also read more about producing study ratings elsewhere on the HomVEE website.