-FAQ-Review standards-analyses not eligible

HomVEE focuses its resources on reviewing manuscripts about impact studies that answer the review’s core question of whether an early childhood home visiting model is effective. Research that answers other questions is not eligible for review by HomVEE. For example, questions about for whom and under what circumstances a model is effective are valuable to the field but beyond the scope of the HomVEE review.

Research evaluating the impact of an isolated model feature or group of features is generally ineligible for HomVEE’s annual review. Knowing that a certain feature of a model is effective in isolation does not establish that a model consisting of multiple features (including the effective one) is effective overall. Therefore, research on single features should not contribute to the evidence base for an entire model.

Analyses designed to answer questions other than whether a model is effective are generally ineligible for review. Once HomVEE has confirmed that a manuscript reports on a study that uses an eligible design, a reviewer examines whether any analysis in the manuscript uses an eligible analytic approach. Specifically, two types of approaches are generally ineligible for review by HomVEE: most mediating and moderating analyses and all analyses that control for endogenous characteristics. A longer discussion of these types of analyses and exceptions in which HomVEE would review them can be found in Chapter 3 of the Version 2 Handbook of Procedures and Evidence Standards located on the Methods and Standards section of the website.

HomVEE may explore questions of which models are effective and for whom in other products beyond the annual review, such as Evidence Says briefs on special topics and HomVEE’s review of research on tribal populations.

Custom Title

What types of analyses or contrasts are not eligible for review?