View definitions of terms used throughout the Pathways Clearinghouse.
E
Effectiveness rating
The assessment of the Pathways Clearinghouse, based on the existing evidence from impact studies, of the extent to which a given intervention improves a specific type of outcome. The effectiveness rating indicates whether the intervention is likely to produce favorable results if faithfully replicated with a similar population. After we review research on an intervention, we assign an effectiveness ratings to indicate how effective the intervention is at improving each of four types of outcomes: employment, earnings, public benefit receipt, and education and training. The ratings depend on (1) the quality of the impact study or studies conducted of the intervention and (2) the favorability (or lack thereof), statistical significance, and consistency of the study findings for that type of labor market outcome.
Well-supported. We have strong and consistent evidence that the intervention produces favorable results for a specific outcome domain, such as short-term earnings. These interventions have at least two impact studies of moderate or high quality that show evidence of favorable findings within the domain. However, because implementation challenges and successes often vary, and because no two implementations of an intervention are identical, Pathways Clearinghouse users should not view this rating as a guarantee of future success.
Supported. We have some evidence that the intervention improves outcomes. These ratings are domain specific, meaning that the intervention is considered supported only for the particular domains for which we have given this rating. These interventions have at least one study of moderate or high quality and show evidence of favorable findings in the domain, but the evidence is less conclusive than that for evidence-based interventions.
Not supported. We have the strongest evidence that the intervention is unlikely to produce substantial favorable results in a given outcome domain. Studies of these interventions have found only a pattern of null and/or unfavorable findings. We only consider impact studies of at least moderate quality in determining this rating.
Mixed support. We have some evidence, from impact studies of moderate or high quality, that indicates the intervention improves outcomes in a given outcome domain, and some evidence that indicates it worsens outcomes in that domain. For instance, in the educational attainment domain, an intervention might have unfavorable effects on attainment of a high school diploma, but favorable effects on GED attainment.
Insufficient evidence to assess support. We have some research, from impact studies of moderate or high quality, on the intervention’s effect in a given outcome domain. But we do not have a sufficient body of evidence to assign one of the other ratings.
No evidence to assess support. We did not find any studies that rated moderate or high that studied the intervention’s effect on outcomes in a given outcome domain. These interventions need further study to support conclusions about their effectiveness.