Assessment & Evaluation Methods Flashcards

Which evaluation design is most appropriate when random assignment to treatment and control groups is not feasible?

Answer: Quasi-experimental design

Quasi-experimental designs allow for causal inference when random assignment is not possible by using comparison groups or statistical controls.

A grant evaluator uses a Difference-in-Differences (DiD) approach. What does this method compare?

Answer: Changes over time in treatment vs. control groups

DiD compares the change in outcomes over time between a treatment group and a control group, removing shared time trends.

Which term describes the unintended positive outcomes of a grant-funded program discovered during evaluation?

Answer: Spillover effects

Spillover effects (also called positive externalities) are unintended benefits that extend beyond the program's direct participants.

An evaluator tracking whether activities were completed on schedule is conducting which type of evaluation?

Answer: Process evaluation

Process evaluation monitors program implementation fidelity, including whether activities were carried out as planned and on schedule.

Which statistical concept indicates the minimum detectable effect size that a study can reliably identify?

Answer: Statistical power

Statistical power is the probability that a study will detect an effect of a given size if it truly exists, informing sample size decisions.

A funder requires grantees to report outputs, outcomes, and impact. Which of these represents an OUTPUT?

Answer: Number of training sessions delivered

Outputs are the direct, countable products of program activities, such as the number of training sessions held.

When an evaluator controls for pre-existing differences between groups using statistical regression, this technique is called:

Answer: Analysis of covariance (ANCOVA)

ANCOVA adjusts for pre-existing group differences on covariates, making post-test comparisons more accurate.