Assessment & Evaluation Methods Flashcards

Which of the following BEST describes a criterion-referenced interpretation of test scores?

Answer: The examinee demonstrated mastery of the defined content domain

Criterion-referenced interpretations compare performance to a defined standard of knowledge or skill, not to other test-takers.

An item with a point-biserial correlation of -0.15 is MOST likely:

Answer: A poorly performing item that should be reviewed for revision or removal

A negative point-biserial indicates that higher-scoring examinees are more likely to answer incorrectly, suggesting the item is problematic.

In the context of accommodations, 'extended time' is classified as which type of modification?

Answer: Timing/scheduling accommodation

Extended time alters when or how long an examinee has to complete the test, making it a timing/scheduling accommodation.

Inter-rater reliability is MOST critical in assessments that use:

Answer: Constructed-response or performance-based tasks scored by human raters

When human judgment is involved in scoring, consistency between raters must be measured and controlled to ensure reliability.

A test with high reliability but low validity can BEST be described as:

Answer: Consistently measuring the wrong construct

A test can be consistently measuring something other than the intended construct — reliable but not valid.

Differential Item Functioning (DIF) analysis is conducted to identify items that:

Answer: Perform differently for subgroups of equal ability

DIF flags items where examinees of similar overall ability from different demographic groups have different probabilities of answering correctly.

Before distributing test materials, a test administrator should verify that:

Answer: The correct test form and quantity match the roster and seating plan

Confirming the correct test form and sufficient materials before distribution prevents administration errors that could invalidate scores.