PC Test Development and Validation Flashcards

Criterion-related validity evidence is obtained by:

Answer: Correlating test scores with an external measure of the same construct

Criterion-related validity is established by statistically correlating test scores with a relevant external criterion, such as job performance ratings.

In test development, which item format is most susceptible to guessing, potentially inflating scores?

Answer: True/False

True/False items have a 50% probability of a correct guess by chance, making them the most susceptible to guessing among common item formats.

Test equating in large-scale psychometric programs is performed to:

Answer: Ensure that scores from different test forms are comparable

Test equating adjusts scores across multiple test forms so that a given score reflects the same level of ability regardless of which form was administered.

Which principle of test development requires that instructions, administration conditions, and scoring procedures be identical for all examinees?

Answer: Standardization

Standardization ensures that all examinees experience the same testing conditions, making scores meaningful and comparable across individuals.

Convergent validity evidence for a new psychometric instrument is demonstrated when:

Answer: The instrument correlates highly with established measures of the same construct

Convergent validity is supported when the new measure correlates strongly with other measures theoretically designed to assess the same or similar constructs.

The purpose of anchor items (common items) in psychometric test development is to:

Answer: Link different test forms to enable score equating

Anchor items appear on multiple test forms and provide statistical links between forms, enabling equating so scores can be compared across administrations.