Test Design and Blueprinting Flashcards

What does the term 'cut score' mean in the context of a CBT blueprint?

Answer: The minimum score required to pass the exam

A cut score is the minimum performance level a candidate must achieve to be classified as passing, established through a standard-setting process.

In test design, 'item stem' refers to:

Answer: The question or problem posed to the candidate

The item stem is the question, scenario, or problem statement that precedes the answer options.

Which of the following best describes 'content domain weighting' in a test blueprint?

Answer: Assigning percentage of items to each topic area

Content domain weighting specifies what proportion of test items should come from each subject area, ensuring coverage matches job relevance findings.

A blueprint that includes both 'recall' and 'application' items is addressing which aspect of test design?

Answer: Cognitive level distribution

Including items at multiple cognitive levels (recall vs. application) ensures the test measures different depths of understanding as specified in the blueprint.

Why is a 'table of specifications' used during test blueprint development?

Answer: To cross-reference content topics with cognitive levels and item counts

A table of specifications is a grid that aligns content topics with cognitive levels to show exactly how many items will assess each combination.

Which document is typically produced FIRST when designing a new CBT certification exam?

Answer: Job task analysis report

The job task analysis identifies critical job duties and required KSAs, providing the empirical foundation upon which the blueprint and all subsequent documents are built.

What is the risk of having too many items from a single content domain in a CBT blueprint?

Answer: Content imbalance that threatens content validity

Overweighting one domain means the test does not proportionally represent all required KSAs, undermining the test's ability to validly measure overall competency.