Test Design and Blueprinting Flashcards
7 cards from real CBT practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.
Read the first 7 Test Design and Blueprinting flashcards as text
Which stakeholder group is most critical to consult during the job task analysis phase of test design?
Answer: Subject matter experts currently performing the job
Subject matter experts (SMEs) who actively perform the job provide the most accurate and current information about the tasks and KSAs that should be assessed.
A CBT blueprint that specifies a minimum of 5 items per domain ensures:
Answer: That each domain contributes enough items for stable domain-level score reporting
Setting a minimum item count per domain ensures there are enough items to provide reliable subscores or domain-level diagnostic feedback.
What is 'blueprint fidelity' in the context of computerized test delivery?
Answer: The degree to which the delivered test matches the content and statistical specifications of the blueprint
Blueprint fidelity refers to how closely the actual delivered test conforms to all of the specifications (domain weights, cognitive levels, formats) laid out in the blueprint.
Why might a test design team include 'unscored tutorial items' at the start of a CBT?
Answer: To familiarize candidates with item formats before scored questions begin
Tutorial items give candidates practice with the interface and item formats so that unfamiliarity with the technology does not disadvantage them on scored items.
A blueprint specifying that no two consecutive items share the same content subdomain is an example of:
Answer: Item sequencing constraint
Item sequencing constraints in a blueprint control the order in which items from different content areas appear, often to prevent clustering and reduce context effects.
When reviewing a test blueprint for legal defensibility, which element is most important to verify?
Answer: That domain weights are empirically tied to JTA criticality data
Legal defensibility requires that blueprint domain weights can be traced to documented JTA findings showing the relative importance of each content area for job performance.
In blueprint terminology, 'anchor items' are used primarily for:
Answer: Score equating across different test forms or administrations
Anchor items appear in multiple test forms and allow psychometricians to place scores from different forms on the same scale through equating.