Assessment and Evaluation Flashcards
7 cards from real CAC practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.
Read the first 7 Assessment and Evaluation flashcards as text
A candidate must correctly complete 8 of 10 defined tasks to pass, regardless of how others score. What is this approach?
Answer: Criterion-referenced
Criterion-referenced assessment measures performance against a fixed standard.
An item analysis shows that high scorers miss a question more often than low scorers. What does this suggest?
Answer: The item may be flawed or miskeyed
Negative discrimination often means the item is ambiguous, flawed, or has the wrong key.
In item analysis, a difficulty index (p-value) of 0.90 means what?
Answer: 90% of candidates answered correctly
The p-value is the proportion of candidates who answered the item correctly, so 0.90 means the item is easy.
Which assessment method best measures hands-on procedural skill?
Answer: Performance-based assessment
Performance-based assessments have candidates demonstrate skills in realistic tasks.
Which practice most reduces scorer bias when grading open-ended responses?
Answer: Using a clear rubric and blind scoring
Clear rubrics plus anonymized (blind) scoring reduce subjective bias.
A test with very low reliability cannot have high validity. Why?
Answer: Inconsistent scores cannot measure anything accurately
Reliability is necessary but not sufficient for validity, because random error limits accurate measurement.
Which evaluation data collection method best gathers in-depth qualitative insight from a small group?
Answer: Focus group
Focus groups use guided discussion to collect rich qualitative information.