Test Validation and Reliability Flashcards
7 cards from real CODESP practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.
Read the first 7 Test Validation and Reliability flashcards as text
According to the Society for Industrial-Organizational Psychology (SIOP) Principles, which of the following is the LEAST acceptable justification for using a test with adverse impact?
Answer: A belief that the test 'looks' job-related to applicants
Face validity — the perception that a test looks job-related — is not a sufficient scientific or legal justification for using a test with adverse impact.
Coefficient alpha will be artificially INFLATED when:
Answer: Items have very high inter-correlations due to item overlap or redundancy
When items are redundant or essentially paraphrase one another, alpha rises artificially without reflecting true reliability.
A test manual reports a test-retest reliability of 0.85 with a 6-month interval. Compared to a 2-week interval, the 6-month coefficient is MOST likely:
Answer: Lower, because real changes in the construct may occur over time
Longer time intervals allow true changes in the measured attribute to occur, which lowers test-retest reliability coefficients.
Which approach to establishing validity is MOST appropriate for a newly developed test when no local criterion data are yet available?
Answer: Validity generalization / transportability argument
When local criterion data are unavailable, validity generalization allows practitioners to use accumulated evidence from prior studies to justify test use.
The four-fifths (4/5) rule in the Uniform Guidelines is used to evaluate:
Answer: Whether adverse impact exists in selection rates between groups
The 4/5 rule compares the selection rate of a protected group to that of the highest-selected group to detect adverse impact.
A personnel psychologist corrects an observed validity coefficient for criterion unreliability. The corrected coefficient will be:
Answer: Higher than the observed coefficient
Correcting for criterion unreliability removes attenuation caused by criterion measurement error, yielding a higher estimated true validity.
Which of the following BEST describes the concept of test bias in the context of employment testing?
Answer: Systematic over- or under-prediction of criterion scores for a subgroup
Test bias in psychometrics refers specifically to differential prediction — when a test systematically over- or under-predicts job performance for a particular group.