← All CODESP Flashcard Decks

Test Validation and Reliability Flashcards

7 cards from real CODESP practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.

Read the first 7 Test Validation and Reliability flashcards as text
  1. According to the Society for Industrial-Organizational Psychology (SIOP) Principles, which of the following is the LEAST acceptable justification for using a test with adverse impact?

    Answer: A belief that the test 'looks' job-related to applicants

    Face validity — the perception that a test looks job-related — is not a sufficient scientific or legal justification for using a test with adverse impact.

  2. Coefficient alpha will be artificially INFLATED when:

    Answer: Items have very high inter-correlations due to item overlap or redundancy

    When items are redundant or essentially paraphrase one another, alpha rises artificially without reflecting true reliability.

  3. A test manual reports a test-retest reliability of 0.85 with a 6-month interval. Compared to a 2-week interval, the 6-month coefficient is MOST likely:

    Answer: Lower, because real changes in the construct may occur over time

    Longer time intervals allow true changes in the measured attribute to occur, which lowers test-retest reliability coefficients.

  4. Which approach to establishing validity is MOST appropriate for a newly developed test when no local criterion data are yet available?

    Answer: Validity generalization / transportability argument

    When local criterion data are unavailable, validity generalization allows practitioners to use accumulated evidence from prior studies to justify test use.

  5. The four-fifths (4/5) rule in the Uniform Guidelines is used to evaluate:

    Answer: Whether adverse impact exists in selection rates between groups

    The 4/5 rule compares the selection rate of a protected group to that of the highest-selected group to detect adverse impact.

  6. A personnel psychologist corrects an observed validity coefficient for criterion unreliability. The corrected coefficient will be:

    Answer: Higher than the observed coefficient

    Correcting for criterion unreliability removes attenuation caused by criterion measurement error, yielding a higher estimated true validity.

  7. Which of the following BEST describes the concept of test bias in the context of employment testing?

    Answer: Systematic over- or under-prediction of criterion scores for a subgroup

    Test bias in psychometrics refers specifically to differential prediction — when a test systematically over- or under-predicts job performance for a particular group.