โ† All CODESP Flashcard Decks

Test Validation and Reliability Flashcards

7 cards from real CODESP practice questions. Tap to flip, then mark Knew It or Still Learning โ€” missed cards come back until you master them.

Read the first 7 Test Validation and Reliability flashcards as text
  1. A job analysis identifies five critical task clusters for a position. A test that covers only two of those clusters likely lacks:

    Answer: Content validity

    Content validity requires adequate coverage of all critical KSAs and tasks identified in the job analysis.

  2. The attenuation of a validity coefficient due to restriction of range refers to:

    Answer: A coefficient that is artificially deflated because the sample lacks score variability

    Range restriction occurs when hired employees represent a narrow band of scores, which deflates observed validity coefficients.

  3. Which statistic is most commonly used to assess internal consistency reliability for tests with polytomous (multi-point) items?

    Answer: Cronbach's alpha

    Cronbach's alpha is appropriate for items with multiple response categories, while KR-20 is for dichotomous items.

  4. A validity generalization (VG) study concludes that a test has consistent validity across multiple settings. This finding supports:

    Answer: The transportability of test validity to new settings without local studies

    Validity generalization supports using existing validity evidence to infer a test's validity in a new setting without conducting a full local study.

  5. When evaluating construct validity, convergent evidence is demonstrated when:

    Answer: The test correlates highly with measures of theoretically similar constructs

    Convergent evidence shows that measures of the same or related constructs correlate substantially with each other.

  6. The Uniform Guidelines on Employee Selection Procedures recommend that a content validity strategy is most defensible when the selection procedure measures:

    Answer: Observable work behaviors or knowledge used on the job

    The Uniform Guidelines indicate content validity is most appropriate for tests measuring observable work behaviors or directly job-related knowledge.

  7. Inter-rater reliability is MOST critical to establish when:

    Answer: Structured interviews or work samples involve human judgment in scoring

    Inter-rater reliability ensures that different evaluators assign consistent scores when human judgment is involved in the scoring process.