Practice Test GeeksCODESP - Cooperative Organization for the Development of Employee Selection Procedures Practice Test
← All CODESP Flashcard Decks

Structured Oral Examination Design Flashcards

7 cards from real CODESP practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.

Read the first 7 Structured Oral Examination Design flashcards as text

  1. A jurisdiction wants to convert its structured oral examination scores to a rank-ordered list. Which psychometric consideration is most important?

    Answer: Verifying that score differences are statistically meaningful before treating ranks as distinct

    Rank-ordering requires that score differences exceed measurement error; candidates with statistically indistinguishable scores should be treated as tied.

  2. In a structured oral examination, 'situational questions' differ from 'experience-based questions' primarily in that situational questions:

    Answer: Ask candidates what they would do in a hypothetical future scenario

    Situational (or hypothetical) questions present a future scenario and ask intended behavior, while experience-based (behavioral) questions ask for past actual behavior.

  3. Which documentation practice is most essential for defending a structured oral examination against a legal challenge?

    Answer: Keeping records of the job analysis, question development rationale, rater training, and individual scores

    Comprehensive documentation of the entire development and administration process provides the evidentiary trail needed to demonstrate job-relatedness and fairness.

  4. When a structured oral examination panel includes a subject matter expert (SME), what is their primary role during scoring?

    Answer: To evaluate response quality against job-relevant technical and competency benchmarks

    SMEs provide domain expertise to judge whether candidate responses reflect the knowledge, skills, and abilities actually required on the job.

  5. A CODESP oral examination yields an inter-rater reliability coefficient of 0.55. What action is most appropriate?

    Answer: Investigate rater training gaps and scoring anchor clarity before using the exam operationally

    A reliability coefficient of 0.55 is below the generally accepted threshold of approximately 0.70, signaling that rater calibration and anchor definition need improvement.

  6. Which practice best ensures that structured oral examination questions remain legally defensible over time?

    Answer: Periodically re-linking questions to updated job analyses as job duties evolve

    Jobs change over time, so questions must be periodically validated against current job analysis data to maintain content validity and legal defensibility.

  7. In a CODESP structured oral examination, the 'board administrator' role is distinct from 'rater' because the board administrator primarily:

    Answer: Manages procedural consistency—timing, question reading, and form distribution—without scoring

    The board administrator is responsible for standardizing exam procedures and logistics, keeping their role separate from the evaluative scoring function.