Case Studies & Practical Application Flashcards
7 cards from real ATP practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.
Read the first 7 Case Studies & Practical Application flashcards as text
A testing organization discovers mid-administration that a subset of test items had a technical error causing ambiguous wording. What is the most appropriate immediate response?
Answer: Flag the affected items for post-hoc analysis and consider score adjustments or item removal
Flagging affected items for post-hoc analysis allows the psychometric team to evaluate impact and apply appropriate scoring adjustments while minimizing disruption.
A credentialing body finds that its passing standard was set without formal job task analysis. Which remediation step is most critical to ensure defensibility?
Answer: Commission a new job task analysis and conduct a standard-setting study to establish a defensible cut score
A new job task analysis followed by a formal standard-setting study establishes the empirical and content linkage required for defensible credentialing decisions.
An employer uses a cognitive ability test that shows adverse impact against a protected group. Under the Uniform Guidelines, which action best addresses this situation?
Answer: Conduct a validity study to determine whether the test predicts job performance and explore alternative tests with less adverse impact
The Uniform Guidelines require employers to demonstrate validity for any selection procedure causing adverse impact or to seek less adverse alternatives.
A test developer is adapting an English-language licensure exam for Spanish-speaking candidates. Which process is most critical to ensure linguistic equivalence?
Answer: Perform forward-and-back translation, conduct bilingual review panels, and run pilot studies to verify item performance
Forward-and-back translation with bilingual expert review and pilot testing is the standard methodology for ensuring linguistic and construct equivalence in test adaptation.
A large-scale K-12 assessment program is under scrutiny because schools are 'teaching to the test.' What is the most appropriate psychometric and policy response?
Answer: Distinguish between coaching on the construct versus coaching on specific items, and periodically refresh item pools to maintain construct validity
Differentiating construct-relevant preparation from item-specific coaching, combined with item pool renewal, protects validity while acknowledging that legitimate test preparation is acceptable.
A professional certification exam is challenged in court because the test blueprint was developed without practicing professionals' input. Which standard is most relevant to this challenge?
Answer: Standards for Educational and Psychological Testing — content validity requirements
The Standards for Educational and Psychological Testing require that content validity evidence be based on a systematic analysis of the job or domain, including input from practicing professionals.
An organization administers both a paper-and-pencil and a computer-based version of the same certification exam. Examinees performing better on the CBT version raises concern. What analysis should be conducted first?
Answer: Conduct differential item functioning (DIF) and mode-equivalence studies to determine whether the score scales are comparable
DIF and mode-equivalence studies are the standard approach to determining whether test scores from different delivery modes can be placed on a common scale.