BCP Test Security and Integrity 2 — Questions and Answers
Question 1: A candidate is observed glancing repeatedly at another examinee's answer sheet. What is the psychometrist's FIRST appropriate action?
- Immediately invalidate both examinees' scores
- Document the behavior and reposition the examinees if possible (Correct answer)
- Announce a general warning to all examinees without singling anyone out
- Contact law enforcement
Correct answer: Document the behavior and reposition the examinees if possible
Documenting and repositioning disrupts potential cheating while preserving test integrity without prematurely invalidating scores.
Question 2: Which of the following best describes 'chain of custody' in testing contexts?
- The hierarchy of test administrators
- A documented record of who handled test materials at each stage (Correct answer)
- The order in which answer sheets are scored
- The sequence of test sections administered
Correct answer: A documented record of who handled test materials at each stage
Chain of custody ensures accountability for test materials by tracking possession at every point from distribution to destruction.
Question 3: Erasure analysis is used to detect which potential integrity violation?
- Examinees sharing prohibited devices
- Systematic changing of wrong answers to right answers after testing (Correct answer)
- Unauthorized copying of test booklets
- Proxy test-taking
Correct answer: Systematic changing of wrong answers to right answers after testing
Erasure analysis identifies suspicious patterns where wrong-to-right erasures occur at rates significantly higher than chance, suggesting post-hoc answer alteration.
Question 4: When a security breach is discovered involving leaked test items, what is the PRIMARY concern for the testing program?
- Identifying the leaker for disciplinary action
- Assessing the validity and fairness of scores earned under compromised conditions (Correct answer)
- Notifying all candidates of the breach immediately
- Redesigning the entire test
Correct answer: Assessing the validity and fairness of scores earned under compromised conditions
The primary concern is whether compromised items undermine score validity, which affects fairness and the defensibility of decisions based on those scores.
Question 5: A test site supervisor notices an examinee using an unauthorized calculator. Under most testing protocols, the BEST immediate response is to:
- Allow the examinee to finish and note the incident in the report
- Confiscate the device and allow the examinee to continue under observation (Correct answer)
- Immediately dismiss the examinee from the testing room
- Pretend not to notice to avoid disrupting other examinees
Correct answer: Confiscate the device and allow the examinee to continue under observation
Confiscating the unauthorized item stops the violation while allowing testing to continue, with a full incident report filed afterward.
Question 6: Which statistical method is commonly used to detect examinees with suspiciously similar wrong-answer patterns, suggesting possible collusion?
- Item response theory calibration
- Answer copying indices (e.g., ω or K-index) (Correct answer)
- Classical test theory reliability estimation
- Factor analysis
Correct answer: Answer copying indices (e.g., ω or K-index)
Answer copying indices statistically measure the probability that two examinees' identical wrong answers occurred by chance, flagging potential collusion.
Question 7: Test materials classified as 'secure' should be stored in which manner between administrations?
- In a locked, access-controlled location with a documented inventory (Correct answer)
- In a locked cabinet in any staff office
- In the proctoring room under a desk
- Digitally scanned and stored on any shared network drive
Correct answer: In a locked, access-controlled location with a documented inventory
Secure materials require locked storage with restricted access and a documented inventory to maintain their integrity between administrations.
A candidate is observed glancing repeatedly at another examinee's answer sheet.
What is the psychometrist's FIRST appropriate action?