CBT Introduction to CBT 5 — Questions and Answers
Question 1: Which of the following best describes 'test blueprint' (exam specification) in CBT development?
- A diagram of the test center floor plan
- A document defining content domains, weightings, and question counts for the exam (Correct answer)
- The technical architecture of the testing software
- A candidate's personalized study plan
Correct answer: A document defining content domains, weightings, and question counts for the exam
A test blueprint outlines the topics, their relative importance, and how many questions per domain appear on the exam, guiding both item writing and test assembly.
Question 2: What is the main reason CBT programs often impose a 'non-disclosure agreement' (NDA) on candidates?
- To protect the candidate's personal information
- To legally prohibit sharing of exam content that could compromise future test security (Correct answer)
- To ensure candidates do not share their scores publicly
- To prevent candidates from registering at competing testing centers
Correct answer: To legally prohibit sharing of exam content that could compromise future test security
NDAs bind candidates to confidentiality regarding specific exam questions, protecting the integrity of the item bank and the fairness of future administrations.
Question 3: What is 'test center scheduling software' primarily used for in a CBT operation?
- Writing new exam questions
- Managing appointment bookings, seat availability, and candidate check-in workflows (Correct answer)
- Grading open-ended responses
- Monitoring network latency during exams
Correct answer: Managing appointment bookings, seat availability, and candidate check-in workflows
Scheduling software allows candidates to book appointments at available test centers, and helps administrators track seat capacity and manage day-of-test logistics.
Question 4: Which measurement concept ensures a CBT produces consistent results if the same candidate were tested under equivalent conditions on different days?
- Validity
- Reliability (Correct answer)
- Equating
- Standardization
Correct answer: Reliability
Reliability refers to the consistency of test scores; a highly reliable CBT would yield very similar scores for the same candidate across repeated administrations.
Question 5: A candidate's exam is terminated early by the CBT system after a certain number of questions. This is most likely a feature of:
- A fixed-form test with a technical error
- A computer-adaptive test that has reached sufficient measurement precision (Correct answer)
- A proctored test where time expired
- A beta test version with incomplete question pools
Correct answer: A computer-adaptive test that has reached sufficient measurement precision
CAT algorithms stop administering items once the system determines it can estimate the candidate's ability with sufficient statistical confidence, often before the maximum item count is reached.
Question 6: What does 'standard setting' refer to in the context of a high-stakes CBT?
- Installing and configuring the testing software to meet technical standards
- A formal process in which subject-matter experts recommend where the passing score should be set (Correct answer)
- Setting the uniform font and layout standards across all test forms
- Establishing minimum hardware requirements for candidate workstations
Correct answer: A formal process in which subject-matter experts recommend where the passing score should be set
Standard setting (e.g., Angoff or Bookmark methods) is a structured, expert-driven process used to determine the defensible cut score that distinguishes passing from failing performance.
Question 7: Which of the following is an example of a 'selected-response' item type commonly found in CBT exams?
- An essay requiring 500 words
- A multiple-choice question with four answer options (Correct answer)
- A simulation requiring the candidate to perform a task
- A fill-in-the-blank question with typed input
Correct answer: A multiple-choice question with four answer options
Selected-response items ask candidates to choose from provided options rather than produce their own answer; multiple-choice is the most prevalent format in this category.
CBT Introduction to CBT 5
Which of the following best describes 'test blueprint' (exam specification) in CBT development?