ATP ATP Test Development & Design 1 — Questions and Answers
Question 1: What is the primary purpose of a test blueprint in test development?
- To outline the financial budget for the project
- To define the content areas and cognitive levels to be assessed (Correct answer)
- To schedule the printing timeline
- To list approved testing vendors
Correct answer: To define the content areas and cognitive levels to be assessed
A test blueprint defines the content domains, cognitive levels, and item distribution to guide test development.
Question 2: Which item format requires examinees to construct their own response rather than select from choices?
- Multiple-choice
- True/False
- Constructed-response (Correct answer)
- Matching
Correct answer: Constructed-response
Constructed-response items require examinees to produce their own answers rather than selecting from provided options.
Question 3: What does 'cognitive level' refer to in test development?
- The reading grade level of items
- The mental processes required to answer an item, such as recall or analysis (Correct answer)
- The IQ score required to pass the test
- The number of answer choices in an item
Correct answer: The mental processes required to answer an item, such as recall or analysis
Cognitive level refers to the mental processes (e.g., recall, application, analysis) that an examinee must use to answer a test item.
Question 4: In test development, what is a 'pilot test'?
- A test administered only to aviation professionals
- A preliminary administration used to gather item statistics before operational use (Correct answer)
- The first published version of a test
- A test with fewer than 10 items
Correct answer: A preliminary administration used to gather item statistics before operational use
A pilot test is a preliminary administration of items to collect statistical data before they are used operationally.
Question 5: What does 'content validity' refer to in test development?
- Whether a test measures what it is intended to measure based on content coverage (Correct answer)
- The number of questions in a test
- The visual design quality of the test
- The speed at which examinees complete the test
Correct answer: Whether a test measures what it is intended to measure based on content coverage
Content validity refers to the degree to which test items adequately represent the content domain being measured.
Question 6: What is a 'cut score' in credentialing tests?
- The score at which items are removed from the test bank
- The minimum score required to pass or achieve a credential (Correct answer)
- A penalty applied for wrong answers
- The average score of all test takers
Correct answer: The minimum score required to pass or achieve a credential
A cut score is the minimum score an examinee must achieve to be classified as passing or competent.
ATP ATP Test Development & Design 1
What is the primary purpose of a test blueprint in test development?