BCP Psychometric Concepts and Test Theory Questions and Answers 1 — Questions and Answers
Question 1: What does reliability refer to in psychological testing?
- The accuracy with which a test measures what it is intended to measure
- The consistency of test scores across repeated administrations (Correct answer)
- The degree to which test items represent the content domain
- The extent to which test results predict future performance
Correct answer: The consistency of test scores across repeated administrations
Reliability refers to the consistency of scores when the same test is administered under similar conditions, not whether the test measures the right construct.
Question 2: Which type of reliability is measured by correlating scores from two administrations of the same test separated by a time interval?
- Inter-rater reliability
- Internal consistency
- Test-retest reliability (Correct answer)
- Split-half reliability
Correct answer: Test-retest reliability
Test-retest reliability assesses score stability over time by correlating results from two separate administrations of the same instrument.
Question 3: A test with a mean of 100 and a standard deviation of 15 is using which score scale?
- T-scores
- Scaled scores
- Standard scores (deviation IQ type) (Correct answer)
- Percentile ranks
Correct answer: Standard scores (deviation IQ type)
Deviation IQ-type standard scores have a mean of 100 and SD of 15, used in most intelligence and many neuropsychological composite scores.
Question 4: What is the primary purpose of the Standard Error of Measurement (SEM)?
- Calculating the mean score for a normative sample
- Estimating the range within which an examinee's true score likely falls (Correct answer)
- Determining the reliability coefficient of a test
- Comparing the validity of two different tests
Correct answer: Estimating the range within which an examinee's true score likely falls
The SEM quantifies the margin of error in an obtained score, allowing clinicians to construct a confidence interval around that score for the true score.
Question 5: A percentile rank of 75 indicates that the examinee:
- Answered 75% of items correctly
- Scored higher than 75% of the normative sample (Correct answer)
- Obtained a raw score of 75
- Performed 75 points above the normative mean
Correct answer: Scored higher than 75% of the normative sample
A percentile rank of 75 means the examinee scored at or above 75% of individuals in the normative comparison group.
Question 6: Which type of validity evidence is gathered by examining whether test content adequately represents the domain being assessed?
- Criterion validity
- Construct validity
- Content validity (Correct answer)
- Convergent validity
Correct answer: Content validity
Content validity evaluates whether the test items collectively and adequately sample the full range of the intended knowledge or skill domain.
Question 7: A 'ceiling effect' in testing occurs when:
- Items are too easy, causing scores to cluster near the maximum (Correct answer)
- Items are too difficult, causing most examinees to score near zero
- The testing environment is too hot and affects concentration
- The normative sample was too small to be representative
Correct answer: Items are too easy, causing scores to cluster near the maximum
A ceiling effect occurs when test items are not difficult enough, causing high-ability examinees to score at or near the maximum and preventing differentiation among them.
BCP Psychometric Concepts and Test Theory Questions and Answers 1
What does reliability refer to in psychological testing?