PC PC Test Development and Validation

Question 1

The first step in developing a psychometrically sound certification exam is typically:

Accepted Answer

Conducting a job task analysis

Answer

Writing test items

Answer

Establishing cut scores

Answer

Administering pilot tests

Question 2

Content validity evidence in test development is best established through:

Accepted Answer

Expert review confirming items represent the intended content domain

Answer

Correlating test scores with a criterion measure

Answer

Factor analysis of item responses

Answer

Calculating internal consistency

Question 3

A test blueprint (table of specifications) in certification exam development specifies:

Accepted Answer

The proportion of items covering each content area

Answer

The passing score for each examinee

Answer

The statistical difficulty of every item

Answer

The identities of item writers

Question 4

In psychometric test development, construct validity refers to:

Accepted Answer

The degree to which a test measures the theoretical construct it purports to measure

Answer

The consistency of scores across repeated administrations

Answer

Whether test content matches the curriculum

Answer

The accuracy of scoring procedures

Question 5

Which method is used to set a defensible passing score on a professional certification examination?

Accepted Answer

Standard-setting methods such as the Angoff method

Answer

Norm-referencing to the top 50% of candidates

Answer

Setting the passing score at the median

Answer

Using the item mean as the cut score

Question 6

Pilot testing or field testing new psychometric items primarily serves to:

Accepted Answer

Collect item performance data before operational use

Answer

Finalize the test blueprint

Answer

Establish inter-rater reliability

Answer

Determine certification eligibility requirements