EQAO EQAO Assessment Development and Validity 1 — Questions and Answers
Question 1: Who is primarily responsible for developing the questions used in EQAO assessments?
- University professors hired externally
- Ontario classroom teachers working with EQAO staff and measurement experts (Correct answer)
- The federal government's curriculum branch
- Independent international testing agencies
Correct answer: Ontario classroom teachers working with EQAO staff and measurement experts
EQAO item development involves Ontario classroom teachers collaborating with EQAO staff and psychometric experts to create relevant, curriculum-aligned questions.
Question 2: What is the purpose of 'field testing' questions before they appear in a scored EQAO assessment?
- To reward top-performing students with bonus marks
- To gather data on question difficulty and fairness before questions are used for scoring (Correct answer)
- To teach students the content of upcoming assessments
- To allow principals to preview the full test
Correct answer: To gather data on question difficulty and fairness before questions are used for scoring
Field testing collects statistical data on how students respond to new questions, ensuring they are appropriately difficult and unbiased before being scored.
Question 3: Which Ontario document serves as the primary blueprint for aligning EQAO assessment content?
- The Ontario Health Curriculum
- The Ontario Language and Mathematics curricula (Correct answer)
- The Canadian Charter of Rights and Freedoms
- The Ontario College of Teachers' professional standards
Correct answer: The Ontario Language and Mathematics curricula
EQAO assessments are explicitly aligned to the Ontario Language and Mathematics curricula to ensure content validity.
Question 4: What is a 'bias review' in the context of EQAO assessment development?
- A review to ensure questions favour high-achieving students
- A process to identify and remove questions that may disadvantage particular cultural or demographic groups (Correct answer)
- A check that questions are sufficiently difficult
- A review conducted by parents after the test is published
Correct answer: A process to identify and remove questions that may disadvantage particular cultural or demographic groups
Bias reviews involve diverse panels examining questions to identify and eliminate content that could unfairly disadvantage students based on cultural, linguistic, or demographic factors.
Question 5: How does EQAO ensure consistency in scoring open-response (written) items across thousands of student papers?
- By having a single expert score all papers alone
- By using detailed scoring rubrics and training markers to apply them reliably (Correct answer)
- By converting all written responses to multiple-choice
- By asking students to self-assess their own written answers
Correct answer: By using detailed scoring rubrics and training markers to apply them reliably
EQAO develops detailed scoring rubrics and provides extensive marker training to ensure inter-rater reliability across large volumes of student work.
Question 6: What does 'content validity' mean when applied to an EQAO assessment?
- That the test questions are interesting to students
- That the assessment adequately covers the knowledge and skills outlined in the curriculum (Correct answer)
- That the results are consistent from year to year
- That the test is easy enough for most students to pass
Correct answer: That the assessment adequately covers the knowledge and skills outlined in the curriculum
Content validity means the assessment items comprehensively and accurately represent the curriculum expectations they are intended to measure.
EQAO EQAO Assessment Development and Validity 1
Who is primarily responsible for developing the questions used in EQAO assessments?