CEFR CEFR Assessment and Testing Methods Questions and Answers 2 — Questions and Answers
Question 1: What does 'reliability' mean in the context of CEFR-aligned language testing?
- The test measures what it is supposed to measure
- The test produces consistent results across different occasions and raters (Correct answer)
- The test reflects real-world language tasks
- The test is accepted by universities and employers
Correct answer: The test produces consistent results across different occasions and raters
Reliability refers to the consistency and dependability of test scores, ensuring that results would be similar if the test were repeated under the same conditions.
Question 2: In CEFR-based oral assessments, what is 'interrater reliability'?
- Agreement between the learner and the examiner about the score
- The degree to which different examiners assign the same score to the same performance (Correct answer)
- The consistency of a single examiner scoring the same learner twice
- A statistical measure of test internal consistency
Correct answer: The degree to which different examiners assign the same score to the same performance
Interrater reliability measures how consistently multiple raters apply CEFR level descriptors when scoring the same spoken performance.
Question 3: Which exam is widely recognized in the United States as providing official CEFR-linked English language certification at B2 level?
- TOEFL iBT (broadly mapped to B2–C1)
- IELTS Academic Band 5.5
- Cambridge B2 First (FCE) (Correct answer)
- Duolingo English Test
Correct answer: Cambridge B2 First (FCE)
Cambridge B2 First (formerly FCE) is the most widely recognized exam explicitly linked to CEFR B2, accepted by universities and employers worldwide including in the US.
Question 4: What is a 'can-do statement' in the context of CEFR assessment?
- A grammar rule the learner has mastered
- A positive descriptor of what a learner is able to accomplish at a given proficiency level (Correct answer)
- A checklist of vocabulary items required for each level
- A teacher's written feedback on learner errors
Correct answer: A positive descriptor of what a learner is able to accomplish at a given proficiency level
Can-do statements are positive, action-oriented descriptors (e.g., 'I can understand the main points of clear standard speech on familiar topics') that define learner ability at each CEFR level.
Question 5: What is 'washback' (or backwash) in the context of CEFR-aligned language testing?
- The process of returning corrected test papers to learners
- The influence a test has on the teaching and learning that takes place before it (Correct answer)
- A technique for re-scoring borderline test papers
- The statistical process of equating different test versions
Correct answer: The influence a test has on the teaching and learning that takes place before it
Washback describes how the design and content of a test shapes classroom instruction and learner preparation strategies, which can be positive or negative.
Question 6: In CEFR-linked speaking tests, what is typically assessed under the descriptor 'range'?
- How long the learner speaks during the test
- The variety and scope of language structures and vocabulary the learner can deploy (Correct answer)
- The clarity of the learner's pronunciation
- How many topics the learner discusses
Correct answer: The variety and scope of language structures and vocabulary the learner can deploy
Range refers to the breadth of linguistic resources — grammar patterns and vocabulary — that a speaker can draw upon to express ideas at a given CEFR level.
What does 'reliability' mean in the context of CEFR-aligned language testing?