SLLA Data-Informed Decision Making 2 — Questions and Answers
Question 1: A principal notices that math proficiency scores have plateaued for three consecutive years despite new curriculum adoption. What is the BEST first step in a data-informed response?
- Disaggregate the data by subgroup and grade level to identify specific patterns (Correct answer)
- Replace the curriculum with a different one immediately
- Increase instructional time for all students equally
- Survey teachers about their satisfaction with the curriculum
Correct answer: Disaggregate the data by subgroup and grade level to identify specific patterns
Disaggregating data reveals where the plateau exists and for whom, enabling targeted rather than blanket interventions.
Question 2: Which type of assessment provides the most actionable real-time data for adjusting daily instruction?
- State summative assessments
- Annual benchmark assessments
- Formative assessments embedded in instruction (Correct answer)
- Norm-referenced standardized tests
Correct answer: Formative assessments embedded in instruction
Formative assessments are designed to provide immediate feedback that teachers can use to adjust instruction in real time.
Question 3: A school leader wants to evaluate the effectiveness of a new reading intervention. Which data source would BEST measure program impact over time?
- Teacher anecdotal records
- Pre- and post-intervention assessment scores for participating students (Correct answer)
- Parent satisfaction surveys
- Attendance records of intervention participants
Correct answer: Pre- and post-intervention assessment scores for participating students
Pre- and post-assessment data directly measures student learning gains attributable to the intervention.
Question 4: When presenting data to a school board, a principal should PRIMARILY focus on:
- Raw score distributions for all tested grades
- Trend data that shows progress toward strategic goals over time (Correct answer)
- Comparisons of individual teacher performance
- State ranking compared to neighboring districts
Correct answer: Trend data that shows progress toward strategic goals over time
Trend data aligned to strategic goals communicates meaningful progress and keeps stakeholders focused on shared priorities.
Question 5: A data team discovers that English Language Learners are underrepresented in gifted programs relative to their school population. This finding MOST directly calls for:
- Reducing the overall size of the gifted program
- Examining identification criteria and referral processes for potential bias (Correct answer)
- Increasing ELL support staff in regular classrooms
- Reporting the discrepancy to the state education department only
Correct answer: Examining identification criteria and referral processes for potential bias
Underrepresentation often reflects biased or culturally narrow identification tools, so reviewing the referral process is the appropriate equity-focused response.
Question 6: Which statistical concept describes the extent to which an assessment consistently measures what it measures across administrations?
- Validity
- Reliability (Correct answer)
- Standard error of measurement
- Effect size
Correct answer: Reliability
Reliability refers to the consistency of assessment results across repeated administrations or raters.
Question 7: A principal finds that students who attend tutoring sessions show higher test scores. Before concluding the tutoring program caused the gains, the leader should consider:
- The cost per student of the tutoring program
- Selection bias — higher-motivated students may self-select into tutoring (Correct answer)
- Whether tutors have sufficient credentials
- The number of tutoring hours per week
Correct answer: Selection bias — higher-motivated students may self-select into tutoring
Self-selection bias means observed gains may reflect student motivation rather than program effectiveness, undermining causal claims.
SLLA Data-Informed Decision Making 2
A principal notices that math proficiency scores have plateaued for three consecutive years despite new curriculum adoption.
What is the BEST first step in a data-informed response?