SLLA Data-Informed Decision Making 5 — Questions and Answers
Question 1: A school leader analyzes graduation rate data and finds it improved from 78% to 88% over five years. To determine if this is a meaningful improvement, the leader should calculate:
- The median graduation rate across all schools in the state
- An effect size or confidence interval to assess practical and statistical significance (Correct answer)
- The number of graduates who enrolled in college
- The cost per graduate over the five-year period
Correct answer: An effect size or confidence interval to assess practical and statistical significance
Effect size and confidence intervals help determine whether an observed change is statistically meaningful rather than due to chance variation.
Question 2: When designing a school survey to gather stakeholder input, which practice MOST threatens the validity of the data collected?
- Using a Likert scale with five response options
- Including leading questions that imply a preferred response (Correct answer)
- Pilot testing the survey with a small group first
- Keeping responses anonymous to encourage honesty
Correct answer: Including leading questions that imply a preferred response
Leading questions bias respondents toward a particular answer, undermining the validity and reliability of survey findings.
Question 3: A school implements a new tutoring program in January. Student scores on the spring state test improve. A critical thinker would note that this improvement could ALSO be explained by:
- Regression to the mean — students selected for tutoring may have had unusually low scores that would naturally rise
- Teachers becoming more effective over winter break
- The state making the test easier
- Both A and C (Correct answer)
Correct answer: Both A and C
Both regression to the mean (students with unusually low scores tend to score higher on retest) and test difficulty changes are alternative explanations for score gains.
Question 4: Which stakeholder communication strategy BEST supports data literacy among parents?
- Sending home only the student's national percentile rank
- Providing a data report with technical jargon to demonstrate rigor
- Translating data into plain language with concrete examples of what scores mean for learning (Correct answer)
- Withholding individual score data to protect against parental misinterpretation
Correct answer: Translating data into plain language with concrete examples of what scores mean for learning
Plain-language explanations with concrete learning implications empower parents to understand and act on assessment data.
Question 5: A data team is conducting a gap analysis. What does this process PRIMARILY involve?
- Comparing current performance data against desired performance targets to identify discrepancies (Correct answer)
- Analyzing differences between teacher salaries and market rates
- Reviewing gaps in the curriculum scope and sequence document
- Examining time gaps between assessment administration and score reporting
Correct answer: Comparing current performance data against desired performance targets to identify discrepancies
Gap analysis identifies the difference between where students currently perform and where they need to be, guiding improvement priorities.
Question 6: A school's value-added measure (VAM) is negative even though the school's proficiency rate is above the state average. This MOST likely means:
- The school's data was entered incorrectly into the state system
- Students are entering the school above grade level but making less than expected growth (Correct answer)
- The school should be placed on the state's underperforming list immediately
- Value-added measures are unreliable and should be disregarded
Correct answer: Students are entering the school above grade level but making less than expected growth
A negative VAM with high proficiency indicates students start high but the school adds less growth than predicted, a meaningful instructional equity concern.
Question 7: Which scenario BEST illustrates the principle of triangulating data before making a major decision?
- Using three years of state test score data to identify a trend
- Cross-referencing attendance records, classroom grades, and formative assessment results to understand a student's performance pattern (Correct answer)
- Asking three different teachers for their opinions about a student
- Comparing your school's scores to three neighboring schools
Correct answer: Cross-referencing attendance records, classroom grades, and formative assessment results to understand a student's performance pattern
Triangulation means using multiple different types of data sources — not just repeated measures of one type — to build a more complete and reliable picture.
SLLA Data-Informed Decision Making 5
A school leader analyzes graduation rate data and finds it improved from 78% to 88% over five years.
To determine if this is a meaningful improvement, the leader should calculate: