Neal McCluskey
Neal McCluskey
Last month I wrote about creating an updated K‑12 productivity chart. The difficulty of any chart is balancing ease of understanding with accuracy and nuance, and that applies here.
A major concern with the trial chart I produced was complication. It was not intuitive, especially using outcomes of high school seniors surpassing certain performance benchmarks. The goal was to have roughly comparable spending and outcome measures—percentage change in spending versus percentage point change in student performance. The primary source of confusion is that the “main” National Assessment of Educational Progress (NAEP) exam, which was added to extend the performance trend from 2012 to 2019, has a “proficiency” benchmark, but the long-term trend (LTT) exam does not.
I used the change in the percent of students scoring “proficient” or above to demonstrate progress on the main NAEP, and passing the middle cut-score on the NAEP reporting table for the LTT. But that score could seem arbitrary (also, it is actually the second-highest cut-score overall). The NAEP does have descriptions of the benchmarks, but those would be difficult to explain on the chart.
A simpler version of that chart can be seen next, still using students surpassing cut scores, but with spending and scores compared to a base year, which varies for each trend because some tests were first administered later or earlier than others.
To remedy the benchmark problem, next is essentially the original productivity chart that ended in 2012, except rather than using inflation-adjusted total funding for a high school senior’s K‑12 career, it plots percentage change in NAEP scale scores against percentage change in inflation-adjusted per-pupil spending, and adds main NAEP scores to extend the trend to 2019.
The problem is that a percentage change in a scale score has indeterminate meaning; a small percentage change could indicate small or large learning increases. » Read More
https://www.cato.org/blog/depicting-k-12-productivity-continued
