It’s Test Score Season, But Some States Don’t Release Test Scores

Posted by on July 9, 2013

** Reprinted here in the Washington Post

We’ve entered the time of year during which states and districts release their testing results. It’s fair to say that the two districts that get the most attention for their results are New York City and the District of Columbia Public Schools (DCPS), due in no small part to the fact that both enacted significant, high-profile policy changes over the past 5-10 years.

The manner in which both districts present annual test results is often misleading. Many of the issues, such as misinterpreting changes in proficiency rates as “test score growth” and chalking up all “gains” to recent policy changes, are quite common across the nation. These two districts are just among the more aggressive in doing so. That said, however, there’s one big difference between the test results they put out every year, and although I’ve noted it a few times before, I’d like to point it out once more: Unlike New York City/State, DCPS does not actually release test scores.

That’s right – despite the massive national attention to their “test scores,” DCPS – or, specifically, the Office of the State Superintendent for Education (OSSE) – hasn’t released a single test score in many years. Not one.

Instead, they only report the percent of students who are advanced, proficiency, basic and below basic (with a particular focus on the proficiency rates). Although these rates have advantages, particularly the fact that they are much easier to interpret than scale scores (and that matters), they are a terribly distorted way to measure performance, particularly over time.

Consider, as just one example, the NYC test results in 2011 (discussed here). There was a slight 2-3 point increase in the citywide proficiency rate in both math and reading between 2010 and 2011. The city made a pretty big deal out of this increase, issuing a press release hailing the “continued progress.” The problem was that the average scores, which cannot be compared across grades, told a somewhat different story. Actually, out of the 12 separate citywide scores reported that year (six tested grades, in two subjects), 7 were either totally flat or declined. This illustrates the basic fact that the rates and the actual scores upon which they’re based often move in different directions, even when the sample is as large as NYC’s.

In the case of DCPS, however, there is no way to even check things like this. The public is not given the information necessary to do so.

And, unfortunately, DCPS is not alone. A quick scan of state/district websites suggests that many do release actual scores (though they are sometimes difficult to find), but it seems that a fair number fail to do so.

This has to change. The scores are public information, releasing them costs nothing, and they are required for anything resembling proper interpretation. If we’re going to put so much faith in test results, we should at least have the data.

- Matt Di Carlo


6 Comments posted so far

  • [...] With test scores nearing, a reminder that New York City data presentation can be misleading. (Shanker) [...]

    July 9, 2013 at 8:04 PM
  • [...] Di Carlo, senior fellow at the non-profit Albert Shanker Institute, located in Washington, D.C. This post appeared on the institute’s [...]

    July 10, 2013 at 7:00 AM
  • [...] Matthew Di Carlo wrote an interesting piece on the Shaker Blog– It’s Test Score Season, But Some States Don’t Release Test Scores– that got me thinking about a measurement and assessment class I took last fall (more on [...]

    July 10, 2013 at 10:15 PM
  • [...] Your Partner Fight So Much The Gitmo Torture Obama Is Ignoring On Those That Are Really Heroes… It’s Test Score Season, But Some States Don’t Release Test Scores For the First Time in 20 Years, New York’s Crime Rate Is on the Rise New York Times Does [...]

    July 11, 2013 at 4:45 PM
  • I would add that some States –e.g., VT– furnish NAEP test scores, but only several years stale and never for local districts. VT proudly posts its NECAP scores by district because that easier “test” produces seemingly better student scores.
    Would you have a list of States which don’t post NAEP scores?

    Comment by martin harris
    August 21, 2013 at 11:39 AM
  • typo correction for earlier comment/question.
    MH

    Comment by martin harris
    August 21, 2013 at 11:41 AM

Sorry, the comment form is closed at this time.

Disclaimer

This web site and the information contained herein are provided as a service to those who are interested in the work of the Albert Shanker Institute (ASI). ASI makes no warranties, either express or implied, concerning the information contained on or linked from shankerblog.org. The visitor uses the information provided herein at his/her own risk. ASI, its officers, board members, agents, and employees specifically disclaim any and all liability from damages which may result from the utilization of the information provided herein. The content in the shankerblog.org may not necessarily reflect the views or official policy positions of ASI or any related entity or organization.

Banner image adapted from 1975 photograph by Jennie Shanker, daughter of Albert Shanker.