Happy Holidays From The Shanker Institute

Posted by on December 19, 2014

We at the Shanker Institute are taking a break for the holidays.

We wish all of you a happy, peaceful holiday season.

Blog posts will resume after the New Year.

- Leo Casey


New Research On School Discipline

Posted by on December 18, 2014

School discipline was one of the most prominent education issues this year. A major theme within the discipline conversation has been the large discipline disparities by race/ethnicity and gender, which are exhibited as early as pre-K. These disparities drew attention to the important issue of implicit bias – i.e., the idea that we all harbor unconscious attitudes that tend to favor individuals from some groups (whites, males), while putting others (people of color, women) at a disadvantage. This research, which the Kirwan Institute has reviewed in great depth, strongly suggests that a double standard exists – one that is more lenient toward white students and girls – when assessing and addressing challenging student behaviors.

A second area of focus has been the shortcomings of policies, such as “zero tolerance,” which, have been shown to be ineffective in the establishment of order and injurious to suspended or expelled students – who, as a result, are more likely to fall behind academically, drop out of school, and/or become disconnected from the educational system. Nevertheless, many still believe that harsh policies are sometimes necessary to keep the majority of students safe, maintain order and establish a positive school climate.  So, do suspensions and expulsions really help create an environment conducive to learning for all students?

A new paper by Brea L. Perry and Edward W. Morris, published in the most recent issue of American Sociological Review, suggests that harsh discipline practices actually aren’t good for anyone, including non-suspended students. Read More »


Teacher Strikes In China

Posted by on December 16, 2014

Teachers in China are joining other workers in protesting their compensation and working conditions, reports the China Labour Bulletin (CLB), a workers rights-monitoring and research group founded in Hong Kong in 1994 (CLB’s executive director, Han Dongfang, is a member of the Shanker Institute board of directors).

Throughout the past three months there have been at least 30 strikes by Chinese teachers. In the map below, which is taken from the CLB article, the numbers are strike frequencies. Many of them occurred in smaller cities and higher-poverty inland areas. For example, last month, over 20,000 teachers went on strike in cities and districts surrounding Harbin, the capital of the northeastern province of Heilongjiang.

The article notes that low (and/or unpaid) salaries are a recurrent theme in the protests, but there are a couple of other issues on the table that may sound familiar to those who follow U.S. education policy. Read More »


Constitution For Effective School Governance

Posted by on December 10, 2014

Our guest author today is Kenneth Frank, professor in Measurement and Quantitative Methods at the Department of Counseling, Educational Psychology and Special Education at Michigan State University. This column is part of The Social Side of Reform Shanker Blog series.

Maybe it’s because I grew up in Michigan, but when I think of how to improve schools, I think about the “Magic Johnson effect.” During his time at Michigan State, Earvin “Magic” Johnson scored an average of 17 points per game. Good, but many others have had higher averages. Yet, I would want Magic Johnson on my team because he made everyone around him better. Similarly, the best teachers may be those that make everyone around them better.  This way of thinking is not currently the focus of many current educational reforms, which draw on individual competition and market metaphors.

So how can we leverage the Magic Johnson effect to make schools better? We have to think of ways that teachers can work together. This might be in terms of co-teaching, sharing materials, or taking the time to engage one another in honest professional dialogues. There is considerable evidence that teachers who can draw on the expertise of colleagues are better able to implement new practices. There is also evidence that when there is an atmosphere of trust teachers can engage in honest dialogues that can improve teaching practices and student achievement (e.g., Bryk and Schneider, 2002). Read More »


Is Teaching More Like Baseball Or Basketball?

Posted by on December 8, 2014

Earlier this year, a paper by Roderick I. Swaab and colleagues received considerable media attention (e.g., see here, here, and here). The research questioned the widely shared belief that bringing together the most talented individuals always produces the best result. The authors looked at various types of sports (e.g., player characteristics and behavior, team performance etc.), and were able to demonstrate that there is such thing as “too much talent,” and that having too many superstars can hurt overall team performance, at least when the sport requires cooperation among team members.

My immediate questions after reading the paper were: Do these findings generalize outside the world of sports and, if so, what might be the implications for education? To my surprise, I did not find much commentary or analysis addressing them. I am sure not everybody saw the paper, but I also wonder if this absence might have something to do with how teaching is generally viewed: More like baseball (i.e., a more individualistic team sport) than, say, like basketball. But in our social side of education reform series, we have been discussing a wealth of compelling research suggesting that teaching is not individualistic at all, and that schools thrive on trusting relationships and cooperation, rather than competition and individual prowess.

So, if teaching is indeed more like basketball than like baseball, what are the implications of this study for strategies and policies aimed at identifying, developing and supporting teaching quality? Read More »


PISA And TIMSS: A Distinction Without A Difference?

Posted by on December 4, 2014

Our guest author today is William Schmidt, a University Distinguished Professor and co-director of the Education Policy Center at Michigan State University. He is also a member of the Shanker Institute board of directors.

Every year or two, the mass media is full of stories on the latest iterations of one of the two major international large scale assessments, the Trends in International Mathematics and Science Study (TIMSS) and the Program for International Student Assessment (PISA). What perplexes many is that the results of these two tests — both well-established and run by respectable, experienced organizations — suggest different conclusions about the state of U.S. mathematics education. Generally speaking, U.S. students do better on the TIMSS and poorly on the PISA, relative to their peers in other nations. Depending on their personal preferences, policy advocates can simply choose whichever test result is convenient to press their argument, leaving the general public without clear guidance.

Now, in one sense, the differences between the tests are more apparent than real. One reason why the U.S. ranks better on the TIMSS than the PISA is that the two tests sample students from different sets of countries. The PISA has many more wealthy countries, whose students tend to do better – hence, the U.S.’s lower ranking. It turns out that when looking at only the countries that participated in both the TIMSS and the PISA we find similar country rankings. There are also some differences in statistical sampling, but these are fairly minor. Read More »


Do Attitudes Toward Taxation Change When Economic Situations Change?: Evidence from Poland

The following is written by Kinga Wysieńska-Di Carlo and Matthew Di Carlo. Wysieńska-Di Carlo is an Assistant Professor of Sociology in the Institute of Philosophy and Sociology at the Polish Academy of Sciences.

In general, people tend to support expanding many of the programs funded by their taxes, but they don’t like paying taxes. In the U.S., for example, most people think the government should spend more on programs such as education, health care and urban renewal, but only a tiny fraction believes their own taxes, especially their federal taxes, are too low.

One of the possible explanations for these seemingly contradictory attitudes might be that people think tax systems should be more progressive – that is, they believe that tax revenue should increase, but that the increase should come from higher tax rates on higher earners. Poland is an interesting example in this context (if for no other reason than the fact that there were no taxes in Poland during the communist period). Today, when asked a generic question about whether the government should play a role in reducing income differences between the rich and the poor, Polish people tend to respond in the affirmative in larger proportions than their counterparts in virtually any other advanced nation. Yet responses to these types of questions can be quite different when they ask about specific issues, such as tax rates (Roberts et al. 1994).

Let’s take a quick look at some very tentative analyses that we (and our colleague Zbigniew Karpiński) have performed on this issue, with a specific focus on the question of whether people’s attitudes toward taxation change as their circumstances (e.g., income, employment) change.

Read More »


A Descriptive Analysis Of The 2014 D.C. Charter School Ratings

Posted by on November 24, 2014

The District of Columbia Public Charter School Board (PCSB) recently released the 2014 results of their “Performance Management Framework” (PMF), which is the rating system that the PCSB uses for its schools.

Very quick background: This system sorts schools into one of three “tiers,” with Tier 1 being the highest-performing, as measured by the system, and Tier 3 being the lowest. The ratings are based on a weighted combination of four types of factors — progress, achievement, gateway, and leading — which are described in detail in the first footnote.* As discussed in a previous post, the PCSB system, in my opinion, is better than many others out there, since growth measures play a fairly prominent role in the ratings, and, as a result, the final scores are only moderately correlated with key student characteristics such as subsidized lunch eligibility.** In addition, the PCSB is quite diligent about making the PMF results accessible to parents and other stakeholders, and, for the record, I have found the staff very open to sharing data and answering questions.

That said, PCSB’s big message this year was that schools’ ratings are improving over time, and that, as a result, a substantially larger proportion of DC charter students are attending top-rated schools. This was reported uncritically by several media outlets, including this story in the Washington Post. It is also based on a somewhat questionable use of the data. Let’s take a very simple look at the PMF dataset, first to examine this claim and then, more importantly, to see what we can learn about the PMF and DC charter schools in 2013 and 2014. Read More »


Feeling Socially Connected Fuels Intrinsic Motivation And Engagement

Posted by on November 20, 2014

Our “social side of education reform” series has emphasized that teaching is a cooperative endeavor, and as such is deeply influenced by the quality of a school’s social environment — i.e., trusting relationships, teamwork and cooperation. But what about learning? To what extent are dispositions such as motivation, persistence and engagement mediated by relationships and the social-relational context?

This is, of course, a very complex question, which can’t be addressed comprehensively here. But I would like to discuss three papers that provide some important answers. In terms of our “social side” theme, the studies I will highlight suggest that efforts to improve learning should include and leverage social-relational processes, such as how learners perceive (and relate to) — how they think they fit into — their social contexts. Finally, this research, particularly the last paper, suggests that translating this knowledge into policy may be less about top down, prescriptive regulations and more about what Stanford psychologist Gregory M. Walton has called “wise interventions” — i.e., small but precise strategies that target recursive processes (more below).

The first paper, by Lucas P. Butler and Gregory M. Walton (2013), describes the results of two experiments testing whether the perceived collaborative nature of an activity that was done individually would cause greater enjoyment of and persistence on that activity among preschoolers. Read More »


Rethinking The Use Of Simple Achievement Gap Measures In School Accountability Systems

Posted by on November 17, 2014

So-called achievement gaps – the differences in average test performance among student subgroups, usually defined in terms of ethnicity or income –  are important measures. They demonstrate persistent inequality of educational outcomes and economic opportunities between different members of our society.

So long as these gaps remain, it means that historically lower-performing subgroups (e.g., low-income students or ethnic minorities) are less likely to gain access to higher education, good jobs, and political voice. We should monitor these gaps; try to identify all the factors that affect them, for good and for ill; and endeavor to narrow them using every appropriate policy lever – both inside and outside of the educational system.

Achievement gaps have also, however, taken on a very different role over the past 10 or so years. The sizes of gaps, and extent of “gap closing,” are routinely used by reporters and advocates to judge the performance of schools, school districts, and states. In addition, gaps and gap trends are employed directly in formal accountability systems (e.g., states’ school grading systems), in which they are conceptualized as performance measures.

Although simple measures of the magnitude of or changes in achievement gaps are potentially very useful in several different contexts, they are poor gauges of school performance, and shouldn’t be the basis for high-stakes rewards and punishments in any accountability system. Read More »


Multiple Measures And Singular Conclusions In A Twin City

Posted by on November 12, 2014

A few weeks ago, the Minneapolis Star Tribune published teacher evaluation results for the district’s public school teachers in 2013-14. This decision generated a fair amount of controversy, but it’s worth noting that the Tribune, unlike the Los Angeles Times and New York City newspapers a few years ago, did not publish scores for individual teachers, only totals by school.

The data once again provide an opportunity to take a look at how results vary by student characteristics. This was indeed the focus of the Tribune’s story, which included the following headline: “Minneapolis’ worst teachers are in the poorest schools, data show.” These types of conclusions, which simply take the results of new evaluations at face value, have characterized the discussion since the first new systems came online. Though understandable, they are also frustrating and a potential impediment to the policy process. At this early point, “the city’s teachers with the lowest evaluation ratings” is not the same thing as “the city’s worst teachers.” Actually, as discussed in a previous post, the systematic variation in evaluation results by student characteristics, which the Tribune uses to draw conclusions about the distribution of the city’s “worst teachers,” could just as easily be viewed as one of the many ways that one might assess the properties and even the validity of those results.

So, while there are no clear-cut “right” or “wrong” answers here, let’s take a quick look at the data and what they might tell us. Read More »


Librarians, Libraries, Serendipity And Passion

Posted by on November 6, 2014

Our guest author today is Connie Williams, a National Board Certified Teacher librarian at Petaluma High School in Petaluma, CA, past president of the California School Library Association, and co-developer of the librarian and teacher 2.0 classroom tutorials.

Down the road from where I live, on the first-of-the month, a group of vintage car owners gather for a “cars and coffee” meet up. The cars that show up with their drivers cover many years and obsessions. Drivers park, open up the car hoods and take a few steps back and begin talking with other car owners and visitors who happen by. These are people who are interested in the way cars work, their history, and they all have stories to share.

How do they know so much about their cars? They work on them – gaining insight by hands-on practice and consultations with experts. If they’re wealthy enough, they pay someone else to do the work, yet they don’t just hand over their cars to them. They read about them, participate in on-line groups, ask for guidance, and they drive them. Most often, when they drive them, someone stops and asks questions about their cars and they teach what they know to others. 

This is an example of the kind of learning we would hope for, for all our students – a passion that is ignited and turns into knowledge that is grown, developed, and shared. In this sense, it is inquiry – asking questions and taking the required steps to answer them – that is at the heart of learning. Read More »


The Bewildering Arguments Underlying Florida’s Fight Over ELL Test Scores

Posted by on November 3, 2014

The State of Florida is currently engaged in a policy tussle of sorts with the U.S. Department of Education (USED) over Florida’s accountability system. To make a long story short, last spring, Florida passed a law saying that the test scores of English language learners (ELLs) would only count toward schools’ accountability grades (and teacher evaluations) once the ELL students had been in the system for at least two years. This runs up against federal law, which requires that ELLs’ scores be counted after only one year, and USED has indicated that it’s not willing to budge on this requirement. In response, Florida is considering legal action.

This conflict might seem incredibly inane (unless you’re in one of the affected schools, of course). Beneath the surface, though, this is actually kind of an amazing story.

Put simply, Florida’s argument against USED’s policy of counting ELL scores after just one year is a perfect example of the reason why most of the state’s core accountability measures (not to mention those of NCLB as a whole) are so inappropriate: Because they judge schools’ performance based largely on where their students’ scores end up without paying any attention to where they start out. Read More »


The Equity Projection

Posted by on October 30, 2014

A new Mathematica report examines the test-based impact of The Equity Project (TEP), a New York City charter school serving grades 5-8. TEP opened up for the 2009-10 school year, receiving national attention mostly due to one unusual policy: They paid teachers $125,000 per year, regardless of experience and education, in addition to annual bonuses (up to $25,000) for returning teachers. TEP largely makes up for these unusually high salary costs by minimizing the number of administrators and maintaining larger class sizes.

As is typical of Mathematica, the TEP analysis is thorough and well-done. The school’s students’ performance is compared to that of similar peers with a comparable probability of enrolling in TEP, as identified with propensity scores. In general, the study’s results were quite positive. Although there were statistically discernible negative impacts of attendance for TEP’s first cohort of students during their first two years, the cumulative estimated test-based impact was significant, positive and educationally meaningful after three and four years of attendance. As always, the estimated effect was stronger in math than in reading (estimated effect sizes for the former were very large in magnitude). The Mathematica researchers also present analyses on student attrition, which did not appear to bias the estimates substantially, and they also show that their primary results are robust when using alternative specifications (e.g., different matching techniques, score transformations, etc.).

Now we get to the tricky questions about these results: What caused them and what can be learned as a result? That’s the big issue with charter analyses in general (and with research on many other interventions): One can almost never separate the “why” from the “what” with any degree of confidence. And TEP, with its “flagship policy” of high teacher salaries, which might appeal to all “sides” in the education policy debate, provides an interesting example in this respect. Read More »


All The World’s A Stage: How Churn Undermines Change

Posted by on October 28, 2014

Our guest authors today are Kara S. Finnigan, Associate Professor at the Warner School of Education at the University of Rochester, and Alan J. Daly, Professor and Chair of Education Studies at the University of California San Diego. Finnigan and Daly recently co-edited Using Research Evidence in Education: From the Schoolhouse Door to Capitol Hill (Springer, 2014), which explores the use and diffusion of different types of evidence across levels of the educational system. This column is part of The Social Side of Reform Shanker Blog series.

“All the world’s a stage, and all the men and women merely players; they have their exits and their entrances.” William Shakespeare – As You Like It

All too often in districts under intense accountability pressures, exits and entrances happen frequently and repeatedly. One might conceptualize the work of district reform as a play in which actors are beginning to learn their lines and block places on the stage but, just as the play is underway, some key actors leave and others join, causing disruption to the performance. Now, if all of those who leave or join have smaller roles, the disruption may be less extreme, but if most are lead actors or the director or even the head of costume design, you’d likely have to push back opening night. Read More »


Disclaimer

This web site and the information contained herein are provided as a service to those who are interested in the work of the Albert Shanker Institute (ASI). ASI makes no warranties, either express or implied, concerning the information contained on or linked from shankerblog.org. The visitor uses the information provided herein at his/her own risk. ASI, its officers, board members, agents, and employees specifically disclaim any and all liability from damages which may result from the utilization of the information provided herein. The content in the shankerblog.org may not necessarily reflect the views or official policy positions of ASI or any related entity or organization.

Banner image adapted from 1975 photograph by Jennie Shanker, daughter of Albert Shanker.