Orwell Award Announcement SusanOhanian.Org Home

NCLB Outrages

NCLB Seen as Curbing Low, High Achievers’ Gains

By Debra Viadero


A new study of Chicago students suggests that the federal No Child Left Behind Act may indeed be leaving behind students at the far ends of the academic ability spectrumâthe least able students and those who are gifted.

The study by University of Chicago economists Derek A. Neal and Diane Whitmore Schanzenbach lends some empirical support to the common perception that schools are focusing on students in the middleâthe so-called âbubble kidsââin order to boost scores on the state exams used to determine whether schools are meeting their proficiency targets.

âThe whole point is that the details of how you calculate `adequate yearly progressâ matter for how teachers will allocate their effort across students,â said Mr. Neal, who presented his paper today at a conference hosted by the American Enterprise Institute, a think tank based here. âAnytime you keep score by looking at the number of kids who pass some proficiency standard, that will shape whom teachers teach.â

But Doug Mesecar, the acting assistant secretary in the Office of Planning, Evaluation, and Policy Development at the U.S. Department of Education, said itâs too soon to conclude that the lawâs accountability mechanisms arenât working as they were intended.

âI donât think it tells enough of the whole story to support the generalizations that were made,â said Mr. Mesecar, who was part of a panel formed by the AEI to discuss the report. âWe need to know more, to continue to study, and have more data to do these kinds of analyses, and then, if we do find it is a problem, we need to go in and rectify it.â
âThe Ironyâ

For their study, the Chicago researchers zeroed in on two time periods during which the 421,000-student school system was changing its testing-and-accountability system. The most recent period was 2002, when the school system, seeing that passage of the NCLB law was imminent, made the Illinois Standards Achievement Test a high-stakes exam and set proficiency cutoffs that students would be expected to meet.

The earlier period was 1998, after city school officials tried much the same approach with the Iowa Test of Basic Skills. While the ITBS cutoff points were considered lower, the 1998 accountability system also upped the stakes in a slightly different way by requiring 8th graders who did not pass the tests to attend summer school.

To measure the impact of the new systems, the researchers compared reading and mathematics scores for students in 5th, 6th, or 8th grades in the year, or years, after the changes had taken place with those made by similar cohorts of students a few years earlier. The idea was to determine whether the changes in studentsâ tests scores were larger or smaller than what might have been expected had the school system conducted business as usual.

The post-reform pattern, in all cases, was consistent: Students in the middle of the pack made the largest test-score gains, compared with students in previous years. The bottom 20 percent of students made the least progress and, in some cases, even lost ground. The top 10 percent of students made either no academic gains or improvements that were smaller than those of students in the middle, depending on the subject matter.

For the least-able students, the situation was only slightly better in the post-1998 reform period. Those studentsâ scores improved more then, the researchers believe, because the standards had been set at lower levels. They speculated that teachers may be more likely to write off low-achieving students when the likelihood that they will ever meet the achievement target is more distant.

Also, while the federal law mandates that schools ensure that all students reach proficiency levels by the 2013-14 school year, âthereâs no evidence to show that schools are taking that seriously,â Mr. Neal said.

"This is the irony of the `soft bigotry of low expectations,`â he added, quoting a line from President Bush. âHaving lower standards is actually beneficial to low-advantage children."
Teaching to the Middle

Another panelist, Charles Murray, AEIâs W.H. Brady scholar, said he found Mr. Nealâs finding âpersuasive.â

âThis strikes, I hope, a major blow to the chest of proficiency counts as a measure of progress in education,â added Mr. Murray, who recently published studies suggesting that achievement gaps between children of different races may be immutable. âTo ask children to perform at levels at which they are incapable is one of the cruelest things you could ask a child to do.â

A more pointed critique of the study, however, came from Susan L. Traiman, the director of education and workforce policy at the Washington-based Business Roundtable and a supporter of the NCLB law. Like Mr. Mesecar, she said more years of data are needed to determine if the patterns Mr. Neal found in the early years of testing-and-accountability changes are consistent.

âTeaching to the middle is nothing new,â she added. âItâs what most beginning teachers do.â

While the law requires most states to gauge studentsâ academic progress by counting the number of students who reach proficiency targets, U.S. Secretary of Education Margaret Spellings in recent years began to allow some states and districts to experiment with other accountability models. Currently, for example, nine states have waivers to try so-called âgrowth models,â which typically give schools credit for gains that students make toward proficiency.

A better variant on that model, Mr. Neal said, might be one that takes into account previous achievement differences among students, their peers, and other factors in the same way that golfers are assigned handicaps to account for differences in golf courses or in their ability levels.

âYou need some handicapping system that allows you to say that teacher A had a bad year or teacher B had a good year, regardless of whether they taught in New Trier, Ill., or some inner-city school in New Jersey,â he said.

The new study, âLeft Behind by Design: Proficiency Counts and Test-Based Accountability,âRequires Adobe Acrobat Reader has not yet been published in a peer-reviewed journal.

— Debra Viadero
Education Week


This site contains copyrighted material the use of which has not always been specifically authorized by the copyright owner. We are making such material available in our efforts to advance understanding of education issues vital to a democracy. We believe this constitutes a 'fair use' of any such copyrighted material as provided for in section 107 of the US Copyright Law. In accordance with Title 17 U.S.C. Section 107, the material on this site is distributed without profit to those who have expressed a prior interest in receiving the included information for research and educational purposes. For more information click here. If you wish to use copyrighted material from this site for purposes of your own that go beyond 'fair use', you must obtain permission from the copyright owner.