Orwell Award Announcement SusanOhanian.Org Home

Tulane's Cowen Institute retracts New Orleans schools report, apologizes

Reader Comment: It's time to investigate Tulane's "interest" in this charter "movement" in new orleans. and, maybe, just what syndicate is behind the whole thing. it's obvious that this is a coordinated "attack," replete with a program of propaganda that is carried out by Tulane and the Times-Picayune, among others.

Statement from John Ayers:
Statement from the Executive Director

The Cowen Institute has withdrawn its recent report Beating the Odds, which indicated that some public high schools in New Orleans, especially those that serve the most vulnerable youth, are performing better than predicted.

After its release, officials determined the report's methodology was flawed, making its conclusions inaccurate. The report will not be reissued.

As a result of this incident, the Cowen Institute will thoroughly examine and strengthen its internal protocols to ensure it adheres to the highest standards of review and accuracy in its research and in future reports.

We apologize for this mistake.

John Ayers, Executive Director

John Ayers was named executive director of the Cowen Institute for Public Education Initiatives at Tulane University in July, 2012. Previously he served as the vice president and treasurer of the Carnegie Foundation for the Advancement of Teaching in Stanford, CA. Before that engagement, he devoted his career to improving the Chicago Public Schools. John has provided consulting for National-Louis University, a graduate school of education in Illinois, and for foundations working in the education arena. Previously John served as director of external affairs for the Sargent Shriver National Center on Poverty Law, a law and policy group.

Key findings from the withdrawn report by Patrick Sims and Debra Vaughn:

1. On average, characteristics of vulnerable students (i.e. over-age for grade level,
failed LEAP, FRL-eligible, and special education) are associated with lower
student achievement.

Many students in New Orleans, especially in RSD high schools, are considered vulnerable. On average, these characteristics make the task of high schools more challenging. Schools with higher percentages of vulnerable students tend to have lower achievement levels.

2. Selective admissions policies tend to be associated with higher levels of student

Holding constant the percentage of students that fall into these vulnerable categories, a school with selective admissions is still predicted to have highe EOC passage rates, score higher on the ACT Index, and report higher cohort graduation rates than schools with open admissions policies.

3. On key measures of student achievement (EOC, ACT, and cohort graduation rates), many public high schools in New Orleans with high proportions of vulnerable students are performing better than predicted given the vulnerable characteristics of their students.
The majority of public high schools in New Orleans (60%) exceeded their predicted EOC passage rates. About half of New Orleans public high schools with available data had higher ACT Indices than predicted. All New Orleans high schools with available data were at or above their predicted cohort graduation rates.

This analysis identifies average relationships; it does not identify causation. While the
analysis provides a useful means for identifying schools that are performing at or
above their predicted levels given their vulnerable student population, it does not
identify the causes behind a school's successes or shortcomings. Factors outside of the scope of this analysis are also responsible for driving performance. Further research
should focus on uncovering the underlying causes that lead to better than predicted


Patrick Sims:
Senior Research Analyst, Cowen Institute at Tulane University
Analyst at National Council on Teacher Quality

Debra Vaughn:
Director of Research, Cowen Institute at Tulane University
Director of Research and Evaluation at the Public Education Foundation

by Jessica Williams

In a high-profile embarrassment, Tulane University's Cowen Institute for Education Initiatives on Friday retracted its widely cited Oct. 1 report on New Orleans public high school performance. The study concluded that most schools are posting higher graduation rates and better test scores than could be expected, given the socio-economic disadvantages of their students.

The institute, launched by former Tulane President Scott Cowen, is the primary group that has examined massive shifts in New Orleans public education since Hurricane Katrina. Its research has been touted by numerous news agencies, charter school support groups and the Louisiana Department of Education.

The repudiated report, "Beating the Odds: Academic Performance and Vulnerable Student Populations in New Orleans Public High Schools," has been removed from the non-profit institute's website. Cowen's executive director, John Ayers, said the research was inaccurate.

"Officials determined the report's methodology was flawed, making its conclusions inaccurate," Ayers said. "The report will not be reissued." The institute plans to "thoroughly examine and strengthen its internal protocols" to ensure its future reports are accurate and have been appropriately reviewed, he said.

"We apologize for this mistake," he added.

The report, which listed Debra Vaughan and Patrick Sims as lead researchers, used what's called a "value-added" formula to predict the performance of students at 25 high schools. Researchers said they considered schools' challenges -- for example, the report analyzed how many students were classified as receiving free or discounted lunch, how many students were over-age for their class and how many failed state standardized tests -- then created performance measures with those factors in mind.

Schools with students who exceeded expected measures were considered to have beaten the odds. Ayers would not say what piece of the methodology was flawed.

Among other high schools, the report highlighted Landry-Walker College & Career Preparatory Academy, George Washington Carver Preparatory Academy and Carver Collegiate Academy for their exemplary performance on end-of-course tests. Other schools, such as Dr. Martin Luther King Charter, McDonogh No. 35 High and Lake Area New Tech Early College High, were showcased for their higher-than-expected graduation rates. NOLA.com published a story on the report the day it was released.

Before the retraction, the report had leaped to prominence in some New Orleans education circles, touted by everyone from state Recovery School District Superintendent Patrick Dobard to Leslie Jacobs, a former member of the Louisiana Board of Elementary and Secondary Education and a driving force behind the state's education reforms of the past 20 years. It also was highlighted via social media by leaders of the charter management organization Collegiate Academies, which runs Carver Prep and Carver Collegiate, and of the nonprofit charter support group New Schools for New Orleans.

Zoey Reed, a spokeswoman for Collegiate Academies, said Friday that while the Cowen report was "validation" of the schools' success, its retraction doesn't diminish them. "There's just so much great stuff that we already do," she said. "That still holds true with or without the report."

"Value-added" measures are already controversial; many have questioned their calculations. The state Education Department uses a value-added system to measure teacher performance in classrooms, but it seeks to balance the value-added portion of a teacher's evaluation with classroom observations.

Thus far, school performance scores are largely measured by how children score at the end of each year on state standardized tests, as opposed to how far certain cohorts of children have come over time. This appears to be Cowen's first attempt to measure student performance with value-added principles in mind.

— Jessica Williams
New Orleans Times-Picayune





This site contains copyrighted material the use of which has not always been specifically authorized by the copyright owner. We are making such material available in our efforts to advance understanding of education issues vital to a democracy. We believe this constitutes a 'fair use' of any such copyrighted material as provided for in section 107 of the US Copyright Law. In accordance with Title 17 U.S.C. Section 107, the material on this site is distributed without profit to those who have expressed a prior interest in receiving the included information for research and educational purposes. For more information click here. If you wish to use copyrighted material from this site for purposes of your own that go beyond 'fair use', you must obtain permission from the copyright owner.