Orwell Award Announcement SusanOhanian.Org Home


"Reform Florida" Policy Briefs

Susan Notes: Although these policy briefs focus on Florida, everyone should pay attention. Florida's reforms have served as de facto models for federal education policy.


This series of policy briefs examining education reform in Florida finds that the results of the state's aggressive school-reform program have been mixed, and that the state's actions often do not match its rhetoric when it comes to implementing reforms.


Introduction and Executive Summary

For nearly a decade, Florida has been a laboratory for school reform unlike any in the nation. While nearly every state has undertaken a variety of programs aimed at improving achievement in public schools, Florida's efforts have been more far-reaching and wide-ranging. The state's FCAT testing program and A+ accountability system have served as de facto models for the 2002 federal No Child Left Behind (NCLB) legislation. Florida Governor Jeb Bush has played an active role in initiating and advocating for a number of Florida's newer education initiatives – particularly those that seek to create market competition as a means of solving the perceived problems of public schools.

Florida's education reform efforts began well before Governor Bush took office in 1999. Under Governor Lawton Chiles, the state took the first steps toward improving the curriculum and expanding the role of testing in the state's accountability system. The state's efforts have not been limited to measuring test outcomes, nor have they been only driven by the state's governors or legislature. Florida voters have passed a series of mandates, in the form of amendments to the state constitution, that seek to reform education by insuring adequate resources are provided and by investing in early education and reduced class size.

Reform Florida is a collection of eleven policy briefs by eight authors who assess the current status of key education reforms in Florida and make recommendations for the future. Reform Florida topics range from school funding, to teacher supply, to English language learning. In general the briefs paint a decidedly mixed picture of Florida's efforts to meet its ambitious agenda for improving student achievement. A number of the briefs point to ways in which various of the current state requirements and mandates may actually undermine student achievement, particularly the achievement of low-income minority students.
Madhabi Chatterji of Columbia University's Teachers College (Good and Bad News About Florida Student Achievement: Performance Trends on Multiple Indicators Since Passage of the A+ Legislation) observes that elementary achievement trends show strong gains in writing and steady improvements over time in reading and mathematics. In upper grades the news is not so good, with continued and in some cases widening achievement gaps along ethnic and socioeconomic lines.

Lisa Abrams of Boston College (Teachers' Views on High-stakes Testing: Implications for the Classroom) reports that the emphasis on test-driven assessment under the state's A-plus accountability program has tended to produce more fear than trust in Florida's classrooms. Florida teachers who took part in a national survey on the impact of high-stakes testing on their teaching practices were more likely than their counterparts in other states to report positive views of state standards and of their compatibility with the state's testing program. However, they report spending more time on tested subject matter, to the detriment of important activities that are not tested. They also report that the pressure to raise test scores has produced widespread anxiety among students and quite possibly encouraged some to drop out of school.

One result of the testing mandated by the A-plus accountability program has been the retention in grade of students who fall below a threshold test score. Mary Lee Smith of Arizona State University (Retaining Students in Grade: Consequences for Florida) examines the research on the impact of retaining students in grade and finds that the practice drives up dropout rates. She concludes that although retaining students in grade provides no short-term benefits, the policy entails substantial long-term risks for students, and increases costs to taxpayers. Students retained in grade are disproportionately students living in poverty and members of ethnic minorities.
Examining the state's record since the 1998 implementation of the constitutional mandate to provide "adequate provision…for a uniform, efficient, safe, secure, and high quality system of free public schools," Douglas Harris of Florida State University (Funding Florida's Schools: Adequacy, Costs, and the State Constitution) finds that a strong case can be made that the state has failed to live up to its constitutional obligation and that Florida is at risk of being held legally liable as a consequence. Harris recommends that the legislature empanel a bipartisan commission to study the state's education system and bring its funding into line with terms that would enable the state to meet the constitutional standard voters have approved.

One group of Florida students potentially put at risk both by the state's accountability regime and the requirements of No Child Left Behind are those with limited English proficiency (LEP). Victoria-Maria Macdonald of Florida State University (The Status of English Language Learners in Florida: Trends and Prospects) finds that while Florida remains under a 1990 consent decree requiring "equal and comprehensible instruction" to the state's LEP students, efforts to meet the decree's standards have been hampered by the requirements of the state's A-plus accountability system, the No Child Left Behind act, and the too-hasty movement of LEP students away from bilingual instruction and into inclusion programs. Macdonald notes, however, that Florida has avoided the wholesale hostility to bilingualism that has harmed LEP education programs elsewhere.

Briefs by Douglas Harris of FSU (Putting a High Quality Teacher in Every Florida Classroom) and Gene Glass of ASU (Teacher Evaluation) examine the challenges of recruiting high quality teachers for every classroom and appropriately assessing them once they have been hired. Harris warns of a serious challenge in finding qualified teachers to fill every classroom in Florida, and concludes that while the state has taken some steps toward filling that need, its overall effort has been more symbolic than meaningful. Glass, meanwhile, reviews research on teacher evaluation. Policy makers have increasingly turned to two forms of test-driven evaluations of teachers: paper-and-pencil tests of teachers themselves, and student test scores, where student performance is used to assess teachers' competence. While both are increasingly popular, these approaches to assessing teachers, Glass points out, are far less accurate and valid predictors of student achievement than their proponents claim. The questionable validity of paper-and-pencil tests of teachers and of value-added teacher evaluation methods means, Glass reasons, that they cannot be used as substitutes for college degree requirements in the teacher certification process.

Reform Florida concludes with briefs that examine those aspects of the accountability regime that focus on market-based solutions to public education problems, i.e., the state's voucher, charter school, business tax credit, and "virtual" education initiatives. Tim Hacsi of the University of Massachusetts at Boston (Innovations and Accountability: Vouchers, Charters, and the Florida Virtual School) observes that Florida has been one of the most active states in the nation in creating and expanding such market-based educational options. To date, however, there is no reliable evidence that such measures have improved student achievement in the state. Hacsi and the University of South Florida's Sherman Dorn, in a separate brief (Reforming the Structure of Florida's Accountability System), both make the point that Florida's publicly funded choice options are not subject to the same accountability standards as are traditional public schools. This unequal standard for accountability, they contend, deprives Florida residents of the means to assess comprehensively whether the results of these experiments are worth the tax dollars they cost.

In a separate analysis (Alternatives for Florida's Assessment and Accountability System), Dorn analyzes the state's accountability regime for public schools. He finds that the system of awarding letter grades to schools and then responding by providing a monetary reward (for desired improvements) or sanctions such as losing students to vouchers (for undesired failure to improve) is a misuse of test result data and violates the standards set by testing experts. Additionally, Dorn argues that the system as currently structured fails to adequately aid struggling schools to improve.

Finally, Douglas Harris's brief (Class Size, Pre-kindergarten, and Educational Adequacy: Costs and Funding Options for Florida) reviews Florida's efforts to respond to voter approved constitutional amendments mandating smaller classes and universal pre-kindergarten. He finds that Florida's efforts so far have been inadequate and makes the case that the state can adequately fund both amendments without giving up its position as a low-tax state.
The people of Florida have high expectations of their publicly funded schools, as reflected by the reforms implemented over the last 10 years. As the Reform Florida briefs demonstrate, while some of these reforms show promising signs of making a positive impact on student achievement, others do not. In some cases the reforms implemented are not sufficiently grounded in research evidence to warrant their having been adopted. Other reforms have the potential to make important contributions to improving the achievement of Florida's children, but lack sufficient infrastructure or state investment to accomplish their purposes.

The school reform debate frequently takes place in an environment that is long on emotion and short on hard data. By grounding its examination of Florida's reforms in data, the Reform Florida briefs offer guidance on how successful reforms can be made better, which promising initiatives need more support, and which efforts should be significantly modified or abandoned altogether. The Reform Florida briefs thus provide Florida's public and policy makers with an assessment of how effectively their money is currently being spent and a roadmap to how it might be better invested in the years to come.

ARIZONA STATE UNIVERSITY
EDUCATION POLICY STUDIES LABORATORY
Education Policy Research Unit


****NEWS RELEASE****

from the Education Policy Research Unit (EPRU)
of the Education Policy Studies Laboratory (EPSL)
at Arizona State University


FOR IMMEDIATE RELEASE


Find the report at:
http://www.asu.edu/educ/epsl/EPRU/epru_2004_Research_Writing.htm

Find the Chatterji brief on Florida student achievement at:
http://www.asu.edu/educ/epsl/EPRU/documents/EPSL-0401-105-EPRU.doc

Find the Abrams brief on teachers' views on high-stakes testing at:
http://www.asu.edu/educ/epsl/EPRU/documents/EPSL-0401-104-EPRU.doc

Find the Smith brief on retaining students in grade at:
http://www.asu.edu/educ/epsl/EPRU/documents/EPSL-0401-114-EPRU.doc

Find the Harris brief on funding Florida's schools at:
http://www.asu.edu/educ/epsl/EPRU/documents/EPSL-0401-110-EPRU.doc

Find the MacDonald brief on English language learners at:
http://www.asu.edu/educ/epsl/EPRU/documents/EPSL-0401-113-EPRU.doc

Find the Harris brief on putting a high quality teacher in every classroom
at:
http://www.asu.edu/educ/epsl/EPRU/documents/EPSL-0401-111-EPRU.doc

Find the Glass brief on teacher evaluation at:
http://www.asu.edu/educ/epsl/EPRU/documents/EPSL-0401-112-EPRU.doc

Find the Hacsi brief on vouchers, charter schools, and "virtual" schools at:
http://www.asu.edu/educ/epsl/EPRU/documents/EPSL-0401-109-EPRU.doc

Find the Dorn brief on reforming the structure of Florida's accountability
system at:
http://www.asu.edu/educ/epsl/EPRU/documents/EPSL-0401-106-EPRU.doc

Find the Dorn brief on alternatives for Florida's assessment and
accountability system at:
http://www.asu.edu/educ/epsl/EPRU/documents/EPSL-0401-107-EPRU.doc

Find the Harris brief on costs and funding of class size reduction, pre-K,
and educational adequacy at:
http://www.asu.edu/educ/epsl/EPRU/documents/EPSL-0401-108-EPRU.doc


NEW REPORT ON FLORIDA EDUCATION REFORM ILLUMINATES STRENGTHS AND WEAKNESSES
OF STATE AND FEDERAL REFORM EFFORTS.

TEMPE, Ariz.-A series of policy briefs examining education reform in Florida finds that the results of the state's aggressive school-reform program have been mixed, and that the state's actions often do not match its rhetoric when it comes to implementing reforms.

"Reform Florida" was produced by the Education Policy Studies Laboratory (EPSL) at Arizona State University for the Florida-based think tank Civic Concern.

Although the report focuses on Florida, it has national significance. Florida's reforms have served as de facto models for federal education
policy, particularly laws signed by Governor Bush that stress high-stakes testing and market-based competition, the report notes. In addition, voters have put guarantees of adequate funding, smaller class sizes, and universal pre-Kindergarten into the state's constitution.

The report finds that the state consistently fails to meet the goals it has set for itself. While the state's reforms require accountability for public schools, this requirement does not extend to charter and voucher schools. While the state has called for higher quality teachers, it has not funded
programs intended to improve teacher quality. While state policy makers have demanded high quality education, it has not fulfilled constitutional mandates for adequate funding or smaller class sizes.

"In general, the briefs paint a decidedly mixed picture of Florida's record of success at meeting the ambitious agenda for improving student achievement that the state has set for itself," writes Alex Molnar, director of the
EPSL, in the introduction to "Reform Florida."

"Reform Florida" contains the following 11 briefs:

1) Madhabi Chatterji (Columbia University) Good and Bad News About Florida Student Achievement: Performance Trends on Multiple Indicators Since Passage of the A+ Legislation.

Key recommendation: Provide local support and evaluation training opportunities to help teachers and school leaders make better use of data to reduce achievement gaps in reading and mathematics, particularly at the secondary level.

2) Lisa Abrams (Boston College) Teacher's Views on High-stakes Testing: Implications for the Classroom.

Key recommendation: Make Florida testing policy adhere to the recognized professional standards regarding test development and to the appropriate use of test results as described in the Standards for Educational and Psychological Testing, published jointly by the American Educational Research Association, the American Psychological Association, and the National Council on Measurement in Education.

3) Mary Lee Smith (Arizona State University) Retaining Students in Grade: Consequences for Florida.

Key recommendation: Repeal the relevant section of Statute 1008 so that pupils' progression from grade to grade is disconnected from their FCAT scores.

4) Douglas Harris (Florida State University) Funding Florida's Schools: Adequacy, Costs, and the State Constitution.

Key recommendation: Establish and fund a bipartisan commission of key education experts and stakeholders to oversee a cost study to determine what constitutes an adequate education based on Florida's Constitution and the state's unique circumstances.

5) Victoria-Maria MacDonald (Florida State University) The Status of English Language Learners in Florida: Trends and Prospects.

Key recommendation: Enhance teacher education programs at the in-service and pre-service levels by mandating that ESOL teachers be certified in the areas they teach, recruiting high quality (particularly minority) teachers, and removing exemptions for Consent Decree-mandated ESOL training of teachers.

6) Douglas Harris (Florida State University) Putting a High Quality Teacher in Every Florida Classroom.

Key recommendation: Reduce restrictions on colleges of education that limit innovation and create an uneven playing field in relation to the alternate certification system.

7) Gene Glass (Arizona State University) Teacher Evaluation.

Key recommendation: Oppose any attempt to substitute test performance for college degree requirements in the teacher certification process.

8) Tim Hacsi (University of Massachusetts Boston) Innovations and Accountability: Vouchers, Charters, and the Florida Virtual School.

Key recommendation: Require the FCAT to be given to all students receiving publicly financed vouchers, and to have the results made public.

9) Sherman Dorn (University of South Florida) Reforming the Structure of Florida's Accountability System.

Key recommendation: Create a uniform system of accountability that allows the accurate assessment of, and comparison among, all schools receiving direct or indirect financial aid from the state.

10) Sherman Dorn (University of South Florida) Alternatives for Florida's Assessment and Accountability System.

Key recommendation: Institute a moratorium on monetary rewards and then reform the rewards system.

11) Douglas Harris (Florida State University) Class Size, Pre-kindergarten, and Educational Adequacy: Costs and Funding Options for Florida.

Key recommendation: Fund an independent, external review of CSR costs and benefits to provide a steady source of objective information as the amendments are implemented.

In describing the purpose of the "Reform Florida" briefs, Education Policy Studies Laboratory director Alex Molnar commented, "We hope the 'Reform Florida' briefs help Florida citizens and policy makers better understand
how education reform in the state is faring. Taken together, we believe these briefs can help Floridians make sound decisions about where to go from here."



**********


The Education Policy Research Unit (EPRU) conducts original research, provides independent analyses of research and policy documents, and facilitates educational innovation. EPRU facilitates the work of leading academic experts in a variety of disciplines to help inform the public debate about education policy issues.

— Alex Molnar
Education Policy Studies Laboratory

http://edpolicylab.org


INDEX OF RESEARCH THAT COUNTS


FAIR USE NOTICE
This site contains copyrighted material the use of which has not always been specifically authorized by the copyright owner. We are making such material available in our efforts to advance understanding of education issues vital to a democracy. We believe this constitutes a 'fair use' of any such copyrighted material as provided for in section 107 of the US Copyright Law. In accordance with Title 17 U.S.C. Section 107, the material on this site is distributed without profit to those who have expressed a prior interest in receiving the included information for research and educational purposes. For more information click here. If you wish to use copyrighted material from this site for purposes of your own that go beyond 'fair use', you must obtain permission from the copyright owner.