Orwell Award Announcement SusanOhanian.Org Home

Trying to Find a Measure for How Well Colleges Do

NOTE: As of this posting, there are 98 comments burning up the Internet. They are being added at record speed. Here are a few.

Reader Comment: The educational testing industry has already sucked the blood out of our primary and secondary school systems, and now they want to move on to the collegiate system. When will we learn? (Pun intended.)

Reader Comment: Follow the money, period, end of discussion. Who benefits from this proposal? Corporate testing agencies and educrats who have a platform to promote themselves with. Follow. The. Money.

There is ZERO proof that the standardized testing assaults on our nation's 99% have improved anything whatsoever, and ample data to demonstrate that the tests are completely statistically invalid, reduce education to mediocrity at best, and are a thinly disguised means for privatization.

And I say "99%" for a good reason. The wealthy who propose these tests ALWAYS exclude their own children from the mess--they have no skin in the game. You think Harvard will agree to this? No. Will various state and lower tier schools that are affordable for the middle class be *forced* to agree to this? Enough said.

Reader Comment: The idea is nuts. It must be the brain child of some corporate ideologues who are still fixated in making the world over in their image of the world's peoples becoming consumers for needs never truly met, but always tantalized.

First of all: Not only does every course grade the results of its students' work, so testing to some abstracted paradigm that has no culturally congruent value in a time of social confusion & upheaval, is not only redundant but myopic and we have majors, different strokes, etc....

Plus, factual accumulation, that tests best measure, does not a wise man make. They do not measure well the vision accrued, the ways your narrow way of seeing the world may have expanded to have understanding and compassion for the variety of the world's cultures.

Plus, Colleges are the one place where people live in community -- form deep friendships and those friendships are the dear and reliable and connective tissue that help in future years graduates to navigate the world, and fulfill their missions. That is an untestable affect of a college or university education -- not to be minimized and surely not to be put on a test -- so heart is taken out of the equation and manipulation is rewarded.

Sickening thought. I feel all discussion on it should be immediately DROPPED. Bad Idea: yes: NUTS!

Reader Comment: And instead of "higher education", we can just call it "job training." And since monetary reward is the only, only value left in our land, that would be reasonable. If otherwise, the people are ignorant of history, current affairs, reasoning skills, and so forth, that's okay. It's not like we expect them to be self-governing. Or to use their minds for anything but monetary work. They're to be machine parts, so train them for the machine part they will be.

What a nightmare this nation has become.

By Richard Perez=Pena

How well does a college teach, and what do its students learn? Rankings based on the credentials of entering freshmen are not hard to find, but how can students, parents and policy makers assess how well a college builds on that foundation?

What information exists has often been hidden from public view. But that may be changing.

In the wake of the No Child Left Behind federal education law, students in elementary, middle and high schools take standardized tests whose results are made public, inviting anyone to assess, however imperfectly, a schoolâs performance. There is no comparable trove of public data for judging and comparing colleges.

Pieces of such a system may be taking shape, however, with several kinds of national assessments â including, most controversially, standardized tests â gaining traction in recent years. More than 1,000 colleges may be using at least one of them.

âThereâs a real shift in attitudes under way,â said David C. Paris, executive director of the New Leadership Alliance for Student Learning and Accountability, a coalition of higher education groups. âWe used to hear a lot more of, âThe value of college canât be measured,â and now we hear more of, âLetâs talk about how we can measure.â â

In January, the New Leadership Alliance released guidelines calling on colleges to systematically âgather evidence of student learningâ â though not explicitly advocating standardized tests â and release the results. The report was endorsed by several major organizations of colleges and universities.

Advocates say the point is not to measure how each collegeâs students perform after four years, which depends heavily on the caliber of students it enrolls in the first place, but to see how much they improve along the way. The concern is less about measuring knowledge of chemistry or literature than about harder to define skills like critical thinking and problem-solving.

That vision still faces major obstacles. Colleges that use standardized tests vary widely in what they test, how and when. And many of them that use those tests or national surveys keep the results to themselves.

âIâd love for all the data to be public,â said Jennifer Carney, director of program evaluation at the Jack Kent Cooke Foundation, which conducts education research. But, she added, that would inevitably lead to some colleges manipulating the figures in pursuit of a higher standing, just as some have done with existing ranking systems.

In the best-known college rankings, by U.S. News & World Report, up to 40 percent of a collegeâs score is based on its reputation among educators and its selectivity in admitting students. Other factors include several indirect indicators of what happens in classrooms, like student retention, graduation rates and class sizes, but no direct measures of learning.

Critics of standardized tests say they are too narrow and simplistic.

âIâm not sure any standardized test can effectively measure what students gain in problem-solving, or the ability to work collaboratively,â said Alice P. Gast, president of Lehigh University.

In 2008, the Consortium on Financing Higher Education, a group of some of the nationâs most prestigious colleges and universities â including all of the Ivy League â issued a lengthy manifesto saying that what its students learn becomes evident over decades and warning against a âfocus on what is easily measured.â

Many of those same colleges participate in the National Survey of Student Engagement, which measures many factors that educators say are good, though indirect, indicators of learning, like how many hours students spend studying and how much they interact with professors. The survey, which began with a handful of colleges in 2000, had more than 700 participate last year. Each college can see its own results and those of a group of comparable colleges, but the scores are not made public.

The view from state-supported colleges has been shaped in part by pressure from policy makers to show what taxpayer dollars are accomplishing, through standardized tests. Texas, a leader in the movement, has required its state colleges to administer tests since 2004, and it makes the outcomes public.

Testing advocates have also gained ammunition from books calling into question the quality of American colleges, notably âAcademically Adrift,â by Richard Arum and Josipa Roksa, published last year. It was based on a study showing that more than one-third of students show no significant gain in critical thinking skills after four years of college.

But the concept of universal assessment got its biggest boost in 2006, from the findings of a commission appointed by Margaret Spellings, then the education secretary. The report said that learning âmust be measured by institutions on a âvalue addedâ basis that takes into account studentsâ academic baseline,â and that the results must be made available to everyone âto measure the relative effectiveness of different colleges and universities.â

That prompted talk that the federal government might mandate standardized testing, as it did for public schools with No Child Left Behind in 2001.

âThatâs what gave this issue urgency,â said Christine M. Keller, executive director of the Voluntary System of Accountability, an alliance of more than 300 state colleges that was created in response to the Spellings Commission. âNo one wanted the government imposing a standard.â

Her group has approved three competing tests and asks public colleges to use them and post scores on the groupâs Web site.

They are the ETS Proficiency Profile, from Educational Testing Service; the Collegiate Assessment of Academic Proficiency, produced by ACT; and the Collegiate Learning Assessment (used in the âAcademically Adriftâ study), from the Council for Aid to Education, a research group.

âThese instruments are not without controversy,â Ms. Keller said. âItâs still very much a work in progress.â

While more blanks are filled in each year, the âcollege portraitsâ remain spotty. Some member colleges have not posted test scores so far, while others first posted scores from two or three years ago and have not updated them. Typically, only a small sample of students takes a test, and the ways the samples are chosen can vary, making comparison harder.

Some major systems, like the University of California, do not participate in the organization, while others, like the State University of New York, are represented by only a few campuses.

Selective colleges, public and private, complain of a âceiling effectâ in standardized testing, making it especially hard for their students to show improvement.

âIt does not, in my opinion, measure value added very well for our kind of institution,â said Neal E. Armstrong, a vice provost of the University of Texas at Austin. âOur freshmen come in with very high aptitude and critical thinking skills.â

Even so, the use of the three tests in the voluntary system has boomed, with each company claiming several hundred client colleges, most of which do not make their scores public. Test authors acknowledge that colleges often use them in less than optimal ways, like skipping some sections, testing only once every few years (often to satisfy an accreditation agency) and not measuring student growth over time.

If officials and experts in higher education can reach a broad consensus about how to measure learning, it will become routine, with results being made public âonly if consumers demand it,â said Ms. Carney, of the Cooke Foundation.

New York Times





This site contains copyrighted material the use of which has not always been specifically authorized by the copyright owner. We are making such material available in our efforts to advance understanding of education issues vital to a democracy. We believe this constitutes a 'fair use' of any such copyrighted material as provided for in section 107 of the US Copyright Law. In accordance with Title 17 U.S.C. Section 107, the material on this site is distributed without profit to those who have expressed a prior interest in receiving the included information for research and educational purposes. For more information click here. If you wish to use copyrighted material from this site for purposes of your own that go beyond 'fair use', you must obtain permission from the copyright owner.