Orwell Award Announcement SusanOhanian.Org Home

Dartmouth and Stanford Apologize After a Political-Science Experiment Gone Wrong

Susan Notes:

A mailer sent to Montana voters by college professors featured the state's official seal and offered information about the political leanings of candidates for the state's Supreme Court. I guess for starters the question is who's entitled to use a state seal.

And that is just for starters. The conduct of these professors strikes me as much more than a "lapse of judgment."

Reader Comment: I'd love to know who paid for the initial printing & mailing of the 100,000 mailers. Apparently no one in that department/institution asked questions either.

By Tom Bartlett

A joint letter from the presidents of Stanford University and Dartmouth College will be sent to nearly 100,000 Montana voters to apologize for an experiment by three political-science professors at the two institutions. The letter comes after voters and state officials objected to a mailer, sent by the professors, that featured the state's official seal and offered information about the political leanings of candidates for the state's Supreme Court as part of an attempt to see whether such information would alter how Montanans voted.

The experiment has been condemned by other researchers in the field as unwise and perhaps unethical. Theda Skocpol, a professor of government and sociology at Harvard University, told Talking Points Memo that the research struck her as a "lapse in judgment."

The apology letter, which will cost the universities around $50,000 to send out, asks voters to ignore the mailer and states that "no research study should risk disrupting an election."

Which should go without saying, but in this case apparently had to be said.

The episode is an embarrassment to the two universities, both of which say they are investigating exactly what happened. A Stanford spokeswoman said the experiment had never been approved by an institutional review board there, though reportedly an earlier version of the flier was submitted to an IRB at Dartmouth. A spokesman for Dartmouth, Justin Anderson, said officials there were still determining whether the research had undergone a proper review.

The three political scientists--Jonathan Rodden and Adam Bonica at Stanford and Kyle Dropp at Dartmouth--have so far declined to comment. In an email message to The Chronicle, Mr. Rodden wrote that "we are not in a position to talk yet because of the charges being brought against us. Hopefully we can respond soon." (Those charges include allegations by state officials that the researchers may have broken four laws, including using a "fraudulent contrivance" to influence voters.)

Similar mailers were also sent to voters in California and New Hampshire. Like the ones in Montana, they included seals that made it seem as if they had been approved by those states' governments.

Ethical Conundrums

So this particular experiment was, if not ill conceived, pretty clearly flawed in its execution. But is it an aberration, or a symptom of a deeper problem in the discipline?

Jon Krosnick, a professor of political science, communication, and psychology at Stanford who was not involved in the study, believes it's the latter. Up-and-coming political scientists are embracing the experimental methods of disciplines like psychology, according to Mr. Krosnick, and, as they do, they routinely run into some of that field's ethical conundrums.

"This is researchers manipulating, or at least seeking to manipulate, politics," Mr. Krosnick said, referring to the Dartmouth-Stanford experiment. "As appealing as this might be on scientific grounds, the real question is whether it's appropriate to interfere in this way."

Mr. Krosnick pointed to a previous study co-authored by Mr. Dropp, who is an assistant professor of government at Dartmouth, in which more than 1,000 email requests were sent to Texas legislators in 2010. The emails appeared to come from Texas citizens, but were actually sent by the researchers to measure the legislators' response rates.

"It crosses an ethical line to create fictitious people and use government resources for people who don't exist," Mr. Krosnick said. "There's a habit here of lying to people."

Those experiments may be extreme examples, but they are part of a general shift toward testing out political-science theories in the real world. For proof, just scroll through the abstracts of the Journal of Experimental Political Science, which came into existence just last year. That may generally be a good thing, but it is naturally more fraught than, say, performing regression analysis alone in your office.

"Under some conditions, it may be acceptable to be deceptive, but when is it unethical?" wonders John T. Ishiyama, a professor of political science at the University of North Texas and lead editor of The American Political Science Review. "That's something that the discipline is grappling with."

— Tom Bartlett
Chronicle of Higher Education


This site contains copyrighted material the use of which has not always been specifically authorized by the copyright owner. We are making such material available in our efforts to advance understanding of education issues vital to a democracy. We believe this constitutes a 'fair use' of any such copyrighted material as provided for in section 107 of the US Copyright Law. In accordance with Title 17 U.S.C. Section 107, the material on this site is distributed without profit to those who have expressed a prior interest in receiving the included information for research and educational purposes. For more information click here. If you wish to use copyrighted material from this site for purposes of your own that go beyond 'fair use', you must obtain permission from the copyright owner.