Monday, July 26, 2010

Eddington's Experiment Was Bogus

Einstein stated that common sense was nothing but the collection of prejudices we acquire before the age 18. I think that's pretty correct. Most people don't change their minds on big issues during their working lives, though they may acknowledge certain tactics within their grand theory are not fruitful.

The Skeptics' Guide to the Universe has a podcast on the 90th anniversary of Sir Arthur Eddington's eclipse experiment that supposedly proved General Relativity was correct. While one discussant mentioned that the experiment had higher standard error than could have proved this, the next discussant said all measurement issues were addressed appropriately, and that claims Eddington engaged in fraud are pure myth. In the end, one discussant states, this is how real science is done: testing theories against reality.

I agree this is how real science is done, but contra the discussant, it was a bogus confirmation of Einstein's theory, tendentious cherry picking of what to leave in, what to leave out. The fact that the theory was correct does not change this, and it's very tempting to use hindsight to give the scientists involved the benefit of the doubt, especially when something is generally accepted. Deferral to conventional wisdom has some logic to it, but when you look at the past and note how many important beliefs were clearly untrue, there are probably many common scientific beliefs today that are untrue (unless somehow now we finally have everything right).

To recap the issue, in 1919, Einstein’s General Theory of Relativity was only a few years old, yet academics were eager to put the nightmare of World War I behind them and show the common bond of the old adversaries. Proving the German’s theory correct was greatly desired by scientists who rightly saw the conflict as simply madness. The null hypothesis, set up by standard Newtonian Physics, was that there should be a 0.85 arc-second deflection in light from stars behind the sun, while Einstein predicted a 1.7 arc-second deflection.

English physicist Arthur Eddington was a WorldWar I pacifist, and so had a predisposition to mend the rift between German and English academics. He made a trek to the island of Principe, off the coast of West Africa, one of the best locations for observing the eclipse. He used a series of complex calculations to extract the deflection estimate from the data and came up with an estimate of 1.6 arc-seconds. Data from two spots in Brazil from that same eclipse were 1.98 and 0.86, but Eddington threw out the 0.86 measurement.

In 10 further eclipses from 1922 to 1952 only one of these produced seemingly high-quality data, and in that case generated results much greater than Einstein predicted. In 1962, an English team tried to redo the experiment given a similar eclipse and methodology but newer equipment, and they found they could not. The tools and the event were simply too primitive to allow the kind of accuracy needed to prove general relativity via this experiment at that time. Eddington's dismissal of observations that would have lowered the key measurement's mean and increased its standard error used an objection that could just as easily been applied to the measurements he kept. In the late 1960s, using radio frequencies as opposed to pictures from an eclipse, Eddington’s results were confirmed, but that does not make that initial experiment good empirical research.

Eddington's method is held up as the epitome of science, and currently Wikipedia states "The myth that Eddington's results were fraudulent is a modern invention[citation needed]". Indeed.

Eddington died after a life of honors, his eclipse experiment his most conspicuous achievement, yet it was tendentious empirical work. Science is filled with fraud behind correct results: Mendel fudged his numbers, Pasteur was hardly fair to his critics. A great deal of science is motivated by confabulation, generating evidence for prejudices. In that sense scientists are little different than most professions, where one has ideals vs. reality. Lawyers aren't primarily interested in justice, teachers aren't primarily interested in children, even 'the best'. After all, unlike judges, most scientists have a rooting interest for whatever theory they are proposing, they want to be the founding father of some branch of knowledge. Those of us merely judging, meanwhile, are choosing between two choices, and as we don't have any skin in the game, we want the truth because that's what's helpful.


Anonymous said...

Great article.

In your last paragraph, I believe you meant to say "teachers aren't ..."

Dave said...

Interesting. I wasn't aware of Eddington's political motivation.

Ivan said...

When Albert Einstein was on the make as young man he wasn't all that much of an honest man either. His paper on Special Relativity was largely based on Poincare's work, but he didn't give the older man any credit. Allegedly Einstein's is the greater work because Poincare couldn't let go of the ether. Peter Gallison in his book Einstein's Clocks Poincare's Maps spends his time cantering out the question of priority because it is obvious in that Poincare's work was prior to and wholly independent of Einstein's, whereas Eintein according to his friends was an avid reader of Poincare's more accessible works. Being a mere historian of science Gallison would not want to fall foul of the holy terrors of the temple of physics. The same goes for Einstein's paper on Brownian motion, the Australian Sutherland had published a similar paper earlier in 1904, but he couldn't get some constant or other correct, so of course all the glory belongs to Einstein. But if the positions were reversed, the Einstein worshippers would be demanding justice, hinting darkly
that the other side was motivated by antisemitism.

The avancular Einstein, father figure to such far out figures as Charles Hapgood and Immanuel Velikovsky is a somewhat different man from his younger self

rajan said...

"A great deal of science is motivated by confabulation, generating evidence for beliefs already acquired. In that sense scientists are little different than most professions, where one has ideals vs. reality."

I thought Koestler's "The Sleepwalkers" was a great exposition of this view of science. A great read (after you get past the Greeks).

Tristram Brelstaff said...

Tubin said...

interesting in the light of the current mess with Duke and soon-to-be-ex-faculty Anil Potti...

Politics, personal glory, money, pressures of tenure requirements - there's so many factors encouraging fraudulent science, it's a miracle anything correct ever gets produced!