Thursday, 1 May 2008
Rustum Roy's intention experiment: we are all Qigong masters
According to the Intention Experiment blog, "Although the scientists are not finished examining their data, they have told me one thing: they’ve seen results they’ve never seen before with their equipment". This suggests to me that there was a problem with the experimental set-up, which of course has not been described in any detail.
Then "One reason it is taking so long is that our water had a great deal of variation an hour before the experiment was run. This could mean that our anticipation of the event began to affect the water. Or it could mean that our hypothesis is wrong. Or it could mean that with intention, we are emanating an energy like a Qigong master, which is being picked up by the spectroscopy before the event". Or could it mean that the impurities in the water are changing through time as it sits in an open beaker on a lab bench? Obviously, emanating energy like a Qigong master is a much more plausible explanation, but might it not be a good idea to control the experiment just in case? Also, looking at Rao and Roy's previous work on homeopathic remedies, it seems that 'stray light is eliminated by turning off all the room lights whenever data are being collected'. Unless they are in a proper darkroom, that isn't going to be enough to keep out all the ambient light. Raman is also noisy and highly sensitive to impurities.
There's also some weirdness going on here, as this page talks about taking a Raman spectrum with the 'laser turned off'. With the laser off, there is no incident beam to undergo Raman scattering, so I'm simply not clear what they could be talking about here at all. A 'member of the Penn State team' also says that "The laser light is absorbed by the water molecules, depending on how they are energetically configured or arranged, and then reradiated at a different wavelength". As I understand it, this isn't quite right: the incident beam is scattered, with a wavelength shift of the scattered beam. There is no absorption and re-radiation in Raman scattering. Do the Penn State team have any idea what they're doing?
I can't wait for the final results...
Sunday, 20 April 2008
Homeopathy and wikipedia
The arbitration page is long and parts of it are somewhat tedious, but it is interesting in that it demonstrates some of the problems science has in presenting evidence to laypeople in a clear way. The literature on homeopathy is complex, consisting of a mixture of poorly conducted studies that show some (at best equivocal) evidence that homeopathy might work, and well-designed studies that show homeopathy has no effect. (A meta-analysis by Shang et al. that was published in the Lancet elegantly showed that the largest and least biased studies showed the least effect for homeopathy). It is then easy for advocates of homeopathy to emphasise the apparently positive studies, and claim that sceptics of homeopathy do not consider all the evidence. In other words, advocates of homeopathy take the studies at face value; they don't look at the studies and analyse them to see how they were conducted and whether the results make sense.
Because there are some people who think homeopathy works, and there are some peer-reviewed journals of homeopathy and other 'alternative' therapies that superficially appear to be scientific, it is possible to claim that there is some scientific controversy about the effectiveness of homeopathy. As Wikipedia is based around the idea of neutral point of view (NPOV), it seems superficially sensible to present a 'balanced' view whereby evidence for and against homeopathy is described. But, crucially, this is not a balanced view; it gives undue weight to poorly conducted studies. Looking at the evidence as a whole shows that homeopathy is nothing more than a placebo. Quite apart from that, it contains ideas (e.g. that the 'potency' of a remedy increases the more it is diluted) that are in conflict with well established science. A neutral point of view is surely that homeopathy is extremely implausible and that there is no evidence that it works.
This sort of thing is not just a problem for Wikipedia. There is a general problem of spurious 'balance' in scientific reporting. Another clear example is the BBC linking to anti-vaccine websites in stories about vaccines. Science is a notoriously complicated business, but there are times when the scientific evidence is clear, when it is evaluated properly. The challenge is to show that this is the case, without coming across as some kind of monolithic establishment that wishes to crush all dissent.
Saturday, 19 April 2008
More water-related nonsense from Rustum Roy
Fortunately, Roy has not been discouraged by this setback. He is now involved in an experiment that attempts to show that we can change the structure of water with our minds. There are some truly astounding statements by Roy here.
Structured water is found in the cytoplasm of healthy tissues and it is characterized by having a high solubility for body minerals. It is also found in healing waters. This appears to be the structure shared by very different healing waters from some healing spas to silver aquasols used worldwide.
Structured waters have been produced using various forms of energy, such as light, sound, heat, pressure and radiation.
In our proposed experiment, we aim to examine whether we can structure water with intention alone. We’ll be monitoring any change against control using analytical tools such as spectroscopy.
As far as I can tell, there is no evidence that 'healing waters' actually do any healing, and there is no evidence that different structures of water have different biological effects. But why worry about that? Why not set up a badly designed experiment anyway?
What Roy is proposing to do is get a beaker of water, and collect a Raman spectrum of it. Raman spectroscopy is a technique that can identify vibrational and rotational modes in a system. It can be used to detect changes in chemical bonding, which is what Roy will be looking for. Then people all over the world are going to concentrate on changing the Raman spectrum of the beaker of water. Roy will then collect a new Raman spectrum, and compare it to the old one. This is going to happen on April 26th.
The main problem I can see with this is that the experiment is totally uncontrolled. A beaker of water sitting around is going to dissolve gases and incorporate dust, particulates, skin cells and so on from the atmosphere surrounding it. It might also lose some of the dissolved gases in it to the atmosphere through time. Roy is apparently making no attempt to control for this at all.
Roy's previous work doesn't exactly give cause for confidence. The paper in Homeopathy claims to show differences in Raman spectra between homeopathic remedies. Essentially, all the paper does is present graphs, state that they look different, and leave it at that. There is no attempt to understand why the graphs might be different, or assign peaks to distinct vibrational/rotational modes, or show that the differences between the spectra are statistically significant, or anything.
I think I can confidently predict that the second spectrum will look subtly different from the first, and Roy will declare that we can change water structure with the power of our minds alone. The experiment will be totally worthless, but that won't stop people citing it for years to come as cast-iron evidence for telekinesis.
Monday, 7 April 2008
You've got to laugh
Promises to raise the dead, secure good fortune or heal through the laying on of hands are all at risk of legal action from disgruntled customers. Spiritualists say they will be forced to issue disclaimers, such as 'this is a scientific experiment, the results of which cannot be guaranteed'.
This really is pure comedy gold. I'm fairly sure that most of these 'scientific experiments' are going to fall short of the standards you would normally expect. For example, you would want to see adequate controls and blinding. I wonder if you could sue someone for describing something as a 'scientific experiment' when it is clearly no such thing?
Previously there was something called the Fraudulent Mediums Act (1951), which protected mediums against litigation, unless it could be proven that they acted with dishonest intent. As long as you genuinely believed the rubbish you were talking, you were in the clear. This is not an approach we would accept if, say, we were buying a used car. If Honest Pete's Motors told you "Sorry about that, guv, but I genuinely believed that there was nothing wrong with the gearbox on that Austin Allegro", you would not be happy. So why should spiritualists get away with it? According to the story:
Carole McEntee-Taylor, a spiritualist healer in Essex, said having to stand up and describe the invoking of spirits as an 'experiment' was forcing spiritualists to 'lie and deny our beliefs'. She added: 'No other religion has to do that'.
Perhaps if you have genuinely held religious beliefs, you shouldn't be attempting to make money out of them?
Monday, 31 March 2008
Homeopaths capitulate [by guest blogger Olaf Priol]
Una Daleman, a well known US homeopath, issued the following statement:
"Friends, I've spent many years working as a homeopath, and I have always felt that the fact my patients felt better after treatment was proof that homeopathy did something. I also knew of several studies that seemed to show statistically significant evidence that homeopathy works. Scientists dismissed this as being placebo effect, or regression to the mean (whatever that is!), or the result of biased and useless studies with poor methodology, but I thought I knew better. However, as you all will know, I am nothing if not HUMBLE, willing to learn, and intellectually honest. So, after spending much time at skeptical blogs and websites, taking in the criticisms of the apparently positive studies I wanted to discuss, and evaluating the scientific evidence as a whole, I have to conclude that homeopathy is just about the most ridiculous pile of faux-magical and pseudoscientific garbage that humanity has constructed.
In particular, I want to totally repudiate the nonsensical study by Rustum Roy and colleagues on spectrophotometry of homeopathic remedies, which is so poorly conducted it shows nothing at all. I also want to acknowledge that a study in Chest that I have spammed all over the internet as evidence for homeopathy is invalid, because of differences between the placebo and treatment groups."
Dieter Wisher, president of the Guild of Homeopaths, added:
"After long reflection, it seems to me that Ben Goldacre was right about the evidence from meta-analyses after all, and they show no effect beyond placebo for homeopathy. The attempts by myself and others to explain these results through quantum entanglement (whatever that is!), the bad vibes of anti-homeopaths infecting experimental procedures, or the wrong kind of magic wand being used in the treatment group, were misguided attempts to avoid the conclusion that everything we believed in is nonsense.
As penitence, I will be travelling to Togo and working at a malaria clinic."
However, maverick US homeopath Dana Ullman said:
"It is EASY to assume that homeopathic medicines are akin to placebos if one has a superficial understanding of what homeopathy is and what good research has been conducted to evaluate it. I want to remind skeptics that good and serious scientists maintain a high level of HUMILITY about what they know and what they don't know. I am proud of my humility of what I know and what I don't know - particularly what I don't know. I can tell you that about a new study on homeopathy and water by a respected professor of material sciences, Rustum Roy, PhD (of Penn State University)....[continued p. 94]
Friday, 14 March 2008
Academic shenanigans
Another Sinai field trip...
The field trip people arrive today. We go out in the morning to look at one of the sites we’ll visit, and arrive back at