BMJ
It’s good to see the BMJ joining the campaign for free speech (only a month or two behind the blogs). The suing of Simon Singh for defamation by the British Chiropractic Association has stirred up a hornet’s nest that could (one hopes) change the law of the land, and destroy chiropractic altogether. The BMJ’s editor, Fiona Godlee, has a fine editorial, Keep the libel laws out of science. She starts “I hope all readers of the BMJ are signed up to organised scepticism” and says
“Weak science sheltered from criticism by officious laws means bad medicine. Singh is determined to fight the lawsuit rather than apologise for an article he believes to be sound. He and his supporters have in their sights not only the defence of this case but the reform of England’s libel laws.”
Godlee refers to equally fine articles by the BMJ’s Deputy Editor, Tony Delamothe, Thinking about Charles II“, and by Editor in Chief, Harvey Marcovitch, “Libel law in the UK“.
The comments on Godlee’s editorial, show strong support, (apart from one from the infamous quantum fantasist, Lionel Milgrom). But there was one that slighlty surprised me, from Tricia Greenhalgh, author of the superb book, “How to read a paper”. She comments
“the use of the term ‘bogus’ seems both unprofessional and unscholarly. The argument would be stronger if expressed in more reserved terms”
That set me thinking, not for the first time, about the difference between journalism and scholarship. I can’t imagine ever using a word like ‘bogus’ in a paper about single ion channels. But Singh was writing in a newspaper, not in a scientific paper. Even more to the point, his comments were aimed at people who are not scholars and who, quite explicitly reject the normal standards of science and evidence. The scholarly approach has been tried for centuries, and it just doesn’t work with such people. I’d defend Singh’s language. It is the only way to have any effect. That is why I sent the following comment.
The ultimate irony is that the comment was held up by the BMJ’s lawyers, and has still to appear.
Thanks for an excellent editorial. I doubt that it’s worth replying to Lionel Milgrom whose fantasy physics has been totally demolished by real physicists. Trisha Greenhalgh is, though, someone whose views I’d take very seriously. She raises an interesting question when she says “bogus” is an unprofessional word to use. Two things seem relevant. First, there is little point in writing rational scholarly articles for a group of people who do not accept the ordinary rules of evidence or scholarship. We are dealing with fantasists. Worse still, we are dealing with fantasists whose income depends on defending their fantasies. You can point out to your heart’s content that “subluxations” are figment of the chiropractors’ imagination, but they don’t give a damn. They aren’t interested in what’s true and what isn’t. Throughout my lifetime, pharmacologists and others have been writing scholarly articles about how homeopathy and other sorts of alternative medicine are bogus. All this effort had little effect. What made the difference was blogs and investigative journalism. When it became possible to reveal leaked teaching materials that taught students that “amethysts emit high yin energy“, and name and shame the vice-chancellors who allow that sort of thing to happen (in this case Prof Geoffrey Petts of Westminster University), things started to happen. In the last few years all five “BSc” degrees in homeopathy have closed and that is undoubtedly a consequence of the activities of bloggers and can assess evidence but who work more like investigative journalists. When the BCA released, 15 months after the event, its “plethora of evidence” a semi-organised effort by a group of bloggers produced, in less than 24 hours, thoroughly scholarly analyses of all of them (there is a summary here). As the editorial says, they didn’t amount to a hill of beans, They also pointed out the evidence that was omitted by the BCA. The conventional press just followed the bloggers. I find it really rather beautiful that a group of people who have other jobs to do, spent a lot of time doing these analyses, unpaid, in their own time, simply to support Singh, because they believed it is the right thing to do. Simon Singh has analysed the data coolly in his book. But In the case that gave rise to the lawsuit he was writing in a newspaper. It was perfectly clear from the context what ‘bogus’ meant. but Mr Justice Eady (aided by a disastrous law) chose to ignore entirely the context and the question of truth. The description ‘bogus’. as used by Singh, seems to be entirely appropriate for a newspaper article. To criticise him for using “unprofessional” language is inappropriate because we are not dealing with professionals. At the heart of the problem is the sort of stifling political correctness that has resulted in quacks being referred to as “professions” rather than fantasists and fraudsters [of course I use the word fraudster with no implication that it necessarily implies conscious lying]. At least there are some laughs to be had from the whole sorry affair. Prompted by that prince among lawyers known as Jack of Kent there was a new addition to my ‘Patients’ Guide to Magic Medicine‘, as featured in the Financial Times.
|
It is, perhaps, misplaced political correctness that lies at the heart of the problem. Who can forget the letter from Lord Hunt, while he was at the Department of Health, in which he described “psychic surgery” (one of the best known fraudulent conjuring tricks) as a “profession”.
Follow-up
Two days later, the comment has appeared in the BMJ at last. But it has been altered a bit.
Unprofessional language is appropriate when dealing with unprofessional people Thanks for an excellent editorial. I doubt that it’s worth replying to Lionel Milgrom whose fantasy physics has been totally demolished by real physicists. Trisha Greenhalgh is, though, someone whose views I’d take very seriously. She raises an interesting question when she says “bogus” is an unprofessional word to use. Two things seem relevant. First, there is little point in writing rational scholarly articles for a group of people who do not seem to accept the ordinary rules of evidence or scholarship. You can point out to your heart’s content that “subluxations” are figment of the chiropractors’ imagination, but they don’t give a damn. Throughout my lifetime, pharmacologists and others have been writing scholarly articles about how homeopathy and other sorts of alternative medicine are bogus. All this effort had little effect. What made the difference was blogs and investigative journalism. When it became possible to reveal leaked teaching materials that taught students that “amethysts emit high yin energy”, and name and shame the vice-chancellors who allow that sort of thing to happen (in this case Prof Geoffrey Petts of Westminster University), things started to happen. In the last few years all five “BSc” degrees in homeopathy have closed and that is undoubtedly a consequence of the activities of bloggers and can assess evidence but who work more like investigative journalists. When the BCA released, 15 months after the event, its “plethora of evidence” a semi-organised effort by a group of bloggers produced, in less than 24 hours, thoroughly scholarly analyses of all of them (there is a summary here). As the editorial says, they didn’t amount to a hill of beans, They also pointed out the evidence that was omitted by the BCA. The conventional press just followed the bloggers. I find it really rather beautiful that a group of people who have other jobs to do, spent a lot of time doing these analyses, unpaid, in their own time, simply to support Singh, because they believed it is the right thing to do. Simon Singh has analysed the data coolly in his book. But In the case that gave rise to the lawsuit he was writing in a newspaper. It was perfectly clear from the context what ‘bogus’ meant. but Mr Justice Eady (aided by a disastrous law) chose to ignore entirely the context. The description ‘bogus’. as used by Singh, seems to be entirely appropriate for a newspaper article. To criticise him for using “unprofessional” language is inappropriate because we are not dealing with professionals. At least there are some laughs to be had from the whole sorry affair. Prompted by that prince among lawyers known as Jack of Kent there was a new addition to my ‘Patients’ Guide to Magic Medicine’, as featured in the Financial Times.
|
Here are the changes that were made. Hmm.very interesting.
Today brings a small setback for those of us interested in spreading sensible ideas about science. According to a press release
“The BMJ Group is to begin publishing a medical journal on acupuncture from next year, it was announced today (Tuesday 11 November 2008).
This will be the first complementary medicine title that the BMJ Group has published.”
And they are proud of that? What one earth is going on? The BMJ group is a publishing company which says, of itself,
“Our brand stands for medical credibility. We are one of the world’s best known and most respected medical publishers.”
Well perhaps it used to be.
They have certainly picked a very bad moment for this venture. In the last year there have been at least five good books that assess the evidence carefully and honestly. Of these, the ones that are perhaps the best on the subject of acupuncture are Singh & Ernst’s Trick or Treatment and Barker Bausell’s Snake Oil Science. Both Ernst and Bausell have first hand experience of acupuncture research. And crucially, none of these authors has any financial interest in whether the judgement goes for acupuncture or against it.
Here are quotations from Singh & Ernst’s conclusions
“Reliable conclusions from systematic reviews make it clear that acupuncture does not work for a whole range of conditions, except as a placebo.”
“There are some high quality trials that support the use of acupuncture for some types of pain and nausea, but there are also high quality trials that contradict this conclusion. In short, the evidence is neither consistent nor convincing – it is borderline.”
The House of Lords’ report in 2000 tended to give acupuncture the benefit of the (very considerable) doubt that existed at the time the report was written. Since that time there have been a lot of very well-designed trials of acupuncture.
Now it is quite clear that, for most (and quite possibly all) conditions, acupuncture is no more than a particularly theatrical placebo. Perhaps that is not surprising insofar as the modern western practice of acupuncture owes more to Chinese nationalistic propaganda that started in the time of Mao-Tse Tung than it owes to ancient wisdom (which often turns out to be bunk anyway).
The BMJ Group has decided to endorse acupuncture at a time when it is emerging that the evidence for any specific effect is very thin indeed. Well done.
The journal in question is this.
Acupuncture in Medicine is a quarterly title, which aims to build the evidence base for acupuncture. It is currently self-published by the British Medical Acupuncture Society (BMAS).
One good thing can be said about the Society and the Journal. That is that they don’t espouse all the mumbo-jumbo about ‘meridians’ and ‘Qi’. This, of course, puts them at odds with the vast majority of acupuncture teaching. This sort of internecine warfare between competing sects is characteristic of all sorts of alternative medicine. But that is just ideology. What matters is whether or not sticking needles in you is actually anything more than a placebo.
British Medical Acupuncture Society (BMAS)
The British Medical Acupuncture Society (BMAS). is “a registered charity established to encourage the use and scientific understanding of acupuncture within medicine for the public benefit.”. The phrase “encourage the use” suggests that they do not even envisage the possibility that it might not work. Their web site includes these claims.
Acupuncture can help in a variety of conditions:
- Pain relief for a wide range of painful conditions
- Nausea, especially postoperative nausea and vomiting
- Overactive bladder, also known as bladder detrusor instability
- Menstrual and menopausal problems, eg period pains and hot flushes
- Allergies such as hay fever and some types of allergic rashes
- Some other skin problems such as ulcers, itching and localised rashes
- Sinus problems and more
Presumably the word “help” is chosen carefully to fall just short of “cure”. The claims are vaguely worded, but let’s see what we can find about them from systematic reviews. It appears that the BMAS is being rather optimistic about the evidence.
BMJ Clinical Evidence is considered reliable and is particular interesting because it is owned by the BMJ Publishing Group.
Low Back Pain (chronic) Acupuncture is listed as being of “unknown effectiveness”.
Dysmenorrhoea Acupuncture is listed as being of “unknown effectiveness”.
Osteoarthritis of the knee. Acupuncture is listed as being of “unknown effectiveness”.
Psoriasis (chronic plaque) Acupuncture is listed as being of “unknown effectiveness”.
Neck pain “Acupuncture may be more effective than some types of sham treatment (not further defined) or inactive treatment (not further defined) at improving pain relief at the end of treatment or in the short term (less than 3 months), but not in the intermediate term (not defined) or in the long term (not defined)”
Headache (chronic tension-type) Acupuncture is listed as being of “unknown effectiveness”.
What about the greatest authority, the Cochrane Reviews?
Cochrane Reviews
Low back pain The data do not allow firm conclusions about the effectiveness of acupuncture for acute low-back pain. For chronic low-back pain, acupuncture is more effective for pain relief and functional improvement than no treatment or sham treatment immediately after treatment and in the short-term only. Acupuncture is not more effective than other conventional and “alternative” treatments. The data suggest that acupuncture and dry-needling may be useful adjuncts to other therapies for chronic low-back pain. Because most of the studies were of lower methodological quality, there certainly is a further need for higher quality trials in this area.
Chronic asthma. There is not enough evidence to make recommendations about the value of acupuncture in asthma treatment. Further research needs to consider the complexities and different types of acupuncture.
But most of the vaguely-worded claims made by BMAS have not been the subject of Cochrane reviews. The obvious interpretation of that is that there is not enough evidence to make it worth writing a review. In which case, why does BMAS claim that acupuncture can “help”?
Bandolier is another excellent source of high quality information, This was their view in September 2006
“Large, high-quality randomised trials of acupuncture have been published since the reviews. In fibromyalgia, chemotherapy-induced nausea and vomiting, breech presentation, tension headache, and migraine, all were negative compared with sham acupuncture. One in osteoarthritis of the knee, had statistical improvement over sham acupuncture at three months, but not later. Both large trials and this review of reviews come to the same general conclusion; that over a whole range of conditions and outcomes acupuncture cannot yet be shown to be effective.”
After thousands of years of acupuncture (or at least almost 40 years in the West) there seems to be very little to show for it.
The journal: Acupuncture in Medicine
What about the journal in question? Like all journals devoted to alternative medicine, it claims to be evidence-based. And like all journals devoted to alternative medicine it suffers from a fatal conflict of interest. If this journal were ever to conclude that acupuncture is a placebo, it would destroy the journal and the livelihoods of many of the people who write for it.
Scanning the first three issues of 2008 shows that it is very much like other alternative medicine journals. Most of the papers don’t address the critical question, is it a placebo. And most papers end up rather limply, with a statement along the lines “acupuncture may be useful for ***. More research is needed.”
The editor in chief of the journal is Dr Adrian White, and its editor is Michael Cummings. White is quoted by Ernst in the Guardian in 2004.
“We need to provide hard evidence to support what we all see in our clinics every day: that the modern approach to acupuncture works, and is highly relevant to the new, patient-centred NHS.” .
That means the answer is assumed in advance. That just isn’t science.. ‘We know the answer, all we have to do now is get some evidence’.
Why should the BMJ Group want to do a thing like this?
The press release says
Commenting on the move, BMJ and BMJ Journals Publishing Director, Peter Ashman, said “The journal is a good complement for our existing portfolio of journals and we’re certain that the Society’s members and other subscribers will appreciate the benefits of the decision the BMAS has made on their behalf.”
He continued: “The BMAS is ambitious for its journal to grow and flourish and we’re looking forward to working with the Society to develop an editorial and commercial strategy which will achieve the aims of BMAS and those of its members, while reaching out to the wider global community interested in this fascinating area of medicine.”
Yes, you got it. Money. The same motive that causes some vice-chancellors to bring their university into disrepute by awarding BSc degrees in subjects that are not only not science, but which are oftenly openly anti-science.
Conscience doesn’t seem to bother these people, so let’s put the problem in purely cash terms.
Both the BMJ Group and the vice-chancellors will have to decide whether the cash they gain is sufficient to counterbalance the corrosive effects of their actions on their own reputations.
Follow-up
Only a couple of days later, two new trials show acupuncture is no different from sham controls for helping IVF pregnancy rates. James Randerson in the Guardian writes thus.
“Acupuncture aimed at improving IVF success rates is widely offered by fertility clinics in the UK. In the first of the studies, researchers in Hong Kong split 370 women receiving IVF into two groups. One group received real acupuncture before and after having an IVF embryo implanted into their uterus. The other had the same procedure, except the treatment used retractable needles that did not penetrate the skin.”
“Of the 185 who received the sham treatment, 91 achieved a clinical pregnancy (foetal heartbeat identified using ultrasound) and 71 had a successful delivery. This compared with 72 clinical pregnancies in the true acupuncture group and 55 live births. The differences between the groups were not statistically significant.”
“In a second study, researchers in Chicago used a similar design in which 124 women received true or sham acupuncture. The control group had their skin punctured by real acupuncture needles, but not at genuine “Qi-lines” on the body. In the true acupuncture group, 43.9% achieved a clinical pregnancy, compared with 55.2% of the women given the sham treatment. “
The original paper for the first study can be seen here.