Download Lectures on Biostatistics (1971). Corrected and searchable version of Google books edition
Download review of Lectures on Biostatistics (THES, 1973).
Bait and switch
This piece is almost identical with today’s Spectator Health article.
This week there has been enormously wide coverage in the press for one of the worst papers on acupuncture that I’ve come across. As so often, the paper showed the opposite of what its title and press release, claimed. For another stunning example of this sleight of hand, try Acupuncturists show that acupuncture doesn’t work, but conclude the opposite: journal fails, published in the British Journal of General Practice).
Presumably the wide coverage was a result of the hyped-up press release issued by the journal, BMJ Acupuncture in Medicine. That is not the British Medical Journal of course, but it is, bafflingly, published by the BMJ Press group, and if you subscribe to press releases from the real BMJ. you also get them from Acupuncture in Medicine. The BMJ group should not be mixing up press releases about real medicine with press releases about quackery. There seems to be something about quackery that’s clickbait for the mainstream media.
As so often, the press release was shockingly misleading: It said
Acupuncture may alleviate babies’ excessive crying Needling twice weekly for 2 weeks reduced crying time significantly
This is totally untrue. Here’s why.
|
Luckily the Science Media Centre was on the case quickly: read their assessment. The paper made the most elementary of all statistical mistakes. It failed to make allowance for the jelly bean problem. The paper lists 24 different tests of statistical significance and focusses attention on three that happen to give a P value (just) less than 0.05, and so were declared to be "statistically significant". If you do enough tests, some are bound to come out “statistically significant” by chance. They are false postives, and the conclusions are as meaningless as “green jelly beans cause acne” in the cartoon. This is called P-hacking and it’s a well known cause of problems. It was evidently beyond the wit of the referees to notice this naive mistake. It’s very doubtful whether there is anything happening but random variability. And that’s before you even get to the problem of the weakness of the evidence provided by P values close to 0.05. There’s at least a 30% chance of such values being false positives, even if it were not for the jelly bean problem, and a lot more than 30% if the hypothesis being tested is implausible. I leave it to the reader to assess the plausibility of the hypothesis that a good way to stop a baby crying is to stick needles into the poor baby. If you want to know more about P values try Youtube or here, or here. |
|
One of the people asked for an opinion on the paper was George Lewith, the well-known apologist for all things quackish. He described the work as being a "good sized fastidious well conducted study ….. The outcome is clear". Thus showing an ignorance of statistics that would shame an undergraduate.
On the Today Programme, I was interviewed by the formidable John Humphrys, along with the mandatory member of the flat-earth society whom the BBC seems to feel obliged to invite along for "balance". In this case it was professional acupuncturist, Mike Cummings, who is an associate editor of the journal in which the paper appeared. Perhaps he’d read the Science media centre’s assessment before he came on, because he said, quite rightly, that
"in technical terms the study is negative" "the primary outcome did not turn out to be statistically significant"
to which Humphrys retorted, reasonably enough, “So it doesn’t work”. Cummings’ response to this was a lot of bluster about how unfair it was for NICE to expect a treatment to perform better than placebo. It was fascinating to hear Cummings admit that the press release by his own journal was simply wrong.
Listen to the interview here
Another obvious flaw of the study is that the nature of the control group. It is not stated very clearly but it seems that the baby was left alone with the acupuncturist for 10 minutes. A far better control would have been to have the baby cuddled by its mother, or by a nurse. That’s what was used by Olafsdottir et al (2001) in a study that showed cuddling worked just as well as another form of quackery, chiropractic, to stop babies crying.
Manufactured doubt is a potent weapon of the alternative medicine industry. It’s the same tactic as was used by the tobacco industry. You scrape together a few lousy papers like this one and use them to pretend that there’s a controversy. For years the tobacco industry used this tactic to try to persuade people that cigarettes didn’t give you cancer, and that nicotine wasn’t addictive. The main stream media obligingly invite the representatives of the industry who convey to the reader/listener that there is a controversy, when there isn’t.
Acupuncture is no longer controversial. It just doesn’t work -see Acupuncture is a theatrical placebo: the end of a myth. Try to imagine a pill that had been subjected to well over 3000 trials without anyone producing convincing evidence for a clinically useful effect. It would have been abandoned years ago. But by manufacturing doubt, the acupuncture industry has managed to keep its product in the news. Every paper on the subject ends with the words "more research is needed". No it isn’t.
Acupuncture is pre-scientific idea that was moribund everywhere, even in China, until it was revived by Mao Zedong as part of the appalling Great Proletarian Revolution. Now it is big business in China, and 100 percent of the clinical trials that come from China are positive.
if you believe them, you’ll truly believe anything.
Follow-up
29 January 2017
Soon after the Today programme in which we both appeared, the acupuncturist, Mike Cummings, posted his reaction to the programme. I thought it worth posting the original version in full. Its petulance and abusiveness are quite remarkable.
I thank Cummings for giving publicity to the video of our appearance, and for referring to my Wikipedia page. I leave it to the reader to judge my competence, and his, in the statistics of clinical trials. And it’s odd to be described as a "professional blogger" when the 400+ posts on dcscience.net don’t make a penny -in fact they cost me money. In contrast, he is the salaried medical director of the British Medical Acupuncture Society.
It’s very clear that he has no understanding of the error of the transposed conditional, nor even the mulltiple comparison problem (and neither, it seems, does he know the meaning of the word ‘protagonist’).
I ignored his piece, but several friends complained to the BMJ for allowing such abusive material on their blog site. As a result a few changes were made. The “baying mob” is still there, but the Wikipedia link has gone. I thought that readers might be interested to read the original unexpurgated version. It shows, better than I ever could, the weakness of the arguments of the alternative medicine community. To quote Upton Sinclair:
“It is difficult to get a man to understand something, when his salary depends upon his not understanding it.”
It also shows that the BBC still hasn’t learned the lessons in Steve Jones’ excellent “Review of impartiality and accuracy of the BBC’s coverage of science“. Every time I appear in such a programme, they feel obliged to invite a member of the flat earth society to propagate their make-believe.
Acupuncture for infantile colic – misdirection in the media or over-reaction from a sceptic blogger?26 Jan, 17 | by Dr Mike Cummings So there has been a big response to this paper press released by BMJ on behalf of the journal Acupuncture in Medicine. The response has been influenced by the usual characters – retired professors who are professional bloggers and vocal critics of anything in the realm of complementary medicine. They thrive on oiling up and flexing their EBM muscles for a baying mob of fellow sceptics (see my ‘stereotypical mental image’ here). Their target in this instant is a relatively small trial on acupuncture for infantile colic.[1] Deserving of being press released by virtue of being the largest to date in the field, but by no means because it gave a definitive answer to the question of the efficacy of acupuncture in the condition. We need to wait for an SR where the data from the 4 trials to date can be combined. So what about the research itself? I have already said that the trial was not definitive, but it was not a bad trial. It suffered from under-recruiting, which meant that it was underpowered in terms of the statistical analysis. But it was prospectively registered, had ethical approval and the protocol was published. Primary and secondary outcomes were clearly defined, and the only change from the published protocol was to combine the two acupuncture groups in an attempt to improve the statistical power because of under recruitment. The fact that this decision was made after the trial had begun means that the results would have to be considered speculative. For this reason the editors of Acupuncture in Medicine insisted on alteration of the language in which the conclusions were framed to reflect this level of uncertainty. DC has focussed on multiple statistical testing and p values. These are important considerations, and we could have insisted on more clarity in the paper. P values are a guide and the 0.05 level commonly adopted must be interpreted appropriately in the circumstances. In this paper there are no definitive conclusions, so the p values recorded are there to guide future hypothesis generation and trial design. There were over 50 p values reported in this paper, so by chance alone you must expect some to be below 0.05. If one is to claim statistical significance of an outcome at the 0.05 level, ie a 1:20 likelihood of the event happening by chance alone, you can only perform the test once. If you perform the test twice you must reduce the p value to 0.025 if you want to claim statistical significance of one or other of the tests. So now we must come to the predefined outcomes. They were clearly stated, and the results of these are the only ones relevant to the conclusions of the paper. The primary outcome was the relative reduction in total crying time (TC) at 2 weeks. There were two significance tests at this point for relative TC. For a statistically significant result, the p values would need to be less than or equal to 0.025 – neither was this low, hence my comment on the Radio 4 Today programme that this was technically a negative trial (more correctly ‘not a positive trial’ – it failed to disprove the null hypothesis ie that the samples were drawn from the same population and the acupuncture intervention did not change the population treated). Finally to the secondary outcome – this was the number of infants in each group who continued to fulfil the criteria for colic at the end of each intervention week. There were four tests of significance so we need to divide 0.05 by 4 to maintain the 1:20 chance of a random event ie only draw conclusions regarding statistical significance if any of the tests resulted in a p value at or below 0.0125. Two of the 4 tests were below this figure, so we say that the result is unlikely to have been chance alone in this case. With hindsight it might have been good to include this explanation in the paper itself, but as editors we must constantly balance how much we push authors to adjust their papers, and in this case the editor focussed on reducing the conclusions to being speculative rather than definitive. A significant result in a secondary outcome leads to a speculative conclusion that acupuncture ‘may’ be an effective treatment option… but further research will be needed etc… Now a final word on the 3000 plus acupuncture trials that DC loves to mention. His point is that there is no consistent evidence for acupuncture after over 3000 RCTs, so it clearly doesn’t work. He first quoted this figure in an editorial after discussing the largest, most statistically reliable meta-analysis to date – the Vickers et al IPDM.[2] DC admits that there is a small effect of acupuncture over sham, but follows the standard EBM mantra that it is too small to be clinically meaningful without ever considering the possibility that sham (gentle acupuncture plus context of acupuncture) can have clinically relevant effects when compared with conventional treatments. Perhaps now the best example of this is a network meta-analysis (NMA) using individual patient data (IPD), which clearly demonstrates benefits of sham acupuncture over usual care (a variety of best standard or usual care) in terms of health-related quality of life (HRQoL).[3] |
30 January 2017
I got an email from the BMJ asking me to take part in a BMJ Head-to-Head debate about acupuncture. I did one of these before, in 2007, but it generated more heat than light (the only good thing to come out of it was the joke about leprechauns). So here is my polite refusal.
|
Hello Thanks for the invitation, Perhaps you should read the piece that I wrote after the Today programme Why don’t you do these Head to Heads about genuine controversies? To do them about homeopathy or acupuncture is to fall for the “manufactured doubt” stratagem that was used so effectively by the tobacco industry to promote smoking. It’s the favourite tool of snake oil salesman too, and th BMJ should see that and not fall for their tricks. Such pieces night be good clickbait, but they are bad medicine and bad ethics. All the best David |
‘We know little about the effect of diet on health. That’s why so much is written about it’. That is the title of a post in which I advocate the view put by John Ioannidis that remarkably little is known about the health effects if individual nutrients. That ignorance has given rise to a vast industry selling advice that has little evidence to support it.
The 2016 Conference of the so-called "College of Medicine" had the title "Food, the Forgotten Medicine". This post gives some background information about some of the speakers at this event. I’m sorry it appears to be too ad hominem, but the only way to judge the meeting is via the track record of the speakers.
Quite a lot has been written here about the "College of Medicine". It is the direct successor of the Prince of Wales’ late, unlamented, Foundation for Integrated Health. But unlike the latter, its name is disguises its promotion of quackery. Originally it was going to be called the “College of Integrated Health”, but that wasn’t sufficently deceptive so the name was dropped.
For the history of the organisation, see
Don’t be deceived. The new “College of Medicine” is a fraud and delusion
The College of Medicine is in the pocket of Crapita Capita. Is Graeme Catto selling out?
The conference programme (download pdf) is a masterpiece of bait and switch. It is a mixture of very respectable people, and outright quacks. The former are invited to give legitimacy to the latter. The names may not be familiar to those who don’t follow the antics of the magic medicine community, so here is a bit of information about some of them.
The introduction to the meeting was by Michael Dixon and Catherine Zollman, both veterans of the Prince of Wales Foundation, and both devoted enthusiasts for magic medicne. Zollman even believes in the battiest of all forms of magic medicine, homeopathy (download pdf), for which she totally misrepresents the evidence. Zollman works now at the Penny Brohn centre in Bristol. She’s also linked to the "Portland Centre for integrative medicine" which is run by Elizabeth Thompson, another advocate of homeopathy. It came into being after NHS Bristol shut down the Bristol Homeopathic Hospital, on the very good grounds that it doesn’t work.
Now, like most magic medicine it is privatised. The Penny Brohn shop will sell you a wide range of expensive and useless "supplements". For example, Biocare Antioxidant capsules at £37 for 90. Biocare make several unjustified claims for their benefits. Among other unnecessary ingredients, they contain a very small amount of green tea. That’s a favourite of "health food addicts", and it was the subject of a recent paper that contains one of the daftest statistical solecisms I’ve ever encountered
"To protect against type II errors, no corrections were applied for multiple comparisons".
If you don’t understand that, try this paper.
The results are almost certainly false positives, despite the fact that it appeared in Lancet Neurology. It’s yet another example of broken peer review.
It’s been know for decades now that “antioxidant” is no more than a marketing term, There is no evidence of benefit and large doses can be harmful. This obviously doesn’t worry the College of Medicine.
Margaret Rayman was the next speaker. She’s a real nutritionist. Mixing the real with the crackpots is a standard bait and switch tactic.
Eleni Tsiompanou, came next. She runs yet another private "wellness" clinic, which makes all the usual exaggerated claims. She seems to have an obsession with Hippocrates (hint: medicine has moved on since then). Dr Eleni’s Joy Biscuits may or may not taste good, but their health-giving properties are make-believe.
Andrew Weil, from the University of Arizona
gave the keynote address. He’s described as "one of the world’s leading authorities on Nutrition and Health". That description alone is sufficient to show the fantasy land in which the College of Medicine exists. He’s a typical supplement salesman, presumably very rich. There is no excuse for not knowing about him. It was 1988 when Arnold Relman (who was editor of the New England Journal of Medicine) wrote A Trip to Stonesville: Some Notes on Andrew Weil, M.D..
“Like so many of the other gurus of alternative medicine, Weil is not bothered by logical contradictions in his argument, or encumbered by a need to search for objective evidence.”
This blog has mentioned his more recent activities, many times.
Alex Richardson, of Oxford Food and Behaviour Research (a charity, not part of the university) is an enthusiast for omega-3, a favourite of the supplement industry, She has published several papers that show little evidence of effectiveness. That looks entirely honest. On the other hand, their News section contains many links to the notorious supplement industry lobby site, Nutraingredients, one of the least reliable sources of information on the web (I get their newsletter, a constant source of hilarity and raised eyebrows). I find this worrying for someone who claims to be evidence-based. I’m told that her charity is funded largely by the supplement industry (though I can’t find any mention of that on the web site).
Stephen Devries was a new name to me. You can infer what he’s like from the fact that he has been endorsed byt Andrew Weil, and that his address is "Institute for Integrative Cardiology" ("Integrative" is the latest euphemism for quackery). Never trust any talk with a title that contains "The truth about". His was called "The scientific truth about fats and sugars," In a video, he claims that diet has been shown to reduce heart disease by 70%. which gives you a good idea of his ability to assess evidence. But the claim doubtless helps to sell his books.
Prof Tim Spector, of Kings College London, was next. As far as I know he’s a perfectly respectable scientist, albeit one with books to sell, But his talk is now online, and it was a bit like a born-again microbiome enthusiast. He seemed to be too impressed by the PREDIMED study, despite it’s statistical unsoundness, which was pointed out by Ioannidis. Little evidence was presented, though at least he was more sensible than the audience about the uselessness of multivitamin tablets.
Simon Mills talked on “Herbs and spices. Using Mother Nature’s pharmacy to maintain health and cure illness”. He’s a herbalist who has featured here many times. I can recommend especially his video about Hot and Cold herbs as a superb example of fantasy science.
Annie Anderson, is Professor of Public Health Nutrition and
Founder of the Scottish Cancer Prevention Network. She’s a respectable nutritionist and public health person, albeit with their customary disregard of problems of causality.
Patrick Holden is chair of the Sustainable Food Trust. He promotes "organic farming". Much though I dislike the cruelty of factory farms, the "organic" industry is largely a way of making food more expensive with no health benefits.
The Michael Pittilo 2016 Student Essay Prize was awarded after lunch. Pittilo has featured frequently on this blog as a result of his execrable promotion of quackery -see, in particular, A very bad report: gamma minus for the vice-chancellor.
Nutritional advice for patients with cancer. This discussion involved three people.
Professor Robert Thomas, Consultant Oncologist, Addenbrookes and Bedford Hospitals, Dr Clare Shaw, Consultant Dietitian, Royal Marsden Hospital and Dr Catherine Zollman, GP and Clinical Lead, Penny Brohn UK.
Robert Thomas came to my attention when I noticed that he, as a regular cancer consultant had spoken at a meeting of the quack charity, “YestoLife”. When I saw he was scheduled tp speak at another quack conference. After I’d written to him to point out the track records of some of the people at the meeting, he withdrew from one of them. See The exploitation of cancer patients is wicked. Carrot juice for lunch, then die destitute. The influence seems to have been temporary though. He continues to lend respectability to many dodgy meetings. He edits the Cancernet web site. This site lends credence to bizarre treatments like homeopathy and crystal healing. It used to sell hair mineral analysis, a well-known phony diagnostic method the main purpose of which is to sell you expensive “supplements”. They still sell the “Cancer Risk Nutritional Profile”. for £295.00, despite the fact that it provides no proven benefits.
Robert Thomas designed a food "supplement", Pomi-T: capsules that contain Pomegranate, Green tea, Broccoli and Curcumin. Oddly, he seems still to subscribe to the antioxidant myth. Even the supplement industry admits that that’s a lost cause, but that doesn’t stop its use in marketing. The one randomised trial of these pills for prostate cancer was inconclusive. Prostate Cancer UK says "We would not encourage any man with prostate cancer to start taking Pomi-T food supplements on the basis of this research". Nevertheless it’s promoted on Cancernet.co.uk and widely sold. The Pomi-T site boasts about the (inconclusive) trial, but says "Pomi-T® is not a medicinal product".
There was a cookery demonstration by Dale Pinnock "The medicinal chef" The programme does not tell us whether he made is signature dish "the Famous Flu Fighting Soup". Needless to say, there isn’t the slightest reason to believe that his soup has the slightest effect on flu.
In summary, the whole meeting was devoted to exaggerating vastly the effect of particular foods. It also acted as advertising for people with something to sell. Much of it was outright quackery, with a leavening of more respectable people, a standard part of the bait-and-switch methods used by all quacks in their attempts to make themselves sound respectable. I find it impossible to tell how much the participants actually believe what they say, and how much it’s a simple commercial drive.
The thing that really worries me is why someone like Phil Hammond supports this sort of thing by chairing their meetings (as he did for the "College of Medicine’s" direct predecessor, the Prince’s Foundation for Integrated Health. His defence of the NHS has made him something of a hero to me. He assured me that he’d asked people to stick to evidence. In that he clearly failed. I guess they must pay well.
Follow-up
This is my version of a post which I was asked to write for the Independent. It’s been published, though so many changes were made by the editor that I’m posting the original here (below).
Superstition is rife in all sports. Mostly it does no harm, and it might even have a placebo effect that’s sufficient to make a difference of 0.01%. That might just get you a medal. But what does matter is that superstition has given rise to an army of charlatans who are only to willing to sell their magic medicine to athletes, most of whom are not nearly as rich as Phelps.
So much has been said about cupping during the last week
that it’s hard to say much that’s original. Yesterday I did six radio interviews and two for TV, and today Associated Press TV came to film a piece about it. Everyone else must have been on holiday. The only one I’ve checked was the piece on the BBC News channel. That one didn’t seem to go too badly, so it’s here
BBC news coverage
It starts with the usual lengthy, but uninformative, pictures of someone being cupped, The cupper in this case was actually a chiropractor, Rizwhan Suleman. Chiropractic is, of course a totally different form of alternative medicine and its value has been totally discredited in the wake of the Simon Singh case. It’s not unusual for people to sell different therapies with conflicting beliefs. Truth is irrelevant. Once you’ve believed one impossible thing, it seems that the next ones become quite easy.
The presenter, Victoria Derbyshire, gave me a fair chance to debunk it afterwards.
Nevertheless, the programme suffered from the usual pretence that there is a controversy about the medical value of cupping. There isn’t. But despite Steve Jones’ excellent report to the BBC Trust, the media insist on giving equal time to flat-earth advocates. The report, (Review of impartiality and accuracy of the BBC’s coverage of science) was no doubt commissioned with good intentions, but it’s been largely ignored.
Still worse, the BBC News Channel, when it repeated the item (its cycle time is quite short) showed only Rizwhan Suleman and cut out my comments altogether. This is not false balance. It’s no balance whatsoever. A formal complaint has been sent. It is not the job of the BBC to provide free advertising to quacks.
After this, a friend drew my attention to a much worse programme on the subject.
The Jeremy Vine show on BBC Radio 2, at 12.00 on August 10th, 2016. This was presented by Vanessa Feltz. It was beyond appalling. There was absolutely zero attempt at balance, false or otherwise. The guest was described as being am "expert" on cupping. He was Yusef Noden, of the London Hijama Clinic, who "trained and qualified with the Hijama & Prophetic Medicine Institute". No doubt he’s a nice bloke, but he really could use a first year course in physiology. His words were pure make-believe. His repeated statements about "withdrawing toxins" are well know to be absolutely untrue. It was embarrassing to listen to. If you really want to hear it, here is an audio recording.
The Jeremy Vine show
This programme is one of the worst cases I’ve heard of the BBC mis-educating the public by providing free advertising for quite outrageous quackery. Another complaint will be submitted. The only form of opposition was a few callers who pointed out the nonsense, mixed with callers who endorsed it. That is not, by any stretch of the imagination, fair and balanced.
It’s interesting that, although cupping is often associated with Traditional Chinese Medicine, neither of the proponents in these two shows was Chinese, but rather they were Muslim. This should not be surprising as neither cupping nor acupuncture are exclusively Chinese. Similar myths have arisen in many places. My first encounter with this particular branch of magic medicine was when I was asked to make a podcast for “Things Unseen”, in which I debated with a Muslim hijama practitioner and an Indian Ayurvedic practitioner. It’s even harder to talk sense to practitioners of magic medicine who believe that god is on their side, as well as believing that selling nonsense is a good way to make a living.
An excellent history of the complex emergence of similar myths in different parts of the world has been published by Ben Kavoussi, under the title "Acupuncture is astrology with needles".
Now the original version of my blog for the Independent.
Cupping: Michael Phelps and Gwyneth Paltrow may be believers, but the truth behind it is what really sucks
The sight of Olympic swimmer, Michael Phelps, with bruises on his body caused by cupping resulted in something of a media feeding-frenzy this week. He’s a great athlete so cupping must be responsible for his performance, right? Just as cupping must be responsible for the complexion of an earlier enthusiast, Gwyneth Paltrow.
The main thing in common between Phelps and Paltrow is that they both have a great deal of money, and neither has much interest in how you distinguish truth from myth. They can afford to indulge any whim, however silly.
And cupping is pretty silly. It’s a pre-scientific medical practice that started in a time when there was no understanding of physiology, much like bloodletting. Indeed one version does involve a bit of bloodletting. Perhaps bloodletting is the best argument against the belief that it’s ancient wisdom, so it must work. It was a standard part of medical treatment for hundreds of years, and killed countless people.
It is desperately implausible that putting suction cups on your skin would benefit anything, so it’s not surprising that there is no worthwhile empirical evidence that it does. The Chinese version of cupping is related to acupuncture and, unlike cupping, acupuncture has been very thoroughly tested. Over 3000 trials have failed to show any benefit that’s big enough to benefit patients. Acupuncture is no more than a theatrical placebo. And even its placebo effects are too small to be useful.
At least it’s likely that cupping usually does no lasting damage.. We don’t know for sure because in the world of alternative medicine there is no system for recording bad effects (and there is a vested interest in not reporting them). In extreme cases, it can leave holes in your skin that pose a serious danger of infection, but most people probably end up with just broken capillaries and bruises. Why would anyone want that?
The answer to that question seems to be a mixture of wishful thinking about the benefits and vastly exaggerated claims made by the people who sell the product.
It’s typical that the sales people can’t even agree on what the benefits are alleged to be. If selling to athletes, the claim may be that it relieves pain, or that it aids recovery, or that it increases performance. Exactly the same cupping methods are sold to celebs with the claim that their beauty will be improved because cupping will “boost your immune system”. This claim is universal in the world of make-believe medicine, when the salespeople can think of nothing else. There is no surer sign of quackery. It means nothing whatsoever. No procedure is known to boost your immune system. And even if anything did, it would be more likely to cause inflammation and blood clots than to help you run faster or improve your complexion.
It’s certainly most unlikely that sucking up bits of skin into evacuated jars would have any noticeable effect on blood flow in underlying muscles, and so increase your performance. The salespeople would undoubtedly benefit from a first year physiology course.
Needless to say, they haven’t tried to actually measuring blood flow, or performance. To do that might reduce sales. As Kate Carter said recently “Eating jam out of those jars would probably have a more significant physical impact”.
The problem with all sports medicine is that tiny effects could make a difference. When three hour endurance events end with a second or so separating the winner from the rest, that is an effect of less than 0.01%. Such tiny effects will never be detectable experimentally. That leaves the door open to every charlatan to sell miracle treatments that might just work. If, like steroids, they do work, there is a good chance that they’ll harm your health in the long run.
You might be better off eating the jam.
Here is a very small selection of the many excellent accounts of cupping on the web.
There have been many good blogs. The mainstream media have, on the whole, been dire. Here are three that I like,
|
In July 2016, Orac posted in ScienceBlogs. "What’s the harm? Cupping edition". He used his expertise as a surgeon to explain the appalling wounds that can be produced by excessive cupping. |
 Photo from news,com.au |
Timothy Caulfield, wrote "Olympic debunk!". He’s Chair in Health Law and Policy at the University of Alberta, and the author of Is Gwyneth Paltrow Wrong about Everything.
“The Olympics are a wonderful celebration of athletic performance. But they have also become an international festival of sports pseudoscience. It will take an Olympic–sized effort to fight this bunk and bring a win to the side of evidence-based practice.”
Jennifer Raff wrote Pseudoscience is common among elite athletes outside of the Olympics too…and it makes me furious. She works on the genomes of modern and ancient people at the University of Kansas, and, as though that were not a full-time job for most people, she writes blogs, books and she’s also "training (and occasionally competing) in Muay Thai, boxing, BJJ, and MMA".
"I’m completely unsurprised to find that pseudoscience is common among the elite athletes competing in the Olympics. I’ve seen similar things rampant in the combat sports world as well."
What she writes makes perfect sense. Just don’t bother with the comments section which is littered with Trump-like post-factual comments from anonymous conspiracy theorists.
Follow-up
Despite the First Amendment in the US and a new Defamation Act in the UK, fear of legal threats continue to suppress the expression of honest scientific opinion.
I was asked by Nature Medicine (which is published in the USA) to write a review of Paul Offit’s new book. He’s something of a hero, so of course I agreed. The editor asked me to make some changes to the first draft, which I did. Then the editor concerned sent me this letter.
|
Thank you for the revised version of the book review.
The chief editor of the journal took a look at your piece, and he thought that it would be a good idea to run it past our legal counsel owing to the strong opinions expressed in the piece in relation to specific individuals. I regret to say that the lawyers have advised us against publishing the review. |
After that I tried the UK Conversation. They had done a pretty good job with my post on the baleful influence of royals on medicine. They were more helpful then Nature Medicine, but for some reason that I can’t begin to understand, they insisted that I should not name Nature Medicine, but to refer only to "a leading journal". And they wanted me not to name Harvard in the last paragraph. I’m still baffled about why. But it seemed to me that editorial interference had gone too far, so rather than have an editor re-write my review, I withdrew it.
It is precisely this sort of timidity that allows purveyors of quackery such success with their bait and switch tactics. The fact that people seem so terrified to be frank must be part of the reason why Harvard, Yale and the rest have shrugged their shoulders and allowed nonsense medicine to penetrate so deeply into their medical schools. It’s also why blogs now are often better sources of information than established journals.
Here is the review. I see nothing defamatory in it.
Do You Believe in Magic? The Sense and Nonsense of Alternative Medicine
|
Paul A. Offit Reviewed by David Colquhoun Research Professor of Pharmacology, UCL. |
|
Here’s an odd thing. There is a group of people who advocate the silly idea that you can cure all ills by stuffing yourself with expensive pills, made by large and unscrupulous Pharma companies. No, I’m not talking about pharmacologists or doctors or dietitians. They mostly say that stuffing yourself with pills is often useless and sometimes harmful, because that’s what the evidence says .
Rather, the pill pushers are the true believers in the alternative realities of the “supplement” industry. They seem blithely unaware that the manufacturers are mostly the same big pharma companies that they blame for trying to suppress “natural remedies”. Far from trying to suppress them, pharma companies love the supplement industry because little research is needed and there are few restrictions on the claims that can be made.
Paul Offit’s excellent book concentrates on alternative medicine in the USA, with little mention of the rest of the world. He describes how American pork barrel politics have given supplement hucksters an almost unrestricted right to make stuff up.
Following the thalidomide tragedy, which led to birth defects in babies in the 1950s and 60s, many countries passed laws that required evidence that a drug was both effective and safe before it could be sold. This was mandate by the Kefauver-Harris amendment (1961) in the USA and the Medicines Act (1968) in the UK. Laws like that upset the quacks, and in the UK the quacks got a free pass, a ‘licence of right‘, largely still in existence.
|
In order to sell a herbal concoction in the UK you need to present no evidence at all that it works, just evidence of safety, in return for which you get a reassuring certification mark and freedom to use misleading brand names and labels. |
 Tradional herbal mark |
In the USA the restrictions didn’t last long. Offit describes how a lobby group for vitamin sellers, the National Health Federation, had a board made up of quacks, some of whom, according to Offit (page 73) had convictions. They found an ally in Senator William Proxmire who introduced in 1975 an amendment that banned the Food and Drugs Administration (FDA) from regulating the safety of megavitamins. Tragically, this bill was even supported by the previously-respected scientist Linus Pauling. Offit tells us that “to Proxmire” became a verb meaning to obstruct science for political gain.
The author then relates how the situation got worse with the passage of the Dietary Supplement Health and Education Act (DSHEA) in 1994. It was passed with the help of ex-vitamin salesman Senator Orin Hatch and lots of money from the supplement industry.
This act iniquitously defined a “supplement” as “a product intended to supplement the diet that bears or contains one or more of the following ingredients: a vitamin, a mineral, an herb or other botanical, or an amino acid”. At a stroke, herbs were redefined as foods. There was no need to submit any evidence of either efficacy or even of safety, before marketing anything. All a manufacturer had to do to sell almost any herbal drug or megadose vitamin was to describe it as a “dietary supplement”. The lobbying to get this law through was based on appealing to the Tea Party tendency –get the government’s hands off our vitamins. And it was helped by ‘celebrities’ such as Sissy Spacek and Mel Gibson (it’s impossible to tell whether they really believed in the magic of vitamins, or whether they were paid, or had Tea Party sympathies).
Offit’s discussion of vaccination is a heartbreaking story of venom and misinformation. As co-inventor of the first rotavirus vaccine he’s responsible for saving many lives around the world. But he, perhaps more than anyone, suffered from the autism myth started by the falsified work of Andrew Wakefield.
The scientific community took the question seriously and soon many studies showed absolutely no link between vaccination and autism. But evidence did not seem to interest the alternative world. Rather than Offit being lauded as a saver of children’s lives, he describes how he was subjected to death threats and resorted to having armed guards at meetings.
Again, Offit tells us how celebrities were able to sway public opinion For example (chapter 6), the actress Jenny McCarthy and talk-show hostess Oprah Winfrey promoted, only too successfully, the vaccine-autism link despite abundant evidence that it didn’t exist, and promoted a number of theories that were not supported by any evidence, such as the idea that autism can be “cured” by mega-doses of vitamins and supplements.
Of course vaccines like the one for rotavirus can’t be developed without pharmaceutical companies because, as Offit says, only they "have the resources and expertise to make a vaccine. We can’t make it in our garage". When the Children’s Hospital of Philadelphia sold its royalty stake in the rotavirus vaccine for $182 million, Offit received an undisclosed share of the intellectual property, “in the millions ”.
That’s exactly what universities love. We are encouraged constantly to collaborate with industry, and, in the process, make money for the university. It’s also what Wakefield, and the Royal Free Hospital where he worked, hoped to do. But sadly, these events led to Offit being called names such as “Dr Proffit” and “Biostitute” (to rhyme with “prostitute”) by people like Jenny McCarthy and Robert F. Kennedy Jr. The conspiritorialist public lapped up this abuse, but appeared not to notice that many quacks have become far richer by peddling cures that do not work.
One lesson from this sad story is that we need to think more about the potential for money to lead to good science being disbelieved, and sometimes to corrupt science.
Everyone should buy this book, and weep for the gullibility and corruption that it describes.
I recommend it especially to the deans of US Medical schools, from Harvard downwards, who have embraced “integrative medicine” departments. In doing so they have betrayed both science and their patients.
Abraham Flexner, whose 1910 report first put US medicine on a sound scientific footing, must be turning in his grave.
|
|
Follow-up
30 August 2013
Quack lobby groups got a clause inserted into Obamacare that will make any attempt to evaluate whether a treatment actually works will leave insurance companies open to legal action for "discrimination".
"Discrimination? Yes! We must not allow the government to exclude health care providers just because those providers don’t cure anything."
The latest piece of well-organised corporate corruption by well-funded lobbyists is revealed by Steven Salzberg, in Forbes Magazine. The chaos in the US health system makes one even more grateful for the NHS and for the evaluation of effectiveness of treatments by NICE.
Here is a record of a couple of recent newspaper pieces. Who says the mainstream media don’t matter any longer? Blogs may be in the lead now when it comes to critical analysis. The best blogs have more expertise and more time to read the sources than journalists. But the mainstream media get the message to a different, and much larger, audience.
The Observer ran a whole page interview with me as part of their “Rational Heroes” series. I rather liked their subtitle [pdf of article]
“Professor of pharmacology David Colquhoun is the take-no-prisoners debunker of pseudoscience on his unmissable blog”
It was pretty accurate apart from the fact that the picture was labelled as “DC in his office”. Actually it was taken (at the insistence of the photographer) in Lucia Sivilotti’s lab.
Photo by Karen Robinson.
The astonishing result of this was that on Sunday the blog got a record 24,305 hits. Normally it gets 1,000-1,400 hits a day . between posts, fewer on Sunday, and the previous record was around 7000/day
A week later it was still twice normal. It remains to be seen whether the eventual plateau stays up.
I also gained around 1000 extra followers on twitter, though some dropped away quite soon, and 100 or so people signed for email updates. The dead tree media aren’t yet dead. I’m happy to say.
3 June 2013
Perhaps as a result of the foregoing piece, I got asked to write a column for The Observer, at barely 48 hours notice. This is the best I could manage in the time. The web version has links.
This attracted the usual "it worked for me" anecdotes in the comments, but I spent an afternoon answering them. It seems important to have a dialogue, not just to lecture the public. In fact when I read a regular scientific paper, I now find myself looking for the comment section. That may say something about the future of scientific publishing.
It is for others to judge how succesfully I engage with the public, but I was quite surprised to discover that UCL’s public engagement unit, @UCL_in_public, has blocked me on twitter. Hey ho. They have 1574 follower and I have 7597. I wish them the best of luck.
Follow-up
Anesthesia & Analgesia is the official journal of the International Anesthesia Research Society. In 2012 its editor, Steven Shafer, proposed a head-to-head contest between those who believe that acupuncture works and those who don’t. I was asked to write the latter. It has now appeared in June 2013 edition of the journal [download pdf]. The pro-acupuncture article written by Wang, Harris, Lin and Gan appeared in the same issue [download pdf].
Acupuncture is an interesting case, because it seems to have achieved greater credibility than other forms of alternative medicine, despite its basis being just as bizarre as all the others. As a consequence, a lot more research has been done on acupuncture than on any other form of alternative medicine, and some of it has been of quite high quality. The outcome of all this research is that acupuncture has no effects that are big enough to be of noticeable benefit to patients, and it is, in all probablity, just a theatrical placebo.
After more than 3000 trials, there is no need for yet more. Acupuncture is dead.
Acupuncture is a theatrical placebo
David Colquhoun (UCL) and Steven Novella (Yale)
Anesthesia & Analgesia, June 2013 116:1360-1363.
Pain is a big problem. If you read about pain management centres you might think it had been solved. It hasn’t. And when no effective treatment exists for a medical problem, it leads to a tendency to clutch at straws. Research has shown that acupuncture is little more than such a straw.
Although it is commonly claimed that acupuncture has been around for thousands of years, it hasn’t always been popular even in China. For almost 1000 years it was in decline and in 1822 Emperor Dao Guang issued an imperial edict stating that acupuncture and moxibustion should be banned forever from the Imperial Medical Academy.
Acupuncture continued as a minor fringe activity in the 1950s. After the Chinese Civil War, the Chinese Communist Party ridiculed traditional Chinese medicine, including acupuncture, as superstitious. Chairman Mao Zedong later revived traditional Chinese Medicine as part of the Great Proletarian Cultural Revolution of 1966 (Atwood, 2009). The revival was a convenient response to the dearth of medically-trained people in post-war China, and a useful way to increase Chinese nationalism. It is said that Chairman Mao himself preferred Western medicine. His personal physician quotes him as saying “Even though I believe we should promote Chinese medicine, I personally do not believe in it. I don’t take Chinese medicine” Li {Zhisui Li. Private Life Of Chairman Mao: Random House, 1996}.
The political, or perhaps commercial, bias seems to still exist. It has been reported by Vickers et al. (1998) (authors who are sympathetic to alternative medicine) that
"all trials [of acupuncture] originating in China, Japan, Hong Kong, and Taiwan were positive"(4).
Acupuncture was essentially defunct in the West until President Nixon visited China in 1972. Its revival in the West was largely a result of a single anecdote promulgated by journalist James Reston in the New York Times, after he’d had acupuncture in Beijing for post-operative pain in 1971. Despite his eminence as political journalist, Reston had no scientific background and evidently didn’t appreciate the post hoc ergo propter hoc fallacy, or the idea of regression to the mean.
After Reston’s article, acupuncture quickly became popular in the West. Stories circulated that patients in China had open heart surgery using only acupuncture (Atwood, 2009). The Medical Research Council (UK) sent a delegation, which included Alan Hodgkin, to China in 1972 to investigate these claims , about which they were skeptical. In 2006 the claims were repeated in 2006 in a BBC TV program, but Simon Singh (author of Fermat’s Last Theorem) discovered that the patient had been given a combination of three very powerful sedatives (midazolam, droperidol, fentanyl) and large volumes of local anaesthetic injected into the chest. The acupuncture needles were purely cosmetic.
Curiously, given that its alleged principles are as bizarre as those on any other sort of pre-scientific medicine, acupuncture seemed to gain somewhat more plausibility than other forms of alternative medicine. The good thing about that is that more research has been done on acupuncture than on just about any other fringe practice.
The outcome of this research, we propose, is that the benefits of acupuncture, if any, are too small and too transient to be of any clinical significance. It seems that acupuncture is little or no more than a theatrical placebo. The evidence for this conclusion will now be discussed.
Three things that are not relevant to the argument
There is no point in discussing surrogate outcomes such as fMRI studies or endorphine release studies until such time as it has been shown that patients get a useful degree of relief. It is now clear that they don’t.
There is also little point in invoking individual studies. Inconsistency is a prominent characteristic of acupuncture research: the heterogeneity of results poses a problem for meta-analysis. Consequently it is very easy to pick trials that show any outcome whatsoever. Therefore we shall consider only meta-analyses.
The argument that acupuncture is somehow more holistic, or more patient-centred, than medicine seems us to be a red herring. All good doctors are empathetic and patient-centred. The idea that empathy is restricted to those who practice unscientific medicine seems both condescending to doctors, and it verges on an admission that empathy is all that alternative treatments have to offer.
There is now unanimity that the benefits, if any, of acupuncture for analgesia, are too small to be helpful to patients.
Large multicenter clinical trails conducted in Germany {Linde et al., 2005; Melchart et, 2005; Haake et al, 2007, Witt et al, 2005), and in the United States {Cherkin et al, 2009) consistently revealed that verum (or true) acupuncture and sham acupuncture treatments are no different in decreasing pain levels across multiple chronic pain disorders: migraine, tension headache, low back pain, and osteoarthritis of the knee.
If, indeed, sham acupuncture is no different from real acupuncture the apparent improvement that may be seen after acupuncture is merely a placebo effect. Furthermore it shows meridians don’t exist, so the "theory" memorized by qualified acupuncturists is just myth. All that remains to be discussed is whether or not the placebo effect is big enough to be useful, and whether it is ethical to prescribe placebos.
Some recent meta-analyses have found that there may be a small difference between sham and real acupuncture. Madsen Gøtzsche & Hróbjartsson {2009) looked at thirteen trials with 3025 patients, in which acupuncture was used to treat a variety of painful conditions. There was a small difference between ‘real’ and sham acupuncture (it didn’t matter which sort of sham was used), and a somewhat bigger difference between the acupuncture group and the no-acupuncture group. The crucial result was that even this bigger difference corresponded to only a 10 point improvement on a 100 point pain scale. A consensus report (Dworkin, 2009) that a change of this sort should be described as a “minimal” change or “little change”. It isn’t big enough for the patient to notice much effect.
The acupuncture and no-acupuncture groups were, of course, not blind to the patients and neither were they blind to the practitioner giving the treatment. It isn’t possible to say whether the observed difference is a real physiological action or whether it’s a placebo effect of a rather dramatic intervention. Interesting though it would be to know this, it matters not a jot, because the effect just isn’t big enough to produce any tangible benefit.
Publication bias is likely to be an even greater problem for alternative medicine than it is for real medicine, so it is particularly interesting that the result just described has been confirmed by authors who practise, or sympathise with, acupuncture. Vickers et al. (2012) did a meta-analysis for 29 RCTs, with 17,922 patients. The patients were being treated for a variety of chronic pain conditions. The results were very similar to those of Madsen et al.{2009). Real acupuncture was better than sham, but by a tiny amount that lacked any clinical significance. Again there was a somewhat larger difference in the non-blind comparison of acupuncture and no-acupuncture, but again it was so small that patients would barely notice it.
Comparison of these two meta-analyses shows how important it is to read the results, not just the summaries. Although the outcomes were similar for both, the spin on the results in the abstracts (and consequently the tone of media reports) was very different.
An even more extreme example of spin occurred in the CACTUS trial of acupuncture for " ‘frequent attenders’ with medically unexplained symptoms” (Paterson et al., 2011). In this case, the results showed very little difference even between acupuncture and no-acupuncture groups, despite the lack of blinding and lack of proper controls. But by ignoring the problems of multiple comparisons the authors were able to pick out a few results that were statistically significant, though trivial in size. But despite this unusually negative outcome, the result was trumpeted as a success for acupuncture. Not only the authors, but also their university’s PR department and even the Journal editor issued highly misleading statements. This gave rise to a flood of letters to the British Journal of General Practice and much criticism on the internet.
From the intellectual point of view it would be interesting to know if the small difference between real and sham acupuncture found in some, but not all, recent studies is a genuine effect of acupuncture or whether it is a result of the fact that the practitioners are never blinded, or of publication bias. But that knowledge is irrelevant for patients. All that matters for them is whether or not they get a useful degree of relief.
There is now unanimity between acupuncturists and non-acupuncturists that any benefits that may exist are too small to provide any noticeable benefit to patients. That being the case it’s hard to see why acupuncture is still used. Certainly such an accumulation of negative results would result in the withdrawal of any conventional treatment.
Specific conditions
Acupuncture should, ideally, be tested separately for effectiveness for each individual condition for which it has been proposed (like so many other forms of alternative medicine, that’s a very large number). Good quality trials haven’t been done for all of them. It’s unlikely that acupuncture works for rheumatoid arthritis, stopping smoking, irritable bowel syndrome or for losing weight. And there is no good reason to think it works for addictions, asthma, chronic pain, depression, insomnia, neck pain, shoulder pain or frozen shoulder, osteoarthritis of the knee, sciatica, stroke or tinnitus and many other conditions (Ernst et al., 2011).
In 2009, the UK’s National Institute for Clinical Excellence (NICE) did recommend both acupuncture and chiropractic for back pain. This exercise in clutching at straws caused something of a furore. In the light of NICE’s judgement the Oxford Centre for Evidence-based medicine updated its analysis of acupuncture for back pain. Their verdict was
“Clinical bottom line. Acupuncture is no better than a toothpick for treating back pain.”
The paper by Artus et al. (2010) is of particular interest for the problem of back pain. Their Fig 2 shows that there is a modest improvement in pain scores after treatment, but much the same effect, with the same time course is found regardless of what treatment is given, and even with no treatment at all. They say
“we found evidence that these responses seem to follow a common trend of early rapid improvement in symptoms that slows down and reaches a plateau 6 months after the start of treatment, although the size of response varied widely. We found a similar pattern of improvement in symptoms following any treatment, regardless of whether it was index, active comparator, usual care or placebo treatment”.
It seems that most of what’s being seen is regression to the mean. And that is very likely to be the main reason why acupuncture sometimes appears to work when it doesn’t.
Although the article by Wang et al (2012) was written to defend the continued use of acupuncture, the only condition for which they claim that there is any reasonably strong evidence is for post-operative nausea and vomiting (PONV). It would certainly be odd if a treatment that had been advocated for such a wide variety of conditions turned out to work only for PONV. Nevertheless, let’s look at the evidence.
The main papers that are cited to support the efficacy of acupuncture in alleviation of PONV are all from the same author: Lee & Done (1999), and two Cochrane reviews, Lee & Done (2004), updated in Lee & Fan (2009). We need only deal with this latest updated meta-analysis.
Although the authors conclude “P6 acupoint stimulation prevented PONV”, closer examination shows that this conclusion is very far from certain. Even taken at face value, a relative risk of 0.7 can’t be described as “prevention”. The trials that were included were not all tests of acupuncture but included several other more or less bizarre treatments (“acupuncture, electro-acupuncture, transcutaneous nerve stimulation, laser stimulation, capsicum plaster, an acu-stimulation device, and acupressure”). The number needed to treat varied from a disastrous 34 to a poor 5 for patients with control rates of PONV of 10% and 70% respectively.
The meta-analysis showed, on average, similar effectiveness for acupumcture and anti-emetic drugs. The problem is that the effectiveness of drugs is in doubt because an update to the Cochrane review has been delayed (Carlisle, 2012) by the discovery of major fraud by a Japanese anesthetist, Yoshitaka Fujii (Sumikawa, 2012). It has been suggested that metclopramide barely works at all (Bandolier, 2012; Henzi, 1999).
Of the 40 trials (4858 participants) that were included; only four trials reported adequate allocation concealment. Ninety percent of trials were open to bias from this source. Twelve trials did not report all outcomes. The opportunities for bias are obvious. The authors themselves describe all estimates as being of “Moderate quality” which is defined this: “Further research is likely to have an important impact on our confidence in the estimate of effect and may change the estimate”. That being the case, perhaps the conclusion should have been “more research needed”. In fact almost all trials of alternative medicines seem to end up with the conclusion that more research is needed.
Conclusions
It is clear from meta-analyses that results of acupuncture trials are variable and inconsistent, even for single conditions. After thousands of trials of acupuncture, and hundreds of systematic reviews (Ernst et al., 2011), arguments continue unabated. In 2011, Pain carried an editorial which summed up the present situation well.
“Is there really any need for more studies? Ernst et al. (2011) point out that the positive studies conclude that acupuncture relieves pain in some conditions but not in other very similar conditions. What would you think if a new pain pill was shown to relieve musculoskeletal pain in the arms but not in the legs? The most parsimonious explanation is that the positive studies are false positives. In his seminal article on why most published research findings are false, Ioannidis (2005) points out that when a popular but ineffective treatment is studied, false positive results are common for multiple reasons, including bias and low prior probability.”
Since it has proved impossible to find consistent evidence after more than 3000 trials, it is time to give up. It seems very unlikely that the money that it would cost to do another 3000 trials would be well-spent.
A small excess of positive results after thousands of trials is most consistent with an inactive intervention. The small excess is predicted by poor study design and publication bias. Further, Simmons et al (2011) demonstrated that exploitation of "undisclosed flexibility in data collection and analysis" can produce statistically positive results even from a completely nonexistent effect. With acupuncture in particular there is documented profound bias among proponents (Vickers et al., 1998). Existing studies are also contaminated by variables other than acupuncture – such as the frequent inclusion of "electroacupuncture" which is essentially transdermal electrical nerve stimulation masquerading as acupuncture.
The best controlled studies show a clear pattern – with acupuncture the outcome does not depend on needle location or even needle insertion. Since these variables are what define "acupuncture" the only sensible conclusion is that acupuncture does not work. Everything else is the expected noise of clinical trials, and this noise seems particularly high with acupuncture research. The most parsimonious conclusion is that with acupuncture there is no signal, only noise.
The interests of medicine would be best-served if we emulated the Chinese Emperor Dao Guang and issued an edict stating that acupuncture and moxibustion should no longer be used in clinical practice.
No doubt acupuncture will continue to exist on the High Streets where they can be tolerated as a voluntary self-imposed tax on the gullible (as long as they don’t make unjustified claims).
|
REFERENCES
|
|
|
1. Acupuncture Centre. . About Acupuncture. Available at: http://www.acupuncturecentre.org/aboutacupuncture.html. Accessed March 30, 2013 |
|
|
2. Atwood K. “Acupuncture Anesthesia”: a Proclamation from Chairman Mao (Part IV). Available at: http://www.sciencebasedmedicine.org/index.php/acupuncture-anesthesia-a-proclamation-from-chairman-mao-part-iv/. Accessed September 2, 2012 |
|
|
3. Li Z Private Life of Chairman Mao: The Memoirs of Mao’s Personal Physician. 1996 New York: Random House |
|
|
4. Vickers A, Goyal N, Harland R, Rees R. Do certain countries produce only positive results? A systematic review of controlled trials. Control Clin Trials. 1998;19:159–66 Available at: http://bit.ly/WqVGWN. Accessed September 2, 2012 |
|
|
5. Reston J. Now, About My Operation in Peking; Now, Let Me Tell You About My Appendectomy in Peking … The New York Times. 1971 Available at: http://select.nytimes.com/gst/abstract.html?res=FB0D11FA395C1A7493C4AB178CD85F458785F9. Accessed March 30, 2013 |
|
|
6. Atwood K. “Acupuncture anesthesia”: a proclamation from chairman Mao (part I). Available at: http://www.sciencebasedmedicine.org/index.php/acupuncture-anesthesia-a-proclamation-of-chairman-mao-part-i/. Accessed September 2, 2012 |
|
|
7. Linde K, Streng A, Jürgens S, Hoppe A, Brinkhaus B, Witt C, Wagenpfeil S, Pfaffenrath V, Hammes MG, Weidenhammer W, Willich SN, Melchart D. Acupuncture for patients with migraine: a randomized controlled trial. JAMA. 2005;293:2118–25 |
|
|
8. Melchart D, Streng A, Hoppe A, Brinkhaus B, Witt C, Wagenpfeil S, Pfaffenrath V, Hammes M, Hummelsberger J, Irnich D, Weidenhammer W, Willich SN, Linde K. Acupuncture in patients with tension-type headache: randomised controlled trial. BMJ. 2005;331:376–82 |
|
|
9. Haake M, Müller HH, Schade-Brittinger C, Basler HD, Schäfer H, Maier C, Endres HG, Trampisch HJ, Molsberger A. German Acupuncture Trials (GERAC) for chronic low back pain: randomized, multicenter, blinded, parallel-group trial with 3 groups. Arch Intern Med. 2007;167:1892–8 |
|
|
10. Witt C, Brinkhaus B, Jena S, Linde K, Streng A, Wagenpfeil S, Hummelsberger J, Walther HU, Melchart D, Willich SN. Acupuncture in patients with osteoarthritis of the knee: a randomised trial. Lancet. 2005;366:136–43 |
|
|
11. Cherkin DC, Sherman KJ, Avins AL, Erro JH, Ichikawa L, Barlow WE, Delaney K, Hawkes R, Hamilton L, Pressman A, Khalsa PS, Deyo RA. A randomized trial comparing acupuncture, simulated acupuncture, and usual care for chronic low back pain. Arch Intern Med. 2009;169:858–66 |
|
|
12. Madsen MV, Gøtzsche PC, Hróbjartsson A. Acupuncture treatment for pain: systematic review of randomised clinical trials with acupuncture, placebo acupuncture, and no acupuncture groups. BMJ. 2009;338:a3115 |
|
|
13. Dworkin RH, Turk DC, McDermott MP, Peirce-Sandner S, Burke LB, Cowan P, Farrar JT, Hertz S, Raja SN, Rappaport BA, Rauschkolb C, Sampaio C. Interpreting the clinical importance of group differences in chronic pain clinical trials: IMMPACT recommendations. Pain. 2009;146:238–44 |
|
|
14. Vickers AJ, Cronin AM, Maschino AC, Lewith G, MacPherson H, Foster NE, Sherman KJ, Witt CM, Linde K. Acupuncture for chronic pain: individual patient data meta-analysis. Arch Intern Med. 2012;172:1444–53 |
|
|
15. Paterson C, Taylor RS, Griffiths P, Britten N, Rugg S, Bridges J, McCallum B, Kite G. Acupuncture for ‘frequent attenders’ with medically unexplained symptoms: a randomised controlled trial (CACTUS study). Br J Gen Pract. 2011;61:e295–e305 |
|
|
16. . Letters in response to Acupuncture for ‘frequent attenders’ with medically unexplained symptoms. Br J Gen Pract. 2011;61 Available at: http://www.ingentaconnect.com/content/rcgp/bjgp/2011/00000061/00000589. Accessed March 30, 2013 |
|
|
17. Colquhoun D. Acupuncturists show that acupuncture doesn’t work, but conclude the opposite: journal fails. 2011 Available at: https://www.dcscience.net/?p=4439. Accessed September 2, 2012 |
|
|
18. Ernst E, Lee MS, Choi TY. Acupuncture: does it alleviate pain and are there serious risks? A review of reviews. Pain. 2011;152:755–64 |
|
|
19. Colquhoun D. NICE falls for Bait and Switch by acupuncturists and chiropractors: it has let down the public and itself. 2009 Available at: https://www.dcscience.net/?p=1516. Accessed September 2, 2012 |
|
|
20. Colquhoun D. The NICE fiasco, part 3. Too many vested interests, not enough honesty. 2009 Available at: https://www.dcscience.net/?p=1593. Accessed September 2, 2012 |
|
|
21. Bandolier. . Acupuncture for back pain—2009 update. Available at: http://www.medicine.ox.ac.uk/bandolier/booth/painpag/Chronrev/Other/acuback.html. Accessed March 30, 2013 |
|
|
22. Artus M, van der Windt DA, Jordan KP, Hay EM. Low back pain symptoms show a similar pattern of improvement following a wide range of primary care treatments: a systematic review of randomized clinical trials. Rheumatology (Oxford). 2010;49:2346–56 |
|
|
23. Wang S-M, Harris RE., Lin Y-C, Gan TJ. Acupuncture in 21st century anesthesia: is there a needle in the haystack? Anesth Analg. 2013;116:1356–9 |
|
|
24. Lee A, Done ML. The use of nonpharmacologic techniques to prevent postoperative nausea and vomiting: a meta-analysis. Anesth Analg. 1999;88:1362–9 |
|
|
25. Lee A, Done ML. Stimulation of the wrist acupuncture point P6 for preventing postoperative nausea and vomiting. Cochrane Database Syst Rev. 2004:CD003281 |
|
|
26. Lee A, Fan LT. Stimulation of the wrist acupuncture point P6 for preventing postoperative nausea and vomiting. Cochrane Database Syst Rev. 2009:CD003281 |
|
|
27. Carlisle JB. A meta-analysis of prevention of postoperative nausea and vomiting: randomised controlled trials by Fujii etal. compared with other authors. Anaesthesia. 2012;67:1076–90 |
|
|
28. Sumikawa K. The results of investigation into Dr.Yoshitaka Fujii’s papers. Report of the Japanese Society of Anesthesiologists Special Investigation Committee. http://www.anesth.or.jp/english/pdf/news20120629.pdf |
|
|
29. Bandolier. . Metoclopramide is ineffective in preventing postoperative nausea and vomiting. Available at: http://www.medicine.ox.ac.uk/bandolier/band71/b71-8.html. Accessed March 30, 2013 |
|
|
30. Henzi I, Walder B, Tramèr MR. Metoclopramide in the prevention of postoperative nausea and vomiting: a quantitative systematic review of randomized, placebo-controlled studies. Br J Anaesth. 1999;83:761–71 |
|
|
31. Hall H. Acupuncture’s claims punctured: not proven effective for pain, not harmless. Pain. 2011;152:711–2 |
|
|
32. Ioannidis JP. Why most published research findings are false. PLoS Med. 2005;2:e124 |
|
|
33. Simmons JP, Leif DN, Simonsohn U. False-positive psychology: undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychol Sci. 2011;22:1359–66 |
Follow-up
30 May 2013 Anesthesia & Analgesia has put the whole paper on line. No paywall now!
9 June 2013. Since this page was posted on May 30, it has had over 20,000 page views. Not bad.
26 July 2013. The Observer had a large double-page spread about acupuncture. It was written by David Derbyshire, largely on the basis of this article.
26 December 2013
Over christmas the flow of stuff that misrepresents the "thousands of years" of Chinese medicine has continued unabated. Of course one expects people who are selling Chinese herbs and acupuncture to lie. All businesses do. One does not expect such misrepresentation from British Columbia, Cardiff University School of medicine, or from Yale University. I left a comment on the Yale piece. Whether it passes moderation remains to be seen. Just in case, here it is.
One statement is undoubtedly baseless ““If it’s still in use after a thousand years there must be something right,” It’s pretty obvious to the most casual observer that many beliefs that have been round for a thousand years have proved to be utterly wrong.
In any case, it’s simply not true that most “Traditional” Chinese medicine has been around for thousands of years. Acupuncture was actually banned by the Emperor Dao Guang in 1822. The sort of Chinese medicine that is sold (very profitably) to the west was essentially dead in China until it was revived by Mao as part of the great proletarian cultural revolution (largely to stir up Chinese nationalism at that time). Of course he didn’t use it himself.
This history has been documented in detail now, and it surprises me to see it misrepresented, yet again, from a Yale academic.
Of course there might turn out to be therapeutically useful chemicals in Chinese herbs (it has happened with artemesinin). But it is totally irresponsible to pretend that great things are coming in the absence of good RCTs in human patients.
Yale should be ashamed of PR like this. And so should Cardiff University. It not only makes the universities look silly. It corrupts the whole of the rest of these institutions. Who knows how much more of their PR is mere puffery.
18 January 2014. I checked the Yale posting and found that the comment, above, had indeed been deleted. There is little point in having comments if you are going to delete anything that’s mildly critical. It is simply dishonest.
It’s hard to know what to make of David Tredinnick MP (Cons, Bosworth). He is certainly an extreme example of the scientific ignorance of our parliamentary representatives, but he isn’t alone in that. Our present minister of Education, Michael Gove, memorably referred to Newton’s Laws of Thermodynamics, blissfully unaware that thermodynamics was a 19th century development. And our present Minister of Health seems to think that magic water cures diseases.
But Mr Treddinick breaks every record for anti-scientific nonsense. That, no doubt, is why he was upset by the recent revision of come NHS Choices web pages, so that they now give a good account of the evidence (that’s their job, of course). They did that despite two years of obstruction by the Department of Health. which seemed to think that it was appropriate to take advice from Michael Dixon of the Prince’s Foundation for integrated Health. That shocking example of policy based evidence was revealed on this blog, and caused something of a stir.
Treddinick’s latest letter
A copy of a letter from Mr Tredinnick to the Minister of Health, Jeremy Hunt, has some into my possession by a tortuous route [download the letter]. It’s a corker. Here are a few quotations.
"1. UKIP moving onto our ground
Attached is an extract from a recent UKIP policy statement. The position which UKIP has taken is one with which most of our Daily Mail reading supporters of complementary medicine would agree."
It seems that Treddinick’s preferred authority on medicine is now Nigel Farage, leader of the UK’s far right party. UKIP’s policy on health is appended to the letter, and it’s as barmy as most of the other things they say.
"2. Herbal Medicine
. . .there is very real concern that the Government will not regulate Herbal Medicine and Traditional Chinese Medicine. The current situation is unacceptable, because herbal practitioners need regulation and cannot function as herbal therapists, nor can they cannot obtain stocks of their herbal remedies, without it.
This refers to a saga that has been running for at least 10 years. Herbalists are desperate to get a government stamp of approval by getting statutory regulation, much like real doctors have, despite the fact that they make money by selling sick people "an unknown dose of an ill-defined drug, of unknown effectiveness and unknown safety" (as quoted recently in the House of Lords).
Even the US National Center for Complementary and Alternative Medicine (NCCAM) doesn’t claim that a single herbal treatment is useful. The saga of herbal regulation is long and tedious. The short version is that a very bad report, The Pittilo report, recommended regulation of herbalists. After years of prevarication, Andrew Lansley ignored the impartial scientific advice and yielded to the pressure from the herbal industry to accept the Pittilo report. But still nothing has happened.
Could it be that even Jeremy Hunt realises, deep down, that the regulation of nonsense is a nonsense that would harm the public?
We can only hope that a letter from Mr Tredinnick is the kiss of death. Perhaps his continuous pestering will only reinforce the doubts that seem to exist at the Department of Health.
Then Tredinnick returns (yawn) to his obsession with magic water. He vents his rage at the now excellent NHS Choices page on homeopathy.
3. Homeopathy
"Recently this wording has been removed and instead a comment by the Chief Medical Officer that homeopathy is placebo inserted in its place, as well as links to external organisations which campaign against homeopathy. For instance, there is a link to the Sense About Science website, and Caroline Finucane, who is Editor of new content at NHS Choices, also writes for the Sense About Science website. This is an organisation which has no expertise in homeopathy and traces its roots back to the ultra-left Revolutionary Communist Party (RCP)."
"I respectfully suggest that the original wording be reinstated and these links to external organisations be removed or changed to ensure a balanced view.".
So it seems that he prefers the medical views of Nigel Farage and the Prince of Wales to those of the Chief Medical Officer and the government’s chief scientist. Disgracefully, Tredinnick picks out one particular employee of NHS Choices among many, and one who does an excellent job. And he raises the hoary old myth that Sense About Science is a communist organisation. Odd, since others accuse it of being neo-libertarian. The actual history is here. The organisation that is a bit too libertarian for my taste is Spiked Online. I haven’t agreed with every word that Sense about Science has printed, but they have a totally honest belief in evidence.
To drag in the name of one person out of many, and to justify it by a false history shows, once again, how very venomous and vindictive the advocates of delusional medicine can be when they feel cornered.
A bit more information about Mr Treddinick
This is what the BBC News profile says about him.
|
David Tredinnick is an old style Conservative MP, being an Eton-educated former Guards officer, who has sat in the Commons since 1987. However, his ambition for high office was thwarted by his role in one of the sleaze stories which helped to sink the Major government. He accepted £1,000 from an undercover reporter to ask parliamentary questions about a fictitious drug. He was obliged to resign from his role as a PPS and was suspended from the Commons for 20 sitting days. He has not sat on the frontbench since. He is an orthodox Conservative loyalist, though he is more supportive of the European Union than many of his colleagues. He has, however, carved himself a niche as the Commons’ most enthusiastic supporter of complementary medicine. He has wearied successive health secretaries with his persistent advocacy of any and all homeopathic remedies. He has also supported their use in prisons and even suggested them as an aid in alleviating the foot and mouth crisis. |
|
Tredinnick has also asserted that he was aware of a psychiatric hospital that doubled its staff at full moon (this is an old urban myth, and is, of course, quite untrue). His advocacy of homeopathic borax as a way to control the 2001 epidemic of foot and mouth diease can be read here. Luckily it was ignored by the government. I hope his latest letter will be treated similarly. Picture of David Tredinnick MP from the Conservative Party |
 |
Follow-up
The Scottish Universities Medical Journal asked me to write about the regulation of alternative medicine. It’s an interesting topic and not easy to follow because of the veritable maze of more than twenty overlapping regulators and quangos which fail utterly to protect the public against health fraud. In fact they mostly promote health fraud. The paper is now published, and here is a version with embedded links (and some small updates).
We are witnessing an increasing commercialisation of medicine. It’s really taken off since the passage of the Health and Social Security Bill into law. Not only does that mean having NHS hospitals run by private companies, but it means that “any qualified provider” can bid for just about any service. The problem lies, of course, in what you consider “qualified” to mean. Any qualified homeopath or herbalist will, no doubt, be eligible. University College London Hospital advertised for a spiritual healer. The "person specification" specified a "quallfication", but only HR people think that a paper qualification means that spiritual healing is anything but a delusion.
The vocabulary of bait and switch
First, a bit of vocabulary. Alternative medicine is a term that is used for medical treatments that don’t work (or at least haven’t been shown to work). If they worked, they’d be called “medicine”. The anti-malarial, artemesinin, came originally from a Chinese herb, but once it had been purified and properly tested, it was no longer alternative. But the word alternative is not favoured by quacks. They prefer their nostrums to be described as “complementary” –it sounds more respectable. So CAM (complementary and alternative medicine became the politically-correct euphemism. Now it has gone a stage further, and the euphemism in vogue with quacks at the moment is “integrated” or “integrative” medicine. That means, very often, integrating things that don’t work with things that do. But it sounds fashionable. In reality it is designed to confuse politicians who ask for, say, integrated services for old people.
Put another way, the salespeople of quackery have become rather good at bait and switch. The wikepedia definition is as good as any.
Bait-and-switch is a form of fraud, most commonly used in retail sales but also applicable to other contexts. First, customers are “baited” by advertising for a product or service at a low price; second, the customers discover that the advertised good is not available and are “switched” to a costlier product.
As applied to the alternative medicine industry, the bait is usually in the form of some nice touchy-feely stuff which barely mentions the mystical nonsense. But when you’ve bought into it you get the whole panoply of nonsense. Steven Novella has written eloquently about the use of bait and switch in the USA to sell chiropractic, acupuncture, homeopathy and herbal medicine: "The bait is that CAM offers legitimate alternatives, the switch is that it primarily promotes treatments that don’t work or are at best untested and highly implausible.".
The "College of Medicine" provides a near-perfect example of bait and switch. It is the direct successor of the Prince of Wales’ Foundation for Integrated Health. The Prince’s Foundation was a consistent purveyor of dangerous medical myths. When it collapsed in 2010 because of a financial scandal, a company was formed called "The College for Integrated Health". A slide show, not meant for public consumption, said "The College represents a new strategy to take forward the vision of HRH Prince Charles". But it seems that too many people have now tumbled to the idea that "integrated", in this context, means barmpottery. Within less than a month, the new institution was renamed "The College of Medicine". That might be a deceptive name, but it’s a much better bait. That’s why I described the College as a fraud and delusion.
Not only did the directors, all of them quacks, devise a respectable sounding name, but they also succeeded in recruiting some respectable-sounding people to act as figureheads for the new organisation. The president of the College is Professor Sir Graham Catto, emeritus professor of medicine at the University of Aberdeen. Names like his make the bait sound even more plausible. He claims not to believe that homeopathy works, but seems quite happy to have a homeopathic pharmacist, Christine Glover, on the governing council of his college. At least half of the governing Council can safely be classified as quacks.
So the bait is clear. What about the switch? The first thing to notice is that the whole outfit is skewed towards private medicine: see The College of Medicine is in the pocket of Crapita Capita. The founder, and presumably the main provider of funds (they won’t say how much) is the huge outsourcing company, Capita. This is company known in Private Eye as Crapita. Their inefficiency is legendary. They are the folks who messed up the NHS computer system and the courts computer system. After swallowing large amounts of taxpayers’ money, they failed to deliver anything that worked. Their latest failure is the court translation service.. The president (Catto), the vice president (Harry Brunjes) and the CEO (Mark Ratnarajah) are all employees of Capita.
The second thing to notice is that their conferences and courses are a bizarre mixture of real medicine and pure quackery. Their 2012 conference had some very good speakers, but then it had a "herbal workshop" with Simon Mills (see a video) and David Peters (the man who tolerates dowsing as a way to diagnose which herb to give you). The other speaker was Dick Middleton, who represents the huge herbal company, Schwabe (I debated with him on BBC Breakfast), In fact the College’s Faculty of Self-care appears to resemble a marketing device for Schwabe.
Why regulation isn’t working, and can’t work
There are various levels of regulation. The "highest" level is the statutory regulation of osteopathy and chiropractic. The General Chiropractic Council (GCC) has exactly the same legal status as the General Medical Council (GMC). This ludicrous state of affairs arose because nobody in John Major’s government had enough scientific knowledge to realise that chiropractic, and some parts of osteopathy, are pure quackery,
The problem is that organisations like the GCC function more to promote chiropractic than to regulate them. This became very obvious when the British Chiropractic Association (BCA) decided to sue Simon Singh for defamation, after he described some of their treatments as “bogus”, “without a jot of evidence”.
In order to support Singh, several bloggers assessed the "plethora of evidence" which the BCA said could be used to justify their claims. When, 15 months later, the BCA produced its "plethora" it was shown within 24 hours that the evidence was pathetic. The demolition was summarised by lawyer, David Allen Green, in The BCA’s Worst Day.
In the wake of this, over 600 complaints were made to the GCC about unjustified claims made by chiropractors, thanks in large part to heroic work by two people, Simon Perry and Allan Henness. Simon Perry’s Fishbarrel (browser plugin) allows complaints to be made quickly and easily -try it). The majority of these complaints were rejected by the GCC, apparently on the grounds that chiropractors could not be blamed because the false claims had been endorsed by the GCC itself.
My own complaint was based on phone calls to two chiropractors, I was told such nonsense as "colic is down to, er um, faulty movement patterns in the spine". But my complaint never reached the Conduct and Competence committee because it had been judged by a preliminary investigating committee that there was no case to answer. The impression one got from this (very costly) exercise was that the GCC was there to protect chiropractors, not to protect the public.
The outcome was a disaster for chiropractors, wno emerged totally discredited. It was also a disaster for the GCC which was forced to admit that it hadn’t properly advised chiropractors about what they could and couldn’t claim. The recantation culminated in the GCC declaring, in August 2010, that the mythical "subluxation" is a "historical concept " "It is not supported by any clinical research evidence that would allow claims to be made that it is the cause of disease.". Subluxation was a product of the fevered imagination of the founder of the chiropractic cult, D.D. Palmer. It referred to an imaginary spinal lesion that he claimed to be the cause of most diseases. .Since ‘subluxation’ is the only thing that’s distinguished chiropractic from any other sort of manipulation, the admission by the GCC that it does not exist, after a century of pretending that it does, is quite an admission.
The President of the BCA himself admitted in November 2011
“The BCA sued Simon Singh personally for libel. In doing so, the BCA began one of the darkest periods in its history; one that was ultimately to cost it financially,”
As a result of all this, the deficiencies of chiropractic, and the deficiencies of its regulator were revealed, and advertisements for chiropractic are somewhat less misleading. But this change for the better was brought about entirely by the unpaid efforts of bloggers and a few journalists, and not at all by the official regulator, the GCC. which was part of the problem. not the solution. And it was certainly not helped by the organisation that is meant to regulate the GCC, the Council for Health Regulatory Excellence (CHRE) which did nothing whatsoever to stop the farce.
At the other end of the regulatory spectrum, voluntary self-regulation, is an even worse farce than the GCC. They all have grand sounding "Codes of Practice" which, in practice, the ignore totally.
The Society of Homeopaths is just a joke. When homeopaths were caught out recommending sugar pills for prevention of malaria, they did nothing (arguably such homicidal advice deserves a jail sentence).
The Complementary and Natural Healthcare Council (CNHC) is widely know in the blogosphere as Ofquack. I know about them from the inside, having been a member of their Conduct and Competence Committee, It was set up with the help of a £900,000 grant from the Department of Health to the Prince of Wales, to oversee voluntary self-regulation. It fails utterly to do anything useful.. The CNHC code of practice, paragraph 15 , states
“Any advertising you undertake in relation to your professional activities must be accurate. Advertisements must not be misleading, false, unfair or exaggerated”.
When Simon Perry made a complaint to the CNHC about claims being made by a CNHC-registered reflexologist, the Investigating Committee upheld all 15 complaints. But it then went on to say that there was no case to answer because the unjustified claims were what the person had been taught, and were made in good faith.
This is precisely the ludicrous situation which will occur again and again if reflexologists (and many other alternative therapies) are “accredited”. The CNHC said, correctly, that the reflexologist had been taught things that were not true, but then did nothing whatsoever about it apart from toning down the advertisements a bit. They still register reflexologists who make outrageously false claims.
Once again we see that no sensible regulation is possible for subjects that are pure make-believe.
The first two examples deal (or rather, fail to deal) with regulation of outright quackery. But there are dozens of other quangos that sound a lot more respectable.
European Food Standards Agency (EFSA). One of the common scams is to have have your favourite quack treatment classified as a food not as a medicine. The laws about what you can claim have been a lot laxer for foods. But the EFSA has done a pretty good job in stopping unjustified claims for health benefits from foods. Dozens of claims made by makers of probiotics have been banned. The food industry, needless to say, objects very strongly to be being forced to tell the truth. In my view, the ESFA has not gone far enough. They recently issued a directive about claims that could legally be made. Some of these betray the previously high standards of the EFSA. For example you are allowed to say that "Vitamin C contributes to the reduction of tiredness and fatigue" (as long as the product contains above a specified amount of Vitamin C. I’m not aware of any trials that show vitamin C has the slightest effect on tiredness or fatigue, Although these laws do not come into effect until December 2012, they have already been invoked by the ASA has a reason not to uphold a complaint about a multivitamin pill which claimed that it “Includes 8 nutrients that can contribute to the reduction in tiredness and fatigue”
The Advertising Standards Authority (ASA). This is almost the only organisation that has done a good job on false health claims. Their Guidance on Health Therapies & Evidence says
"Whether you use the words ‘treatment’, ‘treat’ or ‘cure’, all are likely to be seen by members of the public as claims to alleviate effectively a condition or symptom. We would advise that they are not used"
"Before and after’ studies with little or no control, studies without human subjects, self-assessment studies and anecdotal evidence are unlikely to be considered acceptable"
"Before and after’ studies with little or no control, studies without human subjects, self-assessment studies and anecdotal evidence are unlikely to be considered acceptable"
They are spot on.
The ASA’s Guidance for Advertisers of Homeopathic Services is wonderful.
"In the simplest terms, you should avoid using efficacy claims, whether implied or direct,"
"To date, the ASA has have not seen persuasive evidence to support claims that homeopathy can treat, cure or relieve specific conditions or symptoms."
That seems to condemn the (mis)labelling allowed by the MHRA as breaking the rules.. Sadly, though, the ASA has no powers to enforce its decisions and only too often they are ignored. The Nightingale collaboration has produced an excellent letter that you can hand to any pharmacist who breaks the rules
The ASA has also judged against claims made by "Craniosacral therapists" (that’s the lunatic fringe of osteopathy). They will presumably uphold complaints about similar claims made (I’m ashamed to say) by UCLH Hospitals.
The private examination company Edexcel sets exams in antiscientific subjects, so miseducating children. The teaching of quackery to 16 year-olds has been approved by a maze of quangos, none of which will take responsibility, or justify their actions. So far I’ve located no fewer than eight of them. The Office of the Qualifications and Examinations Regulator (OfQual), Edexcel, the Qualifications and Curriculum Authority (QCA), Skills for Health, Skills for Care, National Occupational Standards (NOS), private exam company VTCT and the schools inspectorate, Ofsted.. Asking any of these people why they approve of examinations in imaginary subjects meets with blank incomprehension. They fail totally to protect tha public from utter nonsense.
The Department of Education has failed to do anything about the miseducation of children in quackery. In fact it has encouraged it by, for the first time, giving taxpayers’ money to a Steiner (Waldorf) school (at Frome, in Somerset). Steiner schools are run by a secretive and cult-like body of people (read about it). They teach about reincarnation, karma, gnomes, and all manner of nonsense, sometimes with unpleasant racial overtones. The teachers are trained in Steiner’s Anthroposophy, so if your child gets ill at school they’ll probably get homeopathic sugar pills. They might well get measles or mumps too, since Steiner people don’t believe in vaccination.
Incredibly, the University of Aberdeen came perilously close to appointing a chair in anthroposophical medicine. This disaster was aborted by bloggers, and a last minute intervention from journalists. Neither the university’s regulatory mechanisms. nor any others, seemed to realise that a chair in mystical barmpottery was a bad idea.
Trading Standards offices and the Office of Fair Trading.
It is the statutory duty of Trading Standards to enforce the Consumer Protection Regulations (2008) This European legislation is pretty good. it caused a lawyer to write " Has The UK Quietly Outlawed “Alternative” Medicine?". Unfortunately Trading Standards people have consistently refused to enforce these laws. The whole organisation is a mess. Its local office arrangement fails totally to deal with the age of the internet. The situation is so bad that a group of us decided to put them to the test. The results were published in the Medico-Legal Journal, Rose et al., 2012. "Spurious Claims for Health-care Products: An Experimental Approach to Evaluating Current UK Legislation and its Implementation". They concluded "EU directive 2005/29/EC is
largely ineffective in preventing misleading health claims for consumer products in
the UK"
Skills for Health is an enormous quango which produces HR style "competences" for everything under the son. They are mostly quite useless. But those concerned with alternative medicine are not just useless. They are positively harmful. Totally barmy. There are competences and National Occupational Standards for every lunatic made-up therapy under the sun. When I phoned them to discover who’d written them, I learned that the had been drafted by the Prince of Wales’ Foundation for Magic Medicine. And when I joked by asking if they had a competence for talking to trees, I was told, perfectly seriously, “You’d have to talk to LANTRA, the land-based organisation for that.”
That was in January 2008. A lot of correspondence with the head of Skills for Health got nowhere at all. She understood nothing and it hasn’t improved a jot.
This organisation costs a lot of taxpayers’ money and it should have been consigned to the "bonfire of the quangos" (but of course there was no such bonfire in reality). It is a disgrace.
The Quality Assurance Agency (QAA) is supposed to ensure the quality of university courses. In fact it endorses courses in nonsense alternative medicine and so does more harm than good. The worst recent failure of the QAA was in the case of the University of Wales: see Scandal of the University of Wales and the Quality Assurance Agency. The university was making money by validating thousands of external degrees in everything from fundamentalist theology to Chinese Medicine. These validations were revealed as utterly incompetent by bloggers, and later by BBC Wales journalist Ciaran Jenkins (now working for Channel 4).
The mainstream media eventually caught up with bloggers. In 2010, BBC1 TV (Wales) produced an excellent TV programme that exposed the enormous degree validation scam run by the University of Wales. The programme can be seen on YouTube (Part 1, and Part 2). The programme also exposed, incidentally, the uselessness of the Quality Assurance Agency (QAA) which did nothing until the scam was exposed by TV and blogs. Eventually the QAA sent nine people to Malaysia to investigate a dodgy college that had been revealed by the BBC. The trip cost £91,000. It could have been done for nothing if anyone at the QAA knew how to use Google.
The outcome was that the University of Wales stopped endorsing external courses, and it was soon shut down altogether (though bafflingly, its vice-chancellor, Marc Clement was promoted). The credit for this lies entirely with bloggers and the BBC. The QAA did nothing to help until the very last moment.
Throughout this saga Universities UK (UUK), has maintained its usual total passivity. They have done nothing whatsoever about their members who give BSc degrees in anti-scientific subjects. (UUK used to known as the Committee of Vice-Chancellors and Principals).
Council for Health Regulatory Excellence (CHRE), soon to become the PSAHSC,
Back now to the CHRE, the people who failed so signally to sort out the GCC. They are being reorganised. Their consultation document says
"The Health and Social Care Act 20122 confers a new function on the Professional Standards Authority for Health and Social Care (the renamed Council for Healthcare Regulatory Excellence). From November 2012 we will set standards for organisations that hold voluntary registers for people working in health and social care occupations and we will accredit the register if they meet those standards. It will then be known as an ‘Accredited Register’. "
They are trying to decide what the criteria should be for "accreditation" of a regulatory body. The list of those interested has some perfectly respectable organisations, like the British Psychological Society. It also contains a large number of crackpot organisations, like Crystal and Healing International, as well as joke regulators like the CNHC.
They already oversee the Health Professions Council (HPC) which is due to take over Herbal medicine and Traditional Chinese Medicine, with predictably disastrous consequences.
Two of the proposed criteria for "accreditation" appear to be directly contradictory.
Para 2.5 makes the whole accreditation pointless from the point of view of patients
2.5 It will not be an endorsement of the therapeutic validity or effectiveness of any particular discipline or treatment.
Since the only thing that matters to the patient is whether the therapy works (and is safe), accrediting of organisations that ignore this will merely give the appearance of official approval of crystal healing etc etc. This appears to contradict directly
A.7 The organisation can demonstrate that there either is a sound knowledge base underpinning the profession or it is developing one and makes that explicit to the public.
A "sound knowledge base", if it is to mean anything useful at all, means knowledge that the treatment is effective. If it doesn’t mean that, what does it mean?
It seems that the official mind has still not grasped the obvious fact that there can be no sensible regulation of subjects that are untrue nonsense. If it is nonsense, the only form of regulation that makes any sense is the law.
Please fill in the consultation. My completed return can be downloaded as an example, if you wish.
Medicines and Healthcare products Regulatory Agency (MHRA) should be a top level defender of truth. Its strapline is
"We enhance and safeguard the health of the public by ensuring that medicines and medical devices work and are acceptably safe."
The MHRA did something (they won’t tell me exactly what) about one of the most cruel scams that I’ve ever encountered, Esperanza Homeopathic Neuropeptide, peddled for multiple sclerosis, at an outrageous price ( £6,759 for 12 month’s supply). Needless to say there was not a jot of evidence that it worked (and it wasn’t actually homeopathic).
Astoundingly, Trading Standards officers refused to do anything about it.
The MHRA admit (when pushed really hard) that there is precious little evidence that any of the herbs work, and that homeopathy is nothing more than sugar pills. Their answer to that is to forget that bit about "ensuring that medicines … work"
Here’s the MHRA’s Traditional Herbal Registration Certificate for devils claw tablets.
The wording "based on traditional use only" has to be included because of European legislation. Shockingly, the MHRA have allowed them to relegate that to small print, with all the emphasis on the alleged indications. The pro-CAM agency NCCAM rates devil’s claw as "possibly effective" or "insufficient evidence" for all these indications, but that doesn’t matter because the MHRA requires no evidence whatsoever that the tablets do anything. They should, of course, added a statement to this effect to the label. They have failed in their duty to protect and inform the public by allowing this labelling.
But it gets worse. Here is the MHRA’s homeopathic marketing authorisation for the homeopathic medicinal product Arnicare Arnica 30c pillules
It is nothing short of surreal.
|
|
Since the pills contain nothing at all, they don’t have the slightest effect on sprains, muscular aches or bruising. The wording on the label is exceedingly misleading.
If you "pregnant or breastfeeding" there is no need to waste you doctor’s time before swallowing a few sugar pills.
"Do not take a double dose to make up for a missed one". Since the pills contain nothing, it doesn’t matter a damn.
"If you overdose . . " it won’t have the slightest effect because there is nothing in them
And it gets worse. The MHRA-approved label specifies ACTIVE INGREDIENT. Each pillule contains 30c Arnica Montana
No, they contain no arnica whatsoever.
|
|
It truly boggles the mind that men with dark suits and lots of letters after their names have sat for hours only to produce dishonest and misleading labels like these.
When this mislabeling was first allowed, it was condemned by just about every scientific society, but the MHRA did nothing.
The Nightingale Collaboration.
This is an excellent organisation, set up by two very smart skeptics, Alan Henness and Maria MacLachlan. Visit their site regularly, sign up for their newsletter Help with their campaigns. Make a difference.
Conclusions
The regulation of alternative medicine in the UK is a farce. It is utterly ineffective in preventing deception of patients.
Such improvements as have occurred have resulted from the activity of bloggers, and sometime the mainstream media. All the official regulators have, to varying extents, made things worse.
The CHRE proposals promise to make matters still worse by offering "accreditation" to organisations that promote nonsensical quackery. None of the official regulators seem to be able to grasp the obvious fact that is impossible to have any sensible regulation of people who promote nonsensical untruths. One gets the impression that politicians are more concerned to protect the homeopathic (etc, etc) industry than they are to protect patients.
Deception by advocates of alternative medicine harms patients. There are adequate laws that make such deception illegal, but they are not being enforced. The CHRE and its successor should restrict themselves to real medicine. The money that they spend on pseudo-regulation of quacks should be transferred to the MHRA or a reformed Trading Standards organisation so they can afford to investigate and prosecute breaches of the law. That is the only form of regulation that makes sense.
Follow-up
The shocking case of the continuing sale of “homeopathic vaccines” for meningitis, rubella, pertussis etc was highlighted in an excellent TV programme by BBC South West. The failure of the MHRA and the GPC do take any effective action is a yet another illustration of the failure of regulators to do their job. I have to agree with Andy Lewis when he concludes
“Children will die. And the fault must lie with Professor Sir Kent Woods, chairman of the regulator.”
Although many university courses in quackery have now closed, two subjects that hang on in a few places are western herbalism, and traditional Chinese medicine (including acupuncture). The University of Westminster still runs Chinese medicine, and Western herbal medicine (with dowsing). So do the University of Middlesex and University of East London.
Since the passing of the Health and Social Security Act, these people have been busy with their customary bait and switch tactics, trying to get taxpayers’ money. It’s worth looking again at the nonsense these people talk.
Take for example, the well known herbalist, Simon Mills. At one time he was associated with the University of Exeter, but no longer. Perhaps his views are too weird even for their Third Gap section (the folks who so misrepresented their results in a trial of acupuncture). Unsurprisingly, he was involved in the late Prince’s Foundation for Magic Medicine, and, unsurprisingly, he is involved with its successor, the "College of Medicine", where he spoke along similar lines. You can get a good idea about his views from the video of a talk that he gave at Schumacher College in 2005. It’s rather long, and exceedingly uncritical, so here’s a shorter version to which some helpful captions have been added.
That talk is weird by any standards. He says, apparently with a straight face, that "all modern medicines are cold in the third degree"..And with ginger and cinnamon "You can stop a cold, generally speaking, in its tracks" (at 21′ 30" in the video). This is simply not true, but he says it, despite the fact that the Plant Medicine with site (of which he’s a director) which he is associated gives them low ratings
Simon Mills is also a director of SustainCare. Their web site says
SustainCare Community Interest Company is a social enterprise set up to return health care to its owners: “learning to look after ourselves and our families in ways that make sense and do not cost the earth“. It is founded on the principle that one’s health is a personal story, and that illness is best managed when we make our health care our own. The enterprise brings clinical expertise, long experience of academia, education and business, and the connections and resources to deliver new approaches.
"As its own social enterprise contribution to this project Sustaincare set up and supported Café Sustain as a demonstration Intelligent Waiting Room at Culm Valley Integrated Centre for Health in Devon". (yes, that’s Michael Dixon, again]
In the talk (see video) Mills appears to want to take medicine back to how it was 1900 years ago, in the time of Galen. The oblique speaking style is fascinating. He never quite admits that he thinks all that nonsense is true, but presumably it is how he treats patients. Yet a person with these bizarre pre-scientific ideas is thought appropriate to advise the MHRA
It’s characteristic of herbalists that they have a very long list of conditions for which each herb is said to be good. The sort of things said by Mills differ little from the 1900-year old ideas of Galen, io the 17th century ideas of Culpepper.
You can see some of the latter in my oldest book, Blagrave’s supplement to Culpepper’s famous herbal, published in 1674.
See what he has to say about daffodils
It is "under the dominion of Mars, and the roots hereof are hot and dry almost in the third degree".
"The root, boyled in posset drink, and drunk, causeth vomiting, and is used with good successe in the beginning of Agues, especiallyTertians, which frequently rage in the spring-time: a plaister made of the roots with parched Barley meal, and applied to swellings and imposthumes do dissolve them; the juice mingled with hony, frankincense, wine and myrrhe, and dropped into the Eares, is good against the corrupt filth and running matter of the Eares; the roots made hollow and boyled in oyl doth help Kib’d heels [or here]: the juice of the root is good for Morphew, and discolourings of the skin."
It seems that daffodils would do a lot in 1674. Even herbalists don’t seem to use it much now. A recent herbal site describes daffodil as "poisonous".
But the descriptions are very like those used by present day herbalists, as you can hear in Simon Mills’ talk.
Chinese medicine is even less tested than western herbs. Not a single Chinese herb has been shown to be useful for treating anything (though in a very few case, they have been found to contain drugs that are useful when purified, notably the anti-malarial compound, artemesinin). They are often contaminated, some are dangerously toxic. And they contribute to the extinction of tigers and rhinoceros because of the silly myths that these make useful medicines. The cruelty of bear bile farming is legendary.
In a recent report in China Daily (my emphasis).
In a congratulation letter, Vice-Premier Li Keqiang called for integration of TCM and Western medicine.
TCM, as a time-honored treasure of Chinese civilization, has contributed to the prosperity of China and brought impacts to world civilization, Li said.
He also urged medical workers to combine the merits of TCM with contemporary medicine to better facilitate the ongoing healthcare reform in China.
The trade in Chinese medicines survives only for two reasons. One is that thay are a useful tool for promoting Chinese nationalism. The other is that they are big business. Both are evident in the vice-premier’s statement.
I presume that it’s the business bit that is the reason why London South Bank University (ranked 114 ou ot 114) that led to one of their main lecture theatres being decorated with pictures like this.“Mr Li Changchun awarding 2010 Confucius Institute of the year to LSBU Vice Chancellor” . I’ll bet Mr Li Changchun uses real medicine himself, as most Chinese who can afford it do.
Presumably, what’s taught in their Confucius Institute is the same sort of dangerous make-believe nonsense.that’s taught on other such courses.
The "College of Medicine" run a classical bait and switch operation. Their "First Thursday lectures" have several good respectable speakers, but then they have Andrew Flower, He is "a former president of the Register of Chinese Herbal Medicine, a medical herbalist and acupuncturist. He has recently completed a PhD exploring the role of Chinese herbal medicine in the treatment of endometriosis". He’s associated with the Avicenna Centre for Chinese Medicine, and with the University of Southampton’s quack division The only bit of research I could find by Andrew Flower was a Cochrane review, Chinese herbal medicine for endometriosis. The main results tell us
"Two Chinese RCTs involving 158 women were included in this review. Both these trials described adequate methodology. Neither trial compared CHM with placebo treatment."
But the plain language summary says
"This review suggests that Chinese herbal medicine (CHM) may be useful in relieving endometriosis-related pain with fewer side effects than experienced with conventional treatment."
It sounds to me as though people as partisan as the authors of this should not be allowed to write Cochrane reviews.
Flower’s talk is followed by one from the notorious representative of the herbal industry, Michael McIntyre, talking on Herbal medicine: A major resource for the 21st century. That’s likely to be about as objective as if they’d invited a GSK drug rep to talk about SSRIs.
The people at Kings College London Institute of Pharmaceutical Sciences are most certainly not quacks. They have made a database of chemicals found in traditional Chinese medicine. It’s sold by a US company, Chem-TCM and it’s very expensive (Commercial license: $3,740.00. Academic/government license: $1,850.00). Not much open access there. It’s a good idea to look at chemicals of plant origin, but only as long as you don’t get sucked into the myths. It’s only too easy to fall for the bait and switch of quacks (like TCM salespeople). The sample page shows good chemical and botanical information, and predicted (not observed) pharmacological activity. More bizarrely, it shows also analysis of the actions claimed by TCM people.
It does seem odd to me to apply sophisticated classification methods to things that are mostly myth.
The multiple uses claimed for Chinese medicines are very like the make-believe claims made for western herbs by Galen, Culpepper and (with much less excuse) by Mills.
They are almost all untrue, but their proponents are good salesmen. Don’t let them get a foot in your door.
Follow-up
10 June 2012. No sooner did this post go public when I can across what must be one of the worst herbal scams ever: “Arthroplex“
31 July 2012. Coffee is the subject of another entry in the 1674 edition of Blagrave.
Blagrave evidently had a lower regard for coffee than I have.
“But being pounded and baked, as do it to make the Coffee-liquor with, it then stinks most loathsomly, which is an argument of some Saturnine quality in it.”
“But there is no mention of an medicinal use thereof, by any Author either Antient of Modern”
Blagrave says also
“But this I may truly say of it [coffee]: Quod Anglorum Corpora quae huic liquori, tantopere indulgent, in Barbarorum naturam degenerasse videntur,”
This was translated expertly by Benet Salway, of UCL’s History department
“that the bodies of the English that indulge in this liquor to such an extent seem to degenerate into the nature of barbarians”
My boss, Lucia Sivolotti got something very like that herself. Be very impressed.
Salway suggested that clearer Latin would have been “quod corpora Anglorum, qui tantopere indulgent huic liquori, degenerasse in naturam barbarorum videntur”.
I’d have passed that on to Blagrave, but I can’t find his email address.
I much prefer Alfréd Rényi’s aphorism (often misattributed to Paul Erdös)
“A mathematician is a machine for turning coffee into theorems”
Almost all the revelations about what’s taught on university courses in alternative medicine have come from post-1992 universities. (For readers not in the UK, post-1992 universities are the many new univerities created in 1992, from former polytechnics etc, and Russell group universities are the "top 20" research-intensive universities)
It is true that all the undergraduate courses are in post-1992 universities, but the advance of quackademia is by no means limited to them. The teaching at St Bartholomew’s Hospital Medical School, one of the oldest, was pretty disgraceful for example, though after protests from their own students, and from me, it is now better, I believe.
Quackery creeps into all universities to varying extents. The good ones (like Southampton) don’t run "BSc" degrees, but it still infiltrates through two main sources,
The first is via their HR departments, which are run by people who tend to be (I quote) "credulous and moronic" when it comes to science.
The other main source is in teaching to medical students. The General Medical Council says that medical students must know something about alterantive medicine and that’s quite right, A lot of their patients will use it. The problem is that the guidance is shockingly vague .
“They must be aware that many patients are interested in and choose to use a range of alternative and complementary therapies. Graduates must be aware of the existence and range of such therapies, why some patients use them, and how these might affect other types of treatment that patients are receiving.” (from Tomorrow’s Doctors, GMC)
In many medical schools, the information that medical students get is quite accurate. At UCL and at King’s (London) I have done some of the familiarisation myself. In other good medical schools, the students get some shocking stuff. St Bartholomew’s Hospital medical School was one example. Edinburgh University was another.
But there is one Russell group university where alternative myths are propagated more than any other that I know about. That is the University of Southampton.
In general, Southampton is a good place, I worked there for three years myself (1972 – 1975). The very first noise spectra I measured were calculated on a PDP computer in their excellent Institute of Sound and Vibration Research, before I wrote my own programs to do it.
But Southanpton also has a The Complementary and Integrated Medicine Research Unit . Oddly the unit’s web site, http://www.cam-research-group.co.uk, is not a university address, and a search of the university’s web site for “Complementary and Integrated Medicine Research Unit” produces no result. Nevertheless the unit is “within the School of Medicine at the University of Southampton”
Notice the usual euphemisms ‘complementary’ and ‘integrated’ in the title: the word ‘alternative’ is never used. This sort of word play is part of the bait and switch approach of alternative medicine.
The unit is quite big: ten research staff, four PhD students and two support staff It is headed by George Lewith.
Teaching about alternative medicine to Southampton medical students.
The whole medical class seems to get quite a lot compared with other places I know about. That’s 250 students (210 on the 5-year course plus another 40 from the 4-year graduate-entry route).
Year 1: Lecture by David Owen on ‘holism’ within the Foundation Course given to all 210 medical students doing the standard (5-year) course.
Year 2: Lecture by Lewith (on complementary medicine, focusing on acupuncture for pain) given within the nervous systems course to the whole medical student year-group (210 students).
Year 3 SBOM (scientific basis of medicine) symposium: The 3-hour session (“Complementary or Alternative Medicine: You Decide”). I’m told that attendance at this symposium is often pretty low, but many do turn up and all of them are officially ‘expected’ to attend.
There is also an optional CAM special study module chosen by 20 students in year 3, but also a small number of medical students (perhaps 2 – 3 each year?) choose to do a BMedSci research project supervised by the CAM research group and involving 16-18 weeks of study from October to May in Year 4. The CAM research group also supervise postgraduate students doing PhD research.
As always, a list of lectures doesn’t tell you much. What we need to know is what’s taught to the students and something about the people who teach it. The other interesting question is how it comes about that alternative medicine has been allowed to become so prominent in a Russell group university. It must have support from on high. In this case it isn’t hard to find out where it comes from. Here are some details.
Year 1 Dr David Owen
David Owen is not part of Lewith’s group, but a member of the Division of Medical Education headed by Dr Faith Hill (of whom, more below). He’s one of the many part-time academics in this area, being also a founder of The Natural Practice .
Owen is an advocate of homeopathy (a past president of the Faculty of Homeopathy). Homeopathy is, of course, the most barmy and discredited of all the popular sorts of alternative medicine. Among those who have discredited it is the head of the alt med unit, George Lewith himself (though oddly he still prescribes it).
And he’s also a member of the British Society of Environmental Medicine (BSEM). That sounds like a very respectable title, but don’t be deceived. It is an organisation that promotes all sorts of seriously fringe ideas. All you have to do is notice that the star speaker at their 2011 conference was none other than used-to-be a doctor, Andrew Wakefield, a man who has been responsible for the death of children from measles by causing an unfounded scare about vaccination on the basis of data that turned out to have been falsified. There is still a letter of support for Wakefield on the BSEM web site.
The BSEM specialises in exaggerated claims about ‘environmental toxins’ and uses phony allergy tests like kinesiology and the Vega test that misdiagnose allergies, but provide en excuse to prescribe expensive but unproven nutritional supplements, or expensive psychobabble like "neuro-linguistic programming".
Other registered "ecological physicians" include the infamous Dr Sarah Myhill, who, in 2010, was the subject of a damning verdict by the GMC, and Southampton’s George Lewith.
If it is wrong to expose medical students to someone who believes that dose-response curves have a negative slope (the smaller the dose the bigger the effect -I know, it’s crazy), then it is downright wicked to expose students to a supporter of Andrew Wakefield.
David Owen’s appearance on Radio Oxford, with the indomitable Andy Lewis appears on his Quackometer blog.
Year 2 Dr George Lewith
Lewith is a mystery wrapped in an enigma. He’s participated in some research that is quite good by the (generally pathetic) standards of the world of alternative medicine.
In 2001 he showed that the Vega test did not work as a method of allergy diagnosis. "Conclusion Electrodermal testing cannot be used to diagnose environmental allergies", published in the BMJ .[download reprint].
In 2003 he published "A randomized, double-blind, placebo-controlled proving trial of Belladonna 30C” [download reprint] that showed homeopathic pills with no active ingredients had no effects: The conclusion was "”Ultramolecular homeopathy has no observable clinical effects" (the word ultramolecular, in this context, means that the belladonna pills contained no belladonna).
In 2010 he again concluded that homeopathic pills were no more than placebos, as described in Despite the spin, Lewith’s paper surely signals the end of homeopathy (again). [download reprint]
What i cannot understand is that, despite his own findings, his private practice continues to prescribe the Vega machine and continues to prescribe homeopathic pills. And he continues to preach this subject to unfortunate medical students.
Lewith is also one of the practitioners recommended by BSEM. He’s a director of the "College of Medicine". And he’s also an advisor to a charity called Yes To Life. (see A thoroughly dangerous charity: YesToLife promotes nonsense cancer treatments).
3rd year Student Selected Unit
The teaching team includes:
- David Owen – Principal Clinical Teaching Fellow SoM, Holistic Physician
- George Lewith – Professor of Health Research and Consultant Physician
- Caroline Eyles – Homeopathic Physician
- Susan Woodhead – Acupuncturist
- Elaine Cooke – Chiropractic Practitioner
- Phine Dahle – Psychotherapist
- Keith Carr – Reiki Master
- Christine Rose – Homeopath and GP
- David Nicolson – Nutritionalist
- Shelley Baker – Aromatherapist
- Cheryl Dunford – Hypnotherapist
- Dedj Leibbrandt – Herbalist
More details of the teaching team here. There is not a single sceptic among them, so the students don’t get a debate, just propaganda.
In this case. there’s no need for the Freedom of Information Act. The handouts. and the powerpoints are on their web site. They seem to be proud of them
Let’s look at some examples
Chiropractic makes an interesting case, because, in the wake of the Singh-BCA libel case, the claims of chiropractors have been scrutinised as never before and most of their claims have turned out to be bogus. There is a close relationship between Lewith’s unit and the Anglo-European Chiropractic College (the 3rd year module includes a visit there). In fact the handout provided for students, Evidence for Chiropractic Care , was written by the College. It’s interesting because it provides no real evidence whatsoever for the effectiveness of chiropractic care. It’s fairly honest in stating that the view at present is that, for low back pain, it isn’t possible to detect any difference between the usefulness of manipulation by a physiotherapist, by an osteopath or by a chiropractor. Of course it does not draw the obvious conclusion that this makes chiropractic and osteopathy entirely redundant -you can get the same result without all the absurd mumbo jumbo that chiropractors and osteopaths love, or their high-pressure salesmanship and superfluous X-rays. Neither does it mention the sad, but entirely possible, outcome that none of the manipulations are effective for low back pain. There is, for example, no mention of the fascinating paper by Artus et al [download reprint]. This paper concludes
"symptoms seem to improve in a similar pattern in clinical trials following a wide
variety of active as well as inactive treatments."
This paper was brought to my attention through the blog run by the exellent physiotherapist, Neil O’Connell. He comments
“If this finding is supported by future studies it might suggest that we can’t even claim victory through the non-specific effects of our interventions such as care, attention and placebo. People enrolled in trials for back pain may improve whatever you do. This is probably explained by the fact that patients enrol in a trial when their pain is at its worst which raises the murky spectre of regression to the mean and the beautiful phenomenon of natural recovery.”
This sort of critical thinking is conspicuously absent from this (and all the other) Southampton handouts. The handout is a superb example of bait and switch: No nonsense about infant colic, innate energy or imaginary subluxations appears in it.
Acupuncture is another interesting case because there is quite a lot of research evidence, in stark contrast to the rest of traditional Chinese medicine, for which there is very little research.
|
There is a powerpoint show by Susan Woodhead (though it is labelled British Acupuncture Council). The message is simple and totally uncritical. It works. |
|
In fact there is now a broad consensus about acupuncture.
(1) Real acupuncture and sham acupuncture have been found to be indistinguishable in many trials. This is the case regardless of whether the sham is a retractable needle (or even a toothpick) in the "right" places, or whether it is real needles inserted in the "wrong" places. The latter finding shows clearly that all that stuff about meridians and flow of Qi is sheer hocus pocus. It dates from a pre-scientific age and it was wrong.
(2) A non-blind comparison of acupuncture versus no acupuncture shows an advantage for acupuncture. But the advantage is usually too small to be of any clinical significance. In all probability it is a placebo effect -it’s hard to imagine a more theatrical event than having someone in a white coat stick long needles into you, like a voodoo doll. Sadly, the placebo effect isn’t big enough to be of much use.
Needless to say, none of this is conveyed to the medical students of Southampton. Instead they are shown crude ancient ideas that date from long before anything was known about physiology as though they were actually true. These folks truly live in some alternative universe. Here are some samples from the acupuncture powerpoint show by Susan Woodhead.
Well this is certainly a "different diagnostic language", but no attempt is made to say which one is right. In the mind of the acupuncurist it seems both are true. It is a characteristic of alternative medicine advocates that they have no difficulty in believing simultaneously several mutually contradictory propositions.
As a final exmple of barminess, just look at the acupuncture points (allegedly) on the ear The fact that it is a favoured by some people in the Pentagon as battlefield acupuncture, is more reminiscent of the mad general, Jack D. Ripper, in Dr Strangelove than it is of science.
There is an equally uncritical handout on acupuncture by Val Hopwood. It’s dated March 2003, a time before some of the most valuable experiments were done.
The handout says "sham acupuncture
is generally less effective than true acupuncture", precisely the opposite of what’s known now. And there are some bits that give you a good laugh, always helpful in teaching. I like
“There is little doubt that an intact functioning nervous system is required for acupuncture to produce
analgesia or, for that matter, any physiological changes”
and
Modern techniques: These include hybrid techniques such as electro-acupuncture . . . and Ryadoraku [sic] therapy and Vega testing.
Vega testing!! That’s been disproved dozens of times (not least by George Lewith). And actually the other made-up nonsense is spelled Ryodoraku.
It’s true that there is a short paragraph at the end of the handout headed "Scientific evaluation of acupuncture" but it doesn’t cite a single reference and reads more like excuses for why acupuncture so often fails when it’s tested properly.
Homeopathy. Finally a bit about that most boring of topics, the laughable medicine that contains no medicine, homeopathy. Caroline Eyles is a member for the Society of Homeopaths, the organisation that did nothing when its members were caught out in the murderous practice of recommending homeopathy for prevention of malaria. The Society of Homeopaths also endorses Jeremy Sherr, a man so crazy that he believes he can cure AIDS and malaria with sugar pills.
The homeopathy handout given to the students has 367 references, but somehow manages to omit the references to their own boss’s work showing that the pills are placebos. The handout has all the sciencey-sounding words, abused by people who don’t understand them.
"The remedy will be particularly effective if matched to the specific/particular characteristics of the individual (the ‘totality’ of the patient) on all levels, including the emotional and mental levels, as well as just the physical symptoms. ‘Resonance’ with the remedy’s curative power will then be at it’s [sic] best."
The handout is totally misleading about the current state of research. It says
"increasing clinical research confirms it’s [sic] clinical effectiveness in treating patients, including babies and animals (where a placebo effect would be hard to justify)."
|
The powerpont show by Caroline Eyles shows all the insight of a mediaeval vitalist |
|
Anyone who has to rely on the utterly discredited Jacques Benveniste as evidence is clearly clutching at straws. What’s more interesting about this slide the admission that "reproducibility is a problem -oops, an issue" and that RCTs (done largely by homeopaths of course) have "various methodological flaws and poor external validity". You’d think that if that was the best that could be produced after 200 yours, they’d shut up shop and get another job. But, like aging vicars who long since stopped believing in god, but are damned if they’ll give up the nice country rectory, they struggle on, sounding increasingly desperate.
How have topics like this become so embedded in a medical course at a Russell group university?
The details above are a bit tedious and repetitive. It’s already established that hardly any alternative medicine works. Don’t take my word for it. Check the web site of the US National Center for Complementary and Alternative Medicine (NCCAM) who, at a cost of over $2 billion have produced nothing useful.
A rather more interesting question is how a good university like Southampton comes to be exposing its medical students to teaching like this. There must be some powerful allies higher up in the university. In this case it’s pretty obvious who thay are.
Professor Stephen Holgate MD DSc CSc FRCP FRCPath FIBiol FBMS FMed Sci CBE has to be the primary suspect, He’s listed as one of Southampton’s Outstanding Academics. His work is nothing to do with alternative medicine but he’s been a long term supporter of the late unlamented Prince of Wales’ Foundation, and he’s now on the advisory board of it’s successor, the so called "College of Medicine" (for more information about that place see the new “College of Medicine” arising from the ashes of the Prince’s Foundation for Integrated Health, and also Don’t be deceived. The new “College of Medicine” is a fraud and delusion ). His description on that site reads thus.
"Stephen Holgate is MRC Clinical Professor of Immunopharmacology at the University of Southampton School of Medicine and Honorary Consultant Physician at Southampton University Hospital Trust. He is also chair of the MRC’s Populations and Systems Medicine Board. Specialising in respiratory medicine, he is the author of over 800 peer-reviewed papers and contributions to scientific journals and editor of major textbooks on asthma and rhinitis. He is Co-Editor of Clinical and Experimental Allergy, Associate Editor of Clinical Science and on the editorial board of 25 other scientific journals."
Clearly a busy man. Personally I’m deeply suspicious of anyone who claims to be the author of over 800 papers. He graduated in medicine in 1971, so that is an average of over 20 papers a year since then, one every two or three weeks. I’d have trouble reading that many, never mind writing them.
Holgate’s long-standing interest in alternative medicine is baffling. He’s published on the topic with George Lewith, who, incidentally, is one of the directors of the "College of Medicine"..
It may be unkind to mention that, for many years now, I’ve been hearing rumours that Holgate is suffering from an unusually bad case of Knight starvation.
The Division of Medical Education appears to be the other big source of support for. anti-scientific medicine. That is very odd, I know, but it was also the medical education people who were responsible for mis-educating medical students at. St. Bartholomew’s and at Edinburgh university. Southampton’s Division of Medical Education has a mind-boggling 60 academic and support staff. Two of them are of particular interest here.
Faith Hill is director of the division. Her profile doesn’t say anything about alternative medicine, but her interest is clear from a 2003 paper, Complementary and alternative medicine: the next generation of health promotion?. The research consisted of reporting anecdotes from interviews of 52 unnamed people (this sort of thing seems to pass for research in the social sciences). It starts badly by misrepresenting the conclusions of the House of Lords report (2000) on CAM. Although it comes to no useful conclusions, it certainly shows a high tolerance of nonsensical treatments.
Chris Stephens is Associate Dean of Medical Education & Student Experience. His sympathy is shown by a paper he wrote In 2001, with David Owen (the homeopath, above) and George Lewith: Can doctors respond to patients’ increasing interest in complementary and alternative medicine?. Two of the conclusions of this paper were as follows.
"Doctors are training in complementary and alternative medicine and report benefits both for their patients and themselves"
Well, no actually. It wasn’t true then, and it’s probably even less true now. There’s now a lot more evidence and most of it shows alternative medicine doesn’t work.
"Doctors need to address training in and practice of complementary and alternative medicine within their own organisations"
Yes they certainly need to do that.
And the first thing that Drs Hill and Stephens should do is look a bit more closely about what’s taught in their own university, I hope that this post helps them,
Follow-up
4 July 2011. A correspondent has just pointed out that Chris Stephens is a member of the General Chiropractic Council. The GCC is a truly pathetic pseudo-regulator. In the wake of the Simon Singh affair it has been kept busy fending off well-justified complaints against untrue claims made by chiropractors. The GCC is a sad joke, but it’s even sadder to see a Dean of Medical Education at the University of Southampton being involved with an organisation that has treated little matters of truth with such disdain.
A rather unkind tweet from (ex)-chiropractor @RichardLanigan.
“Chris is just another light weight academic who likes being on committees. Regulatory bodies are full of them”
One of my first posts about nonsense taught in universities was about the University of Westminster (April 2008): Westminster University BSc: “amethysts emit high yin energy”. since then, there have been several more revelations.
 Professor Petts |
The vice-cnancellor of Westminster, Professor Geoffrey Petts, with whom the buck stops, did have an internal review but its report was all hot air and no action resulted (see A letter to the Times, and Progress at Westminster). That earned Professor Petts an appearence in Private Eye Crystal balls. Professor Petts in Private Eye (and it earned me an invitation to a Private Eye lunch, along with Francis Wheen, Charlie Booker, Ken Livingstone . . ). It also earned Petts an appearence in the Guardian (The opposite of science). |
By that time Salford University had closed down all its CAM, and the University of Central Lancashire was running an honest internal review which resulted in closure of (almost) all of their nonsense degrees. But Westminster proved more resistant to sense and, although they closed down homeopathy, they still remain the largest single provider of degrees in junk medicine. See, for example More make-believe from the University of Westminster. This time it’s Naturopathy, and
The last BSc (Hons) Homeopathy closes! But look at what they still teach at Westminster University.
It’s interesting that Westminster always declined to comply with Freedom of Information requests, yet I had more from them than from most places. All the information about what’s taught at Westminster came from leaks from within the university. Westminster has more moles than a suburban garden. They were people with conscience who realised that the university was harming itself. They would claim that they were trying to save the university from some remarkably bad management. I claim also that I’m working in the interests of the university.
In the wake of the victory at the Information Tribunal, I sent a Freedom of Information Act (FOIA) request for for samples of teaching materials from all of their courses. This time they couldn’t legally refuse. The first batch has just arrived, so here are a few selected gems of utter nonsense. Well, it is worse than nonsense because it endangers the health of sick people.
A letter to the university from a student
Before getting on to the slides, here’s a letter that was supplied under FOIA. It was sent anonymously to the university. I was told that this was the only letter of complaint but I happen to know that’s not true so I’ve asked again. This one was forwarded to the vice-chancellor in 2008, and to the review committee. Both seem to have ignored it. Judging from the wording, one would guess that it came from one of their own undergraduates. :Here are some extracts.[download whole letter]
|
It is a flagrant contradiction of a ‘science’ in the BSc to have these practices, but it also jeopardises our profession, which is under DoH review and being constantly attacked in the media Gustifiable I suggest). We are taught that simply tasting plant tinctures can tell us which part of the body they work. on and what they do in the body. We are given printed charts with an outline of the body on to record our findings on. This is both nonsense, but is dangerous as it implies that the pharmacology of plant tinctures can be divined by taste alone. In class we are taught that we can divine the drug actions or use of an unknown plant simply by tasting an alcohol extract. Science? or dangerous fantasy. There are lecturers taking clinics who allow students to dowse and partake themselves in dowsing or pendulums to diagnose and even to test suitability of plant drugs. Dowsing is taught to us by some lecturers and frowned upon by others but we feel it brings the herbal medicine into a poor light as it is unscientific and bogus nonsense. We are concerned that we have seen the course leader brush over this practice as though she is frightened to make a stand. |
The letter seems to refer to a course in herbal medicine. That is a subject that could be studied scientifically, though to do so would leave students unemployed because so few herbal treatments have been shown to work. It obviously is not being studied scientifically: but even teaching students about dowsing and pendulums does not seem to have stirred the vice-chancellor into action.
David Peters: wishful thinking?
David Peters is a nice man. He’s the Clinical Director of Westminster’s School of Integrated Health. I debated with him on the excellent Radio 4 Programme, Material World.
His lecture on "Complementary Healthcare in the NHS" showed some fine wishful thinking.
It shows the progress of the euphemisms that quacks use to try to gain respectability, but little else. Interestingly, later slides show a bit more realism.
So he has noticed that the tide has turned and that a lot of people are no longer willing to be palmed off with new age gobbledygook. And yes, courses are shutting. Perhaps his course will be the next to shut?
According to an internal Westminster email that found its way to me,
The following courses have been closed/identified for closure due to poor recruitment :
- BSc degrees in Homeopathy and Remedial Massage & Neuromuscular Therapy, students completing by September 2011
- MA degrees in International Community development, Community development and Faith-based Community development, students completing by September 2011
- BSc degree Complementary Medicine
- Graduate diploma BMS
The following courses have been identified as ‘at risk’ (School definition) and will be discussed at the APRG and University Review Group2, due to poor recruitment and high cost of delivery:
- Integrated Health Scheme: BSc Complementary Medicine, Naturopathy; BSc Chinese Medicine; BSc Nutritional Therapy; BSc Herbal Medicine
The BSc (Hons) degree in naturopathy
Naturopathy us pretty bizarre, because it consists largely of doing nothing at all, beyond eating vegetables . Being ill is good for you.
Perhaps the best source to judge claims is the US National Center for Complementary and Alternive Medicine (NCCAM), a branch of the National Institutes of Health. This is the outfit that has spent over a billion dollars of US taxpayers’ money testing alternative medicines and for all that money has not come up with a single useful treatment. They never link to any sort of critical comment, and are nothing if not biassed towards all things alternative. If they can’t come up with evidence. nobody can. Two useful links to NCCAM are Herbs at a glance, and Health Topics A – Z.
Uses of herbal teas in naturopathic dietary care
I was sent a set of over 50 slides on "Herbal Teas/Decoctions (3CMWS03, 1/02, Uses of herbal teas in naturopathic dietary care). About half of them amount to little more than ‘how to make a cup of tea’. but then we get onto uses, but then a lot of fantasy ensues.
What NNCAM says about dandelion. There is no compelling scientific evidence for using dandelion as a treatment for any medical condition.
What Westminster says
Well I know what a diuretic is, but "blood purifier" and "liver tonic" are meaningless gobbledygook. We’ve been through this before with Red Clover (see Michael Quinion’s .look at the term "blood cleanser"). Using words like them is the very opposite of education.
What NCCAM says.about chamomile: Chamomile has not been well studied in people so there is little evidence to support its use for any condition.
What Westminster says
So, judging by NCCAM, these claims are unjustified. It’s teaching folk-lore as though it meant something.
More dangerous advice comes when we get to the ‘repertories’.
Infections can kill you, They are one of the modest number of things that pharmacology can usually cure, rather than treat symptomatically. If you go to a Westminster-trained naturopath with a serious infection and follow their advice to put garlic in your socks, you will not just be smelly, You could die.
Allergy and Intolerance 3CMwS03 18/02
|
Treating allergies, misdiagnosed by fraudulent tests, is very big business for the ‘health food industry’, This lecture, by R. Newman Turner ND, DO, BAc, started tolerably but descended to a nadir when it mentions, apparently seriously, two of the best known fraudulent methods of allergy diagnosis, the Vega test and "Applied Kinesiology". Kinesiology Sounds sort of sciencey, but Applied Kinesiology is actually a fraudulent and totally ineffective diagnostic method invented by (you guessed) a chiropractor. It has been widely used by alternative medicine to misdiagnose food allergies. It does not work (Garrow, 1988: download reprint). |
|
Could this be the same R Newman Turner who wrote a book on Naturopathic First Aid? The mind boggles.
Naturopathic Detoxification 23 CMES03 25/02 Detox Myth of Fact
|
This lecture was the responsibility of Irving S Boxer ND DO MRN LCH, a naturopath, homeopath and osteopath in private practice. Don’t be fooled by the implied question in the title. It might have been taken to suggest a critical approach. Think again. There is all the usual make-believe about unspecified and imaginary toxins that you must get rid of with enemas and vegetables. |
|
|
The skin brushing does not quite plumb the depths of Jacqueline Young’s Taking an air bath , but presumably it is something similar. "Liver activation" by castor oil packs is pure unadulterated gobblydygook. The words mean nothing. Their attempt to divide all foods into those that cleanse and those that clog sounds reminiscent of the Daily Mail’s ontological oncology project. |
 
|
The practice of healing (3CMSS01 2/12)
Next we retreat still further into fantasy land
|
|
All pure hokum, of course’ She could have added "craniosacral therapy" (at present the subject of a complaint against the UCL Hospitals Trust (that’s the NHS, not UCL) to the Advertising Standards Authority,
 |
 |
Is that definition quite clear?
In fact this sort of nonsense about rays coming from your hands was disproved experimentally, in a rather famous paper, the only paper in the Journal of the American Medical Association to have been written by a 9-year old. Emily Rosa. She (with some help from her parents) devised a simple test for her 4th (US) grade science fair project. It was later repeated under more controlled conditions and written up for JAMA [download reprint] . It showed that the claims of ‘therapeutic touch" practitioners to be able to detect "auras" were totally false. No subsequent work has shown otherwise. Why, then, does the University of Westminster teach it as part of a Bachelor of Science degree?
You can see Emily Rosa herself explain why “therapeutic touch is bullshit” with Penn and Teller, in Penn and Teller Expose Therapeutic Touch.
Environmental stress
The last bit of hokum (for the moment) is one of the best. This one has every myth under the sun (including some I hadn’t heard of).
|
The lecturer, Val Bullen, was also responsible for the infamous "Amethysts emit high Yin energy" slide. One of her own students desribes her as "sweet but deluded". I have nothing against Ms Bullen, She can believe whatever she wants. My problem is with the vice-chancellor, Prof Geoffrey Petts, who seems to think that this sort of stuff is appropriate for a BSc. |
|
Everything barmy is here. Mobile phones, power lines, underwater streams, ley lines, sick building syndrome, are all reasons why you don’t feel 100 percent, Actually my reason is having to read this junk. The "definitions" are, as always, just meaningless words.
|
|
|
|
|
|
|
|
 |
|
 |
But don’t despair. Help is at hand.
Just in case you happen to have run out of Alaskan Calling All Angels Essence, you can buy it from Baldwin’s for £19.95. It’s "designed to invoke the nurturing, uplifting and joyful qualities of the angelic kingdom.", and what’s more "can also use them any time to cleanse, energize, and protect your auric field." Well that’s what it says.in the ad.
Yarrow Environmental Solution looks like good stuff too. Only £7.95 for 7.5 ml. For that you get a lot. It will
" . . strengthen and protect against toxic environmental influences, geopathic stress, and other hazards of technology-dominated modern life. This includes the disruptive effects of radiation on human energy fields from X-rays, televisions, computer monitors, electromagnetic fields, airplane flights or nuclear fall-out."
OK stop giggling. This is serious stuff, taught in a UK university as part of a BSc degree, and awarded a high score by the Quality Assurance Agency (QAA).
Professor Petts, are you listening? I believe it is you, not I, who is bringing your university into disrepute.
The slides shown here are copyright of the University of Westminster or of the author of the lecture. They are small sample of what I was sent and are reproduced under the “fair quotation” provision, in the public interest.
Follow-up
5 May 2011. By sheer coincidence, Emily and Linda Rosa were passing through London. They called for lunch and here’s a picture (with Ben Goldacre) in UCL’s (endangered) Housman room. Linda kindly gave me a copy of her book Attachment Therapy on Trial: The Torture and Death of Candace Newmaker. [Download reprint of Rosa’s paper..]
.
6 May 2011. Talking of the “vibrational medicine” fantasy, I had an email that pointed out a site that plumbs new depths in fantasy physics. It’s on the PositiveHealthOnline website: A post there, Spirals and Energy in Nature, was written by Robert McCoy. He claims to have worked on microprocessor layout design, but anyone with school physics could tell that the article is sheer nonsense. In a way it is much more objectionable that the silly slides with coloured rays used in the Westminster course. McCoy’s post seeks to blind with sciencey-sounding language, that in fact makea no sense at all. Luckily my retweet of the site attracted the attention of a real physicist, A.P. Gaylard, who made a very welcome return to blogging with Fantasy physics and energy medicine. He dismantles the physics, line-by-line, in a devastating critique. This sort of junk physics is far more dangerous than the perpetual motion pundits and the cold-fusion fantasists. At PositiveHealthOnline it is being used to push pills that do you no good and may harm you. It is a danger to public health.
Peter Dixon is a chiropractor. He is chair of the General Chiropractic Council (GCC). He was also a member of the hotly-disputed NICE low back pain guidance group that endorsed (you guessed it) the use of chiropractic, a decision that has led to enormous criticism of the standards of the National Institute of health and Clinical Excellence (NICE).
As a consequence largely of the decision of the British Chiropractic Association (BCA) to sue Simon Singh for defamation, there has been an unprecedented interest taken in the claims made by chiropractors in general.
Peter Dixon has a problem because something like 600 individual complaints about unjustified health claims have been sent to the GCC. Even when a web site does not claim to be able to benefit things like asthma and colic, a phone call may reveal that claims are made in private (one of the many complaints to the GCC concerns such behaviour by two practices belonging to, ahem, Peter Dixon Associates).
The crucial question is, as always, one of evidence. The BCA claim to have a plethora of evidence for their claims, but they have been strangely reluctant to produce it. In fact evidence is cited on the “Your first visit” page on Dixon’s site.
At the bottom we see “How effective is Chiropractic?”.
That sounds very impressive indeed: . ” . . . patients who received chiropractic treatment improved by 70% more than those given hospital out-patient.”
But hang on. If we look at the paper, Meade et al., 1990 [download reprint], we see that Figure 2 looks like this.
Several things jump out. First, the Oswestry disability index scale runs for 0 to 100, but scores are plotted only from 0 to 35, so the size of the effects are exaggerated. Second, there are no error bars on the points. Third there is essentially no advantage for chiropractic at all when all patients are taken together (top graph). Fourth, and most important, the patients who were followed up for two years (bottom graph) seem to show a slight advantage for chiropractic but on average, the effect is 7 percent (on the 100 point scale, NOT 70 percent as claimed on the web site of Peter Dixon Associates.
What sort of mistake was made?
The abstract of the paper itself says “A benefit of about 7% points on the Oswestry scale was seen at two years.” How did this become “improved by 70% more”?
It could have been simple a typographical error, but that seems unlikely, Who’d boast about a 7% improvement?
Perhaps it is a question of relative versus absolute change. The Figure does not show the actual scores on the 100 point scale, but rather the change in score, relative to a questionnaire given just before starting treatment. If we look at the lower part of the Figure, restricted to those patients who stayed with the trail for 2 years (by this time 28% of the patients had dropped out), we see that there is a reduction in score (improvement) of about 10 points on the 100 point scale with hospital treatment (not a very impressive response). The improvement with those sent to private chiropractic clinics was about seven points bigger. So a change from 10 to 17 is a 70 percent change. What’s wrong with that?
What’s wrong is that it is highly misleading, as relative changes often are. Imagine that the hospital number had been 7 points and the chiropractic number had been 14 (both out of 100). That would mean that both treatments had provided very modest benefits to the patients. Would it then be fair to describe the chiropractic patients as have improved by 100 percent more than the hospital patients, when in fact neither got much benefit? Of course it would not. To present the results in this way would be highly deceptive.
Put another way, a 70% increase in a trivial effect is still pretty trivial.
That isn’t all either. The paper has been analysed in some detail on the ebm-first site. The seven point difference on a 100 point scale, though it may be real, is too small to be ‘clinically significant’ In other words the patient would scarcely notice such a small change. Another problem lies in the nature of the comparison. Patients were, quite properly, allocated at random to chiropractic or to to hospital treatment. BUT the comparion was very from blind. one group was treated in hospital. The other group was sent to private chiropractic clinics. The trivial 7 point difference could easily be as much to do with the thickness of the carpets rather than any effect of spinal manipulation.
What this paper really tells you is that neither treatment is very effective and that there is little to choose between them.
It is really most unfortunate that the chairman of the GCC should show himself to be so careless about evidence at a time when the evidence for the claims of chiropractors is under inspection as never before. It does not add to their case for criticising Simon Singh and it does not add to one’s confidence in the judgement of the NICE guidance group.
Follow-up
The Pain Society revolt. A letter has been sent from several distinguished members of the British Pain Society to its President and Council.
“We, the undersigned, call upon the President of the British Pain Society to issue a statement to NICE and to the press condemning outright the conclusions of the recent UK National Institute for Health and Clinical Excellence (NICE) guidelines . . .”
The sigificance of this letter is that the present president of the British Pain Society is Professor Paul Watson who was a member of the NICE guidance group that produced the recommendations which have engendered such criticism. He was clinical advisor to the guidance group. There is a video of Paul Watson talking about back pain, that seems to me to illustrate very well the problem with the guidance. He says it is a huge problem (everyone knows that) and that something must be done, but he doesn’t say what. There is no admission that, in very many cases, nobody knows what to do. It is exactly this sort of hubris that that makes the NICE report so bad,
One caustic comment on the letter says
“We are led by a physiotherapist! A Professor who cannot even interpret straight forward evidence when it is presented to him on a plate.
Who’s going to be the next BPS President? A Hospital Porter?”
The first post was NICE falls for Bait and Switch by acupuncturists and chiropractors: it has let down the public and itself.
That was followed by NICE fiasco, part 2. Rawlins should withdraw guidance and start again.
Since then, something of a maelstrom has engulfed NICE, so it’s time for an update.
It isn’t only those who are appalled that NHS should endorse voodoo medicine on the basis of very slim evidence who are asking NICE to rethink their guidance on low back pain. Pain specialists are up in arms too, and have even started a blog, ‘Not Nearly as NICE as you think …‘, to express their views. Equally adverse opinions are being expressed in the Britsh Medical Journal. A letter there is signed by over 50 specialists in pain medicine. It ends thus
“Because of these new guidelines patients will continue to experience unnecessary pain and suffering and their rights to appropriately individually tailored treatment have been removed on the basis of a flawed analysis of available evidence. We believe the guidelines do not reflect best practice, remove patient choice and are not in our patients’ best interests.”
In a contribution headed “NICE misguidance”. Dr Michel Vagg ends
It seems to me that this guideline has been used as a propaganda vehicle to allow cherry-picked evidence to be enshrined as doctrine. This is an abuse of the guideline development process . . . ”
I have to say, though, that it seems to me that some of these people are promoting their own interests as much as chiropractors and acupuncturists. The evidence that spinal injections produce worthwhile benefits seems to be as thin as the evidence that chiropractic and acupuncture produce worthwhile benefits. But no doubt the injections are good for the budgets of PCTs or private practice doctors.. Could it perhaps be the case that some of the clinicians’ anger is being generated by doctors who are rushing to defend their own favourite ineffective treatment?
Why, oh why, can’t either NICE or the pain consultants bring themselves to state the obvious, that nothing works very well. The only thing that can be said for most of the regular treatments is that although they may not be much more effective than acupuncture or chiropractic, at least they don’t come with the intellectually-offensive hokum that accompanies the latter. Very sensible attempts have been made to identify the cause of low back pain [reviewed here], Occasionally they succeed. Mostly they don’t.
One clinician’s letter deserves special attention because it goes into the evidence, and the costs, in some detail. Its conclusions are very different from those in the NICE guidance.
The letter, a Review of NICE guidance, is from Dr C.J.D. Wells [download the whole letter]. He is a pain relief consultant from Liverpool.
Let’s look at some highlights.
Wells points out the absurdity of the cost estimates
“In the pricing section, they estimate that this will require an increase of facilities so that 3,500 patients can be treated instead of 1,000 at present (again see comments on pricing). This is not many treatments for the 20 million sufferers, of whom we can estimate that at least 2 million will have significant long-term disability and psychological distress”
And that is without even costing all the secondary costs of miseducating a new generation of students in fables about “Qi”, meridians, energy flow, subluxations and innate intelligence.
“The abysmal ignorance of the committee is reflected in the poor overall advice. So if you have a committee with special interests in Exercise, Manipulation, PMP’s, and Surgery, and you call an expert on Acupuncture, you get advice to use Exercise, Manipulation, Acupuncture, PMP’s and Surgery. Amazing.”
Another pain consutant, Charles Guaci, says in a comment in the Daily Mail.
I am a Pain Consultant of 30 years experience, have published two books (one translated into different languages).
NICE never asked me for my opinion.
This is the most ridicuculous pseudo-scientific document I have ever seen.
The panel consisted of a surgeon, psychologist, osteopath, acupuncturist a physiotherapist and an academic; not one pain consultant! The conclusions are simply a means of increasing the employment of their friends!
All evidence submitted to NICE was ignored.
It is almost certain than unless NICE rethink their ideas that Pain Consultants will be seeking a judicial review as well as full disclosure of how the panel arrived at their bizarre findings under the Freedom of information act.
Patients should realise that they are being taken for a ride.
Despite the outcry from opponents of magic medicine and from pain specialists, the assessment by the normally excellent NHS Choices site was disappointing. It made no mention at all of the secondary consequences of recommending CAM and described the assertions of the guidance group quite uncritically.
The reputation of NICE
NICE has been criticised before, though usually unjustly. In the past I have often supported them. For example. when NICE said that treatment of dementia with anticholinesterase drugs like galantamine was ineffective, there was a great outcry, but NICE were quite right. There is little or no rationale for such treatments, and more importantly, very little evidence that they work. But patients, especially when they are desperate, have greater faith in drug treatments than most pharmacologists, They want to clutch at straws. A bit like the NICE guidance committee, faced with a bunch of treatments most of which are almost ineffective, clutched at the straws of acupuncture and chiropractic. But this time it isn’t only the patients who are cross. It is most of the medical and scientific world too.
One interpretation of these bizarre events is that they represent a case of medical/scientific arrogance. Ben Goldacre wrote of another aspect of the same problem thus week, in Dodgy academic PR [download the paper on which this is based].
The first job of a scientist is to say openly when the answer to a question is not known. But scientists are under constant pressure to exaggerate the importance of their results. Last year we published an article which I feel may, if verified, turn out to be the second most important that I have ever been an author on. Because it happened to be published in Nature (not because of its quality), a press release was written (by an arts graduate!). It took some argument to prevent the distorted and exaggerated account being imposed on the public. This is typical of the sort of thing reported in Goldacre’s column. I reported a similar case a while ago, Why honey isn’t a wonder cough cure: more academic spin.
If NICE does not reconsider this guidance, it is hard to see how it can be taken seriously in the future. I hope that when NICE’s director, Professor Sir Michael Rawlins, returns from his trips abroad, he will find time to look at the case himself.
Indirectly, then, it can be argued that NICE’s bizarre guidance is just another manifestation of the management of science being passed from the hands of scientists into the hands of administrators and spin experts. It is yet another example of DC’s rule
Never trust anyone who uses the word ‘stakeholder’
Some bone-headed bureaucrat decides that any charlatan or quack is a ‘stakeholder’ in the provision of NHS care and gives them a quite disproportionate say in how taxpayers’ money is spent. The bureaucrats are so busy following processes and procedures, ticking boxes, and so deficient in scientific education, that they failed to notice that they’ve been caught out by the old trick of used car salesmen, bait and switch.
The consequences
The expected consequences have already started to materialise. The Prince of Wales’ Foundation for Magic Medicine is jubilant about having been endorsed by NICE. And I’m told that “The chiropractors have now just written letters to all health boards in Scotland asking for contracts for their services to deal with back pain”.
There could hardly have been a worse time for NICE to endorse chiropractic. We are in the middle of a storm about free speech because of the disgraceful action of the British Chiropractic Associaton in suing one of our best science writers, Simon Singh, for defamation because he had the temerity to express an opinion, Of course, even if the BCA wins in court, it will be the overall loser, because chiropractic claims are now being scrutinised as never before (just look at what they told me).
Follow-up
A much-cited paper. The paper that is most often cited by chiropractors who claim to be able to cure colic by spinal manipulation is Klougart N, Nilsson N and Jacobsen J (1989) Infantile Colic Treated by Chiropractors: A Prospective Study of 316 Cases, J Manip Physiol Ther,12:281-288. This is not easy to get hold of but Steve Vogel has sent me s scanned copy which you can download here. As evidence it is about as useless as the infamous Spence study so beloved of homeopaths. There was no control group at all. It simply follows 316 babies and found that most of them eventually got better. Well, they do, don’t they? It is a sign of the pathetic standard of reaearch in chiropractic that anyone should think this paper worth mentioning at all.
June 6 2009. More flak for NICE from the Royal College of Anaesthetists, and more adverse comment in the BMJ. And of course the blogs. for example, “If this is “evidence based medicine” I want my old job back“.
“Acupuncture on the NHS: a dangerous precedent”: a good analysis at counterknowledge.com.
June 6 2009, Comment sent to the BMJ. The comment was submitted, as below, early on Friday 5th June. The BMJ said it was a “sensitive issue” and for the next five days lawyers pondered over it.
Underwood and Littlejohns describe their guidance as being a “landmark”. I can only agree with that description. It is the first time that NICE has ever endorsed alternative medicine in the face of all the evidence. The guidance group could hardly have picked a worse moment to endorse chiropractic. Chiropractors find it so hard to find evidence for their practices that, when one of our finest science writers, Simon Singh, asked to see the evidence they sued him for defamation. I suggest that the guidance group should look at the formidable list of people who are supporting Singh, after his brave decision to appeal against this iniquitous persecution.
Of course I’m sure this bizarre decision has nothing to do with the presence on the guidance group of Peter Dixon, chair of the General Chiropractic Council. Nevertheless, I am curious to know why it is that when I telephoned two of the practices belonging to Peter Dixon Associates, I was told that they could probably treat infantile colic and asthma. Such claims have just been condemned by the Advertising Standards Authority.
The low back pain guidance stands a good chance of destroying NICE’s previously excellent reputation for dispassionate assessment of benefits and costs. Yes, that is indeed a landmark of sorts.
If NICE is ever to recover its reputation, I think that it will have to start again. Next time it will have to admit openly that none of the treatments work very well in most cases. And it will have to recognise properly the disastrous cultural consequences of giving endorsement to people who, when asked to produce evidence, resort to legal intimidation.
Eventually, on Wednesday 10 June the comment appeared in the BMJ, and it wasn’t greatly changed. Nevertheless if is yet another example of legal chill. This is the final version.
Underwood and Littlejohns describe their guidance as being a “landmark”. I can only agree with that description. It is the first time that NICE has ever endorsed alternative medicine in the face of all the evidence. The guidance group could hardly have picked a worse moment to endorse chiropractic. Chiropractors are so sensitive about criticisms of their practices that, when one of our finest science writers, Simon Singh, queried the evidence-base for their therapeutic claims they sued him for defamation. I suggest that the guidance group should look at the formidable list of people who are supporting Singh, after his brave decision to appeal against an illiberal court ruling in this iniquitous persecution.
One wonders whether this bizarre decision by NICE has anything to do with the presence on the guidance group of Peter Dixon, chair of the General Chiropractic Council. I am also curious to know why it is that when I telephoned two of the practices belonging to Peter Dixon Associates, I was told that chiropractic could be effective in the treatment of infantile colic and asthma. Similar claims about treating colic have just been condemned by the Advertising Standards Authority.
The low back pain guidance stands a good chance of destroying NICE’s previously excellent reputation for dispassionate assessment of benefits and costs. Yes, that is indeed a landmark of sorts.
If NICE is ever to recover its reputation, I think that it will have to start again. Next time it will have to admit openly that none of the treatments works very well in most cases. And it will have to recognise properly the disastrous cultural consequences of giving endorsement to people who, instead of engaging in scientific debate, resort to legal intimidation.
Bait and switch. Oh dear, oh dear. Just look at this. British Chiropractic Association tell their members to hide their sins from prying eyes.
Excellent round-up of the recent outburst of writing about “chiroquacktic” (Tut, tut, is there no respect?).
Dr Crippen writes “NICE recommends a cure for all known disease” [Ed some exaggeration, surely]
Two days ago I wrote NICE falls for Bait and Switch by acupuncturists and chiropractors: it has let down the public and itself
Now the official ‘guidance’ is out, and it is indeed quite as bad as the draft.
The relevant bits now read thus.
- Offer one of the following treatment options, taking into account patient preference: an exercise programme, a course of manual therapy or a course of acupuncture. Consider offering another of these options if the chosen treatment does not result in satisfactory improvement.
- Consider offering a structured exercise programme tailored to the person:
- This should comprise of up to a maximum of 8 sessions over a period of up to 12 weeks.
- Offer a group supervised exercise programme, in a group of up to 10 people.
- A one-to-one supervised exercise programme may be offered if a group programme is not suitable for a particular person.
- Consider offering a course of manual therapy, including spinal manipulation, comprising up to a maximum of nine sessions over a period of up to 12 weeks
- Consider offering a course of acupuncture needling comprising up to a maximum of 10 sessions over a period of up to 12 weeks.
The summary guidance still doesn’t mention chiropractic explicitly, just a coy reference to “spinal manipulation”. At a time when the British Chiropractic Association is busy trying to suppress free speech via the law courts, I guess it isn’t surprising that they don’t like to use the word.
The bias in the recommendations is perhaps not surprising because the guidance development group had a heavy representation from alternative medicine advocates, and of people with a record of what, is, in my view, excessive tolerance of mumbo-jumbo.
Royal College of General Practitioners (RCGP) played a large part in writing the guidance. That is an organisation thar has steadfastly refused to make any sort of sensible statement of policy about magic medicine. It isn’t long since I was told by a senior person at the RCGP that there was nothing odd about neuro-linguistic programming. That does not bode well.
Professor Martin Underwood, Professor of Primary Care Research Warwick Medical School, University of Warwick. Underwood chaired the guidance development group. Martin Underwood is also a GP in Coventry See also the British Osteopathic Association. Underwood was lead author of the BEAM trial (download reprint). It is well worth reading the comments on this trial too. It was a randomised trial (though not, of course, blind).
|
Our main aim was to estimate, for patients consulting their general practitioner with back pain, the effectiveness of adding the following to best care in general practice: a class based exercise programme (“back to fitness”), a package of treatment by a spinal manipulator (chiropractor, osteopath, or physiotherapist), or manipulation followed by exercise Conclusions |
In other words, none of them worked very well. The paper failed to distinguish between manipulation by physiotherapists, chiropractors and osteopaths and so missed a valuable chance to find out whether there is an advantage to employing people from alternative medicine (the very problem that this NICE guidance should have dealt with)
Steve Vogel, another member of the guidance development group, is an osteopath. Osteopathy has cast off its shady origins better than chiropractic, but it remains a largely evidence-free zone, and is still usually classified as alternative medicine.
Peter Dixon DC FCC FBCA is chairman of the General Chiropractic Council and founder of Peter Dixon Associates. They run six chiropractic clinics. The claims made by these clinics on their web site are mostly related to musculo-skeletal conditions (not, all spine-related however). But they also include
“Chiropractic is also suitable for relieving the symptoms of stress, and optimizing the way the body works is one of the best ways of enhancing health and wellbeing.”
I wonder how they could justify that claim? Then we get
A chiropractor is always willing to discuss individual conditions or answer questions in order to assess whether chiropractic may be of benefit.
Thanks for the invitation. I accepted it. After the first two phone calls, I had learned all I needed.
The first of Peter Dixon’s clinics that I called, was asked about my son who was suffeiing from perpetual colic. I asked for advice. I was put through to the chiropractor. Here are some extracts from the conversation.
“I think now it’s termed irritable baby syndrome. . . . . We’ve found chiropractic is very effective for colic . . . . £50 up to 3/4 hour which would involve taking a case history, examining the baby, with regard to seeing how the joints in the spine work because often colic is down to, er um, faulty movement patterns in the spine. We deal with an awful lot of things to do with the frame -how the spine moves -and it’s often problems with the way that the bones of the spine move in infants and babies that is the underlying cause in colicky symptoms. . . usually on the whole, I’ve shot myself in the foot by saying this in the past, if there are -um when I say back problems they’re usually temporary issues -when they are there the response for most babies is quite quick . . . it depends on how it’s related to what’s gone on in the birth process -there is usually some traumatic cause and it usually sets up a problem in the upper neck or the mid-back and that will drive those colic symptoms. . . . Yes it’s quite a straightforward thing we just check the baby’s spine and see if it’s problem we can deal with or not.”
Yes, I think you just shot yourself in the foot again. I have no idea in what fraction of cases a chiropractor would fail to claim that it was a case that they could deal with. At least that possibility was envisaged. But when I asked where he’d refer me to in such case I was told it might be a result of bottle feeding -“what they consume”. So I expect it would have been sent to some sort of “nutritional therapist” who would have used one of their usual battery of unreliable tests for food allergies.
I tried a second clinic in Peter Dixon’s empire and asked if chiropractic could help with asthma.”It can do, depending on what type of asthma you have". After some questions I was asked
“Do you have any general aches and pains otherwise, any tension .problems round the rib cage or thoracic spine . . . There are two things we’d look as chiropractors as to whether we could help or not and that would include the tension round the rib cage -in any type of asthma you’ll become tight round the rib cage and merely by keeping that area loose you’d help to stop the asthma from becoming quite as bad. And the second part is we’d look at the neck area with you to see if there is any restriction there -which houses the nerve supply to the lungs which can be indicated in some asthma cases also.”
I was invited to come for a free screen, so I asked if it usually worked quickly, “It depends what the problem is but you’d need a course I suspect”. £45 for the first appointment then £28 per session. “In most cases you’d need to look at a six to eight session course”.
Would anyone with experience of crying babies or of asthma like to comment on these proposed treatments? They are not my idea of evidence-based treatments and I find it quite surprising that someone who sponsors them is thought appropriate to write guidance for NICE.
This sort of ‘sting’ always makes me feel a bit uneasy, but it seems to be the only way to find out what actually goes on. And what goes on has all the appearance of classic bait and switch. You go in for your backache, and before you know where you are you are being sold a course of treatment to stop your baby crying.
Media follow-up after the NICE announcement
Sadly, I heard that the Today programme (my favourite news programme) was pretty wet. if only their science reporting was as good as their politics reporting.
The 27th May was certainly pretty busy for me, Apart from a couple of local paper interviews, this is what happened,
Sky News TV. Richard Suchet and two cameraman came to UCL and filmed a lot of stuff out of which a 20 second clip was used. And then they grumble that they don’t make money.
BBC TV 6 o’clock News. Similar, but at least only two people this time. Both TV stations spent ages showing pictures of people having needles pushed into them and very little time discussing the problems. A pathetically bad attempt at science reporting. Radio, on the whole, did much better
BBC Three Counties Radio (09.20) Host Ronnie Barbour, The daytime talk shows may be appalling to some of us, but the hosts did a far better job of airing the problems than TV [download the mp3].
Radio 5 Live Victoria Derbyshire [download the mp3]
BBC Radio Sheffield (12.05) was the best talk show by far. First speaker was Steve Vogel, the osteopath from the guidance development group. Although invited by the rather sensible host, Rony, to respond to the idea that a secondary consequence of the guidance would be to introduce hocus-pocus, he steadfastly refused to answer the question. At the end a rather sensible GP summed up the view from the coalface. [play the mp3]
Radio 4 PM programme This excellent early evening news programme is run by Eddie Mair. It was the best interview yet. The other side was put by Martin Underwood, chair of the guidance development group [play the mp3]
Underwood said “the evidence shows that it [acupuncture] works”. I disagree. The evidence shows that acupuncture, in a non-blind comparison with no acupuncture shows a small, variable additional effect that doesn’t last and is of marginal clinical significance, That is not what I call “works”. Underwood then indulges in the subgroup analysis fallacy by asserting that a few people get a large benefit from acupuncture. Or perhaps a few people just happen to get better that day. I was not convinced.
More 4 News TV 20.20 was an interview, with the other side being put by my old friend, George Lewith.
During the introduction, an acupuncturist. Lisa Sherman, ‘explained’ acupuncture in the usual sort of utterly meaningless words that illustrate perfectly the problem.
George Lewith said that “we don’t have a good pretend form of acupuncture”. “We don’t have a good placebo and we can demonstrate that acupuncture is literally twice as effective as conventional care”. The first is simply nonsense: huge efforts have gone into developing good controls in acupuncture studies (see, for example, Barker Bausell’s book, Snake Oil Science). And I hope that George will send the references for his “twice as effective” claim. It seems to me to be nothing short of preposterous.
My conclusions
So what went wrong?
One problem could be regarded as medical arrogance. The fact is that the problem of low back pain has not been solved, either by drugs or anything else. It is a failure of medicine (and of pharmacology). That should be the premise of all discussions, and it smacks of arrogance not to tell people straight out. Of course there are some cases when causes can be identified, and perhaps remedied, usually by surgery, but these are the exceptions not the rule.
One consequence of the inability of medicine to help much is that patients get desperate, and willing to try anything. And of course if they happen to have a remission, that is attributed to the treatment, however preposterous that treatment may have been. Conditions like back pain that come and go unpredictable are a gift for quacks.
Another consequence, for researchers rather than patients, is to clutch at straws. Even small and inconsistent effects are seized on as ‘successes’. This phenomenon seems to be part of the reason for the NICE guidance. Another reason is, almost certainly, the grinding of axes by some of the people who wrote it.
What should be done now?
Professor Sir Michael Rawlins is a sensible chap. He cares about evidence, But it does seem that in this case, he might have taken his eye off the ball, for once. In my opinion, he should restore the reputation of NICE by withdrawing this guidance and starting again.
Follow-up
An interesting document has come my way. It shows the responses of the guidance group to the consultation on the draft guidance. Many people made comments not unlike mone, but they were all brushed aside in a way that looks to me rather partisan. The document appears to have vanished from NICE’s web site, but you can download it here.
Friday 29th May. The Times prints a letter from two consultants in pain medicine, Joan Hestor and Stephen Ward. It says, inter alia
“As experienced pain specialists we feel that NICE has lost its way in publishing these guidelines.”
“We are saddened that NICE has chosen to ignore our important role and promote seemingly unworkable and for the most part clinically ineffective treatments”
Friday 29th May. NICE has had a good reputation in the USA for its important, and usually high-quality, attempts to assess what works and what doesn’t. That makes it all the sadder to see it condemned already from the USA for its latest effort. The excellent Yale neurologist, Steven Novella, has written about it on his Neurologica blog.
Friday 29th May. A correspondent points out that the costings of the guidance can be found on the NICE web site. Table 1 has a strong air of make-believe.
The Daily Mail (29 May 2009). Their article quotes serious criticisms of NICE.
Dr Ron Cooper, past chairman of the group and a consultant pain specialist in Northern Ireland, said: ‘I have never known so many pain medicine specialists to be so furious. More patients will end up having more expensive surgery, which is unnecessary, risky and has worse results.
‘NICE made it difficult for us to submit evidence to a committee on which there was not one experienced pain physician.
‘The guidelines will make us the laughing stock of Europe, Australia and the U.S. where pain specialists will continue to have full access to a wide range of treatments.’
Chirowatch suspended. 30 May 2009. The invaluable chiro-watch site, http://www.chirowatch.com, run by Dr Canadian physician, Dr Tom Polevoy, has been “suspended”. In fact the whole of his domain, healthwatcher.net, has been disabled. It seems that this was the result of a legal threat to his ISP, not by chiropractors this time, but by William O’Neill of the Canadian Cancer Research Group, which is far from being what the respectable-sounding title suggests, according to Dr Stephen Barrett. The site will be back soon, I’m told. Meanwhile you can read the suspended page here, and the only result of their hamfisted bullying will be to vastly increase the number of people who read it. You can read lots more at Quackwatch’s chirobase and at ebm-first.
A new blog, Not as NICE as you think appeared on May 30th. It is written by a pain physician, Stephen Ward. and is devoted to pointing out the serious problems raised by NICE’s guidance. It starts with the (very critical) World Institute of Pain Press Release.
British Medical Journal has more flak for the NICE guidelines
And the BMJ has published a letter signed by 50 consultants in pain medicine, NICE guidelines on low back pain are flawed.(this will probably appear as a letter in the print edition of the BMJ).
First the MHRA lets down the public by allowing deceptive labelling of sugar pills (see here, and this this blog). Now it is the turn of NICE to betray its own principles.
The National Institute for Health and Clinical Excellence (NICE) describes its job thus
“NICE is an independent organisation responsible for providing national guidance on promoting good health and preventing and treating ill health.”
Its Guidance document on Low Back Pain will be published on Wednesday 27 May 2009, but the newspapers have already started to comment, presumably on the assumption that it will have changed little from the Draft Guidance of September 2008. These comments may have to be changed as soon as the final version becomes available.
The draft guidance, though mostly sensible, has two recommendations that I believe to be wrong and dangerous. The recommendations include (page 7) these three.
- Consider offering a course of manual therapy including spinal manipulation of up to 9 sessions over up to 12 weeks.
- Consider offering a course of acupuncture needling comprising up to 10 sessions over a period of up to 12 weeks.
- Consider offering a structured exercise programme tailored to the individual.
All three of this options are accompanied by a footnote that reads thus.
“A choice of any of these therapies may be offered, taking into account patient preference.”
On the face if it, this might seem quite reasonable. All three choices seem to be about as effective (or ineffective) as each other, so why not let patients choose between them?
Actually there are very good reasons, but NICE does not seem to have thought about them. In the past I have had a high opinion of NICE but it seems that even they are now getting bogged down in the morass of political correctness and officialdom that is the curse of the Department of Health. It is yet another example of DC’s rule number one.
Never trust anyone who uses the word ‘stakeholder’.
They do use it, often.
So what is so wrong?
For a start, I take it that the reference to “spinal manipulation” in the first recommendation is a rather cowardly allusion to chiropractic. Why not say so, if that’s whar you mean? Chiropractic is mentioned in the rest of the report but the word doesn’t seem to occur in the recommendations. Is NICE perhaps nervous that it would reduce the credibility of the report if the word chiropractic were said out loud?
Well, they have a point, I suppose. It would.
That aside, here’s what’s wrong.
The Evidence
I take as my premise that the evidence says that no manipulative therapy has any great advantage over the others. They are all more or less equally effective. Perhaps I should say, more or less equally ineffective, because anyone who claims to have the answer to low back pain is clearly deluded (and I should know: nobody has fixed mine yet). So for effectiveness there are no good grounds to choose between exercise, physiotherapy, acupuncture or chiropractic. There is, though, an enormous cultural difference. Acupuncture and chiropractic are firmly in the realm of alternative medicine. They both invoke all sorts of new-age nonsense for which there isn’t the slightest good evidence. That may not poison your body, but it certainly poisons your mind.
Acupuncturists talk about about “Qi”, “meridians”, “energy flows”. The fact that “sham” and “real” acupuncture consistently come out indistinguishable is surely all the evidence one needs to dismiss such nonsense. Indeed there is a small group of medical acupuncturists who do dismiss it. Most don’t. As always in irrational subjects, acupuncture is riven by internecine strife between groups who differ in the extent of their mystical tendencies,
Chiropractors talk of “subluxations”, an entirely imaginary phenomenon (but a cause of much unnecessary exposure to X-rays). Many talk of quasi-religious things like “innate energy”. And Chiropractic is even more riven by competing factions than acupuncture. See, for example, Chiropractic wars Part 3: internecine conflict.
The bait and switch trick
This is the basic trick used by ‘alternative therapists’ to gain respectability.
There is a superb essay on it by the excellent Yale neurologist Steven Novella: The Bait and Switch of Unscientific Medicine. The trick is to offer some limited and reasonable treatment (like back manipulation for low back pain). This, it seems, is sufficient to satisfy NICE. But then, once you are in the showroom, you can be exposed to all sorts of other nonsense about “subluxations” or “Qi”. Still worse, you will also be exposed to the claims of many chiropractors and acupuncturists to be able to cure all manner of conditions other than back pain. But don’t even dare to suggest that manipulation of the spine is not a cure for colic or asthma or you may find yourself sued for defamation. The shameful legal action of the British Chiropractic Association against Simon Singh (follow it here) led to an addition to DC’s Patients’ Guide to Magic Medicine.
(In the face of such tragic behaviour, one has to be able to laugh).
Libel: A very expensive remedy, to be used only when you have no evidence. Appeals to alternative practitioners because truth is irrelevant.
NICE seems to have fallen for the bait and switch trick, hook line and sinker.
The neglected consequences
Once again, we see the consequences of paying insufficient attention to the Dilemmas of Alternative Medicine.
The lying dilemma
If acupuncture is recommended we will have acupuncturists telling patients about utterly imaginary things like “Qi” and “meridians”. And we will have chiropractors telling them about subluxations and innate energy. It is my opinion that these things are simply make-believe (and that is also the view of a minority of acupuncturist and chiropractors). That means that you have to decide whether the supposed benefits of the manipulation are sufficient to counterbalance the deception of patients.
Some people might think that it was worth it (though not me). What is unforgivable is not to consider even the question. The NICE guidance says not a word about this dilemma. Why not?
The training dilemma
The training dilemma is even more serious. Once some form of alternative medicine has successfully worked the Bait and Switch trick and gained a toehold in the NHS, there will be an army of box-ticking HR zombies employed to ensure that they have been properly trained in “subluxations” or “Qi”. There will be quangos set up to issue National Occupational Standards in “subluxations” or “Qi”. Skills for Health will issue “competences” in “subluxations” or “Qi” (actually they already do). There will be courses set up to teach about “subluxations” or “Qi”, some even in ‘universities’ (there already are).
The respectability problem
But worst of all, it will become possible for aupuncturists and chiropractors to claim that they now have official government endorsement from a prestigious evidence-based organisation like NICE for “subluxations” or “Qi”. Of course this isn’t true. In fact the words “subluxations” or “Qi” are not even mentioned in the draft report. That is the root of the problem. They should have been. But omitting stuff like that is how the Bait and Switch trick works.
Alternative medicine advocates crave, above all, respectability and acceptance. It is sad that NICE seems to have given them more credibility and acceptance without having considered properly the secondary consequences of doing so,
How did this failure of NICE happen?
It seems to have been a combination of political correctness, failure to consider secondary consequences, and excessive influence of the people who stand to make money from the acceptance of alternative medicine.
Take, for example, the opinion of the British Pain Society. This organisation encompasses not just doctors. It
includes “doctors, nurses, physiotherapists, scientists, psychologists, occupational therapists and other healthcare professionals actively engaged in the diagnosis and treatment of pain and in pain research for the benefit of patients”. Nevertheless, their response to the draft guidelines pointed out that the manipulative therapies as a whole were over-represented.
|
Manipulation The guidelines assess 9 large groups of interventions of which manual therapies are only one part. The full GDG members panel of 13 individuals included two proponents of spinal manipulation/mobilisation (P Dixon and S Vogel). In addition, the chair of the panel (M Underwood) is the lead author of the UKBEAM trial on which the positive recommendation for |
It seems that the Pain Society were quite right.
LBC 97.3 Breakfast Show (25 May 2009) had a quick discussion on acupuncture (play mp3 file). After I had my say, the other side was put by Rosey Grandage. She has (among other jobs) a private acupuncture practice so she is not quite as unbiassed as me). As usual, she misrepresents the evidence by failing to distinguish between blind and non-blind studies. She also misrepresented what I said by implying that I was advocating drugs. That was not my point and I did not mention drugs (they, like all treatments, have pretty limited effectiveness, and they have side effects too). She said “there is very good evidence to show they (‘Qi’ and ‘meridians’] exist”. That is simply untrue.
There can’t be a better demonstration of the consequences of falling for bait and switch than the defence mounted by Rosey Grandage. NICE may not mention “Qi” and “meridians”; but the people they want to allow into the NHS have no such compunctions.
I first came across Rosey Grandage when I discovered her contribution to the Open University/BBC course K221. That has been dealt with elsewhere. A lot more information about acupuncture has appeared since then. She doesn’t seem to have noticed it. Has she not seen the Nordic Cochrane Centre report? Nor read Barker Bausell, or Singh & Ernst? Has she any interest in evidence that might reduce her income? Probably not.
Where to find out more
An excellent review of chiropractic can be found at the Layscience site. It was written by the indefatigable ‘Blue Wode’ who has provided enormous amounts of information at the admirable ebm-first site (I am authorised to reveal that ‘Blue Wode’ is the author of that site). There you will also find much fascinating information about both acupuncture and about chiropractic.
I’m grateful to ‘Blue Wode’ for some of the references used here.