During the last year, there has been a very welcome flurry of good and informative books about alternative medicine. They are all written in a style that requires little scientific background, even the one that is intended for medical students.
CAM, Cumming | Trick or Treatment | Snake Oil Science |
Testing treatments | Suckers | Healing, Hype or Harm
I’ll start with the bad one, which has not been mentioned on this blog before.
Complementary and Alternative medicine. An illustrated text.
by Allan D. Cumming, Karen R. Simpson and David Brown (and 12 others). 94 pages, Churchill Livingstone; 1 edition (8 Dec 2006).
The authors of this book sound impressive
Allan Cumming, BSc(Hons), MBChB, MD, FRCP(E), Professor of Medical Education and Director of Undergraduate Learning and Teaching, and Honorary Consultant Physician, College of Medicine and Veterinary Medicine, University of Edinburgh, Edinburgh, UK; Karen Simpson, BA(Hons), RN, RNT, Fellow in Medical Education, College of Medicine and Veterinary Medicine David Brown, MBChB, DRCOG, General Practitioner, The Murrayfield Medical Centre, and Honorary Clinical Tutor, University of Edinburgh |
Sadly, this is a book so utterly stifled by political correctness that it ends up saying nothing useful at all. The slim volume is, I have to say, quite remarkably devoid of useful information. Partly that is a result of out-of-date and selective references (specially in the chapters written by alternative practitioners),
But the lack of information goes beyond the usual distortions and wishful thinking. I get the strong impression is that it results not so much for a strong commitment to alternative medicine (at least by Cumming) as from the fact that the first two authors are involved with medical education. It seems that they belong to that singularly barmy fringe of educationalists who hold that the teacher must not give information to s student for fear of imparting bias. Rather the student must be told how to find out the information themselves. There is just one little problem with this view. It would take about 200 years to graduate in medicine.
There is something that worries me about medical education specialists. Just look at the welcome given by Yale’s Dean of Medical Education, Richard Belitsky, to Yale’s own division of “fluid concepts of evidence”, as described at Integrative baloney @ Yale, and as featured on YouTube. There are a lot of cryptic allusions to alternative forms of evidence in Cumming’s book too, but nothing in enough detail to be useful to the reader.
What should a book about Alternative medicine tell you? My list would look something like this.
- Why people are so keen to deceive themselves about the efficacy of a treatment
- Why it is that are so often deceived into thinking that something works when it doesn’t
- How to tell whether a medicine works better than placebo or not,
- Summaries of the evidence concerning the efficacy and safety of the main types of alternative treatments.
The Cumming book contains chapters with titles like these. It asks most of the right questions, but fails to answer any of them. There is, time and time again, the usual pious talk about the importance of evidence, but then very little attempt to tell you what the evidence says. When an attempt is made to mention evidence, it is usually partial and out of date. Nowhere are you told clearly about the hazards that will be encountered when trying to find out whether a treatment works.
The usual silly reflexology diagram is reproduced in Cumming’s introductory chapter, but with no comment at all, The fact that it is obviously total baloney is carefully hidden from the reader.. What is the poor medical student meant to think when they perceive that it is totally incompatible with all the physiology they have learned? No guidance is offered. |
You will look in vain for a decent account of how to do a good randomised controlled trial, though you do get a rather puerile cartoon, The chapter about evidence is written by a librarian. Since the question of evidence is crucial, this is a fatal omission. |
Despite the lack of presentation of evidence that any of it works, there seems to be an assumption throughout the book that is is desirable to integrate alternative medicine into clinical practice. In Cumming’s chapter (page 6) we see
Since it would not be in the interests of patients to integrate treatments that don’t work with treatments that do work, I see only two ways to explain this attitude. Either the authors have assumed than most alternative methods work (in which case they haven’t read the evidence), or they think integration is a good idea even if the treatment doesn’t work. Neither case strikes me as good medical education.
The early chapters are merely vague and uninformative. Some of the later chapters are simply a disgrace.
Most obviously the chapter on homeopathy is highly selective and inaccurate, That is hardly surprising because it is was written by Thomas Whitmarsh, a consultant physician at Glasgow Homeopathic Hospital (one that has still survived). It has all the usual religious zeal of the homeopath. I honestly don’t know whether people like Whitmarsh are incapable of understanding what constitutes evidence, or are simply too blinded by faith to even try. Since the only other possibility is that they are dishonest, I suppose it must be one of the former.
The chapter on “Nutritional therapy” is also written by a convert and is equally misleading piece of special pleading.
The same is true of the chapter on Prayer and Faith Healing. This chapter reproduces the header of the Cochrane Review on “Intercessory prayer for the alleviation of Ill Health”, but then proceeds to ignore entirely its conclusion “Most of the studies show no real differences”).
If you want to know about alternative medicine, don’t buy this book. Although this book was written for medical students, you will learn a great deal more from any of the following books, all of which were written for the general public.
Trick or Treatment
by Simon Singh and Edzard Ernst, Bantam Press, 2008
Simon Singh is the author of many well-known science books, like Fermat’s Last Theorem. Edzard Ernst is the UK’s first professor of complementary and alternative medicine.
Ernst, unlike Cumming et. al is a real expert in alternative medicine. He practised it at an early stage in his career and has now devoted all his efforts to careful, fair and honest assessment of the evidence. That is what this book is about. It is a very good account of the subject and it should be read by everyone, and certainly by every medical student. |
Singh and Ernst follow the sensible pattern laid out above, The first chapter goes in detail into how you distinguish truth from fiction (a little detail often forgotten in this area).
The authors argue, very convincingly, that the development of medicine during the 19th and 20th century depended very clearly on the acceptance of evidence not anecdote. There is a fascinating history of clinical trials, from James Lind (lemons and scurvy), John Snow and the Broad Street pump, Florence Nightingale’s contribution not just to hygiene, but also to the statistical analysis that was needed to demonstrate the strength of her conclusions (she became the first female member of the Royal Statistical Society, and had studied under Cayley and Sylvester, pioneers of matrix algebra).
There are detailed assessments of the evidence for acupuncture, homeopathy, chiropractic and herbalism, and shorter synopses for dozens of others. The assessments are fair, even generous in marginal cases.
Acupunture. Like the other good books (but not Cumming’s), it is pointed out that acupuncture in the West is not so much the product of ancient wisdom (which is usually wrong anyway), but rather a product of Chinese nationalist propaganda engineered by Mao Tse-tung after 1949. It spread to the West after Nixon’s visit Their fabricated demonstrations of open heart surgery under acupuncture have been known since the 70s but quite recently they managed again to deceive the BBC It was Singh who revealed the deception. The conclusion is ” . . . this chapter demonstrates that acupuncture is very likely to be acting as nothing more than a placebo . . . ”
Homeopathy. “hundreds of trials have failed to deliver significant or convincing evidence to support the use of homeopathy for the treatment of any particular ailment. On the contrary, it would be to say that there is a mountain of evidence to suggest that homeopathic remedies simply do not work”.
Chiropractic. Like the other good books (but not Cumming’s) there is a good account of the origins of chiropractic (see, especially, Suckers). D.D. Palmer, grocer, spiritual healer, magnetic therapist and fairground quack, finally found a way to get rich by removing entirely imaginary ‘subluxations’. They point out the dangers of chiropractic (the subject of court action), and they point out that physiotherapy is just as effective and safer.
Herbalism. There is a useful table that summarises the evidence. They conclude that a few work and most don’t Unlike homeopathy, there is nothing absurd about herbalism, but the evidence that most of them do any good is very thin indeed.
“We argue that it is now the time for the tricks to stop, and for the real treatments to take priority. In the name of honesty, progress and good healthcare, we call for scientific standards, evaluation and regulation to be applied to all types of medicine, so that patients can be confident that they are receiving treatments that demonstrably generate more harm than good.” |
Snake Oil Science, The Truth about Complementary and Alternative Medicine.
R. Barker Bausell, Oxford University Press, 2007
Another wonderful book from someone who has been involved himself in acupuncture research, Bausell is a statistician and experimental designer who was Research Director of a Complementary and Alternative Medicine Specialised Research Center at the University of Maryland.
This book gives a superb account of how you find out the truth about medicines, and of how easy it is to be deceived about their efficacy.
I can’t do better than quote the review by Robert Park of the American Physical Society (his own book, Voodoo Science, is also excellent)
“Hang up your lantern, Diogenes, an honest man has been found. Barker Bausell, a biostatistician, has stepped out of the shadows to give us an insider’s look at how clinical evidence is manipulated to package and market the placebo effect. Labeled as ‘Complementary and Alternative Medicine’, the placebo effect is being sold, not just to a gullible public, but to an increasing number of health professionals as well. Bausell knows every trick and explains each one in clear language” |
Bausell’s conclusion is stronger than that of Singh and Ernst.
“There is no compelling, credible scientific evidence to suggest that any CAM therapy benefits any medical condition or reduces any medical symptom (pain or otherwise) better than a placebo”.
Here are two quotations from Bausell that I love.
[Page 22] ” seriously doubt, however, that there is a traditional Chinese medicine practitioner anywhere who ever stopped performing acupuncture on an afflicted body in the presence of similarly definitive negative evidence. CAM therapists simply do not value (and most cases, in my experience, do not understand) the scientific process”
And even better,
[Page39] “But why should nonscientists care one iota about something as esoteric as causal inference? I believe that the answer to this question is because the making of causal inferences is part of our job description as Homo Sapiens.”
Testing Treatments: Better Research for Better Healthcare
by Imogen Evans, Hazel Thornton, Iain Chalmers, British Library, 15 May 2006
You don’t even need to pay for this excellent book (but buy it anyway, eg from Amazon). If you can’t afford, £15 then download it from the James Lind Library.
This book is a unlike all the others, because it is barely mentions alternative medicine. What it does, and does very well, is to describe he harm that can be done to patients when they are treated on the basis of guesswork or ideology, rather than on the basis of proper tests. This, of course, is true whether or not the treatment is labelled ‘alternative’.
It is worth noting that one of the authors of this book is someone who has devoted much of his life to the honest assessement of evidence, Sir Iain Chalmers, one of the founders of the Cochrane Collaboration , and Editor of the James Lind Library . |
A central theme is that randomised double blind trial are essentially the only way to be sure you have the right answer. One of the examples that the authors use to illustrate this is Hormone Replacement Therapy (HRT). For over 20 years, women were told that HRT would reduce their risk of heart attacks and strokes. But when, eventually, proper randomised trials were done, it was found that precisely the opposite was true. The lives of many women were cut short because the RCT had not been done,
The reason why the observational studies gave the wrong answer is pretty obvious. HRT was used predominantly by the wealthier and better-educated women. Income is just about the best predictor of longevity. The samples were biassed, and when a proper RCT was done it was revealed that the people who used HRT voluntarily lived longer despite the HRT, not because of it. It is worth remembering that there are very few RCTs that test the effects of diet. And diet differs a lot between rich and poor people. That, no doubt, is why there are so many conflicting recommendations about diet. And that is why “nutritional therapy” is little more than quackery. Sadly, the media just love crap epidemiology. One of the best discussions of this topics was in Radio 4 Programme. “The Rise of the Lifestyle Nutritionists“, by Ben Goldacre.
One of the big problems in all assessment is the influence of money, in other words corruption, The alternative industry is entirely corrupt of course, but the pharmaceutical industry has been increasingly bad. Testing Treatments reproduces this trenchant comment.
Suckers. How Alternative Medicine Makes Fools of Us All
Rose Shapiro, Random House, London 2008
I love this book. It is well-researched, feisty and a thoroughly good read.
It was put well in the review by George Monbiot.
The chapters on osteopathy and chiropractic are particularly fascinating. |
This passage describes the founder of the chiropractic religion.
“By the 1890s Palmer had established a magnetic healing practice in Davenport, Iowa, and was styling himself ‘doctor’. Not everyone was convinced as a piece about him in an 1894 edition of the local paper, the Davenport Leader, shows.”
A crank on magnetism has a crazy notion hat he can cure the sick and crippled with his magnetic hands. His victims are the eak-minded, ignorant and superstitious, those foolish people who have been sick for years and have become tired of the regular physician and want health by the short-cut method . . . he has certainly profited by the ignorance of his victims . . . His increase in business shows what can be done in Davenport, even by a quack”
Over 100 years later, it seems that the “weak-minded, ignorant and superstitious” include the UK’s Department of Health, who have given these quacks a similar status to the General Medical Council.
The intellectual standards of a 19th Century mid-western provincial newspaper leader writer are rather better than the intellectual standards of the Department of Health, and of several university vice-chancellors in 2007.
Healing Hype or Harm
Edited by Imprint Academic (1 Jun 2008)
Download the contents page
My own chapter in this compilation of essays, “Alternative medicine in UK Universities” is an extended version of what was published in Nature last year (I don’t use the term CAM because I don’t believe anything can be labelled ‘complementary’ until it has been shown to work). Download a copy if the corrected proof of this chapter (pdf).
Perhaps the best two chapters, though, are “CAM and Politics” by Rose and Ernst, and “CAM in Court” by John Garrow.
CAM and politics gives us some horrifiying examples of the total ignorance of almost all politicians and civil servants about the scientific method (and their refusal to listen to anyone who does understand it). CAM in Court has some fascinating examples of prosecutions for defrauding the public. Recent changes in the law mean we may be seeing a lot more of these soon. Rational argument doesn’t work well very well with irrational people. But a few homeopaths in jail for killing people with malaria would probably be rather effective. |
Follow-up
Healing, Hype or Harm has had some nice reviews, That isn’t so surprising from the excellent Harriet Hall at Science-Based Medicine. The introduction to my chapter was a fable about the replacemment of the Department of Physics and Astronomy by the new Department of Alternative Physics and Astrology. It was an unashamedly based on Laurie Taylor’e University of Poppleton column. Hall refers to it as “Crislip-style”, a new term to me. I guess the incomparable Laurie Taylor is not well-known in the USA, Luckily Hall gives a link to Mark Crislip’s lovely article, Alternative Flight,
“Americans want choice. Americans are increasingly using alternative aviation. A recent government study suggests that 75% of Americans have attempted some form of alternative flight, which includes everything from ultralights to falling, tripping and use of bungee cords.”
“Current airplane design is based upon a white male Western European model of what powered flight should look like. Long metal tubes with wings are a phallic design that insults the sensibilities of women, who have an alternative, more natural, emotional, way of understanding airplane design. In the one size fits all design of allopathic airlines, alternative designs are ignored and airplane design utilizing the ideas and esthetics of indigenous peoples and ancient flying traditions are derided as primitive and unscientific, despite centuries of successful use.”
Metapsychology Online Reviews doesn’t sound like a promising title for a good review of Healing, Hype or Harm, but in fact their review by Kevin Purday is very sympathetic. I like the ending.
“One may not agree with everything that is written in this book but it is wonderful that academic honesty is still alive and well.”
“I don’t use the term CAM…”
How about “Supplementary, Complementary and Alternative Medicine”?
I’d just like to add that, while very much feeling that Singh and Ernst are the ‘home team’ and deserving of our support and I enjoyed their book, I really loved the careful precision of the arguments used by R. Barker Baussell. Being led through the the difficulties of doing good placebo-controlled trials and using acupuncture as the model system for the discussion was a joy. The fact that real scientists can see the difficulties, but can also overcome them, seems to be too hard a lesson for the gullible fans of SCAM who just parrot the dogma that their activities are ‘beyond science’.
What I liked about Singh and Ernst is the way in which they become progressively ruder about SCAM as the book progresses- the early chapters insert a gentle stiletto blade, but the book ends with a firm knee to the crotch of alternative medicine. Deeply satisfying.
[They have my permission to use the phrase “a firm knee to the crotch of alternative medicine” as part the blurb for the next printing]
Yes I’d be hard put to choose between Singh & Ernst and Bausell. There is a lot of overlap, and they are both terrific and transparently honest assessments. Any of them should be compulsory reading for Deans of Education in medical schools, To be honest, I probably enjoyed Suckers more than any of them, but perhaps it is more a book for those who already believe in evidence.
“The chapter about evidence is written by a librarian. Since the question of evidence is crucial, this is a fatal omission.”
I agree. “Knowing about/knowing how to find out about” is not the same as “knowing how”. I’m a trained librarian (though haven’t worked as such for several years) and while I could easily locate lots of information about evidence in the context of health care, any analysis I could offer would be, I think, superficial and vastly inferior to that by someone with thorough, specialist knowledge and experience in the area.
On the wider topic of the books reviewed, I must say that, as a parent who has to deal with allergy, these critical assessments of CAM are very welcome. I have read only the Ernst/Singh, but look forward to the others. Parents of allergic children (in my experience) can feel as if they are at the end of a veritable firehose of well-meant information about CAM “cures” from family, friends, mums at the school gate etc, mostly gleaned from the media and the internet and not infrequently accompanied by negative comments about conventional allergy/asthma medical treatment. It can be very unsettling and undermining. As a fairly middle-class, comfortably-off parent, I can afford to look into some of these suggestions (I have done) to see there is anything of merit (not much so far!). But what about parents struggling on a low income to bring up children with allergic disorders? Are they being made to feel that they are not doing the best for their children because they can’t afford this unproven food supplement or that unproven treatment? I really hope not.
Professor Ernst has recently given a summary of complementary therapies in asthma in Pulse: very few are deemed likely to be effective and here are those he assesses as unlikely to be beneficial:
“…Unlikely to be beneficial
Chiropractic: Most trials fail to indicate effectiveness.
Homeopathy: Best evidence shows no effectiveness for lung function and attack frequency.
Reflexology: Best studies fail to indicate effectiveness for attack frequency.
Selenium: Best evidence does not indicate effectiveness.
Spiritual healing: Best evidence shows no effectiveness.
Conclusions
Biofeedback and breathing techniques are likely to be beneficial as the risks are minor and the risk-benefit balance is likely to be positive. Complementary therapies should not be used as alternatives to conventional treatments that are clearly more effective.”
http://www.pulsetoday.co.uk/story.asp?sectioncode=18&storycode=4119744&c=1
[…] 3 Shapiro. Rose. Suckers. How Alternative Medicine Makes Fools of Us All Random House, London 2008. (reviewed here) […]
[…] have been some really excellent books about quackery this year. This isn’t one of […]
[…] were Simon Singh and me. Simon is author of, among other things, Fermat’s Last Theorem and Trick or Treatment. I thought he did an excellent job. Singh pointed out that, contrary to the view propagated by […]
[…] seems that Barts, like Edinburgh, has over-reacted to pressure from the General Medical Council (GMC). Actually all that the GMC […]
[…] medicine, I personally do not believe in it. I don’t take Chinese medicine.” “ Singh & Ernst Trick or Treatmant, page […]
[…] interpretations, written in a style quite understandable by humanities graduates. Try, for example, Trick or Treatment (Singh & Ernst, Bantam Press 2008): a copy should be presented to every person in the DoH and […]
[…] In the case of sausages and bacon, suppose that there is a correlation between eating them and developing colorectal cancer. How do we know that it was eating the bacon that caused the cancer – that the relationship is causal? The answer is that there is no way to be sure if we have simply observed the association. It could always be that the sort of people who eat bacon are also the sort of people who get colorectal cancer. But the question of causality is absolutely crucial, because if it is not causal, then stopping eating bacon won’t reduce your risk of cancer. The recommendation to avoid all processed meat in the WCRF report (2007) is sensible only if the relationship is causal. Barker Bausell said: […]
[…] seem to have noticed it. Has she not seen the Nordic Cochrane Centre report? Nor read Barker Bausell, or Singh & Ernst? Has she any interest in evidence that might reduce her income? […]
[…] huge efforts have gone into developing good controls in acupuncture studies (see, for example, Barker Bausell’s book, Snake Oil Science). And I hope that George will send the references for his “twice as effective” claim. […]
[…] In 1894, a local Iowa newspaper, The Davenport Leader, wrote of the founder of chripractic, D.D. Palmer, thus. “A crank on magnetism has a crazy notion hat he can cure the sick and crippled with his magnetic hands. His victims are the weak-minded, ignorant and superstitious,those foolish people who have been sick for years and have become tired of the regular physician and want health by the short-cut method he has certainly profited by the ignorance of his victim. His increase in business shows what can be done in Davenport, even by a quack.” [quoted in Rose Shapiro’s book, Suckers] […]
[…] “A crank on magnetism has a crazy notion hat he can cure the sick and crippled with his magnetic hands. His victims are the weak-minded, ignorant and superstitious, those foolish people who have been sick for years and have become tired of the regular physician and want health by the short-cut method he has certainly profited by the ignorance of his victim. His increase in business shows what can be done in Davenport, even by a quack.” [quoted in Rose Shapiro’s book, Suckers] […]
[…] Rose Shapiro, Suckers, how alternative medicine makes fools of us all. […]
[…] is somehow more respectable than, say, homeopathy and crystal healing. If you think that, read Barker Bausell’s book ot Trick or Treatment. It is now absolutely clear that ‘real’ acupuncture is […]
[…] read the outcome of NIH-funded studies on acupuncture as summarised by Barker Bausell in his book, Snake Oil Science? Apparently not. It’s hard to know because the report has no […]
[…] doesn’t matter much. Nobody has put it more clearly than Barker Bausell in his book, Snake Oil Science […]
[…] (20) Presenter asks McIntyre leading question "it does work for some and not for others ". No hint there that the ones it "works for" might be the ones who were going to get better anyway. McIntyre himself actual pointed out that some forms of MS (‘relapsing’) undergo spontaneous remissions but of course fails to draw the obvious conclusion that any. He apparent effect of acupuncture could well have been a spontaneous remission. He went on to say (without any evidence) that "acupuncture may help". He relied on the standard line that "more research needed", but failed to mention the vast amount of research that has already been done which shows that acupuncture is probably little more than a theatrical placebo. See, for example, the Nordic Cochrane Centre review and Barker Bausell’s book, Snake Oil Science. […]
[…] "analgesic effect of acupuncture is well documented". It is not. Try reading Barker Bausell’s excellent book, “Snake Oil Science” if you want to know about the strength of the […]
[…] up with research in these areas. Has he never read Barker Bausell’s book on acupuncture, Snake Oil Science.? Apparently not. And there is, of course, not the slightest reason to think that omega-3 or […]
[…] Joint pain hip – when and how to make your own doctor? |? health Hub Articles | Alternative MedicineGetting Flu Shots While on Remicade | Ulcerative Colitis Stories – Colitis Symptoms, Colitis Diet, Colitis MedicationsThoughts as You Approach Your Own DeathNatural Cancer Cure With Cesium Therapy |My brain, and some news about sameRene Agredano Reviews Dr. Dressler's Canine Cancer Survial Guide E-Book | Rene M. AgredanoAre there any alternative medicines for Depression? | Alternative Medicine Guide Apple Cidar Vinegar : Uoom… A fun placeAnswers Junction Five good books and a bad one […]
[…] students get some shocking stuff. St Bartholomew’s Hospital medical School was one example. Edinburgh University was another. But there is one Russell group university where alternative myths are propagated more […]
[…] Others have staunch defenders of quackery, including the University of Warwick, University of Edinburgh and St […]
[…] In the case of sausages and bacon, suppose that there is a correlation between eating them and developing colorectal cancer. How do we know that it was eating the bacon that caused the cancer – that the relationship is causal? The answer is that there is no way to be sure if we have simply observed the association. It could always be that the sort of people who eat bacon are also the sort of people who get colorectal cancer. But the question of causality is absolutely crucial, because if it is not causal, then stopping eating bacon won’t reduce your risk of cancer. The recommendation to avoid all processed meat in the WCRF report (2007) is sensible only if the relationship is causal. Barker Bausell said: […]
[…] The references to Devon and to Thought Field Therapy, make it very obvious that these letters were written by Dr Michael Dixon OBE, who was medical director of the Prince’s Foundation, and who is now a director of the "College of Medicine". And the object of Dixon’s bile is obviously Edzard Ernst (the quotation is from his book, Trick or Treatment). […]
[…] In the case of sausages and bacon, suppose that there is a correlation between eating them and developing colorectal cancer. How do we know that it was eating the bacon that caused the cancer – that the relationship is causal? The answer is that there is no way to be sure if we have simply observed the association. It could always be that the sort of people who eat bacon are also the sort of people who get colorectal cancer. But the question of causality is absolutely crucial, because if it is not causal, then stopping eating bacon won’t reduce your risk of cancer. The recommendation to avoid all processed meat in the WCRF report (2007) is sensible only if the relationship is causal. Barker Bausell said: […]