LOB-vs
Download Lectures on Biostatistics (1971).
Corrected and searchable version of Google books edition

Download review of Lectures on Biostatistics (THES, 1973).

Latest Tweets
Categories
Archives

Patrick Holford

Our undercover investigation finds evidence of nutritional therapists giving out advice that could seriously harm patients’ health

Jump to follow-up

That’s the title of an article in February’s Which? magazine. (That’s similar to Consumer Reports in the USA).

“When Which? sent researchers to investigate the quality of advice from nutritional therapists, some was so bad that patients’ health was put at risk. One nutritional therapist advised against surgery and radiotherapy to treat cancer, while another ‘diagnosed’ a problem with adrenal glands without any blood-test results. Some also used unproven testing, such as iridology or mineral testing, to identify problems or diagnose conditions.”

This sort of sting operation may seem a bit mean but there is no option. It’s the only way to discover what’s actually happening and it is very much in the public interest to know about that.

"Our panel of medical experts rated six of our 15 consultations as ‘dangerous fails’ – potentially endangering the health of our researchers – with a further eight rated as ‘fails’. Only one consultation of the 15 was deemed a borderline pass by our experts.”

which-1

"We sent five undercover researchers to visit three nutritional therapists each. Every researcher was equipped with a specific health-related scenario: Helen (46) and Sarah (40), recently diagnosed with Ductal Carcinoma In Situ (DCIS), the most common type of non-invasive breast cancer; Mark (56) and Linda (52), suffering with serious fatigue for the past three months; and Emily (31), trying unsuccessfully to conceive for more than a year."

 

Sarah, posing as a patient diagnosed with DCIS, visited a nutritional therapist who advised her to delay treatment recommended by her oncologist (a lumpectomy and a course of radiotherapy). The therapist suggested that Sarah follow a no-sugar diet for three to six months and told her, ‘cancer lives off sugar; if you feed it sugar it’s going to thrive. If we starve the cancer of sugar then you have a better opportunity of the cancer going away’.

When Sarah asked whether the cancer could progress during this time the therapist said it was a ‘gamble’.

Dr Margaret McCartney, from our panel of experts, says: ‘If cancer treatment were as simplistic as cutting out sugar, surely we would have discovered a cure. This advice is highly irresponsible.’ Our experts rated this consultation as a ‘dangerous fail’."

The Patients’ Guide to magic medicine defined “Nutritional therapy: self-styled ‘nutritionists’ making untrue claims about diet in order to sell you unnecessary supplements”. That turned out to be pretty accurate. They are part of the alternative medicine fringe.

The Universities Admission Service (UCAS) no longer lists any BSc/MSc degrees in "Nutritional Therapy" or "Nutritional medicine". Westminster University closed its BSc Nutritional Therapy during last year. We still don’t know the fate of the notorious (or should I say hilarious) course run at the Northern College of Acupuncture and validated (after a fashion) by the late University of Wales, but it isn’t listed for entry in 2012. [We do now: see follow-up‘]

But there are a large number of university courses called "Nutrition". How many of them teach properly, and how many of them teach the nonsense that prevails in "nutritional therapy", I don’t know. The term ‘nutrition’ has turned into a dangerous minefield. It can mean almost anything, because the term is undefined. Anyone can, and does, describe themselves as a nutritionist. At one extreme you have slick pills salesman like ‘not-a-Dr’ Gillian McKeith and Patrick Holford. At the other extreme you have a fascinating and respectable subject for study.

The one thing that you need to get clear is that if you want advice about nutrition, go to a dietitian not a "nutritionist". Dietitians are the properly qualified people who work in the NHS, and who are (mostly) free of crackpot ideas.

scores

methods

I suppose that one should not be surprised at the poor, and sometimes dangerous, advice that was given by nutritional therapists. Their training contains much nonsense so it isn’t surprising that they did so badly. Some of it has been revealed here. See, for example,

Another worthless validation: the University of Wales and nutritional therapy
Nutritional Fairy Tales from Thames Valley University
College of Natural Nutrition: bizarre teaching revealed
Nutriprofile: useful aid or sales scam? 
Response to a threatening letter from Mr Holford
Food for the Brain: Child Survey. A proper job?
Teaching bad science to children: OfQual and Edexcel are to blame
The last BSc (Hons) Homeopathy closes! But look at what they still teach at Westminster University.

The level of knowledge of both physiology and chemistry shown my some of the therapists was shocking. One recommended avoiding margarine, because it’s “two chemical bonds away from pure plastic”. Another said that Flora margarine contains lots of trans fat, which has not been true for a long time.

One graduate ot the late Thames Valley University course said “”advantage of the wholemeal or the wholegrain … is that they contain more fibre and the fibre stops the sugars being absorbed quite as quickly”. Not so. Brown and white bread have much the same glycaemic index (60 – 70).

Quack diagnosis

One alarming fact was that several therapists offered methods of diagnosis for allergy and for deficiencies that have been known for many years not to work. There isn’t anything controversial about iridology, hair mineral analysis, taste tests. kinesiology. or the Vega test. They are pure quackery.

“Professor David Colquhoun, from our panel of experts, said: ‘Sadly, nutritional therapy is plagued by “diagnostic tests” that are little more than quackery; they are tools to aid sales, rather than tools to diagnose deficiencies. Iridology and hair analysis simply don’t work.”

Unnecessary treatments

One therapist advised a researcher to have an optimum nutritional evaluation test, costing £312, and a cellular nutrition profile, costing £156. Apparently, these would allow the therapist to give a
more targeted service by establishing what vitamin and mineral deficiencies he had.
Our experts were not convinced by these tests and certainly didn’t think they were worth the money; any necessary testing
could be done by a GP for free.

In 12 of the 15 consultations, researchers were prescribed a huge range of supplements, costing up to £70 per month. It was not revealed whether or not the prescriber made money from this, but usually you were asked to give the prescriber’s name "to get a discount". So it’s a fair guess that they got kickbacks.

British Association for Applied Nutrition & Nutritional Therapy (BANT)

Despite the low standards of advice, 13 out of the 14 therapists who were visited were registered with BANT, the British Association for Applied Nutrition & Nutritional Therapy. This is what passes for a professional association for nutritional therapists, though like all such bodies in alternative medicine, it is entirely ineffective as a regulator. Rather it serves to protect whatever untrue claims they make. BANT’s code of practice says that its members won’t diagnose, but in fact many of the therapists diagnosed conditions and created treatment plans. You can be confident that BANT will do nothing to stop this bad practice.

You can find out a lot about BANT from these sources:

British Association for Nutritional Therapy – when an organisation looks like a regulator, quacks like a regulator, but isn’t a regulator
Why it is easy to get the incorrect impression that BANT is a regulator
Nutritional Therapists Fail to Join Ofquack
BANT: A Profile
Matthias Rath drops his million pound legal case against me and the Guardian.

Only 3 of the 14 therapists were registered with the Complementary and Natural Healthcare Council (the CNHC, more commonly know as Ofquack). They are meant to be the official regulator, launched with a good chunk of taxpayers’ money, but registration is voluntary and not many have volunteered. As a requlator, Ofquack is a bad joke.

Conclusion

"Dr Margaret McCartney says: ‘This investigation appears to show that high street nutritional therapists are a waste of money. If you have symptoms please see your GP, not someone who can’t diagnose accurately.’ If you’re looking for tailored dietary advice, visit a registered dietitian.
"

There is a discussion of this topic on the Which? magazine site.

Follow-up

The excellent Quackometer has posted simultaneously on the great nutritional therapy scam.

16 January 2012 The British Dietetic Association issued a press release that describes very clearly the many differences between a real dietitian and a "nutritional therapist". Download Leading UK Nutrition Association Urges Awareness Between Dietitians and Nutritionists (pdf).

16 January 2012 BANT issued a press release. Download Are Nutritional Therapists Gambling with Your Health?. It answers none of the serious questions raised by the Which? investigation.   BANT moans that that Which?  “did not provide all the promised transcripts/questionnaires in a timely fashion”.   In fact they got them before Christmas and were given until January 15th to respond.

16 January 2012. BBC Radio 4 programme, You and Yours, had an item with Jenny Driscoll from Which? magazine and BANT chairperson, Catherine Honeywell. She did, inter alia, admit that some of the behaviour of the therapists were irresponsible. It remains to be seen if they do anything about it. don’t hold your breath. Hear it on BBC iPlayer.

16 January 2012. There was pretty god coverage of the story, even in the Daily Mail.

17 January 2012 Another question answered. I just learned that the ludicrous course in Nutritional Therapy, previously validated by the University of Wales (and a contributor to its downfall), is now being validated by, yes, you guessed, Middlesex University. Professor Driscoll seems determined to lead his univerity to the bottom of the academic heap. His new partnership with the Northern college of Acupuncture is just one of a long list of validations that almost rivals that of the late University of Wales. The course has, of course, an enthusiastic testimonial, from a student. It starts

I work full time as a team leader for a pension company but I am also a kinesiologist and work in my spare time doing kinesiology, reiki and Indian head massage.

Evidently she’s a believer in the barmiest and totally disproved forms of magic medicine. And Middlesex University will give her a Master of Science degree. I have to say I find it worrying that she’s a team leader for a pension company. Does she also believe in the value of worthless derivatives. I wonder?

17 January 2012 The discussion is going on at the Which? web site. A Chris James cast doubt on the reaults because ot the small sample size, and asked for confidence limits, so I gave them.

Chris James

It is easy enough to calculate limits yourself -you don’t even need to be able to do the maths -there are web calculators that do it for you, e.g. http://www.causascientia.org/math_stat/ProportionCI.html

14/15 = 93% failed. 95% confidence limits for this are 69.8% to 98.4%

6/15 = 40% gave dangerous advice 95% confidence limits 19.7% to 64.6%

So despite the small sample size we can say that it’s likely that at least 70% (and possibly 98%) of nutritional therapists fail.

And it is likely that at least 20% (and possibly 65%) of nutritional therapists give dangerous advice.

These results give real cause for concern, despite the small sample size.

For statistical enthusiasts, these limits are Bayesian with a uniform prior. Very much the same result is given by the standard analysis which is explained in section 7.7 of Lectures on Biostatistics [download pdf 10.5 Mb]

18 January 2012. BANT has, at last, produced an “updated response”. The good thing is that it starts by saying

” . . it is completely outside the BANT Code of Practice to advise a client to withhold any treatment for cancer for any period of time in order to follow a nutritional approach. Were a client to be advised in such a way we would expect to receive a complaint against the practitioner.”

I hope that this will happen. This statement, the only admission of guilt in BANT’s response, is rather spoiled by a later suggestion that no such recommendation was made. It looked very clear to both Which? magazine and to the three members of the expert panel.

The rest of the response admits no fault of any sort.

I’m sorry to say that the response by BANT shows very clearly what is wrong in nutritional therapy. Any organisation which can see nothing wrong in the advice given in 14 of the 15 consultations is, I’d argue, a threat to the health of the nation. Rather than saying we’ll try to improve, they just deny everything.

The response seems to show that the professional organisation for nutritional therapists is not part of the solution. Rather it is part of the problem.

The last few weeks have produced yet another example of how selective reporting can give a very misleading impression.

As usual, the reluctance of the media to report important negative results is, in part, to blame..

The B vitamins are a favourite of the fraudulent supplements industry. One of theit pet propositions is that they will prevent dementia. The likes of Patrick Holford were, no doubt, delighted when a study from Oxford University, published on September 8th, seemed to confirm their ideas. The paper was Homocysteine-Lowering by B Vitamins Slows the Rate of Accelerated Brain Atrophy in Mild Cognitive Impairment: A Randomized Controlled Trial. (Smith AD, Smith SM, de Jager CA, Whitbread P, Johnston C, et al. (2010)).

The main problem with this paper was that it did not measure dementia at all, but a surrogate outcome, brain shrinkage. There are other problems too. They were quickly pointed out in blogs, particularly by the excellent Carl Heneghan of the Oxford Centre for Evidence Based Medicine, at Vitamin B and slowing the rate of Brain Atrophy: the numbers don’t add up. Some detailed comments on this post were posted at Evidence Matters, David Smith, B vitamins and Alzheimer’s Disease.

This paper was reported very widely indeed. A Google search for ‘Vitamin B Alzheimer’s Smith 2010’ gives over 90,000 hits at the time of posting. Most of those I’ve checked report this paper uncritically. The Daily Mail headline was 10p pill to beat Alzheimer’s disease: Vitamin B halts memory loss in breakthrough British trial, though in fairness to Fiona MacRae, she did include at the end

“The Alzheimer’s Society gave the research a cautious welcome. Professor Clive Ballard said: ‘This could change the lives of thousands of people at risk of dementia. However, previous studies looking at B vitamins have been very disappointing and we wouldn’t want to raise people’s expectations yet.’ “

That caution was justified because a mere two weeks later, on September 22nd, another paper appeared, in the journal Neurology.. The paper is Vitamins B12, B6, and folic acid for cognition in older men, by Ford et al. It appears to contradict directly Smith et al. but it didn’t measure the same thing. This one measured what actually matters.

“The primary outcome of interest was the change in the cognitive subscale of the Alzheimer’s Disease Assessment Scale (ADAS-cog). A secondary aim of the study was to determine if supplementation with vitamins decreased the risk of cognitive impairment and dementia over 8 years.”

The conclusion was negative.

Conclusions: The daily supplementation of vitamins B12, B6, and folic acid does not benefit cognitive function in older men, nor does it reduce the risk of cognitive impairment or dementia.”

Disgracefully, this paper has hardly been reported at all.

It is an excellent example of how the public is misled because of the reluctance of the media to publish negative results. Sadly that reluctance is sometimes also shown by academic journals, but not in this case.

Two things went wrong, The first was near-universal failure to evaluate critically the Smith et al paper. The second was to ignore the paper that measured what actually matters.

It isn’t as though there wasn’t a bit of relevant history, Prof Smith was one of the scientific advisors for Patrick Holford’s Food for the Brain survey. This survey was, quie rightly, criticised for being uninterpretable. When asked about this, Smith admitted as much, as recounted in Food for the Brain: Child Survey. A proper job?.

Plenty has been written about Patrick Holford, here and elsewhere. There is even a web site that is largely devoted to dispelling his myths, Holford Watch. He merited an enture chapter in Ben Goldacre’s book, Bad Science. He is an archetypal pill salesman and the sciencey talk seems to be largely used as a sales tool.

It might have been relevant too, to notice that the Smith et al. paper stated

Competing interests: Dr. A. D. Smith is named as an inventor on two patents held by the University of Oxford on the use of folic acid to treat Alzheimer’s disease (US6008221; US6127370); under the University’s rules he could benefit financially if the patent is exploited. 

There is, of course, no reason to think that the interpretation of the data was influenced by he fact that the first author had a financial interest in the outcome. In fact university managers encourage that sort of thing strongly.

Personally, I’m more in sympathy with the view expressed by Strohman (1997)

“academic biologists and corporate researchers have become indistinguishable, and special awards are given for collaborations between these two sectors for behaviour that used to be cited as a conflict of interest”.

When it comes to vitamin pills, caveat emptor.