science
In the course of thinking about metrics, I keep coming across cases of over-promoted research. An early case was “Why honey isn’t a wonder cough cure: more academic spin“. More recently, I noticed these examples.
“Effect of Vitamin E and Memantine on Functional Decline in Alzheimer Disease".(Spoiler -very little), published in the Journal of the American Medical Association. ”
and ” Primary Prevention of Cardiovascular Disease with a Mediterranean Diet” , in the New England Journal of Medicine (which had second highest altmetric score in 2013)
and "Sleep Drives Metabolite Clearance from the Adult Brain", published in Science
In all these cases, misleading press releases were issued by the journals themselves and by the universities. These were copied out by hard-pressed journalists and made headlines that were certainly not merited by the work. In the last three cases, hyped up tweets came from the journals. The responsibility for this hype must eventually rest with the authors. The last two papers came second and fourth in the list of highest altmetric scores for 2013
Here are to two more very recent examples. It seems that every time I check a highly tweeted paper, it turns out that it is very second rate. Both papers involve fMRI imaging, and since the infamous dead salmon paper, I’ve been a bit sceptical about them. But that is irrelevant to what follows.
Boost your memory with electricity
That was a popular headline at the end of August. It referred to a paper in Science magazine:
“Targeted enhancement of cortical-hippocampal brain networks and associative memory” (Wang, JX et al, Science, 29 August, 2014)
This study was promoted by the Northwestern University "Electric current to brain boosts memory". And Science tweeted along the same lines.
Science‘s link did not lead to the paper, but rather to a puff piece, "Rebooting memory with magnets". Again all the emphasis was on memory, with the usual entirely speculative stuff about helping Alzheimer’s disease. But the paper itself was behind Science‘s paywall. You couldn’t read it unless your employer subscribed to Science.
|
All the publicity led to much retweeting and a big altmetrics score. Given that the paper was not open access, it’s likely that most of the retweeters had not actually read the paper. |
|
When you read the paper, you found that is mostly not about memory at all. It was mostly about fMRI. In fact the only reference to memory was in a subsection of Figure 4. This is the evidence.
That looks desperately unconvincing to me. The test of significance gives P = 0.043. In an underpowered study like this, the chance of this being a false discovery is probably at least 50%. A result like this means, at most, "worth another look". It does not begin to justify all the hype that surrounded the paper. The journal, the university’s PR department, and ultimately the authors, must bear the responsibility for the unjustified claims.
Science does not allow online comments following the paper, but there are now plenty of sites that do. NHS Choices did a fairly good job of putting the paper into perspective, though they failed to notice the statistical weakness. A commenter on PubPeer noted that Science had recently announced that it would tighten statistical standards. In this case, they failed. The age of post-publication peer review is already reaching maturity
Boost your memory with cocoa
Another glamour journal, Nature Neuroscience, hit the headlines on October 26, 2014, in a paper that was publicised in a Nature podcast and a rather uninformative press release.
"Enhancing dentate gyrus function with dietary flavanols improves cognition in older adults. Brickman et al., Nat Neurosci. 2014. doi: 10.1038/nn.3850.".
The journal helpfully lists no fewer that 89 news items related to this study. Mostly they were something like “Drinking cocoa could improve your memory” (Kat Lay, in The Times). Only a handful of the 89 reports spotted the many problems.
A puff piece from Columbia University’s PR department quoted the senior author, Dr Small, making the dramatic claim that
“If a participant had the memory of a typical 60-year-old at the beginning of the study, after three months that person on average had the memory of a typical 30- or 40-year-old.”
Like anything to do with diet, the paper immediately got circulated on Twitter. No doubt most of the people who retweeted the message had not read the (paywalled) paper. The links almost all led to inaccurate press accounts, not to the paper itself. |
|
But some people actually read the paywalled paper and post-publication review soon kicked in. Pubmed Commons is a good site for that, because Pubmed is where a lot of people go for references. Hilda Bastian kicked off the comments there (her comment was picked out by Retraction Watch). Her conclusion was this.
"It’s good to see claims about dietary supplements tested. However, the results here rely on a chain of yet-to-be-validated assumptions that are still weakly supported at each point. In my opinion, the immodest title of this paper is not supported by its contents."
(Hilda Bastian runs the Statistically Funny blog -“The comedic possibilities of clinical epidemiology are known to be limitless”, and also a Scientific American blog about risk, Absolutely Maybe.)
NHS Choices spotted most of the problems too, in "A mug of cocoa is not a cure for memory problems". And so did Ian Musgrave of the University of Adelaide who wrote "Most Disappointing Headline Ever (No, Chocolate Will Not Improve Your Memory)",
Here are some of the many problems.
- The paper was not about cocoa. Drinks containing 900 mg cocoa flavanols (as much as in about 25 chocolate bars) and 138 mg of (−)-epicatechin were compared with much lower amounts of these compounds
- The abstract, all that most people could read, said that subjects were given "high or low cocoa–containing diet for 3 months". Bit it wasn’t a test of cocoa: it was a test of a dietary "supplement".
- The sample was small (37ppeople altogether, split between four groups), and therefore under-powered for detection of the small effect that was expected (and observed)
- The authors declared the result to be "significant" but you had to hunt through the paper to discover that this meant P = 0.04 (hint -it’s 6 lines above Table 1). That means that there is around a 50% chance that it’s a false discovery.
- The test was short -only three months
- The test didn’t measure memory anyway. It measured reaction speed, They did test memory retention too, and there was no detectable improvement. This was not mentioned in the abstract, Neither was the fact that exercise had no detectable effect.
- The study was funded by the Mars bar company. They, like many others, are clearly looking for a niche in the huge "supplement" market,
The claims by the senior author, in a Columbia promotional video that the drink produced "an improvement in memory" and "an improvement in memory performance by two or three decades" seem to have a very thin basis indeed. As has the statement that "we don’t need a pharmaceutical agent" to ameliorate a natural process (aging). High doses of supplements are pharmaceutical agents.
To be fair, the senior author did say, in the Columbia press release, that "the findings need to be replicated in a larger study—which he and his team plan to do". But there is no hint of this in the paper itself, or in the title of the press release "Dietary Flavanols Reverse Age-Related Memory Decline". The time for all the publicity is surely after a well-powered study, not before it.
The high altmetrics score for this paper is yet another blow to the reputation of altmetrics.
One may well ask why Nature Neuroscience and the Columbia press office allowed such extravagant claims to be made on such a flimsy basis.
What’s going wrong?
These two papers have much in common. Elaborate imaging studies are accompanied by poor functional tests. All the hype focusses on the latter. These led me to the speculation ( In Pubmed Commons) that what actually happens is as follows.
- Authors do big imaging (fMRI) study.
- Glamour journal says coloured blobs are no longer enough and refuses to publish without functional information.
- Authors tag on a small human study.
- Paper gets published.
- Hyped up press releases issued that refer mostly to the add on.
- Journal and authors are happy.
- But science is not advanced.
It’s no wonder that Dorothy Bishop wrote "High-impact journals: where newsworthiness trumps methodology".
It’s time we forgot glamour journals. Publish open access on the web with open comments. Post-publication peer review is working
But boycott commercial publishers who charge large amounts for open access. It shouldn’t cost more than about £200, and more and more are essentially free (my latest will appear shortly in Royal Society Open Science).
Follow-up
Hilda Bastian has an excellent post about the dangers of reading only the abstract "Science in the Abstract: Don’t Judge a Study by its Cover"
4 November 2014
I was upbraided on Twitter by Euan Adie, founder of Almetric.com, because I didn’t click through the altmetric symbol to look at the citations "shouldn’t have to tell you to look at the underlying data David" and "you could have saved a lot of Google time". But when I did do that, all I found was a list of media reports and blogs -pretty much the same as Nature Neuroscience provides itself.
More interesting, I found that my blog wasn’t listed and neither was PubMed Commons. When I asked why, I was told "needs to regularly cite primary research. PubMed, PMC or repository links”. But this paper is behind a paywall. So I provide (possibly illegally) a copy of it, so anyone can verify my comments. The result is that altmetric’s dumb algorithms ignore it. In order to get counted you have to provide links that lead nowhere.
So here’s a link to the abstract (only) in Pubmed for the Science paper http://www.ncbi.nlm.nih.gov/pubmed/25170153 and here’s the link for the Nature Neuroscience paper http://www.ncbi.nlm.nih.gov/pubmed/25344629
It seems that altmetrics doesn’t even do the job that it claims to do very efficiently.
It worked. By later in the day, this blog was listed in both Nature‘s metrics section and by altmetrics. com. But comments on Pubmed Commons were still missing, That’s bad because it’s an excellent place for post-publications peer review.
Stop press. Financial report casts doubt on Trainor’s claims
Science has a big problem. Most jobs are desperately insecure. It’s hard to do long term thorough work when you don’t know whether you’ll be able to pay your mortgage in a year’s time. The appalling career structure for young scientists has been the subject of much writing by the young (e.g. Jenny Rohn) and the old, e.g Bruce Alberts. Peter Lawrence (see also Real Lives and White Lies in the Funding of Scientific Research, and by me.
Until recently, this problem was largely restricted to post-doctoral fellows (postdocs). They already have PhDs and they are the people who do most of the experiments. Often large numbers of them work for a single principle investigator (PI). The PI spends most of his her time writing grant applications and traveling the world to hawk the wares of his lab. They also (to variable extents) teach students and deal with endless hassle from HR.
The salaries of most postdocs are paid from grants that last for three or sometimes five years. If that grant doesn’t get renewed. they are on the streets.
Universities have come to exploit their employees almost as badly as Amazon does.
The periodical research assessments not only waste large amounts of time and money, but they have distorted behaviour. In the hope of scoring highly, they recruit a lot of people before the submission, but as soon as that’s done with, they find that they can’t afford all of them, so some get cast aside like worn out old boots. Universities have allowed themselves to become dependent on "soft money" from grant-giving bodies. That strikes me as bad management.
The situation is even worse in the USA where most teaching staff rely on research grants to pay their salaries.
I have written three times about the insane methods that are being used to fire staff at Queen Mary College London (QMUL).
Is Queen Mary University of London trying to commit scientific suicide? (June 2012)
Queen Mary, University of London in The Times. Does Simon Gaskell care? (July 2012) and a version of it appeared th The Times (Thunderer column)
In which Simon Gaskell, of Queen Mary, University of London, makes a cock-up (August 2012)
The ostensible reason given there was to boost its ratings in university rankings. Their vice-chancellor, Simon Gaskell, seems to think that by firing people he can produce a university that’s full of Nobel prize-winners. The effect, of course, is just the opposite. Treating people like pawns in a game makes the good people leave and only those who can’t get a job with a better employer remain. That’s what I call bad management.
At QMUL people were chosen to be fired on the basis of a plain silly measure of their publication record, and by their grant income. That was combined with terrorisation of any staff who spoke out about the process (more on that coming soon).
Kings College London is now doing the same sort of thing. They have announced that they’ll fire 120 of the 777 staff in the schools of medicine and biomedical sciences, and the Institute of Psychiatry. These are humans, with children and mortgages to pay. One might ask why they were taken on the first place, if the university can’t afford them. That’s simply bad financial planning (or was it done in order to boost their Research Excellence submission?).
Surely it’s been obvious, at least since 2007, that hard financial times were coming, but that didn’t dent the hubris of the people who took an so many staff. HEFCE has failed to find a sensible way to fund universities. The attempt to separate the funding of teaching and research has just led to corruption.
The way in which people are to be chosen for the firing squad at Kings is crude in the extreme. If you are a professor at the Institute of Psychiatry then, unless you do a lot of teaching, you must have a grant income of at least £200,000 per year. You can read all the details in the Kings’ “Consultation document” that was sent to all employees. It’s headed "CONFIDENTIAL – Not for further circulation". Vice-chancellors still don’t seem to have realised that it’s no longer possible to keep things like this secret. In releasing it, I take ny cue from George Orwell.
"Journalism is printing what someone else does not want printed: everything else is public relations.”
There is no mention of the quality of your research, just income. Since in most sorts of research, the major cost is salaries, this rewards people who take on too many employees. Only too frequently, large groups are the ones in which students and research staff get the least supervision, and which bangs per buck are lowest. The university should be rewarding people who are deeply involved in research themselves -those with small groups. Instead, they are doing exactly the opposite.
Women are, I’d guess, less susceptible to the grandiosity of the enormous research group, so no doubt they will suffer disproportionately. PhD students will also suffer if their supervisor is fired while they are halfway through their projects.
An article in Times Higher Education pointed out
"According to the Royal Society’s 2010 report The Scientific Century: Securing our Future Prosperity, in the UK, 30 per cent of science PhD graduates go on to postdoctoral positions, but only around 4 per cent find permanent academic research posts. Less than half of 1 per cent of those with science doctorates end up as professors."
The panel that decides whether you’ll be fired consists of Professor Sir Robert Lechler, Professor Anne Greenough, Professor Simon Howell, Professor Shitij Kapur, Professor Karen O’Brien, Chris Mottershead, Rachel Parr & Carol Ford. If they had the slightest integrity, they’d refuse to implement such obviously silly criteria.
Universities in general. not only Kings and QMUL have become over-reliant on research funders to enhance their own reputations. PhD students and research staff are employed for the benefit of the university (and of the principle investigator), not for the benefit of the students or research staff, who are treated as expendable cost units, not as humans.
One thing that we expect of vice-chancellors is sensible financial planning. That seems to have failed at Kings. One would also hope that they would understand how to get good science. My only previous encounter with Kings’ vice chancellor, Rick Trainor, suggests that this is not where his talents lie. While he was president of the Universities UK (UUK), I suggested to him that degrees in homeopathy were not a good idea. His response was that of the true apparatchik.
“. . . degree courses change over time, are independently assessed for academic rigour and quality and provide a wider education than the simple description of the course might suggest”
That is hardly a response that suggests high academic integrity.
The students’ petition is on Change.org.
Follow-up
The problems that are faced in the UK are very similar to those in the USA. They have been described with superb clarity in “Rescuing US biomedical research from its systemic flaws“, This article, by Bruce Alberts, Marc W. Kirschner, Shirley Tilghman, and Harold Varmus, should be read by everyone. They observe that ” . . . little has been done to reform the system, primarily because it continues to benefit more established and hence more influential scientists”. I’d be more impressed by the senior people at Kings if they spent time trying to improve the system rather than firing people because their research is not sufficiently expensive.
10 June 2014
Progress on the cull, according to an anonymous correspondent
“The omnishambles that is KCL management
1) We were told we would receive our orange (at risk) or green letters (not at risk, this time) on Thursday PM 5th June as HR said that it’s not good to get bad news on a Friday!
2) We all got a letter on Friday that we would not be receiving our letters until Monday, so we all had a tense weekend
3) I finally got my letter on Monday, in my case it was “green” however a number of staff who work very hard at KCL doing teaching and research are “orange”, un bloody believable
As you can imagine the moral at King’s has dropped through the floor”
18 June 2014
Dorothy Bishop has written about the Trainor problem. Her post ends “One feels that if KCL were falling behind in a boat race, they’d respond by throwing out some of the rowers”.
The students’ petition can be found on the #KCLHealthSOS site. There is a reply to the petition, from Professor Sir Robert Lechler, and a rather better written response to it from students. Lechler’s response merely repeats the weasel words, and it attacks a few straw men without providing the slightest justification for the criteria that are being used to fire people. One can’t help noticing how often knighthoods go too the best apparatchiks rather than the best scientists.
14 July 2014
A 2013 report on Kings from Standard & Poor’s casts doubt on Trainor’s claims
Download the report from Standard and Poor’s Rating Service
A few things stand out.
- KCL is in a strong financial position with lower debt than other similar Universities and cash reserves of £194 million.
- The report says that KCL does carry some risk into the future especially that related to its large capital expansion program.
- The report specifically warns KCL over the consequences of any staff cuts. Particularly relevant are the following quotations
- Page p3 “Further staff-cost curtailment will be quite difficult …pressure to maintain its academic and non-academic service standards will weigh on its ability to cut costs further.”
- page 4 The report goes on to say (see the section headed outlook, especially the final paragraph) that any decrease in KCL’s academic reputation (e.g. consequent on staff cuts) would be likely to impair its ability to attract overseas students and therefore adversely affect its financial position.
- page 10 makes clear that KCL managers are privately aiming at 10% surplus, above the 6% operating surplus they talk about with us. However, S&P considers that ‘ambitious’. In other words KCL are shooting for double what a credit rating agency considers realistic.
One can infer from this that
- what staff have been told about the cuts being an immediate necessity is absolute nonsense
- KCL was warned against staff cuts by a credit agency
- the main problem KCL has is its overambitious building policy
- KCL is implementing a policy (staff cuts) which S & P warned against as they predict it may result in diminishing income.
What on earth is going on?
16 July 2014
I’ve been sent yet another damning document. The BMA’s response to Kings contains some numbers that seem to have escaped the attention of managers at Kings.
10 April 2015
King’s draft performance management plan for 2015
This document has just come to light (the highlighting is mine).
It’s labelled as "released for internal consultation". It seems that managers are slow to realise that it’s futile to try to keep secrets.
The document applies only to Institute of Psychiatry, Psychology and Neuroscience at King’s College London: "one of the global leaders in the fields" -the usual tedious blah that prefaces every document from every university.
It’s fascinating to me that the most cruel treatment of staff so often seems to arise in medical-related areas. I thought psychiatrists, of all people, were meant to understand people, not to kill them.
This document is not quite as crude as Imperial’s assessment, but it’s quite bad enough. Like other such documents, it pretends that it’s for the benefit of its victims. In fact it’s for the benefit of willy-waving managers who are obsessed by silly rankings.
Here are some of the sillier bits.
"The Head of Department is also responsible for ensuring that aspects of reward/recognition and additional support that are identified are appropriately followed through"
And, presumably, for firing people, but let’s not mention that.
"Academics are expected to produce original scientific publications of the highest quality that will significantly advance their field."
That’s what everyone has always tried to do. It can’t be compelled by performance managers. A large element of success is pure luck. That’s why they’re called experiments.
" However, it may take publications 12-18 months to reach a stable trajectory of citations, therefore, the quality of a journal (impact factor) and the judgment of knowledgeable peers can be alternative indicators of excellence."
It can also take 40 years for work to be cited. And there is little reason to believe that citations, especially those within 12-18 months, measure quality. And it is known for sure that "the quality of a journal (impact factor)" does not correlate with quality (or indeed with citations).
Later we read
"H Index and Citation Impact: These are good objective measures of the scientific impact of
publications"
NO, they are simply not a measure of quality (though this time they say “impact” rather than “excellence”).
The people who wrote that seem to be unaware of the most basic facts about science.
Then
"Carrying out high quality scientific work requires research teams"
Sometimes it does, sometimes it doesn’t. In the past the best work has been done by one or two people. In my field, think of Hodgkin & Huxley, Katz & Miledi or Neher & Sakmann. All got Nobel prizes. All did the work themselves. Performance managers might well have fired them before they got started.
By specifying minimum acceptable group sizes, King’s are really specifying minimum acceptable grant income, just like Imperial and Warwick. Nobody will be taken in by the thin attempt to disguise it.
The specification that a professor should have "Primary supervision of three or more PhD students, with additional secondary supervision." is particularly iniquitous. Everyone knows that far too many PhDs are being produced for the number of jobs that are available. This stipulation is not for the benefit of the young. It’s to ensure a supply of cheap labour to churn out more papers and help to lift the university’s ranking.
The document is not signed, but the document properties name its author. But she’s not a scientist and is presumably acting under orders, so please don’t blame her for this dire document. Blame the vice-chancellor.
Performance management is a direct incentive to do shoddy short-cut science.
No wonder that The Economist says "scientists are doing too much trusting and not enough verifying—to the detriment of the whole of science, and of humanity".
Feel ashamed.
Being interested in science communication, I was pleased when the BMJ asked me to review Unscientific America , by Chris Monney and Sheril Kirshenbaum.
The BMJ provides a link that allows you access to the whole review. They have made very few changes from the submitted version, which is reproduced below (with live links in the text. [Download pdf of print version]
I very soon discovered that the book had already caused ructions in the USA, as a result of its advocacy of appeasement of religious groups. In particular there was all out war with P.Z.Myers, whose very popular blog, Pharyngula. documented the battle in detail).
It is an American book through and through, and in the USA the biggest threat to reason comes from the far-right religious fundamentalists who preach young-earth creationism. It is said that 46% of US citizens believe that the earth is less than 10,000 years old. The same far-right religious groups also preach that carrying guns is good, that Iraq was responsible for 9/11, that climate change is a socialist conspiracy and that health care for everyone is a communist plot. And they never hesitate to lie in the promotion of their ‘religious’ views. The US situation is totally different from that in Europe, where religion is all but dead, and young earth creationism is the preserve of a few cranky used-car dealers (and possibly Tony Blair?)
Review of the Week Trust me, I’m a scientist David Colquhoun, professor of pharmacology, University College London Unscientific America sounds like a fascinating topic, not least because the book is a follow-up from Mooney’s The Republican War on Science. It is written entirely from a US perspective (the USA sequenced the genome and invented the internet, apparently unaided). It’s reported that 46 percent of Americans believe that the earth is less than 10,000 years old. That’s certainly cause for alarm and Mooney & Kirshenbaum are certainly alarmed. They think that the public needs to be educated in science. They identify the obvious problems, evolution, climate change and quackery and ask what can be done. The problem is that they propose no good solutions, and some bad ones. Their aims are worthy but sometimes the book reads like an over-long and somewhat condescending whine about why science and scientists are not sufficiently appreciated. I simply don’t think that it’s true that the public are not interested in science, nor that they can’t understand it at a level that is sufficient to be useful. It’s true that they have been let down badly by some sections of the media. Think particularly of the “great MMR hoax”1. The disastrous fall in vaccination is more attributable to talk show presenters and air-headed celebrities than to lack of interest from the public. People are systematically deceived by anti-vaxers, climate change denialists, vitamin pill salesmen and a horde of crackpot alternative therapists. There is one problem that Mooney & Kirshenbaum don’t talk about at all, yet it seems to me to be one of the biggest problems in science communication. It isn’t lack of interest by the public, nor even lack of understanding, but lack of trust. The tendency of real science to indulge in hyperbolic self-promotion is one reason for the lack of trust. Sometimes this descends into outright dishonesty2,3. That is a tendency that is promoted by government and funding agencies by their insistence on imposing silly performance measures. The public is quite sensible enough to take with a pinch of salt the almost daily announcements of “cancer cures” that emanate from university press offices. On the face of it, one should be encouraged that ‘public engagement in science’ is the mode du jour. It isn’t quite that simple though. Only too often, universities regard public engagement as a branch of their own PR machine4. They even instruct you about what tone of voice to use when talking publicly. One reason why scientists need to talk to people outside the lab is precisely to counteract this tide of nonsense from PR people, who are paid to deceive. The problem for academics is usually time. We already do three jobs, teaching, research and coping with HR bollocks. How can we find time for a fourth job? That’s not easy, especially for the best researchers (those that do research themselves, not just lead a team). Mooney & Kirshenbaum suggest that the solution is to create a “cadre of communication and outreach experts”. I don’t think this would work. They would, by and large, be outsiders, writing uncritical paeans, dictated by big name scientists. A new cadre of PR hangers-on does not sound like a great idea. A better, and very much cheaper, solution would be to provide a course in free blogging software and we’ll do it ourselves. The two chapters that I looked forward to reading, on religion and on “The bloggers cannot save us”, proved deeply disappointing. The authors are firmly in the camp of what Richard Dawkins called the “Neville Chamberlain school of evolutionists&rdquo.; They maintain “if the goal is to create an America more friendly to science and reason, the combativeness of the New Atheists is strongly counterproductive”. They are particularly critical of P.Z. Myers5, the University of Minnesota developmental biologist who is splendidly clear in his views. Of the communion wafer, he famously said “It’s a frackin’ cracker”. But he, and Dawkins, are right. When it comes to young earth creationists we have a war on our hands, and nowhere more than in the USA. What’s more it’s a winnable war. Mooney & Kirshenbaum are all for appeasement, but appeasement won’t work. It might please the more moderate wings of the church, but they already believe in evolution and are regarded by fundamentalists as being just as big an enemy as Myers and Dawkins. And, one must ask, who has done best at getting a wide public readership? P.Z Myers’ blog, Pharyngula, has up to two million page views a month. Dawkins’ book The God Delusion has sold three million copies. In comparison the bland and often rather condescending corporate science web sites get tiny numbers of hits. In Europe in general, and the UK in particular, young earth creationists are not the major problem that they are in the USA, despite being supported by Tony Blair6. Perhaps the nearest analogy in Europe is the threat to reason from various sorts of crackpot medicine. The appeasers are widespread. The Royal Colleges and the Department of Health are at the forefront of the Neville Chamberlain approach. But appeasement hasn’t worked there either. What has worked is the revelation that university courses are teaching that “amethysts emit high yin energy”7. Or, in a lecture on herbal approaches for patients with cancer, “Legally, you cannot claim to cure cancer. This is not a problem because: ‘we treat people, not diseases’ “8. This is shocking stuff but it has not been unearthed by the corporate media, but by bloggers. I think Mooney and Kirshenbaum have it all wrong. They favour corporate communications, which are written by people outside science and which easily become mere PR machines for individuals and institutions. Such blogs are rarely popular and at their worst they threaten the honesty of science. More and more individual scientists have found that they can write their own blog. It costs next to nothing and you can say what you think. A few clicks and the world can read what you have to say. Forget corporate communications. Just do it yourself. It’s fun. And think of the money you’d save for doing science if the PR people were just fired. (1) Goldacre, B. The media’s MMR hoax. 2008 http://www.badscience.net/2008/08/the-medias-mmr-hoax/ (2) PLoS One. Ghostwriting documents now fully available on PLoS Medicine website. 21-8-2009 http://speakingofmedicine.plos.org/2009/08/21/ghostwriting-documents-now-fully-available-on-plos-medicine-website/ (3) Colquhoun, D. Universities Inc. in the UK. The Corporate Corruption of Higher Education: part 2. 6-12-2007 https://www.dcscience.net/?p=193 (4) Corbyn, Z. Nottingham raises eyebrows over definition of ‘public engagement’. 21-8-2008 http://www.timeshighereducation.co.uk/story.asp?sectioncode=26&storycode=403234 (5) Myers, P. Z. Pharyngula. 2009 http://scienceblogs.com/pharyngula/ (6) Pyke, N. Revealed: Blair’s link to schools that take the Creation literally (Independent 13 June 2004). 13-7-2004 http://www.independent.co.uk/news/uk/politics/revealed-blairs-link-to-schools-that-take-the-creation-literally-732032.html (7) Colquhoun, D. Westminster University BSc: "amethysts emit high yin energy". 23-4-2008 https://www.dcscience.net/?p=227 (8) Colquhoun, D. Herbal approaches for patients with cancer. 10-8-2009 https://www.dcscience.net/?p=2043 |
Follow-up
P.Z. Myers has posted about thie book review, on Pharyngula, as Is this book dead yet? There are a lot more comments there than here, though few of them address the question of science communications..
Butterflies and Wheels is generating a lot of hits
First the MHRA lets down the public by allowing deceptive labelling of sugar pills (see here, and this this blog). Now it is the turn of NICE to betray its own principles.
The National Institute for Health and Clinical Excellence (NICE) describes its job thus
“NICE is an independent organisation responsible for providing national guidance on promoting good health and preventing and treating ill health.”
Its Guidance document on Low Back Pain will be published on Wednesday 27 May 2009, but the newspapers have already started to comment, presumably on the assumption that it will have changed little from the Draft Guidance of September 2008. These comments may have to be changed as soon as the final version becomes available.
The draft guidance, though mostly sensible, has two recommendations that I believe to be wrong and dangerous. The recommendations include (page 7) these three.
- Consider offering a course of manual therapy including spinal manipulation of up to 9 sessions over up to 12 weeks.
- Consider offering a course of acupuncture needling comprising up to 10 sessions over a period of up to 12 weeks.
- Consider offering a structured exercise programme tailored to the individual.
All three of this options are accompanied by a footnote that reads thus.
“A choice of any of these therapies may be offered, taking into account patient preference.”
On the face if it, this might seem quite reasonable. All three choices seem to be about as effective (or ineffective) as each other, so why not let patients choose between them?
Actually there are very good reasons, but NICE does not seem to have thought about them. In the past I have had a high opinion of NICE but it seems that even they are now getting bogged down in the morass of political correctness and officialdom that is the curse of the Department of Health. It is yet another example of DC’s rule number one.
Never trust anyone who uses the word ‘stakeholder’.
They do use it, often.
So what is so wrong?
For a start, I take it that the reference to “spinal manipulation” in the first recommendation is a rather cowardly allusion to chiropractic. Why not say so, if that’s whar you mean? Chiropractic is mentioned in the rest of the report but the word doesn’t seem to occur in the recommendations. Is NICE perhaps nervous that it would reduce the credibility of the report if the word chiropractic were said out loud?
Well, they have a point, I suppose. It would.
That aside, here’s what’s wrong.
The Evidence
I take as my premise that the evidence says that no manipulative therapy has any great advantage over the others. They are all more or less equally effective. Perhaps I should say, more or less equally ineffective, because anyone who claims to have the answer to low back pain is clearly deluded (and I should know: nobody has fixed mine yet). So for effectiveness there are no good grounds to choose between exercise, physiotherapy, acupuncture or chiropractic. There is, though, an enormous cultural difference. Acupuncture and chiropractic are firmly in the realm of alternative medicine. They both invoke all sorts of new-age nonsense for which there isn’t the slightest good evidence. That may not poison your body, but it certainly poisons your mind.
Acupuncturists talk about about “Qi”, “meridians”, “energy flows”. The fact that “sham” and “real” acupuncture consistently come out indistinguishable is surely all the evidence one needs to dismiss such nonsense. Indeed there is a small group of medical acupuncturists who do dismiss it. Most don’t. As always in irrational subjects, acupuncture is riven by internecine strife between groups who differ in the extent of their mystical tendencies,
Chiropractors talk of “subluxations”, an entirely imaginary phenomenon (but a cause of much unnecessary exposure to X-rays). Many talk of quasi-religious things like “innate energy”. And Chiropractic is even more riven by competing factions than acupuncture. See, for example, Chiropractic wars Part 3: internecine conflict.
The bait and switch trick
This is the basic trick used by ‘alternative therapists’ to gain respectability.
There is a superb essay on it by the excellent Yale neurologist Steven Novella: The Bait and Switch of Unscientific Medicine. The trick is to offer some limited and reasonable treatment (like back manipulation for low back pain). This, it seems, is sufficient to satisfy NICE. But then, once you are in the showroom, you can be exposed to all sorts of other nonsense about “subluxations” or “Qi”. Still worse, you will also be exposed to the claims of many chiropractors and acupuncturists to be able to cure all manner of conditions other than back pain. But don’t even dare to suggest that manipulation of the spine is not a cure for colic or asthma or you may find yourself sued for defamation. The shameful legal action of the British Chiropractic Association against Simon Singh (follow it here) led to an addition to DC’s Patients’ Guide to Magic Medicine.
(In the face of such tragic behaviour, one has to be able to laugh).
Libel: A very expensive remedy, to be used only when you have no evidence. Appeals to alternative practitioners because truth is irrelevant.
NICE seems to have fallen for the bait and switch trick, hook line and sinker.
The neglected consequences
Once again, we see the consequences of paying insufficient attention to the Dilemmas of Alternative Medicine.
The lying dilemma
If acupuncture is recommended we will have acupuncturists telling patients about utterly imaginary things like “Qi” and “meridians”. And we will have chiropractors telling them about subluxations and innate energy. It is my opinion that these things are simply make-believe (and that is also the view of a minority of acupuncturist and chiropractors). That means that you have to decide whether the supposed benefits of the manipulation are sufficient to counterbalance the deception of patients.
Some people might think that it was worth it (though not me). What is unforgivable is not to consider even the question. The NICE guidance says not a word about this dilemma. Why not?
The training dilemma
The training dilemma is even more serious. Once some form of alternative medicine has successfully worked the Bait and Switch trick and gained a toehold in the NHS, there will be an army of box-ticking HR zombies employed to ensure that they have been properly trained in “subluxations” or “Qi”. There will be quangos set up to issue National Occupational Standards in “subluxations” or “Qi”. Skills for Health will issue “competences” in “subluxations” or “Qi” (actually they already do). There will be courses set up to teach about “subluxations” or “Qi”, some even in ‘universities’ (there already are).
The respectability problem
But worst of all, it will become possible for aupuncturists and chiropractors to claim that they now have official government endorsement from a prestigious evidence-based organisation like NICE for “subluxations” or “Qi”. Of course this isn’t true. In fact the words “subluxations” or “Qi” are not even mentioned in the draft report. That is the root of the problem. They should have been. But omitting stuff like that is how the Bait and Switch trick works.
Alternative medicine advocates crave, above all, respectability and acceptance. It is sad that NICE seems to have given them more credibility and acceptance without having considered properly the secondary consequences of doing so,
How did this failure of NICE happen?
It seems to have been a combination of political correctness, failure to consider secondary consequences, and excessive influence of the people who stand to make money from the acceptance of alternative medicine.
Take, for example, the opinion of the British Pain Society. This organisation encompasses not just doctors. It
includes “doctors, nurses, physiotherapists, scientists, psychologists, occupational therapists and other healthcare professionals actively engaged in the diagnosis and treatment of pain and in pain research for the benefit of patients”. Nevertheless, their response to the draft guidelines pointed out that the manipulative therapies as a whole were over-represented.
Manipulation The guidelines assess 9 large groups of interventions of which manual therapies are only one part. The full GDG members panel of 13 individuals included two proponents of spinal manipulation/mobilisation (P Dixon and S Vogel). In addition, the chair of the panel (M Underwood) is the lead author of the UKBEAM trial on which the positive recommendation for |
It seems that the Pain Society were quite right.
LBC 97.3 Breakfast Show (25 May 2009) had a quick discussion on acupuncture (play mp3 file). After I had my say, the other side was put by Rosey Grandage. She has (among other jobs) a private acupuncture practice so she is not quite as unbiassed as me). As usual, she misrepresents the evidence by failing to distinguish between blind and non-blind studies. She also misrepresented what I said by implying that I was advocating drugs. That was not my point and I did not mention drugs (they, like all treatments, have pretty limited effectiveness, and they have side effects too). She said “there is very good evidence to show they (‘Qi’ and ‘meridians’] exist”. That is simply untrue.
There can’t be a better demonstration of the consequences of falling for bait and switch than the defence mounted by Rosey Grandage. NICE may not mention “Qi” and “meridians”; but the people they want to allow into the NHS have no such compunctions.
I first came across Rosey Grandage when I discovered her contribution to the Open University/BBC course K221. That has been dealt with elsewhere. A lot more information about acupuncture has appeared since then. She doesn’t seem to have noticed it. Has she not seen the Nordic Cochrane Centre report? Nor read Barker Bausell, or Singh & Ernst? Has she any interest in evidence that might reduce her income? Probably not.
Where to find out more
An excellent review of chiropractic can be found at the Layscience site. It was written by the indefatigable ‘Blue Wode’ who has provided enormous amounts of information at the admirable ebm-first site (I am authorised to reveal that ‘Blue Wode’ is the author of that site). There you will also find much fascinating information about both acupuncture and about chiropractic.
I’m grateful to ‘Blue Wode’ for some of the references used here.
Follow-up
Herbal medicine is, unlike homeopathy, not ridiculous, It is merely Pharmacology, as practised up to circa 1900. Whereas good trials have now shown acupuncture to be sham and homeopathy to be a placebo, there has been very little good research on herbs.
Most herbalism could fairly be described giving to sick patients an unknown dose of a substance with unknown efficacy and unknown safety.
How odd, then, to visit the Royal Society of Medicine to be greeted thus.
Just look at the words!
“Traditional Chinese Medicine (TCM) has developed over thousands of years”
That’s partly true
“and provides a comprehensive and systematic understanding of the natural world and the treatment of the human body.”
and that is total nonsense. TCM provides no understanding and virtually none of it is known to be useful for treating anything.
Another poster at the RSM exhibition provides some of the explanation. What on earth, one wonders, do they mean by “making efforts to modernise TCM “? So far, the idea of modernising TCM doesn’t seem to include any great effort to find out if it works. Much of the promotion of TCM seems to be not so much ‘ancient wisdom’, but modern nationalist propaganda by the Chinese government. |
The history is fascinating, but you won’t learn it from the posters on display at the exhibition.
“The Daoguang emperor though it [acupuncture] was a barrier to medical progress and removed it from the curriculum of the Imperial Medical Institute,”
“By the start of the twentieth century, acupuncture was extinct in the West and dormant in the East. It might have fallen out of favour permanently, but it suddenly experienced a revival in 1949 as a direct result of the communist revolution and the establishment of the People’s Republic of China. Chairman Mao Tse-tung engineered a resurgence in traditional Chinese medicine, which included not just acupuncture but also Chinese herbal medicine and other therapies ”
“His motivation was partly ideological, inasmuch as he wanted to reinforce a sense of national pride in Chinese medicine. However he was also driven by necessity. He had promised to deliver affordable healthcare .. . . ”
“Mao did not care whether traditional Chinese medicine worked, as long as he could keep the masses contented. In fact, his personal physician, Zhisui Li, wrote a memoir entitled ‘The Private Life of Chairman Mao’, in which he quoted Mao as saying”
“Even though I believe we should promote Chinese medicine, I personally do not believe in it. I don’t take Chinese medicine.” “
Singh & Ernst Trick or Treatmant, page 46.
Or, as put more succinctly by Shapiro
“You would never know that TCM was fashioned in the twentieth century, as we shall see, from a ragbag of therapies in post-revolutionary China.”
Rose Shapiro, Suckers, how alternative medicine makes fools of us all.
Why is the Royal Society of Medicine allowing such mendacious posters? As it happens, I and a friend were visiting the RSM to see their Academic Dean, with a view to finding out why the RSM had failed to take any public position on alternative medicine. The answer appeared to be money, and that was the answer to why the TCM exhibition was being held on their premises too. The Dean no more believed in TCM than we did, but, well, they need the income. He pointed out (looking suitably sheepish) that the address given for the exhibition was not the RSM, but Number 1 Wimpole Street (that, of course, is also the address of the RSM).
Ah, so that’s OK then.
It has to be said that the RSM isn’t alone in its spineless attitude. Both the British Medical Association (BMA) and the Royal College of General Practitioners (RCGP) have failed to make any clear condemnation of mystical medicine. This is in stark contrast to just about every relevant scientific society (here is a summary).
It is a mystery to me why much of medicine should still be dominated by a mindset that seems to have lagged 200 years behind every other science. Perhaps medicine is just too complicated.
UCL Hospitals’ skeleton in the cupboard
Make no mistake, University College London Hospital is top class. The UCLH Trust. runs seven hospitals All but one of them are excellent. But in 2002 the Royal London Homeopathic Hospital was acquired as part of the UCLH group, to the intense embarrassment of UCL scientists.
Let’s start with the good bit. Usually I don’t like anecdotes, so just think of this as a vote of thanks, not evidence.
A personal history of UCH
I owe UCLH a lot personally. On December 13th 1984, my wife had
a subarachnoid haemorrhage when she was seven months pregnant. After misdiagnosis at St Peter’s Hospital, Chertsey, she was moved to UCH and diagnosed very quickly. The next day she had neurosurgery to pin an aneurysm at the Maida Vale Neurosurgical Hospital, part of the UCLH group (it no longer exists). The surgeon, Alan Crockard, came out of theatre after five hours, looking rather tired and said “it was adhered to the optic chiasma on one side and about a millilmetre from the pituitary on the other. It was a bit tricky but I think we got it”.
After a week in intensive care, under heavy sedation, Margaret’s blood pressure was not low enough and they decided to deliver the baby. At about 4 pm on a snowy Christmas Eve, a team of neurosurgeons and a team of obstetricians gathered and soon after, Andrew Stuart Colquhoun emerged in a small incubator to be whisked off in an ambulance to the Special Care Baby Unit at UCH (run, at that time, by Osmund Reynolds).. Christmas day was spent in the hospital, with Margaret’s mother. Andrew weighed 1.4 kg at birth, but by Christmas day he had pulled out his ventilator himself, and was doing fine. He was so tiny that it was a couple of days before I dared to hold him. The Unit had racks of doll-sized clothes, knitted by volunteers. |
Andrew (at 9 days) and Dad. Jan 2, 1985. Click for album.. |
Once Margaret was well enough, she was given a side room in a neurosurgical ward with a cot for Andrew by her bed, an arrangement that gave the neurosurgical nurses some fun. They were in UCLH continuously until 27th April before Margaret had recovered enough to go home, [Full photo album here]
Now they are both fine.and Andrew is 6′ 7″ (200.5 cm)..
It is episodes like this that make one very proud of the NHS. Heaven knows what it would have cost in the USA.
Margaret & Andrew, with carer, Anna, June 2, 1985 |
Andrew playing cricket in Bangladesh, Feb 2005. |
But now the the less desirable side of UCLH
Herbs and homeopaths at UCLH
Recently I was sent the UCLH Annual Review 2007 – 2008. There was a lot of good stuff in it and worth a read despite there being too much hyperbole and too many pictures of men in dark suits. But buried among all the high tech stuff, what do we find but an advertisement for 1900-style pharmacology in the form of the herbal clinic at the Royal London Homeopathic Hospital, accompanied by a load of utterly inaccurate information from the TV botanist, David Bellamy. Take, for example, the claim about Devil’s Claw for osteoarthritis. Even alternative medicine advocates said “The authors concluded that there are insufficient high-quality trials to determine the safety and efficacy of Devil’s Claw (Harpagophytum procumbens) in the treatment of osteoarthritis, and that definitive trials are needed.”
Reading between the lines, I’d guess that the opening of this clinic has a subtext. It is well known that funding for homeopathy has dried up (partly as a result of our letter to NHS Trusts that appeared in the There have been problems before with the herbal activities at the RLHH before (see Conflicts of Interest at the Homeopathic Hospital). It appeared that the Khans, who run the Marigold homeopathic podiatry clinic (no, seriously, it is real) were largely prescribing a herbal product that was made by their own company. without even the hospital trust, never mind the patients, being made aware of it. In normal medicine this would be regarded as a rather serious offence, but as far as I know, nothing was ever done about it. |
The ethics of alternative medicine are truly one of life’s great mysteries.
Reading further in the annual review, we come to the page about the RLHH. The homeopathy side must really have run down because it seems to have diversified into selling cosmetics and groceries. That sounds like desperation.
Good heavens, they sell “chemical-free sun cream”. One wonders what it can be made of, if not chemicals. This is the language of low-grade advertising agencies, not what one expects from an NHS hospital trust.
But next to this there is a much more interesting item. Just look at the last sentence.
I wonder if this could possibly have anything to do with the fact that Michael Baum and I visited the Trust headquarters in August 2006 to propose that the RLHH might be turned into a centre of supportive and palliative care? It would be nice to think so. But it seems they haven’t gone nearly far enough yet. If all they do is replace the waning homeopathy We know they are under pressure from their royal patrons, but that, in a constitutional monarchy, is simply not acceptable. |
Michael Baum is a cancer surgeon who has taken a particular interest in palliative and supportive care. He is someone whose views should be taken seriously. He is also the author of the magnificent “An open letter to the Prince of Wales: with respect, your highness, you’ve got it wrong” Here is a quotation from that letter. The UCLH Trust should bear it in mind.
The power of my authority comes with a knowledge built on 40 years of study and 25 years of active involvement in cancer research. I’m sensitive to the danger of abusing this power and, as a last resort, I know that the General Medical Council (GMC) is watching over my shoulder to ensure I respect a code of conduct with a duty of care that respects patients’ dignity and privacy and reminds me that my personal beliefs should not prejudice my advice. Your power and authority rest on an accident of birth. Furthermore, your public utterances are worthy of four pages, whereas, if lucky, I might warrant one. I don’t begrudge you that authority and we probably share many opinions about art and architecture, but I do beg you to exercise your power with extreme caution when advising patients with life threatening diseases to embrace unproven therapies. There is no equivalent of the GMC for the monarchy, so it is left either to sensational journalism or, more rarely, to the quiet voice of loyal subjects such as myself to warn you that you may have overstepped the mark. It is in the nature of your world to be surrounded by sycophants (including members of the medical establishment hungry for their mention in the Queen’s birthday honours list) who constantly reinforce what they assume are your prejudices. Sir, they patronise you! Allow me this chastisement. |
Follow-up
The photo album chronicling the birth of my son, is really just for family and friends, but at least one blog picked up on the wider significance.
It’s hard enough to communicate basic ideas about how to assess evidence to adults without having the effort hindered by schools.
The teaching of quackery to 16 year-olds has been approved by a maze of quangos, none of which will take responsibility, or justify their actions. So far I’ve located no fewer than eight of them.
[For non-UK readers, quango = Quasi-Autonomous Non-Governmental Organisation].
A lot of odd qualifications are accredited by OfQual (see here). Consider, for example, Edexcel Level 3 BTEC Nationals in Health and Social Care (these exams are described here), Download the specifications here and check page 309.
Unit 23: Complementary Therapies for Health and Social Care
NQF Level 3: BTEC National
Guided learning hours: 60Unit abstract
“In order to be able to take a holistic view towards medicine and health care, health and social care professionals need to understand the potential range of complementary therapies available and how they may be used in the support of conventional medicine.”
Well, Goldacre has always said that homeopathy makes the perfect vehicle for teaching how easy it is to be deceived by bad science, so what’s wrong? But wait
“Learners will consider the benefits of complementary therapies to health and wellbeing, as well as identifying any contraindications and health and safety issues in relation to their use.”
Then later
“The holistic approach to illnesses such as cancer could be used as a focus here. For example, there could be some tutor input to introduce ideas about the role of complementary therapies in the treatment and management of cancer, this being followed up by individual or small group research by learners using both the internet and the services available locally/regionally. If available, a local homeopathic hospital, for example, would be an interesting place to visit.”
It’s true that to get a distinction, you have to “evaluate the evidence relating to the use of complementary therapies in contemporary society”, but it isn’t at all clear that this refers to evidence about whether the treatment works.
The really revealing bit comes when you get to the
“Indicative reading for learners
There are many resources available to support this unit.Websites
www.acupuncture.org.uk British Acupuncture Council
www.bant.org.uk British Association for Nutritional Therapy
www.exeter.ac.uk/sshs/compmed Exeter University’s academic department of Complementary medicine
www.gcc-uk.org General Chiropractic Council
www.nimh.org.uk National Institute of Medical Herbalists
www.nursingtimes.net The Nursing Times
www.osteopathy.org.uk General Osteopathic Council
www.the-cma.org.uk The Complementary Medical Association”
This list is truly astonishing. Almost every one of them can be relied on to produce self-serving inaccurate information about the form of “therapy” it exists to promote. The one obvious exception is the reference to Exeter University’s academic department of complementary medicine (and the link to that one is wrong). The Nursing Times should be an exception too, but their articles about CAM are just about always written by people who are committed to it.
It is no consolation that the 2005 version was even worse. In its classification of ‘therapies’ it said “Pharmaceutically mediated: eg herbalism, homeopathy “. Grotesque! And this is the examinng body!
The Teacher
This particular educational disaster came to my attention when I had a letter from a teacher. She had been asked to teach this unit, and wanted to know if I could provide any resources for it. She said that Edexcel hadn’t done so. She asked ” Do you know of any universities that teach CT’s [sic] so I could contact them about useful teaching resources?.” She seemed to think that reliable information about homeopathy could be found from a ‘university’ homeopathy teacher. Not a good sign. It soon emerged why.
She said.
“My students are studying BTEC National Health Studies and the link is Edexcel BTEC National Complimentary [sic] studies.”
“I am a psychotherapist with an MA in Education and Psychology. I am also trained in massage and shiatsu and have plenty of personal experience of alternative therapy”
Shiatsu uh? It seems the teacher is already committed to placebo medicine. Nevertheless I spent some time looking for some better teaching material for 16 year-old children. There is good stuff at Planet
Science, and in some of the pamphlets from Sense about Science, not least their latest, I’ve got nothing to lose by trying it – A guide to weighing up claims about cures and treatments. I sent all this stuff to her, and prefaced the material by saying
“First of all, I should put my cards on the table and say that I am quite appalled by the specification of Unit 23. In particular, it has almost no emphasis at all on the one thing that you want to know about any therapy, namely does it work? The reference list for reading consists almost entirely of organisations that are trying to sell you various sorts of quackery, There is no hint of balance; furthermore it is all quite incompatible with unit 22, which IS concerned with evidence.”
At this point the teacher the teacher came clean too, As always, anyone who disagrees with the assessment (if any) of the evidence by a true believer is unmeasured and inflammatory.
“I have found your responses very unmeasured and inflammatory and I am sorry to say that this prejudicial attitude has meant that I have not found your comments useful.”
shortly followed by
“I am not coming from a scientific background, neither is the course claiming to be scientific.”
That will teach me to spend a couple of hours trying to help a teacher.
What does Edexcel say?
I wrote to Edexcel’s science subject advisors with some questions about what was being taught. The response that I got was not from the science subject advisors but from the Head of Customer support, presumably a PR person.
From: (Bola Arabome) 12/11/2008 04.31 PM
Dear Professor Colquhoun Thank you for email communication concerning the complementary therapies unit which is available in our BTEC National in Health and BTEC National in Health and Social Care qualifications. I have replied on behalf of Stephen Nugus, our science subject advisor, because your questions do not refer to a science qualification. I would like to answer your questions as directly as possible and then provide some background information relating to the qualifications. The units and whole qualifications for all awarding bodies are accredited by the regulator, the Qualifications and Curriculum Authority. The resource reading list is also produced by us to help teachers and learners. The qualification as a whole is related to the National Occupational Standards for the vocational sectors of Health and Health and social care with consultation taken from the relevant sector skills councils . As you will be aware many of these complementary therapies are available in care centres and health centres under the NHS and in the private sector. The aim of BTEC qualifications is to prepare people for work in these particular sectors. Clearly a critical awareness is encouraged with reference to health and safety and regulation. There are other units, in some cases compulsory, within the qualification with a scientific approach. ‘ ‘ ‘ ‘ ‘ Stephen Harris Head of Customer Support |
Aha, so it seems that teaching people to treat sick patients is “not a science qualification”. Just a business qualification perhaps?. I haven’t yet managed to reach the people who make these decisions, so I persisted with the PR man. Here is part of the next letter (Edexcel’s reply in italic).
19 November
I find it quite fascinating that Edexcel regards the treatment of sick patients as not being part of science (“do not refer to a science qualification”). Does that mean Edexcel regard the “Health” part of “Health and Social Care” as being nothing to do with science, and that it therefore doesn’t matter if Health Care is unscientific, or even actively anti-scientific? I am sorry if my answer lacked clarity. My comment, that I had taken your enquiry on behalf of our Science Advisor because this was not a science qualification, was intended to explain why I was replying. It was not intended as a comment on the relationship between Health and Social Care and science. At Edexcel we use bureaucratic categories where we align our management of qualifications with officially recognised occupational sectors. Often we rely on sector bodies such as Sector Skills Councils to endorse or even approve the qualifications we offer. Those involved in production of our Science qualifications and our (4) You say “The qualification as a whole is related to the National Occupational Standards for the vocational sectors of Health and Health and social care with consultation taken from the relevant sector skills councils”. Are you aware that the Skills for Health specifications for Alternative medicine were written essentially by the Prince of Wales Foundation? The qualification was approved by both ‘Skills for Health’ and ‘Skills for Care and Development’ prior to being accredited by QCA. It uses the NOS in Health and Social Care as the basis for many of the mandatory units. The ‘Complementary Therapies’ NOS were not used. This was not a requirement of a ‘Health and Social Care’ qualification. “Are the NOS in Health and Social Care that you mention the ones listed here? http://www.ukstandards.org/Find_Occupational_Standards.aspx?NosFindID=1&ClassificationItemId=174 If so, I can see nothing there about ‘complementary therapies’. if I have missed it, I’d be very grateful if you could let me know where it is. If it is not there, I remain very puzzled about the provenance of Unit 23, since you say it is not based on Skills for Health.” |
Now we are immediately at sea, struggling under a tidal wave of acronyms for endless overlapping quangos. In this one short paragraph we have no fewer than four of them. ‘Skills for Health’, ‘Skills for Care and Development’ , ‘Quality and Curriculum Authority (QCA) and NOS.
It seems that the specification of unit 23 was written by Edexcel, but Harris (25 Nov) declines to name those responsible
“When I refer to our “Health and Social care team” I mean the mix of Edexcel Staff and the associates we employ on a contract basis as writers, examiners and external verifiers. The writers are generally recruited from those who are involved in teaching and assessment the subjects in schools and colleges. The editorial responsibility lies with the Edexcel Staff. I do not have access to the names of the writers and in any case would not be able to pass on this information. Specifications indicate the managers responsible for authorising publication”
“Edexcel takes full responsibility for its ethical position on this and other issues. However we can not accept responsibility for the opinions expressed in third party materials. There is a disclaimer to this effect at the beginning of the specification. ”
” You have the correct link to the Health NOS . These are the standards, which where appropriate, influence our qualifications. However in the case of Unit 23 I understand that there is no link with the Health NOS. I don’t know if the NOS cover the unit 23 content.”
So, contrary to what I was told at first, neither Skills for Health, nor NOS were involved Or were they (see below)?
So who does take responsibility? Aha that is secret. And the approval by the QCA is also secret.
“I cannot provide you with copies of any correspondence between Skills for Health and Edexcel. We regard this as confidential. “
What does the QCA say?
The strapline of the QCA is
“We are committed to building a world-class education and training framework. We develop and modernise the curriculum, assessments, examinations and qualifications.”
Referring school children to the Society of Homeopaths for advice seems to be world-class bollocks rather than world-class education.
When this matter was brought to light by Graeme Paton in the Daily Telegraph, he quoted Kathleen Tattersall, CEO of the QCA. She said
“The design of these diplomas has met Ofqual’s high standards. We will monitor them closely as they are delivered to make sure that learners get a fair deal and that standards are set appropriately.”
Just the usual vacuous bureaucratic defensive sound-bite there. So I wrote to Kathleen Tattersall myself with some specific questions. The letter went on 2nd September 2008. Up to today, 26 November, I had only letters saying
“Thank you for your email of 12 November addressed to Kathleen Tattersall, a response is being prepared which will be forwarded to you shortly.”
“Thank you for your email of 25th November addressed to Kathleen Tattersall. A more detailed response is being prepared which will be sent to you shortly.”
Here are some of the questions that I asked.
I wrote to Edexcel’s subject advisors about unit 23 and I was told “your questions do not refer to a science qualification”. This seems to mean that if it comes under the name “Health Care” then the care of sick patients is treated as though it were nothing to do with science, That seems to me to be both wrong and dangerous, and I should like to hear your view about that question.
Clearly the fundamental problem here is that the BTEC is intended as a vocational training for careers in alternative medicine, As a body concerned with education, surely you cannot ignore the view of 99% of scientists and doctors that almost all alternative medicine is fraud. That doesn’t mean that you can’t make a living from it, but it surely does create a dilemma for an educational organisation. What is your view of that dilemma? |
Eventually, on 27th November, I get a reply (of sorts) It came not from the Kathleen Tattersall of the QCA but from yet another regulatory body, OfQual, the office of the Qualifications and Examinations Regulator. You’d think that they’d know the answers, but if they do they aren’t telling, [download whole letter. It is very short. The “more detailed response” says nothing.
Ofqual does not take a view on the detailed content of vocational qualifications as that responsibility sits with the relevant Sector Skills Council which represents employers and others involved in the sector. Ofqual accredits the specifications, submitted by sector-skilled professionals, after ensuring they meet National Occupational Standards. Ofqual relies on the professional judgement of these sector-skilled professionals to include relevant subjects and develop and enhance the occupational standards in their profession. The accreditation of this BTEC qualification was supported by both Skills for Health, and Skills for Care and Development, organisations which represent the emerging Sector Qualifications Strategies and comply with the relevant National Occupational Standards Isabel Nisbet Acting Chief Executive |
So no further forward. Every time I ask a question, the buck gets passed to another quango (or two, or three). This letter, in any case, seems to contradict what Edexcel said about the involvement of Skills for Health (that’s the talking to trees outfit),
A nightmare maze of quangos
You may well be wondering what the relationship is between Ofqual and the QCA. There is an ‘explanation’ here.
Ofqual will take over the regulatory responsibilities of the Qualifications and Curriculum Authority (QCA), with stronger powers in relation to safeguarding the standards of qualifications and assessment and an explicit remit as a market regulator. The QCA will evolve into the Qualifications and Curriculum Development Agency (QCDA): supporting Ministers with advice and undertaking certain design and delivery support functions in relation to the curriculum, qualifications, learning and development in the Early Years Foundation Stage, and National Curriculum and Early Years Foundation Stage assessments.
Notice tha QCA won’t be abolished. There will be yet another quango.
The result of all this regulatory bureaucracy seems to be worse regulation, Exactly the same thing happens with accreditiation of dodgy degrees in universities.
At one time, a proposal for something like Unit 23 would have been shown to any competent science teacher, who would have said”you must be joking” and binned it. Now a few hundred bureaucrats tick their boxes and rubbish gets approved.
There seems to be nobody in any of these quangos with the education to realise that if you want to know the truth about homeopathy, the last person you ask is the Society of Homeopaths or the Prince of Wales.
What next?
So the mystery remains. I can’t find out who is responsible for the provenance of the appallingly anti-science Unit 23, and I can’t find out how it got approved. Neither can I get a straight answer to the obvious question about whether it is OK to encourage vocational qualifications for jobs that are bordering on being fraudulent.
.All I can get is platitudes and bland assurances. Everything that might be informative is clouded in secrecy.
The Freedom of Information requests are in. Watch this space. But don’t hold your breath.
Follow-up
Here are some attempts to break through the wall of silence.
Edexcel. I sent them this request.
Freedom of Information Act
Hello
I should like to see please all documents from Edexcel and OfQual or QCA (and communications between then) that concern the formulation and approval of Unit 23 (Complementary Therapies) in the level3 BTEC (page 309 in attached document). In vew of the contentious nature of the subject matter, I believe that is is in the public interest that this information be provided
David Colquhoun
The answer was quite fast, and quite unequivocal, Buzz off.
Dear Mr Colquhoun,
Thank you of your e-mail of today’s date. I note your request for information pursuant to The Freedom of Information Act. As you may know this Act only applies to public bodies and not to the private sector. Edexcel Limited is privately owned and therefore not subject to this Act. Edexcel is therefore not obliged to provide information to you and is not prepared to give you the information you seek. Please do not hesitate to contact me again if you have any further queries. Kate Gregory |
This lack of public accountability just compounds their appalling inability to distinguish education from miseducation.
International Therapy Examination Council (ITEC)
Mojo’s comment, below, draws attention to the Foundation degree in Complementary Therapies offered by Cornwall College, Camborne, Cornwall (as well as to the fact that the Royal National Lifeboat Institution has been wasting money on ‘research’ on homeopathy –write to them).
At least the courses are held on the Camborne campus of Cornwall College, not on the Duchy campus (do we detect the hand of the Quacktitioner Royal in all this nonsense?).
Cornwall College descends to a new level of barminess in its course Crystal Healing VTCT Level 3
“Who is this course for?
This course is designed to enhance the skills of the Holistic Therapist. Crystals may be used on their own in conjunction with other therapies such as Indian Head Massage, Aromatherapy and Reflexology. Due to the nature of the demands of the holistic programme this course is only suitable for students over the age of 18.”
“What will I be doing on the course?
Students will study the art of Crystal healing which is an energy based treatment where crystals and gemstones are used to channel and focus various energy frequencies.”
.VTCT stands for the Vocational Training Charitable Trust.
It is yet another organisation that runs vocational exams, and it is responsible for this particular horror |
The crystals are here. I quote.
Objectives
- the use of interpersonal skills with client
- how to complement other therapies with crystals
- the types and effects of different crystals
- uses of crystals including cleansing, energising, configurations
- concepts of auras and chakras
This is, of course, pure meaningless nonsense. Utter bollocks being offered as further education
Cornwall College has many courses run by ITEC.
The College says
“You will become a professional practitioner with the International Therapy Examination Council (ITEC), study a number of essential modules to give a vocational direction to your study that include: Homeopathy and its application,”
Who on earth, I hear you cry, are ITEC? That brings us to the seventh organisation in the maze of quangos and private companies involved in the miseducation of young people about science and medicine. It appears, like Edexcel, to be a private company though its web site is very coy about that. |
After the foundation degree you can go on to “a brand new innovative BSc in Complementary Health Studies (from Sept 2009)”
The ITEC web site says
- ITEC qualifications are accredited by the Office of the Qualifications and Examination Regulator (OFQUAL)
- ITEC qualifications are funded in the uk by the on behalf of Department for Innovation, Universities and Skills (DIUS)
- ITEC qualifications have been mapped to the National Occupational Standards, where they exist
Oddly enough, there is no mention of accreditation by a University (not that that is worth much). So a few more Freedom of Information requests are going off, in an attempt to find out why are kids are being miseducated about science and medicine.
Meanwhile you can judge the effect of all that education in physiology by one of the sample questions for ITEC Unit 4, reflexology.
The pancreas reflex:
A Extends across both feet
B Is on the right foot only
C Is on the left foot only
D Is between the toes on both feet
Uhuh, they seem to have forgotten the option ‘none of the above’.
Or how about a sample question from ITEC Unit 47 – Stone Therapy Massage
Which organ of the body is associated with the element fire?
A Heart
B Liver
C Spleen
D Pancreas
Or perhaps this?
Which incantation makes hot stones work best?
A Incarcerous
B Avada Kedavra,
C Dissendium
D Expelliarmus.
(OK I made the last one up, with help from Harry Potter, but it makes just about as much sense as the real ones).
And guess what? You can’t use the Freedom of Information Act to find out how this preposterous rubbish got into the educational system because ” ITEC is a private organisation therefore does not come under this legislation”. The ability to conduct business in secret is a side effect of the privatisation of public education is another reason why it’s a bad idea.
Ofsted
Ofsted has inspected Cornwall College. They say “We inspect and regulate to achieve excellence in the care of children and young people, and in education and skills for learners of all ages.”. I can find no mention of this nonsense in their report, so I’ve asked them. |
Ofsted has admitted a spectacular failure in its inspection of child care in the London Borough of Haringey. Polly Curtis wrote in the Guardian (6 Dec 2008) “We failed over Haringey – Ofsted head”. It was the front page story. But of course Ofsted don’t take the blame, they say they were supplied with false information,
That is precisely what happens whenever a committee or quango endorses rubbish. They look only at the documents sent to them and they don’t investigate, don’t engage their brains.
In the case of these courses in utter preposterous rubbish, it seems rather likely that the ultimate source of the misinformation is the Princes’ Foundation for Integrated Health. Tha views of the Prince of Wales get passed on to the ludicrous Skills for Health and used as a criterion by all the other organisations, without a moment of critical appraisal intervening at any point.
2 December 2008 A link from James Randi has sent the hit rate for this post soaring. Someone there left are rather nice comment.
“A quango seems to be a kind of job creation for the otherwise unemployable ‘educated ‘( degree in alternative navel contemplation) middle classes who can’t be expected to do anything useful like cleaning latines ( the only other thing they seem qualified for ). I really hate to think of my taxes paying for this codswollop.”
Today brings a small setback for those of us interested in spreading sensible ideas about science. According to a press release
“The BMJ Group is to begin publishing a medical journal on acupuncture from next year, it was announced today (Tuesday 11 November 2008).
This will be the first complementary medicine title that the BMJ Group has published.”
And they are proud of that? What one earth is going on? The BMJ group is a publishing company which says, of itself,
“Our brand stands for medical credibility. We are one of the world’s best known and most respected medical publishers.”
Well perhaps it used to be.
They have certainly picked a very bad moment for this venture. In the last year there have been at least five good books that assess the evidence carefully and honestly. Of these, the ones that are perhaps the best on the subject of acupuncture are Singh & Ernst’s Trick or Treatment and Barker Bausell’s Snake Oil Science. Both Ernst and Bausell have first hand experience of acupuncture research. And crucially, none of these authors has any financial interest in whether the judgement goes for acupuncture or against it.
Here are quotations from Singh & Ernst’s conclusions
“Reliable conclusions from systematic reviews make it clear that acupuncture does not work for a whole range of conditions, except as a placebo.”
“There are some high quality trials that support the use of acupuncture for some types of pain and nausea, but there are also high quality trials that contradict this conclusion. In short, the evidence is neither consistent nor convincing – it is borderline.”
The House of Lords’ report in 2000 tended to give acupuncture the benefit of the (very considerable) doubt that existed at the time the report was written. Since that time there have been a lot of very well-designed trials of acupuncture.
Now it is quite clear that, for most (and quite possibly all) conditions, acupuncture is no more than a particularly theatrical placebo. Perhaps that is not surprising insofar as the modern western practice of acupuncture owes more to Chinese nationalistic propaganda that started in the time of Mao-Tse Tung than it owes to ancient wisdom (which often turns out to be bunk anyway).
The BMJ Group has decided to endorse acupuncture at a time when it is emerging that the evidence for any specific effect is very thin indeed. Well done.
The journal in question is this.
Acupuncture in Medicine is a quarterly title, which aims to build the evidence base for acupuncture. It is currently self-published by the British Medical Acupuncture Society (BMAS).
One good thing can be said about the Society and the Journal. That is that they don’t espouse all the mumbo-jumbo about ‘meridians’ and ‘Qi’. This, of course, puts them at odds with the vast majority of acupuncture teaching. This sort of internecine warfare between competing sects is characteristic of all sorts of alternative medicine. But that is just ideology. What matters is whether or not sticking needles in you is actually anything more than a placebo.
British Medical Acupuncture Society (BMAS)
The British Medical Acupuncture Society (BMAS). is “a registered charity established to encourage the use and scientific understanding of acupuncture within medicine for the public benefit.”. The phrase “encourage the use” suggests that they do not even envisage the possibility that it might not work. Their web site includes these claims.
Acupuncture can help in a variety of conditions:
- Pain relief for a wide range of painful conditions
- Nausea, especially postoperative nausea and vomiting
- Overactive bladder, also known as bladder detrusor instability
- Menstrual and menopausal problems, eg period pains and hot flushes
- Allergies such as hay fever and some types of allergic rashes
- Some other skin problems such as ulcers, itching and localised rashes
- Sinus problems and more
Presumably the word “help” is chosen carefully to fall just short of “cure”. The claims are vaguely worded, but let’s see what we can find about them from systematic reviews. It appears that the BMAS is being rather optimistic about the evidence.
BMJ Clinical Evidence is considered reliable and is particular interesting because it is owned by the BMJ Publishing Group.
Low Back Pain (chronic) Acupuncture is listed as being of “unknown effectiveness”.
Dysmenorrhoea Acupuncture is listed as being of “unknown effectiveness”.
Osteoarthritis of the knee. Acupuncture is listed as being of “unknown effectiveness”.
Psoriasis (chronic plaque) Acupuncture is listed as being of “unknown effectiveness”.
Neck pain “Acupuncture may be more effective than some types of sham treatment (not further defined) or inactive treatment (not further defined) at improving pain relief at the end of treatment or in the short term (less than 3 months), but not in the intermediate term (not defined) or in the long term (not defined)”
Headache (chronic tension-type) Acupuncture is listed as being of “unknown effectiveness”.
What about the greatest authority, the Cochrane Reviews?
Cochrane Reviews
Low back pain The data do not allow firm conclusions about the effectiveness of acupuncture for acute low-back pain. For chronic low-back pain, acupuncture is more effective for pain relief and functional improvement than no treatment or sham treatment immediately after treatment and in the short-term only. Acupuncture is not more effective than other conventional and “alternative” treatments. The data suggest that acupuncture and dry-needling may be useful adjuncts to other therapies for chronic low-back pain. Because most of the studies were of lower methodological quality, there certainly is a further need for higher quality trials in this area.
Chronic asthma. There is not enough evidence to make recommendations about the value of acupuncture in asthma treatment. Further research needs to consider the complexities and different types of acupuncture.
But most of the vaguely-worded claims made by BMAS have not been the subject of Cochrane reviews. The obvious interpretation of that is that there is not enough evidence to make it worth writing a review. In which case, why does BMAS claim that acupuncture can “help”?
Bandolier is another excellent source of high quality information, This was their view in September 2006
“Large, high-quality randomised trials of acupuncture have been published since the reviews. In fibromyalgia, chemotherapy-induced nausea and vomiting, breech presentation, tension headache, and migraine, all were negative compared with sham acupuncture. One in osteoarthritis of the knee, had statistical improvement over sham acupuncture at three months, but not later. Both large trials and this review of reviews come to the same general conclusion; that over a whole range of conditions and outcomes acupuncture cannot yet be shown to be effective.”
After thousands of years of acupuncture (or at least almost 40 years in the West) there seems to be very little to show for it.
The journal: Acupuncture in Medicine
What about the journal in question? Like all journals devoted to alternative medicine, it claims to be evidence-based. And like all journals devoted to alternative medicine it suffers from a fatal conflict of interest. If this journal were ever to conclude that acupuncture is a placebo, it would destroy the journal and the livelihoods of many of the people who write for it.
Scanning the first three issues of 2008 shows that it is very much like other alternative medicine journals. Most of the papers don’t address the critical question, is it a placebo. And most papers end up rather limply, with a statement along the lines “acupuncture may be useful for ***. More research is needed.”
The editor in chief of the journal is Dr Adrian White, and its editor is Michael Cummings. White is quoted by Ernst in the Guardian in 2004.
“We need to provide hard evidence to support what we all see in our clinics every day: that the modern approach to acupuncture works, and is highly relevant to the new, patient-centred NHS.” .
That means the answer is assumed in advance. That just isn’t science.. ‘We know the answer, all we have to do now is get some evidence’.
Why should the BMJ Group want to do a thing like this?
The press release says
Commenting on the move, BMJ and BMJ Journals Publishing Director, Peter Ashman, said “The journal is a good complement for our existing portfolio of journals and we’re certain that the Society’s members and other subscribers will appreciate the benefits of the decision the BMAS has made on their behalf.”
He continued: “The BMAS is ambitious for its journal to grow and flourish and we’re looking forward to working with the Society to develop an editorial and commercial strategy which will achieve the aims of BMAS and those of its members, while reaching out to the wider global community interested in this fascinating area of medicine.”
Yes, you got it. Money. The same motive that causes some vice-chancellors to bring their university into disrepute by awarding BSc degrees in subjects that are not only not science, but which are oftenly openly anti-science.
Conscience doesn’t seem to bother these people, so let’s put the problem in purely cash terms.
Both the BMJ Group and the vice-chancellors will have to decide whether the cash they gain is sufficient to counterbalance the corrosive effects of their actions on their own reputations.
Follow-up
Only a couple of days later, two new trials show acupuncture is no different from sham controls for helping IVF pregnancy rates. James Randerson in the Guardian writes thus.
“Acupuncture aimed at improving IVF success rates is widely offered by fertility clinics in the UK. In the first of the studies, researchers in Hong Kong split 370 women receiving IVF into two groups. One group received real acupuncture before and after having an IVF embryo implanted into their uterus. The other had the same procedure, except the treatment used retractable needles that did not penetrate the skin.”
“Of the 185 who received the sham treatment, 91 achieved a clinical pregnancy (foetal heartbeat identified using ultrasound) and 71 had a successful delivery. This compared with 72 clinical pregnancies in the true acupuncture group and 55 live births. The differences between the groups were not statistically significant.”
“In a second study, researchers in Chicago used a similar design in which 124 women received true or sham acupuncture. The control group had their skin punctured by real acupuncture needles, but not at genuine “Qi-lines” on the body. In the true acupuncture group, 43.9% achieved a clinical pregnancy, compared with 55.2% of the women given the sham treatment. “
The original paper for the first study can be seen here.
After the announcement that the University of Central Lancashire (Uclan) was suspending its homeopathy “BSc” course, it seems that their vice chancellor has listened to the pressure, both internal and external, to stop bringing his university into disrepute.
An internal review of all their courses in alternative medicine was announced shortly after the course closure. Congratulations to Malcolm McVicar for grasping the nettle at last. Let’s hope other universities follow his example soon.
I have acquired, indirectly, a copy of the announcement of the welcome news.
Homeopathy, Herbalism and cupuncture Concern has been expressed by some colleagues as to whether the University should offer courses in homeopathy, Herbalism and Acupuncture. Therefore, to facilitate proper discussion on this matter I have set up a working party to review the issues. I have asked Eileen Martin, Pro Vice-Chancellor and Dean of the Faculty of Health, to lead this working party and report to me as soon as possible. Whilst the review is taking place, we need to recognise that there are students and staff studying and teaching on these courses which have satisfied the University’s quality assurance procedures and been duly validated. I would therefore ask that colleagues would refrain from comment or speculation which would cause concern to these students and staff. Staff who wish to express their views on this issue should direct these to Eileen Martin, by the end of September. Regards Malcolm McVicar Vice-Chancellor |
Times Higher Education today reports
“The University of Central Lancashire is to review all its courses in homoeopathy, herbalism and acupuncture after some staff said it should not be offering degrees in “quackery”, Times Higher Education has learnt.
A university spokesman said: “As a university we value and practise transparency and tolerance and welcome all academic viewpoints.”
(Later, an almost identical version of the story ran on the Times Online.)
So far, so good. But of course the outcome of a committee depends entirely on who is appointed to it. Quite often such committees do no more than provide an internal whitewash.
It does seem a bit odd to appoint as chair the dean of the faculty where all these course are run, and presumably generate income. Eileen Martin has often appeared to be proud of them in the past. Furthermore, the whole investigation will (or should) turn on the assessment of evidence. It needs some knowledge of the design of clinical trials and their statistical analysis, As far as I can see, Ms Martin has essentially no research publications whatsoever.
I also worry about a bit about “satisfied the University’s quality assurance procedures and been duly validated”. One point of the investigation should be recognise frankly that the validation process is entirely circular, and consequently worth next to nothing. It must be hard for a vice-chancellor to admit that, but it will be an essential step in restoring confidence in Uclan.
Let’s not prejudge though. If there are enough good scientists on the committee, the result will be good.
I hope that transparency extends to letting us know who will be doing the judging. Everything depends on that.
Follow-up
Well well, there’s a coincidence, Once again, the week after a there is an announcement about degrees in witchcraft, what should pop up again in the column of the inimitable Laurie Taylor in THE. The University of Poppleton’s own Department of Palmistry.
Letter to the editor
Dear Sir I was shocked to see yet another scurrilous attack upon the work of my department in The Poppletonian. Although Palmistry is in its early days as an academic discipline it cannot hope to progress while there are people like your correspondent who insist on referring to it as “a load of superstitious nonsense which doesn’t deserve a place on the end of the pier let alone in a university”. A large number of people claim to have derived considerable benefit from learning about life lines, head lines and heart lines and the role of the six major mounts in predicting their future. All of us in the Palmistry Department believe it vitally important that these claims are rigorously examined. How else can science advance? Yours sincerely, |
My original piece on Integrative Baloney@Yale was posted on May 16th, after I got back from a visit there. The talk I gave there included a short video. My movie, Integrative baloney@Yale, was made entirely from clips taken from Yale’s own YouTube movies which showed something approaching three hours of its “1st Annual Scientific [sic] symposium”, entitled “Complementary and Alternative Medicine: Evidence for Integration”. I had merely interspersed a few titles to show the worst scientific absurdities of that rather pathetic event. YouTube removed the movie last week.
You can download the movie here [15.8 Mb, wmv file].
It should soon reappear on YouTube (actually it took over a month and several reminders, but eventually they kept their word in the end).
Yale’s lawyers had written to YouTube, to have my movie removed. I guess if you have no evidence, all you can do is resort to law to suppress the views of those who have the temerity to point out that the emperor is naked. Last week it was New Zealand Chiropractors’ Association Inc. This week the rather more substantial Yale University. We live in interesting times.
This is what I got on 15th August.
Dear Member
This is to notify you that we have removed or disabled access to the following material as a result of a third-party notification by Yale University, Yale School of Medicine (CME) claiming that this material is infringing: Integrative baloney@Yale: http://uk.youtube.com/watch?v=HEl2fhfGBdI Please Note: Repeated incidents of copyright infringement will result in the deletion of your account and all videos uploaded to that account. In order to prevent this from happening |
If you clicked on the link you saw
“This video is no longer available due to a copyright claim by Yale University, Yale School of Medicine (CME)”
It seems that Yale’s Continuing Medical Education (CME) department was responsible.
Of course Yale is correct. I expect they own the copyright of their original movies, but they are not what I posted. I would argue that selecting 6 minutes from a 3 hour original amounts to “fair quotation”, no different from when one cites a short passage from somebody else’s book or paper. Perhaps Yale was just a bit jealous that my movie was getting viewed a lot more times than theirs. Or perhaps they were a bit peeved that a Google search for “Yale Integrative Medicine” produced my movie as #2 (add the word movie and I was #1).
My movie seems to me to be fair comment from someone who is a pharmacologist by trade. Apparently it didn’t seem that way to the apparatchiks of Yale Medical School, who seem to think that academic arguments should be settled by paying lawyers to suppress views they don’t like, rather than by rational discussion.
It’s interesting that the three hours of Yale’s own movie have also vanished from YouTube. Could that be because they realise that the remarks made at the meeting are so embarrassing intellectually that it would be better not to make them public? Actually, no.
What does Yale CME say?
Rather than publishing this straight away, I thought it better to delve a bit further into what had happened. I lodged an appeal with YouTube and I wrote to Ronald J. Vender, MD (Associate Dean, YSM Clinical Affairs, CMO, Yale Medical Group, Medical Director, Yale CME ). The outcome was rather interesting.
First, it turned out that the original posting of the three hours of the symposium proceedings on YouTube was itself unauthorised, which is why it suffered the same fate as my movie.
Dr Vender told me that he is new to the job, and didn’t know about the incident. What’s more surprising, he said he “did not know an Integrative Program even existed at Yale”. That does seem a bit odd indeed for an Associate Dean of Clinical Affairs.
However, Dr Vender turned out to be a very reasonable man,.After some amiable correspondence over the weekend, it took him only a day and a half to sort the matter out. After talking to Yale’s attorney, he wrote on 19th August, thus
“The University attorney believes that there is in fact a difference between the initial unauthorized filming of an entire conference as opposed to quoting from that conference. Therefore, she has agreed to withdraw the injunction that has been imposed on your use of the material. YouTube will be contacted.”
That’s good for me, but it isn’t the main thing. The movie would doubtless have been seen by more people if Yale had tried to maintain the ban. Much more impressively, Dr Vender also said
“As for this particular program, I will be speaking with Dr Belitsky and the program directors to encourage them to adopt a more critical view of the scientific basis for claims made by proponents of CAM. They will also be encouraged to develop a future program that includes faculty who have opposing points of view.”
It remains to be seen what actually happens, but so far, so good.
What next?
The removal of the original videos of the meeting is understandable because they were pretty embarrassing to Yale. But can that be the real reason? I was told that it is simply because their posting was “unauthorised”. But Yale Continuing Medical Education still boasts about the meeting on their own web site. They describe the meeting as “successful”, but if they are so proud of it, why remove the video from YouTube whether it was authorised or not? We are told
“The symposium, accredited for 7.5 AMA PRA Category 1 Credits, began what is hoped to be a long tradition at the Yale School of Medicine.”
They give credits for such miseducation?
Dr Katz’s phrase “we need a more fluid concept of evidence” now gets about 148 hits in Google, since I first helped him to publicise it.
Two of the six “learning objectives” that Yale CME lists for this symposium are particularly revealing.
- Describe therapeutic benefits and recent scientific evidence supporting a wide range of safe and practical complementary treatments, including acupuncture, massage, yoga, meditation, nutrition and exercise
- Identify and discuss barriers to CAM use, practice and research, as well as propose ways of overcoming these barriers
‘Describe the evidence supporting complementary treatments’? But don’t on any account describe the much more substantial evidence that does not support them? A question (or “learning objective”) put in this loaded way is the very antithesis of education.
Equally the second ‘learning objective’ carries with it the assumption that CAM works, otherwise why would anyone want to overcome the barriers to it?
This is indoctrination, not education. It betrays everything that a university should stand for.
Let’s hope the new head of CME, the admirable Dr Vender, succeeds in doing something about it
Follow-up
Success!. Well I think it is success. On 26 November 2008, the admirable Dr Vender wrote to me as follows.
“I do not know if another CAM/Integrative Medicine program is planned at Yale. However, based on the new ACCME standards, this program does not fulfil the standards for receiving CME accreditation (by my interpretation of the standards). At least one of last year’s program directors has been notified already.”
The article below is an editorial that I was asked to write for the New Zealand Medical Journal, as a comment on article in today’s edition about the misuse of the title ‘doctor’ by chiropractors [download pdf]. Titles are not the only form of deception used by chiropractors, so the article looks at some of the others too. For a good collection of articles that reveal chiropractic for what it is, look at Chirobase
THE NEW ZEALAND
MEDICAL JOURNAL
Journal of the New Zealand Medical Association
NZMJ 25 July 2008, Vol 121 No 1278; ISSN 1175 8716
URL: http://www.nzma.org.nz/journal/121-1278/3158/ ©NZMA
Doctor Who?
Inappropriate use of titles by some alternative “medicine” practitioners
David Colquhoun
Who should use the title ‘doctor’? The title is widely abused as shown by Gilbey1 in this issue of the NZMJ in an article entitled Use of inappropriate titles by New Zealand practitioners of acupuncture, chiropractic, and osteopathy. Meanwhile, Evans and colleagues 2, also in this issue, discuss usage and attitudes to alternative treatments.
Gilbey finds that the abuse of the title doctor is widespread and that chiropractors are the main culprits. An amazing 82% of 146 chiropractics used the title Doctor, andL most of them used the title to imply falsely that they were registered medical practitioners.
Although it is illegal in New Zealand to do that, it seems clear that the law is not being enforced and it is widely flouted. This is perhaps not surprising given the history of chiropractic. It has had a strong element of ruthless salesmanship since it was started in Davenport, Iowa by D.D. Palmer (1845–1913). His son, B.J. Palmer, said that their chiropractic school was founded on “a business, not a professional basis. We manufacture chiropractors. We teach them the idea and then we show them how to sell” (Shapiro 2008)3 It is the same now. You can buy advice on how to build “build high-volume, subluxation-based, cash-driven, lifetime family wellness practices”
In her recent book3 , Rose Shapiro comments on the founder of chiropractic as follows.
“By the 1890s Palmer had established a magnetic healing practice in Davenport, Iowa, and was styling himself “doctor”. Not everyone was convinced, as a piece about him in an 1894 edition of the local paper, the Davenport Leader, shows.
A crank on magnetism has a crazy notion hat he can cure the sick and crippled with his magnetic hands. His victims are the weak-minded, ignorant and superstitious,those foolish people who have been sick for years and have become tired of the regular physician and want health by the short-cut method he has certainly profited by the ignorance of his victim. His increase in business shows what can be done in Davenport, even by a quack.”
D.D. Palmer was a curious mixture: grocer, spiritual healer, magnetic therapist, fairground huckster, religious cult leader—and above all, a salesman. He finally found a way to get rich by removing entirely imaginary “subluxations”.
Over 100 years later, it seems that the “weak-minded, ignorant, and superstitious” include the UK’s Department of Health, who have given chiropractics a similar status to the General Medical Council.
The intellectual standards of a 19th Century Mid-Western provincial newspaper journalist are rather better than the intellectual standards of the UK’s Department of Health, and of several university vice-chancellors in 2007.
Do the treatments work?
Neither Gilbey nor Evans et al. really grasp the nettle of judging efficacy. The first thing one wants to know about any treatment —alternative or otherwise — is whether it works. Until that is decided, all talk of qualifications, regulation, and so on is just vacuous bureaucratese. No policy can be framed sensibly until the question of efficacy has been addressed honestly.
It is one good effect of the upsurge of interest in alternative treatments that there are now quite a lot of good trials of the most popular forms of treatments (as well as many more bad trials). Some good summaries of the results are now available too. Cochrane reviews set the standard for good assessment of evidence. New Zealand’s Ministry of Health commissioned the Complementary and Alternative Medicine
website to assess the evidence, and that seems to have done a good job too. Their assessment of chiropractic treatment of low back pain is as follows:
There appears to be some evidence from one systematic review and four other studies, although not conclusive, that chiropractic treatment is as effective as other therapies but this may be due to chance. There is very little evidence that chiropractic is more effective than other therapies.
And two excellent summaries have been published as books this year. Both are by people who have had direct experience of alternative treatments, but who have no financial interest in the outcome of their assessment of evidence. The book by Singh and Ernst4 summarises the evidence on all the major alternative treatments, and the book by Bausell5 concentrates particularly on acupuncture, because the author was for 5 years involved in research in that area, Both of these books come to much the same conclusion about chiropractic. It is now really very well-established that chiropractic is (at best) no more effective than conventional treatment. But it has the disadvantage of being surrounded by gobbledygook about “subluxations” and, more importantly, it kills the occasional patient.
Long (2004)7 said “the public should be informed that chiropractic manipulation is the number one reason for people suffering stroke under the age of 45.”
The chiropractors of Alberta (Canada) and the Alberta Government are now facing a class-action lawsuit8. The lead plaintiff is Sandra Nette. Formerly she was a fit 41 year old. Now she is tetraplegic. Immediately
after neck manipulation by a chiropractor she had a massive stroke as a result of a torn vertebral artery.
Acupuncture comes out of the assessments equally badly. Bausell (2007) concludes that it is no more than a theatrical placebo.
Are the qualifications even real?
It is a curious aspect of the alternative medicine industry that they often are keen to reject conventional science, yet they long for academic respectability. One aspect of this is claiming academic titles on the flimsiest of grounds. You can still be held to have misled the public into thinking you are a medical
practitioner, even if you have a real doctorate. But often pays to look into where the qualifications come from.
A celebrated case in the UK concerned the ‘lifestyle nutritionist’, TV celebrity and multi-millionaire, Dr Gillian McKeith, PhD. A reader of Ben Goldacre’s excellent blog, badscience.net did a little investigation. The results appeared in Goldacre’s Bad Science column in the Guardian9.
She claimed that her PhD came from the American College of Nutrition, but it turned out to come from a correspondence course from a non-accredited US ‘college’. McKeith also boasted of having “professional membership” of the American Association of Nutritional Consultants, for which she provided proof of her degree and three professional references.
The value of this qualification can be judged by the fact that Goldacre sent an application and $60 and as a result “My dead cat Hettie is also a “certified professional member” of the AANC. I have the certificate hanging in my loo”.
Is the solution government regulation?
In New Zealand the law about misleading the public into believing you are a medical practitioner already exists. The immediate problem would be solved if that law were taken seriously, but it seems that it is not.
It is common in both the UK and in New Zealand to suggest that some sort of official government regulation is the answer. That solution is proposed in this issue of NZMJ by Evans et al2. A similar thing has been proposed recently in the UK by a committee headed by Michael Pittilo, vice-chancellor of Robert Gordon’s University, Aberdeen.
I have written about the latter under the heading A very bad report. The Pittilo report recommends both government regulation and more degrees in alternative medicine. Given that we now know that most alternative medicine doesn’t work, the idea of giving degrees in such subjects must be quite ludicrous to any thinking person.
The magazine Nature7 recently investigated the 16 UK universities who run such degrees. In the UK, first-year students at the University of Westminster are taught that “amethysts emit high yin energy” . Their vice chancellor, Professor Geoffrey Petts, describes himself a s a geomorphologist, but he cannot be tempted to express an opinion about the curative power of amethysts.
There has been a tendency to a form of grade inflation in universities—higher degrees for less work gets bums on seats. For most of us, getting a doctorate involves at least 3 years of hard experimental research in a university. But in the USA and Canada you can get a ‘doctor of chiropractic’ degree and most chiropractic (mis)education is not even in a university but in separate colleges.
Florida State University famously turned down a large donation to start a chiropractic school because they saw, quite rightly, that to do so would damage their intellectual reputation. This map, now widely distributed on the Internet, was produced by one of their chemistry professors, and it did the trick.
Other universities have been less principled. The New Zealand College of Chiropractic [whose President styles himself “Dr Brian Kelly”,though his only qualification is B. App Sci (chiro)] is accredited by the New Zealand Qualifications Authority (NZQA). Presumably they, like their UK equivalent (the QAA), are not allowed to take into account whether what is being taught is nonsense or not. Nonsense courses are accredited by experts in nonsense. That is why much accreditation is not worth the paper it’s written on.
Of course the public needs some protection from dangerous or fraudulent practices, but that can be done better (and more cheaply) by simply enforcing existing legislation on unfair trade practices, and on false advertising. Recent changes in the law on unfair trading in the UK have made it easier to take legal action against people who make health claims that cannot be justified by evidence, and that seems the best
way to regulate medical charlatans.
Conclusion
For most forms of alternative medicine—including chiropractic and acupuncture—the evidence is now in. There is now better reason than ever before to believe that they are mostly elaborate placebos and, at best, no better than conventional treatments. It is about time that universities and governments recognised the evidence and stopped talking about regulation and accreditation.
Indeed, “falsely claiming that a product is able to cure illnesses, dysfunction, or malformations” is illegal in Europe10.
Making unjustified health claims is a particularly cruel form of unfair trading practice. It calls for prosecutions, not accreditation.
Competing interests: None.
NZMJ 25 July 2008, Vol 121 No 1278; ISSN 1175 8716
URL: http://www.nzma.org.nz/journal/121-1278/3158/ ©NZMA
Author information: David Colquhoun, Research Fellow, Dept of Pharmacology, University College London, United Kingdom (http://www.ucl.ac.uk/Pharmacology/dc.html)
Correspondence: Professor D Colquhoun, Dept of Pharmacology, University College London, Gower Street, London WC1E 6BT, United Kingdom. Fax: +44(0)20 76797298; email: d.colquhoun@ucl.ac.uk
References:
1. Gilbey A. Use of inappropriate titles by New Zealand practitioners of acupuncture, chiropractic, and osteopathy. N Z Med J. 2008;121(1278). [pdf]
2. Evans A, Duncan B, McHugh P, et al. Inpatients’ use, understanding, and attitudes towards traditional, complementary and alternative therapies at a provincial New Zealand hospital. N Z Med J. 2008;121(1278).
3 Shapiro. Rose. Suckers. How Alternative Medicine Makes Fools of Us All Random House, London 2008. (reviewed here)
4. Singh S, Ernst E. Trick or Treatment. Bantam Press; 2008 (reviewed here)
5. Bausell RB. Snake Oil Science. The Truth about Complementary and Alternative Medicine. (reviewed here)
Oxford University Press; 2007
6. Colquhoun D. Science degrees without the Science, Nature 2007;446:373–4. See also here.
7. Long PH. Stroke and spinal manipulation. J Quality Health Care. 2004;3:8–10.
8. Libin K. Chiropractors called to court. Canadian National Post; June21, 2008.
9. Goldacre B. A menace to science. London: Guardian; February 12, 2007/
10. Department for Business Enterprise & Regulatory Reform (BERR). Consumer Protection from Unfair Trading Regulations 2008. UK: Office of Fair Trading.
This is a fuller version, with links, of the comment piece published in Times Higher Education on 10 April 2008. Download newspaper version here.
If you still have any doubt about the problems of directed research, look at the trenchant editorial in Nature (3 April, 2008. Look also at the editorial in Science by Bruce Alberts. The UK’s establishment is busy pushing an agenda that is already fading in the USA.
Since this went to press, more sense about “Brain Gym” has appeared. First Jeremy Paxman had a good go on Newsnight. Skeptobot has posted links to the videos of the broadcast, which have now appeared on YouTube.
Then, in the Education Guardian, Charlie Brooker started his article about “Brain Gym” thus
Dr Aust’s cogent comments are at “Brain Gym” loses its trousers. |
The Times Higher’s subeditor removed my snappy title and substituted this.
So here it is.
“HR is like many parts of modern businesses: a simple expense, and a burden on the backs of the productive workers”, “They don’t sell or produce: they consume. They are the amorphous support services” .
So wrote Luke Johnson recently in the Financial Times. He went on, “Training advisers are employed to distract everyone from doing their job with pointless courses”. Luke Johnson is no woolly-minded professor. He is in the Times’ Power 100 list, he organised the acquisition of PizzaExpress before he turned 30 and he now runs Channel 4 TV.
Why is it that Human Resources (you know, the folks we used to call Personnel) have acquired such a bad public image? It is not only in universities that this has happened. It seems to be universal, and worldwide. Well here are a few reasons.
Like most groups of people, HR is intent on expanding its power and status. That is precisely why they changed their name from Personnel to HR. As Personnel Managers they were seen as a service, and even, heaven forbid, on the side of the employees. As Human Resources they become part of the senior management team, and see themselves not as providing a service, but as managing people. My concern is the effect that change is having on science, but it seems that the effects on pizza sales are not greatly different.
The problem with having HR people (or lawyers, or any other non-scientists) managing science is simple. They have no idea how it works. They seem to think that every activity
can be run as though it was Wal-Mart That idea is old-fashioned even in management circles. Good employers have hit on the bright idea that people work best when they are not constantly harassed and when they feel that they are assessed fairly. If the best people don’t feel that, they just leave at the first opportunity. That is why the culture of managerialism and audit. though rampant, will do harm in the end to any university that embraces it.
As it happens, there was a good example this week of the damage that can be inflicted on intellectual standards by the HR mentality. As a research assistant, I was sent the Human Resources Division Staff Development and Training booklet. Some of the courses they run are quite reasonable. Others amount to little more than the promotion of quackery. Here are three examples. We are offered a courses in “Self-hypnosis”, in “Innovations for Researchers” and in “Communication and Learning: Recent Theories and Methodologies”. What’s wrong with them?
“Self-hypnosis” seems to be nothing more than a pretentious word for relaxation. The person who is teaching researchers to innovate left science straight after his PhD and then did courses in “neurolinguistic programming” and life-coaching (the Carole Caplin of academia perhaps?). How that qualifies him to teach scientists to be innovative in research may not be obvious.
The third course teaches, among other things, the “core principles” of neurolinguistic programming, the Sedona method (“Your key to lasting happiness, success, peace and well-being”), and, wait for it, Brain Gym. This booklet arrived within a day or two of Ben
Goldacre’s spectacular demolition of Brain Gym “Nonsense dressed up as neuroscience”
“Brain Gym is a set of perfectly good fun exercise break ideas for kids, which costs a packet and comes attached to a bizarre and entirely bogus pseudoscientific explanatory framework”
“This ridiculousness comes at very great cost, paid for by you, the taxpayer, in thousands of state schools. It is peddled directly to your children by their credulous and apparently moronic teachers”
And now, it seems, peddled to your researchers by your credulous and
moronic HR department.
Neurolinguistic programming is an equally discredited form of psycho-babble, the dubious status of which was highlighted in a Beyerstein’s 1995 review, from Simon Fraser University.
“ Pop-psychology. The human potential movement and the fringe areas of psychotherapy also harbor a number of other scientifically questionable panaceas. Among these are Scientology, Neurolinguistic Programming, Re-birthing and Primal Scream Therapy which have never provided a scientifically acceptable rationale or evidence to support their therapeutic claims.”
The intellectual standards for many of the training courses that are inflicted on young researchers seem to be roughly on a par with the self-help pages of a downmarket women’s magazine. It is the Norman Vincent Peale approach to education. Uhuh, sorry, not education, but training. Michael O’Donnell defined Education as “Elitist activity. Cost ineffective. Unpopular with Grey Suits . Now largely replaced by Training .”
In the UK most good universities have stayed fairly free of quackery (the exceptions being the sixteen post-1992 universities that give BSc degrees in things like homeopathy). But now it is creeping in though the back door of credulous HR departments. Admittedly UCL Hospitals Trust recently advertised for spiritual healers, but that is the NHS not a university. The job specification form for spiritual healers was, it’s true, a pretty good example of the HR box-ticking mentality. You are in as long as you could tick the box to say that you have a “Full National Federation of Spiritual Healer certificate. or a full Reiki Master qualification, and two years post certificate experience”. To the HR mentality, it doesn’t matter a damn if you have a certificate in balderdash, as long as you have the piece of paper. How would they know the difference?
A lot of the pressure for this sort of nonsense comes, sadly, from a government that is obsessed with measuring the unmeasurable. Again, real management people have already worked this out. The management editor of the Guardian, said
“What happens when bad measures drive out good is strikingly described in an article in the current Economic Journal. Investigating the effects of competition in the NHS, Carol Propper and her colleagues made an extraordinary discovery. Under competition, hospitals improved their patient waiting times. At the same time, the death-rate e emergency heart-attack admissions substantially increased.”
Two new government initiatives provide beautiful examples of the HR mentality in action, They are Skills for Health, and the recently-created Complementary and Natural Healthcare Council.(already dubbed OfQuack).
The purpose of the Natural Healthcare Council .seems to be to implement a box-ticking exercise that will have the effect of giving a government stamp of approval to treatments that don’t work. Polly Toynbee summed it up when she wrote about “ Quackery
and superstition – available soon on the NHS “ . The advertisement for its CEO has already appeared, It says that main function of the new body will be to enhance public protection and confidence in the use of complementary therapists. Shouldn’t it be decreasing confidence in quacks, not increasing it? But, disgracefully, they will pay no attention at all to whether the treatments work. And the advertisement refers you to
the Prince of Wales’ Foundation for Integrated Health for more information (hang on, aren’t we supposed to have a constitutional monarchy?).
Skills for Health, or rather that unofficial branch of government, the Prince of Wales’ Foundation, had been busy making ‘competences’ for distant healing, with a helpful bulletted list.
“This workforce competence is applicable to:
- healing in the presence of the client
- distant healing in contact with the client
- distant healing not in contact with the client”
And they have done the same for homeopathy and its kindred delusions. The one thing they never consider is whether they are writing ‘competences’ in talking gobbledygook. When I phoned them to try to find out who was writing this stuff (they wouldn’t say), I made a passing joke about writing competences in talking to trees. The answer came back, in all seriousness,
“You’d have to talk to LANTRA, the land-based organisation for that”,
“LANTRA which is the sector council for the land-based industries uh, sector, not with us sorry . . . areas such as horticulture etc.”.
Anyone for competences in sense of humour studies?
The “unrepentant capitalist” Luke Johnson, in the FT, said
“I have radically downsized HR in several companies I have run, and business has gone all the better for it.”
Now there’s a thought.
The follow-up
The provost’s newletter for 24th June 2008 could just be a delayed reaction to this piece? For no obvious reason, it starts thus.
“(1) what’s management about?
Human resources often gets a bad name in universities, because as academics we seem to sense instinctively that management isn’t for us. We are autonomous lone scholars who work hours well beyond those expected, inspired more by intellectual curiosity than by objectives and targets. Yet a world-class institution like UCL obviously requires high quality management, a theme that I reflect on whenever I chair the Human Resources Policy Committee, or speak at one of the regular meetings to welcome new staff to UCL. The competition is tough, and resources are scarce, so they need to be efficiently used. The drive for better management isn’t simply a preoccupation of some distant UCL bureaucracy, but an important responsibility for all of us. UCL is a single institution, not a series of fiefdoms; each of us contributes to the academic mission and good management permeates everything we do. I despair at times when quite unnecessary functional breakdowns are brought to my attention, sometimes even leading to proceedings in the Employment Tribunal, when it is clear that early and professional management could have stopped the rot from setting in years before. UCL has long been a leader in providing all newly appointed heads of department with special training in management, and the results have been impressive. There is, to say the least, a close correlation between high performing departments and the quality of their academic leadership. At its best, the ethos of UCL lies in working hard but also in working smart; in understanding that UCL is a world-class institution and not the place for a comfortable existence free from stretch and challenge; yet also a good place for highly-motivated people who are also smart about getting the work-life balance right.”
I don’t know quite what to make of this. Is it really a defence of the Brain Gym mentality?
Of course everyone wants good management. That’s obvious, and we really don’t need a condescending lecture about it. The interesting question is whether we are getting it.
There is nothing one can really object to in this lecture, apart from the stunning post hoc ergo propter hoc fallacy implicit in “UCL has long been a leader in providing all newly appointed heads of department with special training in management, and the results have been impressive.”. That’s worthy of a nutritional therapist.
Before I started writing this response at 08.25 I had already got an email from a talented and hard-working senior postdoc. “Let’s start our beautiful working day with this charging thought of the week:”.
He was obviously rather insulted at the suggestion that it was necessary to lecture academics with words like ” not the place for a comfortable existence free from stretch and challenge; yet also a good place for highly-motivated people who are also smart about getting the work-life balance right.”. I suppose nobody had thought of that until HR wrote it down in a “competence”?
To provoke this sort of reaction in our most talented young scientists could, arguably, be regarded as unfortunate.
I don’t blame the postdoc for feeling a bit insulted by this little homily.
So do I.
Now back to science.
This is an old joke which can be found in many places on the web, with minor variations. I came across it in an article by Gustav Born in 2002 (BIF Futura, 17, 78 – 86) and reproduce what he said. It has never been more relevant, so it’s well worth repeating. The title of the article was British medical education and research in the new century.
“The other deleterious development in UK research is increased bureaucratic control. Bureaucracy is notoriously bad for all creative activities. The story is told of a company chairman who was given a ticket to a concert in which Schubert’s Unfinished Symphony was to be played. Unable to go himself, he passed the ticket on to his colleague, the director in charge of administration and personnel. The next day the chairman asked, ‘Did you enjoy the concert?’ His colleague replied, ‘My report will be on your desk this afternoon’. This puzzled the chairman, who later received the following:
Report on attendance at a musical concert dated 14 November 1989. Item 3.
Schubert’s Unfinished Symphony.
- The attendance of the orchestra conductor is unnecessary for public performance. The orchestra has obviously practiced and has the prior authorization from the conductor to play the symphony at a predetermined level of quality. Considerable money could be saved by merely having the conductor critique the performance during a retrospective peer-review meeting.
- For considerable periods, the four oboe players had nothing to do. Their numbers should be reduced, and their work spread over the whole orchestra, thus eliminating the peaks and valleys of activity.
- All twelve violins were playing identical notes with identical motions. This was unnecessary duplication. If a larger volume is required, this could be obtained through electronic amplification which has reached very high levels of reproductive quality.
- Much effort was expended in playing sixteenth notes, or semi-quavers. This seems to me an excessive refinement, as listeners are unable to distinguish such rapid playing. It is recommended that all notes be rounded up to the nearest semi-quaver. If this were done, it would be possible to use trainees and lower-grade operatives more extensively.
- No useful purpose would appear to be served by repeating with horns the same passage that has already been handled by the strings. If all such redundant passages were eliminated, as determined by a utilization committee, the concert could have been reduced from two hours to twenty minutes with great savings in salaries and overhead.
- In fact, if Schubert had attended to these matters on a cost containment basis, he probably would have been able to finish his symphony.
In research, as in music, blind bureaucracy has the effect of destroying imaginative creativity. If that is truly valued, it must remain free from bureaucratic excesses. And indeed, the great strength of British science has always been the ability of curiosity-driven individuals to follow up original ideas, and the support that these individuals receive from organizations such as the MRC and the Wellcome Trust. This has given research workers the possibility to twist and turn in following up intuitions and ideas in other fields as well as their own. This freedom has been significantly eroded by job insecurity in universities and in commercial enterprises.”
Later in the article, Born talks about innovation in the pharmaceutical industry
“This ‘urge to merge’, which is affecting the pharmaceutical industry worldwide, is almost always claimed to be justified by the need for a larger research budget to sustain innovation. The actual evidence indicates that such mergers hide -for a while failure of innovation. An almost universal response to this problem has been to ‘streamline’ and ‘commercialize’ the process of research, with ultimate control vested in accountants rather than in pharmaceutically informed scientists. This has meant that the industry’s research and development programmes are being driven by technical novelties, notably computer- aided drug design, combinatorial chemistry, high-throughput screening and genomics. All these techniques are very cost-intensive and, what is worse, are superseding individual scientists with profound appreciation of disease mechanisms and knowledge of biochemical and pharmacological mechanisms. It is they whose ability to ask the crucial, often seemingly simple questions, that have led to blockbuster drugs. Outstanding British examples are James Black’s discovery of the gastric acid secretion inhibitors, and Hans Kosterlitz’s question whether the brain might perhaps contain some analgesic chemical like that in -of all things the poppy plant.”
“The fact is that drug discovery, like all discoveries, is more an individual than a team achievement, at least at the beginning. With a few notable exceptions, the trouble with the industry is summarized by a group research director at one of the leading pharmaceutical companies:
“Creative individuals are being driven out of the industry and being replaced by functionaries wbo parrot strategic maxims. Research is being driven by lawyers, financial experts, salesmen and market strategists who are completely unable to develop new ideas. It is doubtful whether there are any senior executives who understand the problem” (Drews, J., 1999 In quest of tomorrow’s medicine, Springer-Verlag, New York).
And further:
“Partly as a result of mismanagement and partly as a result of a search for solutions which takes no account of disease mechanisms and biomedical complexity, substantial parts of the pharmaceutical industry are failing to innovate at a rate which is needed for their health and for the health of the general public. Research management needs to be rethought with a much greater emphasis on creative individuals with a broad knowledge of biology and medicine, a lower emphasis on market research, and a greater openness to the information to be gained from clinical studies (Horrobin, D.F., 2000, Innovation in the pharmaceutical industry. J. R. Soc. Med. 93, 341 – 345. ).”
For more on keeping univeristies honest, see the excellent new blog, The storm breaking upon the university.
Thursday 24 Jan.
One of the original reasons for going to North America was an invitation from the Toronto Secular Alliance and Center for Inquiry. The talk for them was given a lot of publicity, for example here and here and from the totally admirable Orac.
Toronto seems to be no worse than anywhere else when it comes to delusional thinking about medicine. It is, of course, the home of Ryerson University, the place that produced one of the most outrageous pieces of postmodernist nonsense on record. But when this sort of thing gets into really good universities, it is more worrying.
As a result of the publicity there was some media coverage (and a record 7109 hits on this site on Sunday).
Friday 25th January, Reception and talk: Center for Inquiry. Science in an Age of Endarkenment: Some Examples from Scientific Fraud, Quackery, Religion and University Politics |
The interview was broadcast on Sunday morning (28 Jan) and elicited a lot of correspondence. CBC made it available as a podcast which can be downloaded from CBC here. The endarkenment interview was the last 22 minutes (out of 64 minutes) [play the interview here (mp3, 20 Mb)]. |
Sunday Edition: the follow-upThe week following this CBC show, the backlash started. The Sunday Edition wrote
“A stirred-up hornet’s nest is a mild disturbance compared to the firestorm we unleashed last week over my conversation with Dr. David Colquhoun. Dr. Colquhuon [sic] is a gangly, pipe-puffing British pharmacologist who thinks all alternative medicine, all of it, is a fraud perpetrated by quacks. But he went further, somehow suggesting that those who believe in it probably supported Margaret Thatcher, Ronald Reagan and the Ayatollah Khomeini. He pooh-poohed acupuncture, chiropractic, homeopathy, even vitamins.
Well, his remarks opened the floodgates of listener mail, screaming for Dr. Colquhoun’s head on a pike. In a few moments, alternative or complimentary [sic] medicine strikes back. With the help of two experts, we will try to give the other side of contentious Colquhounism.”
The programme for 3 Feb 2008 started with a few emails from listeners, mainly of the “homeopathy cured my granny” type. Nothing of much significance there. But then Enright interviewed Dugald Seely of the Canadian College of Naturopathic Medicine and Dr. Kien Trinh of the DeGroote School of medicine at McMaster University in Hamilton. You can download the podcast here.
The flat earth problem.
Michael Enright was a good interviewer, but Sunday Edition suffers, like the BBC, from a problem. It is admirable that CBC, like the BBC, should strive to be ‘fair and balanced’, but it is not always easy to see what that means in practice. Is it fair and balanced to give equal time to people who think that the earth is flat and those who think it is spherical (OK, an oblate ellipsoid)? Perhaps, but it also
quite misleading because it can easily convey a very distorted idea of the balance of informed opinion. In this case the flat-earthers are the homeopaths and other alternative medicine advocates. That would not matter so much if the interviewers had enough knowledge of the subject to pin down the falt-earth advocates with the sort of penetrating questions that people like John Humphrys (of the BBC’s Today programme) are so very good at. When it comes to science, though, the flat-earthers tend to get away with murder, and the public can easily be left with a very distorted view. Which “expert” should they believe? If I had been given the option, I would have loved to debate the problems of alternative medicine directly with Trinh and Seely I could have asked then a few questions that Enright missed.
Let’s take a look at what happened at the follow-up.
Quackery at McMaster University
McMaster is one of many universities in North America that has chosen to betray the intellectual tradition of the enlightenment by buying into superstition (see the roll of shame here). The ‘contemporary medical acupuncture program appears to run under the aegis of the anaesthesia
department, though the fact that is doen’t appear on the department’s front page suggests there may be some embarrassment about it. The medical acupuncture program itself, has separate web pages which don’t seem to be on the McMaster server at all (they are on a private server, ThePlanet.com Internet Services, Inc.
As so often, these pages pay lip service to an ‘evidence based’ or ‘scientific’ approach, while doing nothing of the sort. In his CBC interview Kien Trinh agreed (twice) with my contention that trials had shown that it doesn’t matter where you put the needles. But then he failed totally to draw the obvious conclusion that ‘meridians’ are mumbo jumbo. He went right on taking the conventional mystical view of meridians and “energy” flow. Like most proponents of alternative medicine, Trinh seems to live in some sort of parallel universe in which the normal rules of logic don’t apply.
On wouldn’t expect regular anaesthetists to accept this sort of mystical nonsense, but it seems one would be wrong. When I wrote to the Chair of the Department of Anesthesia, at McMaster to ask about their relationship with acupuncturists there was no hint of embarrassement. Dr Norman Buckley, BA (Psych), MD, FRCPC, wrote
“It operates under the principles of evidence based medicine, and relates the concepts raised by the Acupuncture/traditional Chinese medicine to physiology anatomy et as it is more usually taught in Western schools.”
That would be all very well if it were true, but it simply isn’t true. The evidence just isn’t there, and the departments involved make no serious attempts to get evidence. In a later letter, Dr Buckley seems to acknowledge that it may be all placebo, but seems reluctant to offend anyone by saying so. That, I suspect, is how quackery has gained such a foothold.
It is good to keep an open mind, but if it is too open your brains fall out. Or, in another variant, if it is too open, someone will fill it with trash.
One looks in vain on Trinh’s web site for any good evidence. They quote approvingly the conclusion of a 1997 NIH Consensus statement that says “There is sufficient evidence of acupuncture’s value to expand its use into conventional medicine and to encourage further studies of its physiology and clinical value.”, but forget to mention that this document is headed “This statement is more than five years old and is provided solely for historical purposes.”. The department doesn’t seem to do much original research, just to write endless reviews of other peoples’ work. The reviews aren’t too bad, and mostly they come to the right conclusion, that there is not enough evidence to come to firm conclusions. The difference from science is that this doesn’t dent their confidence for a moment. A typical sort of conclusion seems to be
Elbow pain. A review by Green et al. concluded “needle acupuncture [is] of short-term benefit with respect to pain, but this finding [is] based on the results of two small trials, the results of which [are] not able to be combined in metaanalysis.”
The results of thousands of years experience with acupuncture seem to be pretty pathetic so far..
Quackery at the Canadian College of Naturopathic Medicine (CCNM)
Unlike McMaster, CCNM isn’t a proper university, though nonetheless is hands out ‘doctorates’. Dugald Seely’s contribution was interesting insofar as he admitted that there was a lot of fraud and unjustified claims in the alternative medicine industry (never forget there are megabucks involved). What he didn’t explain was how he himself could be distinguished from the frauds. The problem, as always is the second-rate research that goes on in this area.
Take one of Seely’s papers, Adaptogenic Potential of a Polyherbal Natural Health Product: Report
on a Longitudinal Clinical Trial. Is only too typical: a small non-randomised, open-label (not blind) “trial” of a complex herbal mixture on 17 patients. The conclusion was, as it almost always is,
“Further research using a randomized controlled design is necessary to confirm the findings from this pilot study.”
In other words, no conclusion at all. Why is it that the proper trial never seems to appear? Could it be that naturopaths, and the wealthy industry behind them, are afraid to do proper trials? That is certainly the impression they give.
One way in which the alternative medicine industry operates is to invent new words with ill-defined meanings (and Big Pharma does it too). In case you were wondering about the word “adaptogen” it is defined as “Essentially the adaptogen supports the body’s ability to ‘adapt’ ideally to its environment. Essentially the adaptogen supports the body’s ability to ‘adapt’ ideally to its environment. ”
Whatever that means.
The Canadian College of Naturopathic Medicine offers the following “therapies”.
- acupuncture/Asian medicine
- botanical medicine
- physical medicine (massage, hydrotherapy, etc.)
- clinical nutrition
- homeopathic medicine
- lifestyle counseling
Well, nothing wrong with nutrition and lifestyle counseling as long as the claims aren’t exaggerated. But, as always, the claims that are made are vastly exaggerated. For example they claim
Homeopathic remedies are particularly effective for:
- depression
- anxiety
- allergies
- infections
- gynecological concerns
- skin conditions
- digestive problems
- chronic and acute conditions including colds and flu
These claims are simply not true, in my view. If you don’t believe me, check NELCAM (the NHS Complementary and Alternative Medicine Specialist Library). This is written by advocates of alternative medicine, yet it finds no convincing evidence for effectiveness of homeopathy in any of the conditions listed above.
Or, even more remarkably, from a report in Newsweek.
“Dr. Jack Killen, acting deputy director of the National Center for Complementary and Alternative Medicine, says homeopathy “goes beyond current understanding of chemistry and physics.” He adds: “There is, to my knowledge, no condition for which homeopathy has been proven to be an effective treatment.”
The National Center for Complementary and Alternative Medicine (NCCAM) has, incidentally, spent almost one billion US$ billion of US taxpayers’ money and has come up with next-to-nothing useful.
So the claims made by the Canadian College of Naturopathic Medicine are not backed up even by people who are directly involved in alternative medicine You don’t have to be a rocket scientist to understand that the medicine contains no medicine.
As I have often said, you don’t need to be a scientist to see that most alternative medicine is bunk, though it is bunk that is supported and propagated by an enormously wealthy industry..
There were two good examples this week, John Sutherland, who was until recently professor of English literature at UCL, understands it very well. And so does political columnist, Polly Toynbee.
“Complementary and Natural Healthcare Council”
Polly Toynbee’s column, “Quackery and superstition – available soon on the NHS“, was prompted by the announcement in The Times that the government was to set up a “Natural Healthcare Council”. It was soon renamed the “Complementary and Natural Healthcare Council” (CNHC) It was instantly dubbed ‘OfQuack’ in an admirable analysis by quackometer.a>
href=”http://www.quackometer.net/blog/2008/01/prince-charles-ofquack-is-dead-duck.html” target=”_blank”>
The very name is tendentious and offensive to any thinking person. What is “natural” about sticking needles in yourself, or taking homeopathic polonium?
Toynbee comments
“Put not your trust in princes, especially not princes who talk to plants. But that’s what the government has decided to do. The Department of Health has funded the Prince of Wales Foundation for Integrated Healthcare to set up the Natural Healthcare Council to regulate 12 alternative therapies, such as aromatherapy, reflexology and homeopathy. Modelled on the General Medical Council, it has the power to strike therapists off for malpractice.”
There was only one thing wrong in this article. Toynbee says
“The alternative lobby replies that conventional medicine can also do more harm than good. They chortle with glee at an article in the Lancet suggesting there is no scientific evidence for the efficacy of 46% of conventional NHS treatments. But that’s no reason to encourage more of it.”
Professor John Garrow has pointed out (see, also Healthwatch )
“It is true they chortle, but they have got their facts wrong. The 46% of treatments which are not proven to be effective is 46% of all treatments for 240 common conditions – and very few are used in the NHS. The great majority are treatments used by alternative practitioners. “
The unconstitutional interference by the Prince of Wales in public affairs has been noted often before, and it seems that it’s happening again.
For example, there is the TV programme, “Charles, the Meddling Prince”, or, for a US view, see “Homeopathy: Holmes, Hogwarts, and the Prince of Wales“. And then there’s Michael Baum’s superb “An open letter to the Prince of Wales: with respect, your highness, you’ve got it wrong“.
It isn’t that regulation isn’t needed, but that the sort of regulation being proposed won’t do the trick. The framework for the “Natural Healthcare Council” has been set up by Professor Dame Joan Higgins, and it seems to be very much along the lines proposed by the Prince of Wales. Here’s what’s wrong.
Professor Dame Joan Higgins (Jan 10th) says “Complementary therapists have been in practice for many years” and “If complementary therapy is not to be banned, is it not, therefore, wise to regulate it and offer the public some measure of protection”. That’s fine, but I think the sort of regulation that she, and the Prince of Wales, are proposing won’t do the trick. We don’t need new laws, or new quangos, just the even-handed application of existing laws. Homeopathic arnica 30C contains no arnica, and one would expect that the Office of Fair Trading would have banned it. It is no different from selling strawberry jam that contains no strawberries. But absurd legal loopholes make homeopaths immune to prosecution for this obvious mislabeling, whereas jam fraudsters would be in deep trouble. The Advertising Standards Authority, likewise, is prevented from doing its job by legal loopholes, and by the fact that it has no jurisdiction over web advertising, which is now the main source of untrue claims. If alternative medicine advocates had to obey the same laws as the rest of us, the public would be better protected from fraud and delusion. What won’t work is to insist that homeopaths are “properly trained”. If one takes the view that medicines that contain no medicine can’t work, then years of being trained to say that they do work, and years spent memorizing the early 19th century mumbo-jumbo of homeopathy, does not protect the public, it imperils them. |
The “Natural Healthcare Council” isn’t the only example either. Try Skills for Health.
Skills for Health
This appears to be a vast bureaucratic enterprise devoted to HR-style box-ticking. Just in case you don’t know about this latest bit of HR jargon, there is a flash movie that explains all.
“Competences are descriptors of the performance criteria, knowledge and understanding that are required to undertake work activities. They describe what individuals need to do, and to know, to carry out the activity -regardless of who performs it.”
That sounds OK until you realise that no attention whatsoever is paid to the little problem of whether the “knowledge and understanding” are pure gobbledygook or not. It’s rather like the HR form that ensures UCLH that you are a fully-qualified spiritual healer “Laying on of hands: just tick the box“.
It is an invidious insult to human intelligence to suppose that exercises like this are an appropriate way to select people for jobs. They have precisely the opposite effect to that intended.
An indication of the level of their critical thinking is provided what is written about the 62 items listed under “Complementary Medicine” These include “CHH5 Provide Healing”.
“This workforce competence is applicable to:
- healing in the presence of the client
- distant healing in contact with the client
- distant healing not in contact with the client
Both healing in the presence of the client and distant healing use exactly the same mental and spiritual processes. Clearly, however, distant healing does not involve many of the physical aspects of healing in the presence of the client. The performance criteria have been written so as to be able to be interpreted for use in any healing situation.
The workforce competence links to CHH6 which is about evaluating the effectiveness of the healing.”
It also includes homeopathy, for example “HM_2: Plan, prescribe and review homeopathic treatment“.
I sent an email to Skills for Health to ask who wrote this stuff. A reply from their Technical Development Director failed to elicit any names.
We develop competences to fit sector needs and demands. When that need is moved into a competence project we establish a number of groups from the specific area to work with us to develop the competences. One of these groups is a “reference” group which is made up of experts from the field. In effect these experts give us the content of the competences, we write them in our format. So I guess the answer as to who is the author is Skills For Health, but with more complexity behind statement.Please do not hesitate to get in touch with me for further clarity. |
A conversation with Skills for Health
I did want more clarity, so I phoned Skills for Health. Here are some extracts from what I was told.
“It’s not quite as simple as that”
“the competencies on our data base are written by “experts in the field”
DC. Yes and it is their names that I was asking for
“I’m not sure I can give you the names . . . We’re starting to review them in the New Year. Those competencies are around six years old. ”
“We are working with the Prince’s Foundation for Integrated Health [FIH] via Ian Cambray-Smith to review these competencies, all the complementary therapy competences on our web site”
“They are written as a consensus decision across a wide number of stakeholders across that area of …”
DC. Written by whom though?
“written by a member of Skills for Health staff or a contractor that we employ simply to write them, and the writing is a collation of information rather than their original thoughts, if you like”
DC yes, I still think the sources can and should be given.
“FIH didn’t spend any money with us on this project. This project was funded by the Education act regulatory bodies, QCA, the Qualifications and Curriculum Authority . . . ”
“They [FIH] may well have put in and supported members of their professions or groups to do part of this . . they were there as experts on that particular area of complementary therapy ”
DC it’s their names that I was after
“There may well have been members [of FIH] on the reference groups that I’ve referreed to who are members of the FiH . . .they were there as experts from that area of complementary therapies.”
DC Oh, and are the names of [the people on] these reference groups published?
“No they are not published”
DC ah, why not?
“We do not consider it necessary”
DC Well, I consider it very necessary myself
“Tell me why”
DC It’s a question of public accountability
“I guess the accountability lies with us as the owners of those competencies”
DC Uh I’m afraid your bureaucratic jargon is a bit much for me there. “The owners of those competencies”? I’m not sure what that means
“Why do you want the information?”
DC haha, well if you want me to be entirely blunt, it’s because I’m appalled that this black magic is appearing on a government web site
“. . . can I say that as an organisation funded by a number of sources, one being Department of Health England, none of our work condones the practice you’ve just suggested. Our work supports best practice in areas that are evidence- and research-based”
DC Ah would you mind pointing me to the evidence for homeopathy and distant healing?
“Uh [pause] there is [pause]”
DC Yes, go on
“Well homeopathy is a contentious issue, because every newspaper article I read seems to suggest that homeopathy, in itself, is not an appropriate, uh, not an, uhm, appropriate, uh, therapy.”
DC Yes so why are you laying down standards in it?. You know I’m curious. I’m genuinely curious about this
“The areas involved in them have asked us to, including the Prince’s Trust hence the reason we are doing . . .”
DC But the Prince’s Trust is not part of government. Ha, it behaves as though it was , I agree, sometimes but it is surely for the Department of Health to ask you to do these things, not the Prince of Wales.
“We cover the whole health sector.. We don’t purely work for, or are an organisation of, the Department of Health.”
DC. I’m very baffled by the fact that you say, you very accurately the research on homeopathy, namely that it doesn’t work, but you are still setting standards for it. It’s quite baffling to me.
“Working with the Foundation for Integrated Health, as we are doing, homeopathy is one of the 10 areas that is listed for regulation by FIH ”
DC. Well yes the Prince of Wales would like that. His views on medicine are well known, and they are nothing if not bizarre. Haha are you going to have competencies in talking to trees perhaps?
“You’d have to talk to LANTRA, the land-based organisation for that.”
DC. I’m sorry, I have to talk to whom?
“LANTRA which is the sector council for the land-based industries uh, sector, not with us sorry . . . areas such as horticulture etc.”
DC. We are talking about medicine aren’t we? Not horticulture.
“You just gave me an example of talking to trees, that’s outside our remit ”
After explaining that talking to trees was a joke, the conversation continued
DC So can I clarify then? Who is it that said you must include these fairly bizarre things like distance healing and homeopathy? Who decides whether it goes in?
“We did”
“We are going to do a major review. We are doing that review in partnership with the FiH and the awarding bodies that award the qualifications that are developed from these competencies”
“When that need is moved into a competence project we establish a number of groups from the specific area to work with us to develop the competences. One of these groups is a “reference” group which is made up of experts from the field. In effect these experts give us the content of the competences, we write them in our format.”
Conclusions from this dialogue
We still don’t know the names of the people who wrote the stuff, but a Freedom of Information Act request has been submitted to find out
The Skills for Health spokesperson seems to a a bit short of a sense of humour when it comes to talking to trees.
The statement that “Our work supports best practice in areas that are evidence- and research-based” is not true, and when pressed the spokesperson more or less admitted as much.
Most importantly, though, we do now know that the revision of this gobbledygook will be carried out entirely by the Prince’s Foundation for Integrated Health and the people who set exams in the relevant form of gobbledygook. No critical voice will have an input, so don’t expect much improvement. “We are working with the Prince’s Foundation for Integrated Health [FIH] via Ian Cambray-Smith to review these competencies”. And in case you don’t know about the medical expertise of Ian Cambray-Smith, it is described on the FIH web site. He is the FIH’s Health Professionals Manager.
Ian Cambray-Smith acts as the focus for FIH’s involvement with healthcare professionals. He works collaboratively to develop a range of work programmes, policies and initiatives to support healthcare professionals and help them to deliver a truly integrated approach to health. Ian’s background is in plastics research, project management and business development; he has an MSc in polymer technology. He joined the Foundation in 2006. |
The Times Higher Education Supplement (THES) last week had a headline “Staff loyalty key to Hefce report”.
Staff loyalty is something I’m interested in, so I read on eagerly.
The article was about report from the Higher Education Funding Council for England (HEFCE). It came from their Leadership, Governance and Management Strategic Advisory Committee (dated 2-3 July 2007). [Download the report: Word format]
Well there is the first cringe already. Whenever you see the word ‘leadership’ you can bet that it means that you are going to be lectured on how to do your job by somebody who has never done it themselves. (probably somebody suffering from Siegfried delusions -in the words of Ernest Newman. an overgrown boy scout).
No disappointment on that score. This particular sermon is being delivered not by a successful researcher. Not even by an unsuccessful researcher who has been moved up to manage the successful ones. It is being given by Ed Smith, Global Chief Operating Officer and Strategy Leader for Assurance, PricewaterhouseCoopers. |
Their web site says of Ed Smith:
“He is a leading advocate of, and external speaker on People management in organisations, in particular diversity and work/life having led PwC’s own enlightenment in this area “
“PwC’s own enlightenment” ? Cringe!. Who writes this stuff, one wonders,
Here are the main points.
“3. There are high level activities to be undertaken of reconceptualising the university and rethinking the business model.”
Reconceptualise? Is it a condition of essential condition of working for PricewaterhouseCoopers to be unable to write plain English?
More to the point, one would be interested to know what concept of a university he has in mind? The statement as it stands has roughly zero content.
“4. To implement the outcome of this rethinking, there will need to be significant culture change. HEIs’ staff will need to be more aware of and aligned to the strategic needs of the HEI.
Academics’ goals are often related to their discipline rather than their institution and they will need to develop institutional loyalties in addition to discipline loyalties. Corporate planning processes will need to be communicated more effectively for those processes to be more successful. “
This statement fails to make the important distinction between the Institution itself, and the people who, for the time being, are running it (see Letters). The first thought that comes to mind after reading this is that it is a statement that is likely to have exactly the opposite effect from that intended by the writer. The more statements like this that come from on high, the less inclined people are to feel allegiance to the institution that issues them, or, to be more precise, the people who are running the institution for the time being.
Respect has to be earned.
“5. HE staff can find themselves uncertain about their role, typically
because it has never been fully made clear. Research has often become too prominent as an indicator of performance, because it has been measured in the RAE, and other activity has not been equally recognised and rewarded. “
Aha, now does that mean that our role is not to do research and teaching after all? Perhaps it has now been redefined somehow? Perhaps our role now is to waste time on sham consultations, read reams of world-class policy bollocks, and do what one is told by some official in HR? I don’t think so. The second sentence has some justice, but I guess Mr Smith has not had to suffer floods of contradictory instructions from the endlessly-multiplying ‘managers’.
One day a ‘manager’ says we must all publish three papers a year, and they must all be in the same handful of journals (though there has not, as far as I know, been
the sort of crude bullying about this at UCL that I have heard about in, say Imperial and a few other places). Furthermore we mustn’t collaborate with anyone in the same place because the same paper must not appear to the RAE to come from two groups.
The next day we will be told that the entire place must be turned upside down because of the absolute necessity for collaborations. Of course the measures that are proposed never have the slightest effect on collaboration, because they come from people who talk about it, not from people who do it.
And the next day we are told by a third person that all of the above is secondary and that teaching matters more than anything else.
Of course all these contradictory instructions do nothing but prevent us doing the research and teaching that we had supposed to be our job.
“7. HEIs will need to develop their business process and become more efficient, so that they can re-invest. The Committee advises that HEIs should not be afraid of the language and culture of business. “
The language of business, at least of the sort that now permeates universities, is usually both vacuous and pretentious. The culture of business is what produces BSc degrees in anti-science (not to mention accounting scandals).
The use of the word “afraid” in this context is sheer overweening arrogance. I have spent a lifetime trying to express complicated ideas in simple language. That seems to me to be as desirable in real science as it is in my attempts to improve public understanding of science. The aim of managers seems often to be to express
simple ideas in complicated language. I’m never quite sure whether the reason for this is illiteracy. or a conscious effort to disguise the emptiness of the ideas. A bit of both, I expect.
What do we conclude from this?
The interesting thing about this document is that it is written by a businessman but appears to me to ignore two basic business principles that can be put in perfectly simple language.
(1) Supply and demand. There will always be an endless supply of managers and pensioned-off researchers who are willing to accept professorial salaries for producing reams of policy bollocks. There isn’t even much shortage of people who can do a tolerable job of teaching at least at first or second year level. The really scarce people are the top flight original researchers, the ones who will make a difference to the future. It follows that these people have enormous power (though often they are too busy to use it). If the place that they works adopts the culture of managerialism, they will just leave Highly original minds have a low tolerance for policy bollocks. Of course this is a slow process. It might take a decade or more to destroy a good research outfit in this way, and by the time managers notice the consequences of their actions it would already be too late. It is much easier to destroy than to build.
(2) The value of brand names . This is where it gets personal, though I imagine many other people have had similar experiences in recent years. The Pharmacology Department at UCL has had a distinguished history for 100 years. I can’t count the number of times that I’ve been at meetings and heard people say “gosh you are from Pharmacology at UCL -that’s impressive”. People in the department got a glow from comments like that. That is what generated loyalty to the department and to the College that houses it. Now we are told that we are to be part of an over sized monstrosity called the “Research department of Neuroscience, Physiology and Pharmacology”. That really trips off the tongue, right? One can’t imagine something with an utterly unmemorable name like that ever getting an international reputation. In any case, I expect that another policy wonk will come along and change the name again in 5 year’s time,
How does this sort of vandalism happen? I guess one reason is that the sort of people who get to be managers just aren’t sufficiently in contact with science to be aware of the reputation that we used to have. They seem to be unaware that the reputation of an institution is no more than the sum of the reputations of the researchers and teachers who work in it (not the administrators). And if a department has a few good people in it over a long period, the department as a whole contributes too. The College reputation barely exists in isolation, just the sume of individuals. Take an example. At UCL we have an excellent department of German, a department that contributes to the reputation of UCL. But of course not one pharmacologist in a million has heard of it, just as I imagine not one German historian in a million has heard of our (late) pharmacology department.
Let’s get a few things clear.
- The job of universities is to do teaching and research.
- The teaching is enormously important but the external reputation of the establishment will inevitably depend almost entirely on its research.
- The success of the place therefore depends entirely on the people who do the research and teaching. Everybody else, from junior technician to vice chancellor is there only to support them.
- The people who do the research and teaching are the only ones who know how to make a success of those jobs The HR department, for example, know nothing about either either teaching or research. How could they? They have never done either. Their job is to make sure people get paid, not to bully and harass the people doing the real work of the university.
- The aims of business are, in some ways, precisely the opposite of those of universities. Business aims to sell things. Spin and mendacious advertising are an accepted part of the game. The tendency for them to become part of the game in universities too can do nothing but harm. Are universities mean to admire the mentality that gave rise to Enron and Worldcom?
- Remember the words of Robert May (President of the Royal Society, 2000 – 2005).
“A rather different issue that has emerged during the Blair decade is the tendency to invite people from the world of business to advise on the management of universities, or to head them. Given that UK universities still stand significantly higher on international league tables than does most of the UK business sector, this seems odd.”
On ‘leadership’ and ‘vision’.
The two most overworked words in management-speak remind me inexorably of the rhetoric used by those who advocated the merger of UCL and Imperial. And of two comments that appeared in the financial (not the academic) press after the attempt crumbled.
Lessons of a failed merger (Matthew Lynn, Bloomberg News. 20-Nov-02). “: [get the pdf].
“Unfortunately for Sykes, the professors of Imperial and University College London were smarter than the last recipients of his strategic wisdom, the shareholders in the formerly independent drug companies Glaxo Wellcome and SmithKline Beecham.
The biggest universities in the world are clearly not the best. So why do some British universities think that mergers will make them world class? (John Kay, 21-Nov-02 Financial Times).
” The same empty phrases that were used in the 1990s to justify corporate mergers are today used to justify university mergers – the aspiration to be a “global player”, the need to achieve “critical mass”. But greater size is always the aspiration of those with no better strategic vision.”
Two letters
These two responses appeared in THES the following week (Dec 7th), from opposite ends of the age spectrum. Notice that the younger one does not dare to give a name. I don’t blame him or her. That is the rule rather than the exception, when people feel intimidated. Exactly the same thing happened when the crazy “vision” of merging Imperial and UCL was on the cards. Anyone with half a brain could see it was nuts (with the exception of the senior management team at the time), but not everyone dared to say so.
Loyalty, but not blind allegiance 1 Research associate, Russell Group university Published: 07 December 2007 Loyalty cuts both ways (“Staff loyalty key to Hefce report”, November 30). Look at contract research staff such as myself who are forced to seek employment in other institutions and environments. I cannot say that I have had an experience in my institution that inspires anything like loyalty. People there want it to go only one way. When are we going to get loyalty from our employing institutions rather than being treated as disposable drones? Research associate, Russell Group university. |
Loyalty, but not blind allegiance 3 Geoffrey Alderman Published: 07 December 2007 Many years ago, it fell to me to chair Higher Education Funding Council for England teaching-quality inspections of academic departments. At one such event, the head of department confided to me and my team that he and his team completely disagreed with the strategic direction in which their vice-chancellor was taking them and were doing all they could to undermine it, in the interests of the discipline they taught. We agreed, and gave the department top marks. Geoffrey Alderman, Michael Gross professor of politics and contemporary history Buckingham University. |
Postscript
How very nice to get an endorsement from a Nobel prizewinner. Why, I wonder, was he not asked for his opinion about how to get good science. Perhaps PricewaterhouseCooper know better