Friday, February 16, 2007

Why IgG Testing for Food Intolerance Is Not As Simple As ABC or Doh Ray Mi

Cat with rifle poised at a window. The caption reads When all else fails, vote from the rooftopsWhat I know about the scientific validity of IgG testing to diagnose food intolerance could be written on a postcard leaving plenty of room for the address and stamp. I'm just mentioning this because it may be time for authors' competing interest declarations to be supplemented with a statement of scope of knowledge/ignorance/belief.

I've been prompted to consider the need for this statement by Patrick Holford's theatrical outrage about BBC Watchdog's Dirty Allergy Trick* (NB, the original article has been removed, I shall do my best to keep up with other links to it). A healthy volunteer participated in three food allergy/intolerance tests – two VEGA tests (conducted at different times and with different operators), a hair test, and two YorkTest IgG Food Intolerance tests (he submitted two blood samples under different names).

The hair and VEGA tests yielded long lists of foodstuffs that should be avoided. The investigative team highlighted the unreliability of the two VEGA tests that yielded different results. The team mentioned that the Yorktest results differed, but far less egregiously than the VEGA tests. According to Holford, this outcome was equivalent to a " [t]humbs up for Yorktest".
The expert they used to pass judgement said that there had been only one study on IgG as a basis for allergy! That is plain deception. If you go into Medline, the on-line database of published research and put in IgG you’ll find 139,473 referenced studies. If you narrow down to IgG + food intolerance it list 85 studies. I referenced 115 studies in my book Hidden Food Allergies (Piatkus). The evidence for IgG antibody reactions as a basis for food intolerances continues to grow, including well designed randomised controlled trials, however, some health professionals just haven’t kept up to date. Perhaps it’s because a ‘home test’ takes the power away from the professional and puts it in your hands.
Should the 'expert' hang his head in shame? Should I break out the sackcloth and ashes for failing to be convinced by both Patrick Holford's erudite assertions and expert support for IgG testing, as listed by YorkTest? Among the experts, Muriel Simmons of Allergy UK is quoted as saying:
The clinically proven YORKTEST Food Intolerance Test and back up support offered to patients provides a wonderful service for food intolerance sufferers worldwide.
To the comparatively uninformed, such as myself, it seems as if Patrick Holford conflates allergy and intolerance, but he endorses the tests enthusiastically:
The vast majority of food allergies happen because individuals produce IgG antibodies to specific foods. If symptoms, pain or energy levels come and go for no obvious reason, then you may have a hidden food allergy or intolerance. A simple YORKTEST Laboratories IgG food allergy home test provides clear, laboratory analysed, scientific results.
I'm going to deal with these endorsements separately. Although it isn't clear from the quotation attributed to her, Muriel Simmons may be relying upon a study into IgG testing and an elimination diet in a group of people with irritable bowel syndrome (IBS). In the abstract for that paper, the authors quite properly restrict the scope of their conclusions:
Food elimination based on IgG antibodies may be effective in reducing IBS symptoms and is worthy of further biomedical research. [Emphasis added.]
This is in stark contrast to some of the authorities who lend their YorkTest-styled expertise to endorsing the tests as valid for "food intolerance": a catch-all term that can encompass more than 100 symptoms of varying severity.

Dr. Hunter, who has research interests and publications in IBS, made the following comments about the value of the findings from that study: Food Elimination in IBS: The Case for IgG Testing Remains Doubtful.
The percentage of patients showing substantial benefit from this diet is disappointing. In studies using a well conducted and rigorous elimination diet, the "number needed to treat" is between 1.5 and 2.2 [refs]. The "number needed to treat" in this study was 9. (The value of 2.5, calculated on the basis of those who fully complied with the diet, abrogates the intention to treat principle.)

This seemingly poor response to an IgG based diet confirms the widely held view to date that IgG testing for food intolerance is not of value. [refs] These results suggests that if IgG testing identifies food intolerances at all, it does so fortuituously and with an apparent low degree of accuracy.
Hunter further argues that the study was premature because it is not yet possible to answer the basic research question: "do high levels of IgG against a food predict an adverse reaction to that food?". Three of the four authors of the original paper replied to Hunter and elaborated their view on how their findings should be interpreted (scroll down).
[I]t is entirely possible that IgG antibodies may be important in IBS, where we now know that there is an inflammatory component in some cases, whereas they may not be relevant in food intolerance in general. Furthermore, it is likely that only a subset of patients are likely to have an immuno-inflammatory basis to their condition and these might be the very individuals who respond to dietary exlusion based on IgG antibodies. This would fit with our results where only a proportion of patients responded despite all having antibodies. This, of course, limits the specificity and usefulness of the test unless such subgroups can be indentified beforehand. We should also bear in mind that an immunological reaction in the gut, as opposed to other forms of food intolerance, may make the gut more susceptible to other perturbing stimuli, such as stress, rather than necessarily causing symptoms directly. [Emphases added.]
Unlike YorkTest and some of the experts who endorse the scientific validity of their tests, Prof. Whorwell and his colleagues are punctilious in limiting the scope of their findings to IBS: they acknowledge the relevance of other factors, such as stress, in IBS and are open to the possibility that their findings "may not be relevant in food intolerance in general".

On his own site, Patrick Holford ascribes a far greater diagnostic role for YorkTests and praises their "solid science":
The best tests for food and chemical allergies and intolerances measure the presence of antibodies in the blood called immunoglobulins...
My favourite laboratory is Yorktest Laboratories whose tests are clinically validated...
Yorktest have also carried out a number of ‘double-blind’ trials on their IgG test and have solid science to back up their claims of effectiveness.
Prof. Whorwell and his colleagues made no such claims, so Holford's confident claims presumably arise from that overwhelming number of studies on Medline. And, yes, it is true, if you put IgG into Entrez Pubmed, you will have a huge number of hits returned. I did this, today, and in the 5 weeks since Holford did his search, the number has grown to 140032. Narrowing the search to IgG + food intolerance yielded 86 results: less than 140032 but still a substantial body of research.

Except...not all of those 86 results are relevant. I am both unconvinced of the relevance, and unmoved by the implied plight in Longterm effects in neonatal basal forebrain cholinergic lesions on radial maze learning and impulsivity in rats; I'm similarly stumped by the relevance of Leptin administration prevents spontaneous gestational diabetes in heterozygous Lepr(db/+) mice: effects on placental leptin and fetal growth.

At the risk of appearing specie-ist, I restricted my exploration to those papers that seemed to involve humans or readily generalisable to them. A number of the papers involved variations on the word unproved in their titles; see examples here, here and here. Concentrating on these papers seemed unfair, so I consulted a selection of the others. For reasons of delicacy, I thought that I should likewise ignore papers with, e.g., unreliability in the title.

Working through the studies that remained, most of the authors (like Whorwell and colleagues) were scrupulous in defining the limits of the relevance of their findings to populations with IBS or infants with milk intolerance rather than claiming wider relevance in the field of food intolerance or validation for the IgG tests. Even when authors explored a broader remit, e.g., Alternative Tests in the Diagnosis of Food Allergies, they reported findings that do not support Holford's claims:
We reviewed the scientific evidences of these tests (specificity, sensibility, rationale, reproducibility). According to most studies none of them had to be recommended as useful for the diagnosis of food allergy or intolerance. Physicians should alert patients about the risk of an indiscriminate use of these test in the diagnosis of food allergy. In fact the use of an incorrect diet could be dangerous, particularly in childhood, as recently shown.
Other researchers analysed IgG levels in blood from young, healthy, male volunteers with no previous signs or history of food allergy. Their findings do not support Holford's claims:
Common occurrence of asIgG-4 against food allergens in healthy persons (without any symptoms which could suggest allergy or food intolerance) argues against the possible participation of these antibodies in the pathogenesis of food allergy.
Holford claims that he refers to 115 studies in his book; presumably these are supportive studies. However, it is implausible that many of these studies are drawn from the peer-reviewed studies listed in the Entrez PubMed search. Remember that Holford accused the Watchdog team of a "slight [sic] of hand" yet he has referred to the existence of a vast number of papers as if they are relevant and support his claims.

I would emphasise that I am using the literature search terms that Holford cited to bolster his criticism of the judgment of the Watchdog expert and his attack on the Watchdog team that prompts him to use phrases such as "dirty allergy trick" and "plain deception". Holford has recently compared his own qualifications, knowledge and expertise with that of Dr. Ben Goldacre, believing that it is Goldacre who comes off worse for the comparison. He vaunts his
30 years researching, teaching, writing and practising nutrition.
I admit the limitations of my knowledge of these areas, however, I do not think that even a cursory examination of the research literature supports Holford's claims for the "sound science" of either IgG testing or Yorktests in the diagnosis or validation of food intolerance. Perhaps the matter would be clearer to me if Holford had listed the supportive studies rather than sent me off on a wild-goose chase through the literature.

For a wider discussion of the poverty of evidence behind food intolerance, see Sandy's well-referenced, Fear of foods, contaminants and modern life. She quotes some disturbing findings:
Rona and Chinn found that around one half of parents who thought that their child was food allergic or intolerant altered their child's diet, but only one third sought medical advice, and that some children were 4 cm shorter than controls. Unnecessary environmental and chemical avoidance, creating a perception of organic illness where none exists, or advising physical interventions when psychosocial factors are the source of symptoms, can impact on employment and social functioning.
If the experts who provided testimonials to Yorktest meant to limit the scope of their support to the usefulness of IgG testing in guiding food elimination diets in people with IBS, then they should have stated this clearly. If they believe that research findings can support a more generous interpretation than their own authors would assign to them, then it would be helpful if they stated their reasons for this. If there is "sound science" that confirms the value of IgG testing in diagnosing and confirming food intolerance then it would be a valuable contribution to the public debate if either the experts or the company marketing the test were to provide the references. Holford chooses to deprecate the knowledge of others:
some health professionals just haven’t kept up to date. Perhaps it’s because a ‘home test’ takes the power away from the professional and puts it in your hands.
However, until such time as I see these references, I will reserve my judgment as to which parties are indulging in a "dirty allergy trick" or "plain deception". The parents highlighted in the Rona and Chinn took their power into their own hands because they couldn't obtain formal help for their children's perceived food intolerances; as a consequence, those primary school children are shorter than their non-food-intolerant peers by an average 1.5 cm. Encouraging people to take tests that boost their empowerment and lead to restrictive diets can have consequences: it would be useful if the experts who endorse these tests and diets were explicit on this point.

*Edited 1 March It seems that Holford's article has been removed from the site. I have replaced that link with ones to sites that still have a copy. The original link was BBC Watchdog's Dirty Allergy Trick. At the time of writing, other copies are as follows: BBC Watchdog's Dirty Allergy Trick; Nutritional Therapy: BBC Watchdog's Dirty Allergy Trick; BBC Watchdog's Dirty Allergy Trick. If these links disappear then I shall put up a link to the cached version of the article.

Labels: , , , , , , , , , , , , , ,

17 Comments:

Blogger Flea said...

My sense of the parents who have these tests done is that the diets they place their kids on tend to be short lived. Wishful thinking? Perhaps.

Incidentally, I always refuse when asked by parents to draw blood for a "kit" to be sent away.

best,

Flea

11:33 AM  
Blogger Shinga said...

How do the parents react to your refusal, Dr. Flea?

If restrictions are short-lived, then it makes it more intriguing that Rona and Chinn report such a height difference in the 5-7s. It would be interesting to know if the children 'grow out of it' after they revert to a mixed diet or if it sets up some long-term changes.

That is the nuisance of restrictive diets - it can take years for their ill-effects to become apparent.

Regards - Shinga

12:41 PM  
Anonymous Anonymous said...

As someone with real IgE allergies these folks really annoy me. They make it VERY HARD for those of us with REAL allergies to be taken seriously by the medical community.

Those of us who have real, IgE mediated food allergies have enough trouble being taken seriously without people making up food illnesses! They contribute to the idea that "it's all in your head" when it definitely is not.

Pax,

MLO

7:11 PM  
Blogger Shinga said...

Hi MLO - one of my major concerns is that this sort of 'research' brings true allergies into disrepute or leads to them being handled less respectfully than they should be.

The NCCAM in the USA is said to spend 100 million dollars a year on research into CAM. It would be unbelievably easy for the US arm of one of these testing companies to run a proper trial with excellent control arms. One has to wonder why they don't.

Thanks for stopping by - Shinga

7:41 PM  
Anonymous Anonymous said...

You wrote: "Holford claims that he refers to 115 studies in his book; presumably these are supportive studies. However, it is implausible that many of these studies are drawn from the peer-reviewed studies listed in the Entrez PubMed search. Remember that Holford accused the Watchdog team of a "slight [sic] of hand" yet he has referred to the existence of a vast number of papers as if they are relevant and support his claims."

With regard to the "115 studies" Holford said he referred to in his book and which, from the context, he appeared to be implying supported his claim about IgG testing: I’ve had a look at the book in question. It lists 115 references in total. As with his Pubmed search results, many of them do not appear to be relevant to the point he was trying to make about the watchdog programme. As far as peer-review goes, at a quick glance through the list in Waterstones (you don’t think I actually bought a copy, do you) I noticed things like, for example, a letter to the editor of the Lancet and a presentation made to a conference about autism.

All the best,

Mojo.

9:14 PM  
Blogger Shinga said...

Mojo - 115 references for the whole book? Boring old scientists and their 100+ per 2000 words.

Is it at all possible that Holford, too, is practising referenciness a la McKeith?

"Dr Ben Goldacre, used this word to suggest a supposed scholarly reference that wasn't a real one: "The scholarliness of her work is a thing to behold: she produces lengthy documents that have an air of 'referenciness' ... but when you follow the numbers, and check the references, it's shocking how often they aren't what she claimed them to be."

To borrow further from Zwicky, there would be a certain justiciness is seeing this nonsense exposed for what it is.

Regards - Shinga

11:42 AM  
Blogger five_kingdoms said...

I had an IgG test done through Yorktest earlier this year. I procrastinated for several months but was won over by (a) the apparently solid science / methodology involved and (b) the prospect of an objective resolution to the question of whether the foods I'm eating are adversely affecting my health. After several years of gentle accusations of hypochondria from friends and relatives, such verification was long overdue.

I did not see the Watchdog programme but I've read Holford's response and from what I understand of the structure of the test, I believe he has fairly answered the criticism relating to the chap who had differing results from the same blood.

More worrying for me, as someone who has invested hope and money in this test, is the doubt regarding the premise that the presence of IgG for X is indicative that consumption of X is the cause (or even an exacerbating factor) of illness.

The world appears to be moving on from pseudoscience scams and mystical cures but if the critics of IgG testing are to be believed, this need not put their exponents out of business. The same ends may be met by using respected methodology and glossing over the details.

4:05 PM  
Blogger Shinga said...

Hello Five Kingdoms,

Sadly, if you look at the regular Skeptics Circle or Orac's regular Dose of Friday Woo - there is no let up in pseudoscience scams or mystical cures.

My criticism of Holford was in referring to the body of literature that doesn't exist in the way that he implies and he accusations of 'plain deception' and 'slight [sic] of hand'.

I don't understand what you mean about the exponents section with the methodology etc. If you have the time, it would be helpful if you expand on that.

Regards - Shinga

4:19 PM  
Blogger five_kingdoms said...

Hi Shinga

I didn't disagree with your criticism of Holford's reference to supportive material that does not apparently exist.

In his worryingly titled 'Optimum Nutrition Bible' he extols the virtues of IgG testing in a manner that brings to mind a presenter from a shopping channel. From what I have read since taking the test, his endorsement of it is out of step with a majority of respected professionals. A cynical person might ask if he has a personal interest in the matter.

In the last paragraph I was saying that if there is no evidence for IgG as an indication of allergy, the services of Yorktest and similar labs are of no more use than other diagnostic methods that are more widely and readily discounted as pseudoscience. The former are however in part practising good science (in that ELISA is a widely used lab technique) which makes the alleged deception regarding the significance of results all the more enticing and easier to market.

6:24 PM  
Blogger Shinga said...

Hi Five Kingdoms (I have to ask, is there a story behind that name?),

I haven't seen the ONB - I really must take a flick through that chapter. I have no idea whether Holford or McKeith have an interest in the test but they both recommend them: I have to say that the Food Detective and similar recommend a different lab's IgG panel test.

I do agree with you that I think it is potentially confusing that ELISA is a respectable, legitimate technique. I have no problem that that labs may or may not be able to produce concordant results from split samples. I would even accept that they are probably measuring IgG levels correctly (I don't know to the contrary). As you know, my difficulty is that I'm not seeing any evidence or consensus of opinion that raised specific-IgG levels are indicative of food intolerance.

I do wonder about the appropriateness of the marketing and promotion of these tests for their stated purpose. Possibly, I'm a worry wort.

Regards - Shinga

6:40 PM  
Blogger five_kingdoms said...

The name is just a reference to the five kingdoms of life - I like the term, perhaps because its archaic but still in common use.

Very interested to hear that McKeith recommends IgG ELISA but has her own favourite lab. I don't think these celebrities would be where they are if they didn't genuinely have interest and passion in the relationship between food and health. However, I'd expect that to go hand-in-hand with a keen awareness of general opinion regarding the efficacy of available tests and a desire to steer people in the right direction. It appears not.

I believe that the most common four positive results from IgG testing are wheat, dairy, egg and yeast. It is possible that people excluding these foods might see genuine and verifiable improvements that have nothing to do with the reduced level of IgG complexes in the system. For example, I understand that the body's resources of zinc are depleted by (amongst many factors) consumption of phytates (e.g. in wheat) and excessive calcium (e.g. in dairy). However, perhaps that relationship is itself a contentious matter - there seems to be little that is universally agreed upon in this area of debate.

Such subtle factors (and I'm sure they're numerous) might explain the apparent contradiction between personal testimony of those who experience benefit from IgG driven exclusion diets and those who claim to have disproved a causal relationship between IgG and the range of ailments that test-takers present with.

This would not, of course, vindicate any lab that knowingly overplays the claimed relationship between IgG and health problems in the absence of an appropriate body of evidence to back it up.

One thing is for sure - food allergy testing is big business and celebrity endorsement is not unique to sportswear.

10:28 PM  
Blogger Shinga said...

Hi Five Kingdoms (and thanks for the name explanation),

I think that if you are presenting your recommendations as being grounded in science, then you possibly need an official and plausible test to justify the massive changes that you are asking people to make in their diet. I don't know if they recommend supplements to ease over any transitional problems with the diet or to 'promote healing' of the outraged gut/whatever.


I, too, wonder if some people are experiencing an improvement from a more wholefood or diverse diet. E.g., if you used to eat wheat several times a day but are now eating other multi-grains like rye and oat, experimenting with lentils and quinoa etc. then you may just be getting the benefits of a 'better' diet and the role of IgG levels etc. is irrelevant.

As for the rest - I agree. Somewhere on their site, YorkTest refers to a 'plethora' of evidence and then cites 4 papers, one of which is unpublished, another of which is a poster at a conference and one other that is dubious (like the unpublished, it is an audit of a customer satisfaction questionnaire). The only decent paper doesn't fully support their stance as the authors carefully limit its applicability to food intolerance and state that it may be irrelevant.

Regards - Shinga

2:12 PM  
Anonymous drone said...

From what I've read genuine food allergies (the sort that lead to deaths from consuming peanuts) are mediated by IgE, not IgG. Do Holford and McKeith claim that food intolerance is purely an IgG mediated condition, distinct from true IgE mediated allergy?

9:30 AM  
Blogger Shinga said...

It depends what you read - Holford in particular has an irritating habit of conflating allergy and intolerance.

Both of them do recommend IgG testing for food intolerance. However, IgG levels are not scientifically demonstrated to be positively linked to food intolerance.

Regards - Shinga

11:01 AM  
Anonymous Mojo said...

The original "BBC Watchdog's Dirty Allergy Trick" article is now available on the Wayback Machine here:

http://web.archive.org/web/20070208044128/www.patrickholford.com/content.asp?id_Content=1749

(hope the link fits on the page...)

6:32 PM  
Anonymous healthy blog said...

Visit this site for more healthy tips
(health blog food intolerance)
Healthyblog.com

2:54 PM  
Anonymous Anonymous said...

I don’t know If I said it already, but this so good stuff keep up the good work. I read a lot of blogs on a daily basis and for the most part Kenali dan Kunjungi Objek Wisata di Pandeglang just wanted to make a quick comment to say I’m glad I found your blog. Thanks.

Best regards
Seo Motivation Mengembalikan Jati Diri Bangsa

5:22 PM  

Post a Comment

Links to this post:

Create a Link

<< Home