A new meta-analysis on the farm-level impacts of GMOs

Written by Jonas Kathage

6459739667_1a74b89eda_z
Maize breeding, credit: KJHvM

Despite the fact that the global area of GM crops has grown rapidly over the past decade and now encompasses more than 170 million hectares it is still questioned whether current applications of genetic engineering in agriculture are beneficial to farmers or not. While several reviews and meta-analyses on the impact of GM crops exist, the evidence is still not regarded as conclusive by many. A new meta-analysis of the agronomic and economic impacts of GMOs has appeared in the journal PLOS ONE. It summarizes the findings of 147 original studies published until March 2014. Besides being the most up to date, this meta-analysis has two other features that make it an important addition to the existing body of meta-analyses and review articles: First, it includes not only studies from peer-reviewed journals but also those that are not (grey literature), thus providing a broader perspective. Second, the authors investigated the reasons why different studies found different results, providing several interesting insights.
The work was funded exclusively with public money, in part from the German Federal Ministry of Economic Cooperation and Development (BMZ) and the European Union’s Seventh Framework Programme (FP7/2007-2011). The authors are Wilhelm Klümper, a PhD student at the Department of Agricultural Economics and Rural Development at the University of Göttingen, Germany, and Matin Qaim*, a professor at the same institution and well-published researcher on the economics of GMOs.
The average findings reported in the literature are that GM technology in the main crops soybean, maize and cotton has:

  • Reduced chemical pesticide use by 37%
  • Increased crop yields by 22%
  • Increased farmer profits by 68%

Furthermore, on average across studies, pesticide cost was significantly reduced (by 39%), while no significant impact was found on total production cost.
Some of the mechanisms driving these impacts are already well-known: The GMOs currently on the market are insect-resistant (IR) and/or herbicide tolerant (HT). IR traits substitute, to a certain extent, for chemical insecticides. HT traits, on the other hand, do not consistently reduce herbicide use, as they have led to the substitution of one herbicide for another. HT traits have often reduced pesticide costs because glyphosate, the most widely used herbicide compatible with HT crops, was cheaper than the more selective herbicides farmers previously employed. Yields are higher due to more effective pest control and thus lower crop losses. This effect is more pronounced in IR crops and in developing countries.

Bt Cotton Chomp by Angus Catchot via Twitter. xxx
Bt Cotton Chomp by Angus Catchot via Twitter.

Apart from the type of GM trait (IR/HT) and the type of country (developing/developed) the paper also sheds light on several other reasons why some yield results are different from others. For example, it looks at whether funding from industry is associated with higher yield estimates. It is not.
Another interesting question is whether the type of publication matters. Indeed, studies published in peer-reviewed journals report 12 percentage points higher yield gains than studies published elsewhere (conferences, grey literature). This might seem as evidence of publication bias, whereby what is published in journals is artificially inflated and not representative of the data collected for studies. However, journal articles find a wide range of effects, some of which are even negative. Also, the literature not published in journals includes reports of NGO that are outspoken critics of GMOs. It is thus possible that the positive journal publication bias is the result of a negative bias in the grey literature.
A common criticism of the literature is the allegation that the evidence on impacts of GM crops stems only from a few selective datasets and is not representative. Indeed, there are datasets that are used for more than one publication. This can be the case when datasets are built over several years and an early publication reports impacts for the first period while later publication use the panel dataset for their analysis. Also, yield impacts may be the focus of a first paper and be reported again in a later paper which has another focus. Klümper and Qaim checked whether certain primary datasets have a big influence by weighting studies with the inverse of number of results derived from the same primary dataset. This approach yields almost the same results indicating that there is no reason to be concerned that the general conclusions are excessively influenced by a small number of datasets and researchers.
This new meta-analysis provides robust evidence on the positive impacts of the most widely used GM technologies and crops. The reason, however, that these crops are evaluated in a single meta-analysis in the first place is the fact that different GM crops are thrown into one and the same basket both in the public debate and in regulatory frameworks. It is, thus, useful to have a comprehensive paper on the effects of the most important GM crops and traits in order to inform the current public debate. Hopefully, at some point in the future, it will be possible to move the debate to a level where the question of whether a plant trait has been produced with genetic engineering of not will not be an issue anymore. The focus of the discussion can then move to whether a specific seed technology may be a good choice or not.
Reference: Klümper W, Qaim M (2014) A Meta-Analysis of the Impacts of Genetically Modified Crops. PLoS ONE 9(11): e111629. doi:10.1371/journal.pone.0111629

* Jonas Kathage is a former graduate student of Matin Qaim.

Written by Guest Expert

Jonas Kathage is an agricultural economist with a focus on quantitative empirical research. Since 2013, he has been working at the Joint Research Centre of the European Commission in Seville. His PhD in agricultural economics is from the University of Göttingen. Jonas is an expert on the socio-economics of genetically modified crops. He has also worked on plant protection, climate change mitigation, and other topics.

5 thoughts on “A new meta-analysis on the farm-level impacts of GMOs

  1. I’d like to drop a comment in here as I am seeing this study pop up on the social sites quite often now. Although the study does have some compelling trends, I would be hesitant to call it robust, even though the authors themselves use that term. Just preceding that statement, for example, they admit that “not all of the original studies included in this meta-analysis reported sample sizes and measures of variance”. This is unfortunate because good practice in meta-analysis requires these metrics to weight individual studies within the overall picture as to their reliability. Additionally, meta-analyses such as this have the troublesome characteristic of washing out the details, which often are as important to the story as the overall message. So, while I would generally agree with what is said here and the point of the paper, I would advise much caution in promoting this work or quoting specific numbers. It is a start, but nowhere near definitive.

    Like

  2. Dear Jonas,
    Thanks for your article. I want to ask your views about comments for this study that I have seen in social media. Specifically, they mention that the lack of variances and sample sizes are a big limitation for this analysis that even with a proper control of them, as stated in the Methods section, could make this analysis a bad example of a meta-analysis according to what experts state as good manners (link: http://tinyurl.com/pd7rzo8). Thanks!

    Like

  3. I’ve had a lot of criticism to express on the Leifert (Baranski) paper, Higher antioxidant and lower cadmium concentrations and lower incidence of pesticide residues in organically grown crops: a systematic literature review and meta-analyses,

    Click to access bjn_2014_full_paper.pdf

    A meta-analysis combining bits and pieces of research work on very different objects (here crops) in different settings (here agroecological and economic environments) are close to meaning less.
    « The average findings reported in the literature are that GM technology in the main crops soybean, maize and cotton… » is no doubt an honest statement. But every word counts. And it is strictly confined to the literature analyzed.
    I have yet to find out what the authors, their institution and the media have done or will do with the findings. Any bold and generalized statement that GM technology did this by x % to a particular factor would be grossly inappropriate.
    By the way, the Leifert communication was for instance:
    « An international team of experts led by Newcastle University has shown that organic crops are up to 60% higher in a number of key antioxidants than conventionally-grown ones. »
    http://www.ncl.ac.uk/press.office/press.release/item/new-study-finds-significant-differences-between-organic-and-non-organic-food
    If you read French:
    http://imposteurs.over-blog.com/2014/10/aliments-bio-ils-sont-beaux-les-biais-par-wackes-seppi.html
    Back to Klümper and Qaim. I take it from a quick perusal that the data sources are somewhat limited in scope and may essential elements, particularly the additional benefits (and possibly drawbacks) derived from a change in crops grown or the effects on the overall farming system and on other crops in the rotation.

    Like

Leave a comment