A controversial series of articles published in the prestigious Annals of Internal Medicine in late 2019 ignited a firestorm of criticism from nutrition experts worldwide. The publications, which culminated in recommendations suggesting that individuals need not significantly reduce their intake of red and processed meats, were widely decried as a misapplication of scientific principles and a potential public health disservice. Nutrition researchers and leading academics in the field expressed strong dissent, labeling the findings and their accompanying recommendations as deeply flawed and irresponsible.
Background and Controversy Erupts
The core of the controversy stemmed from a set of four papers published in the Annals of Internal Medicine in September 2019. These articles aimed to review the evidence on the health effects of red and processed meat consumption and, based on their interpretation, concluded that the evidence for reducing intake was not strong enough to warrant new dietary guidelines. The lead author of these papers, Dr. John Sievenpiper of St. Michael’s Hospital in Toronto, and his colleagues, asserted that individuals could continue their current meat consumption patterns without significant adverse health consequences.
This assertion directly challenged decades of established nutritional science and public health recommendations from numerous major health organizations, including the World Health Organization (WHO), the American Heart Association, and the American Institute for Cancer Research. These bodies have consistently advised limiting red and processed meat consumption due to associations with increased risks of colorectal cancer, cardiovascular disease, and type 2 diabetes.
The immediate reaction from the scientific community was swift and overwhelmingly negative. Dr. Walter Willett, a distinguished professor of epidemiology and nutrition at Harvard T.H. Chan School of Public Health and former chair of its nutrition department, did not mince words. He characterized the studies as "the most egregious abuse of data I’ve ever seen," citing "layers and layers of problems." Similarly, Dr. Frank Hu, current chair of the nutrition department at Harvard T.H. Chan School of Public Health, described the recommendations as "a very irresponsible public health recommendation." The broad consensus among many public health and nutrition experts was that the Annals papers represented a significant misstep in public health communication.
Methodological Criticisms: The Misapplication of GRADE
A primary and recurring criticism leveled against the Annals papers was their reliance on the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) framework. While GRADE is a widely accepted methodology for evaluating the quality of evidence and formulating guidelines, particularly in clinical medicine for drug interventions, its application to dietary and lifestyle research has been deemed inappropriate by many experts.
The GRADE system, by its very design, places a high premium on randomized controlled trials (RCTs) as the gold standard for evidence. RCTs involve randomly assigning participants to an intervention group or a control group, minimizing bias and allowing for strong causal inferences. However, conducting long-term, large-scale RCTs for dietary and lifestyle factors presents formidable challenges.
The Infeasibility of Dietary Randomized Controlled Trials
As pointed out by numerous critics, it is virtually impossible to conduct double-blind, placebo-controlled RCTs for dietary habits. For instance, researchers cannot ethically or practically assign one group of individuals to consume large quantities of red meat daily for decades while another group abstains, and then monitor their health outcomes like cancer or heart disease. The very nature of food consumption makes blinding impossible; participants are acutely aware of what they are eating.
Dr. Hu elaborated on this point, stating, "You can’t do a double-blinded placebo-controlled trial of red meat and other foods on heart attacks or cancer. For dietary and lifestyle factors, it’s impossible to use the same standards for drug trials." He drew a stark analogy: "Imagine directing one group of people to smoke a pack of cigarettes every day for 20 years to prove that cigarettes cause lung cancer. And how could it be double-blind—have the control group smoke placebo cigarettes?"
The Annals authors, by applying GRADE, systematically downgraded observational studies, which are often the primary source of evidence for the long-term health effects of diet. Observational studies, such as cohort studies and case-control studies, can identify associations between diet and health outcomes but cannot definitively prove causation. However, these studies have consistently shown links between high red and processed meat consumption and increased risks of chronic diseases. The GRADE methodology, by assigning "low- or very-low" scores for "certainty of evidence" to these observational studies due to factors like lack of blinding, effectively dismissed a substantial body of evidence.
Alternative Frameworks for Nutritional Evidence
Critics argued that specialized frameworks designed for evaluating nutritional evidence, such as NutriGrade, should have been employed. These alternative systems are better equipped to assess the nuances and limitations of observational data while still providing a rigorous evaluation of the evidence. The Annals authors themselves acknowledged that their recommendations differed from other guidelines precisely because they had used the GRADE approach, implicitly admitting that other established guidelines had not found the evidence to be of such low certainty.
Dr. Marie-Pierre St-Onge, a nutrition scientist at Laval University, commented on the situation, noting that while large-scale RCTs for dietary exposures are impractical, "that doesn’t mean you have no evidence. It just means you look at the evidence in a more sophisticated way."
Potential Conflicts of Interest and Industry Influence
Beyond the methodological criticisms, concerns were raised about potential conflicts of interest and the influence of the food industry. Investigations revealed that the lead author of the Annals papers, Dr. Sievenpiper, had previously been involved in studies funded by the soda and candy industries, where similar methodologies were employed to cast doubt on established health warnings.
Critics suggested that the misapplication of GRADE could be a deliberate strategy to discredit well-established public health recommendations across various domains. This approach, they argued, could be used by industries to sow doubt in any field where RCTs are not feasible, including climate change, secondhand smoke’s impact on health, air pollution, physical inactivity, and the detrimental effects of trans fats. The concern was that a strict adherence to GRADE, as interpreted in these papers, could even be used to question the causal link between smoking and lung cancer.
The New York Times reported on the lead author’s past food industry ties, prompting questions about whether the appeals to standards of evidence were driven by a genuine scientific inquiry or by a desire to advance industry financial interests. The implication was that the same analytical tools could be weaponized to undermine public health warnings, creating a "perversion of evidence-based medicine."
The Fallacy of "No Evidence" in Dietary Research
A fundamental misunderstanding, critics argued, lies in equating "low certainty of evidence" from specific methodological limitations with "no evidence" of harm or benefit. The Annals papers seemed to lean towards the former, leading to the conclusion that there was insufficient reason to recommend reducing meat intake.
To illustrate the pitfalls of misinterpreting trial outcomes due to methodological constraints, a study on advising middle-aged men to stop smoking was cited. In this trial, those advised to quit did not show a statistically significant reduction in mortality compared to a control group. However, the "fatal flaw" was that participants were randomized to receive advice to quit, not to actually quit. The adherence to the advice was poor, with those receiving advice still smoking an average of eight cigarettes a day compared to twelve in the control group. This minimal difference in smoking behavior explained the lack of difference in mortality outcomes, not that smoking itself was harmless.
Similarly, large-scale randomized dietary trials, such as the Women’s Health Initiative and the Multiple Risk Factor Intervention Trial, have faced challenges with participant adherence. Millions of dollars were spent, but the dietary interventions often failed because participants could not consistently follow the prescribed diets over long periods. This resulted in groups consuming similar diets and exhibiting similar disease outcomes, not because the diets were ineffective, but because the randomization failed to maintain behavioral differences. The article highlighted that even smoking, one of the most potent known risk factors, has faced challenges in demonstrating mortality effects in certain RCT designs due to adherence issues.
Implications for Public Health and Consumer Guidance
The Annals papers and their recommendations had significant implications for public health messaging and consumer guidance. The conclusion that people "should eat whatever they want" based on a misapplied methodological framework was seen as a dangerous oversimplification.
One of the senior co-authors of the meat papers, when asked if physicians could advise patients on the relative healthfulness of a salad versus a bowl of sugar, reportedly responded that physicians should inform patients that "the quality of evidence is low, so it depends almost entirely on their preferences." This stance, critics argued, undermined the ability of healthcare professionals to provide evidence-based dietary advice and could lead to confusion and poor health choices among the public.
The sentiment expressed by a critic was poignant: "When GRADE criteria do not allow us to strongly recommend against smoking a cigarette with your bowl of sugar, we believe that alternative grading systems are preferable." This highlights the absurdity of applying a framework so rigidly that it fails to recognize obvious and well-established health risks.
A Broader Pattern of Industry Influence
This series of articles in the Annals of Internal Medicine is part of a larger pattern discussed in the ongoing analysis of how industries impact dietary and health guidelines. The author of the original piece indicated that this was the fourth in an eight-part series. Previous installments had explored what happened when the 2015 Dietary Guidelines committee recommended reducing sugar consumption and introduced the GRADE approach to evaluating clinical guidelines, suggesting a consistent trend of industry influence and methodological challenges in nutritional science.
The broader impact of such publications is the potential erosion of public trust in scientific institutions and dietary recommendations. When studies, particularly those published in reputable journals, appear to contradict long-standing health advice with seemingly robust, yet fundamentally flawed, analysis, it creates confusion and skepticism. This can lead individuals to disregard important health warnings, potentially increasing the incidence of diet-related chronic diseases.
The manipulation and misuse of scientific evidence to support "subverted or perverted agendas" pose a significant threat to public health. While the pursuit of the best possible evidence is paramount, the methodology employed must be appropriate for the research domain. In the realm of nutrition and lifestyle, where RCTs are often impractical, sophisticated analytical approaches that account for the limitations of observational data are crucial. The Annals papers, by employing a tool ill-suited for the task and potentially influenced by external interests, represent a cautionary tale in the complex interplay between science, industry, and public health policy. The scientific community’s robust response underscores the critical need for rigorous scrutiny of research methodologies and for transparency regarding potential conflicts of interest to safeguard the integrity of evidence-based medicine.
