Lancet Iraq Mortality Surveys: Casualty Estimates and the Suppression Claim (2004-2006)
Introduction
Two cluster-sample household mortality surveys of Iraq, published in The Lancet, produced casualty estimates far higher than official or media-tracked figures and were met with immediate public dismissal by the governments whose military operations they implicitly indicted. The surveys, their methodology, their reception, and the subsequent revelations about their handling form a case study in the intersection of epidemiology, politics, and wartime information management.
The 2004 Survey: Roberts et al.
The first Lancet survey, published in October 2004 — just before the US presidential election — was conducted by Les Roberts of Johns Hopkins and Iraqi colleagues including Riyadh Lafta. The cluster-sample methodology surveyed households in 33 clusters across Iraq and asked about deaths before and after the March 2003 invasion. The study estimated approximately 98,000 excess deaths (with wide confidence intervals) attributable to the invasion and subsequent conflict.
The study was immediately criticised by US and UK government officials as flawed and politically motivated. Some of the methodological criticism — particularly concerning the confidence intervals and the cluster size — was substantive and engaged by epidemiologists. Other criticism was dismissive without engaging the methodology.
The 2006 Survey: Burnham et al.
A second, larger survey led by Gilbert Burnham of Johns Hopkins and again including Riyadh Lafta was published in The Lancet in October 2006. This survey used 47 clusters and a larger sample. It estimated approximately 655,000 excess deaths since the 2003 invasion, with a 95% confidence interval of approximately 393,000 to 943,000.
President Bush publicly stated the methodology was "not credible." Prime Minister Blair''s official spokesperson said the number was "not one we believe to be anywhere near accurate." Neither government produced a counter-methodology or independent survey to support their dismissals.
Donor Disclosure and Pre-Release Briefings
Subsequent reporting raised transparency concerns. The 2006 survey was partly funded by the Open Society Institute, a fact not disclosed in the original publication. Editors of The Lancet acknowledged a disclosure gap. Separately, it emerged that the research team had briefed UK government officials on the findings before publication — a pre-release political contact that raised questions about whether the survey was being handled as a scientific document or a political instrument.
These transparency issues do not resolve the methodological question of whether the estimates were accurate, but they complicated the survey''s reception and provided legitimate grounds for criticism beyond political dismissal.
Alternative Estimates
The Iraq Body Count project, which tracked media-reported civilian deaths, produced estimates substantially lower than the Lancet figures. The Opinion Research Business (ORB) survey (2007) produced an estimate of approximately 1.2 million violent deaths — higher than Burnham et al. The WHO-COSIT Iraq Family Health Survey (2008), using a different methodology and larger sample, estimated approximately 151,000 violent deaths between 2003 and 2006.
The range across credible studies — from Iraq Body Count''s conservative media-tracked figures to ORB''s higher estimate — reflects genuine methodological disagreement rather than a single suppressed truth. Epidemiologists continue to debate which methodology is most appropriate for conflict-zone mortality estimation.
The Suppression Claim
The claim that the surveys were "suppressed" requires precision. The surveys were published in one of the world''s most prominent peer-reviewed medical journals. They were not suppressed in the sense of being withheld from publication. The suppression claim refers rather to: the official dismissal without methodological engagement; the failure to fund independent replication studies; and the possibility that pre-release political briefings influenced framing.
The dismissal by Bush and Blair — heads of government with direct interest in the findings — without commissioning independent methodological review is a documented failure of epistemic responsibility in wartime policymaking. Whether it constitutes "suppression" in a meaningful sense depends on definitional choices.
Verdict
Partially true. The surveys were legitimate peer-reviewed epidemiological work that was publicly dismissed by governments with obvious political interest in lower estimates, without those governments commissioning independent methodological review. The donor-disclosure and pre-release briefing issues are real transparency problems. The estimates themselves remain contested among epidemiologists, with a wide range of credible alternative figures. The "suppression" claim is partially supported; the specific casualty estimates are neither confirmed nor definitively refuted.
Evidence Filters11
Burnham et al. 2006: peer-reviewed, published in The Lancet
DebunkingThe 2006 survey was peer-reviewed and published in one of the world's most prestigious medical journals. It was not suppressed from publication. The scientific process — however contested the findings — was followed.
Bush and Blair dismissed surveys without commissioning independent review
SupportingStrongBoth governments publicly stated the surveys were not credible without producing methodological counter-evidence or commissioning independent epidemiological review. The dismissal was political rather than scientific in character.
Rebuttal
Governments are not obligated to fund research that challenges their policies. However, the dismissal of peer-reviewed epidemiology without scientific counter-argument is a documented epistemic failure.
Open Society Institute funding not disclosed in 2006 publication
DebunkingThe 2006 survey received funding from the Open Society Institute, a fact not disclosed in the original Lancet publication. The Lancet editor acknowledged the disclosure gap. This is a real transparency failure that gave legitimate grounds for criticism.
Pre-release briefing of UK government officials
DebunkingThe research team briefed UK government officials on the survey's findings before publication. This pre-release political contact raised questions about the survey's independence and handling as a scientific document.
WHO/COSIT Iraq Family Health Survey (2008): ~151,000 violent deaths
NeutralStrongThe larger WHO-COSIT survey, using a different methodology and substantially larger sample, estimated approximately 151,000 violent deaths between 2003 and 2006 — far below the Burnham et al. figure. The divergence reflects genuine methodological differences, not simple suppression.
ORB poll (2007): estimated ~1.2 million violent deaths
SupportingThe Opinion Research Business survey estimated approximately 1.2 million violent deaths — higher than Burnham et al. The range across credible studies spans from Iraq Body Count's conservative media-tracked figures to ORB's higher estimate.
Rebuttal
ORB's poll methodology differs from cluster-sample household surveys and has its own critics. The range of estimates reflects genuine methodological disagreement, not a single suppressed truth.
Cluster-sample methodology: legitimate epidemiological tool
SupportingThe cluster-sample approach used in both Lancet surveys is a standard and validated methodology for conflict-zone mortality estimation, used by the same research group in Kosovo and other conflicts. The methodology is not inherently suspect.
No government-funded independent replication study commissioned
SupportingNeither the US nor the UK government commissioned an independent large-scale mortality survey to provide a methodologically rigorous counter-estimate. The absence of a funded replication effort supports the partial-suppression claim.
Johns Hopkins Methodology Widely Used and Peer-Reviewed
SupportingStrongThe cluster sampling methodology used in the 2006 Burnham et al. Lancet study is the same approach recommended by the WHO and used routinely in conflict-zone epidemiology in Darfur, Congo, and Kosovo. Epidemiologists at multiple institutions independently reviewed the methodology and found it sound before publication.
Iraq Body Count Documented Methodology Gap vs. Survey Estimates
NeutralIraq Body Count, which tallies violent deaths from verified media and official reports, counted approximately 50,000-60,000 civilian deaths through 2006. Epidemiologists note passive surveillance systematically undercounts deaths in conflict zones, making the IBC figure a floor rather than an accurate total — supporting the Lancet's higher estimate in principle.
Show 1 more evidence point
UK Government Scientists Internally Criticized the Study's Statistics
DebunkingDeclassified UK Cabinet Office emails obtained via FOI in 2009 showed government statisticians raised concerns about the Lancet study's confidence intervals and cluster design before the UK government publicly dismissed it. Critics argue this shows legitimate methodological debate, not political suppression.
Evidence Cited by Believers5
Bush and Blair dismissed surveys without commissioning independent review
SupportingStrongBoth governments publicly stated the surveys were not credible without producing methodological counter-evidence or commissioning independent epidemiological review. The dismissal was political rather than scientific in character.
Rebuttal
Governments are not obligated to fund research that challenges their policies. However, the dismissal of peer-reviewed epidemiology without scientific counter-argument is a documented epistemic failure.
ORB poll (2007): estimated ~1.2 million violent deaths
SupportingThe Opinion Research Business survey estimated approximately 1.2 million violent deaths — higher than Burnham et al. The range across credible studies spans from Iraq Body Count's conservative media-tracked figures to ORB's higher estimate.
Rebuttal
ORB's poll methodology differs from cluster-sample household surveys and has its own critics. The range of estimates reflects genuine methodological disagreement, not a single suppressed truth.
Cluster-sample methodology: legitimate epidemiological tool
SupportingThe cluster-sample approach used in both Lancet surveys is a standard and validated methodology for conflict-zone mortality estimation, used by the same research group in Kosovo and other conflicts. The methodology is not inherently suspect.
No government-funded independent replication study commissioned
SupportingNeither the US nor the UK government commissioned an independent large-scale mortality survey to provide a methodologically rigorous counter-estimate. The absence of a funded replication effort supports the partial-suppression claim.
Johns Hopkins Methodology Widely Used and Peer-Reviewed
SupportingStrongThe cluster sampling methodology used in the 2006 Burnham et al. Lancet study is the same approach recommended by the WHO and used routinely in conflict-zone epidemiology in Darfur, Congo, and Kosovo. Epidemiologists at multiple institutions independently reviewed the methodology and found it sound before publication.
Counter-Evidence4
Burnham et al. 2006: peer-reviewed, published in The Lancet
DebunkingThe 2006 survey was peer-reviewed and published in one of the world's most prestigious medical journals. It was not suppressed from publication. The scientific process — however contested the findings — was followed.
Open Society Institute funding not disclosed in 2006 publication
DebunkingThe 2006 survey received funding from the Open Society Institute, a fact not disclosed in the original Lancet publication. The Lancet editor acknowledged the disclosure gap. This is a real transparency failure that gave legitimate grounds for criticism.
Pre-release briefing of UK government officials
DebunkingThe research team briefed UK government officials on the survey's findings before publication. This pre-release political contact raised questions about the survey's independence and handling as a scientific document.
UK Government Scientists Internally Criticized the Study's Statistics
DebunkingDeclassified UK Cabinet Office emails obtained via FOI in 2009 showed government statisticians raised concerns about the Lancet study's confidence intervals and cluster design before the UK government publicly dismissed it. Critics argue this shows legitimate methodological debate, not political suppression.
Neutral / Ambiguous2
WHO/COSIT Iraq Family Health Survey (2008): ~151,000 violent deaths
NeutralStrongThe larger WHO-COSIT survey, using a different methodology and substantially larger sample, estimated approximately 151,000 violent deaths between 2003 and 2006 — far below the Burnham et al. figure. The divergence reflects genuine methodological differences, not simple suppression.
Iraq Body Count Documented Methodology Gap vs. Survey Estimates
NeutralIraq Body Count, which tallies violent deaths from verified media and official reports, counted approximately 50,000-60,000 civilian deaths through 2006. Epidemiologists note passive surveillance systematically undercounts deaths in conflict zones, making the IBC figure a floor rather than an accurate total — supporting the Lancet's higher estimate in principle.
Timeline
Lancet 2004: Roberts et al. estimate ~98,000 excess deaths
Les Roberts and Iraqi colleagues publish a cluster-sample household mortality survey in The Lancet estimating approximately 98,000 excess deaths attributable to the Iraq invasion, with wide confidence intervals. The study is immediately dismissed by US and UK officials. Methodological debate among epidemiologists begins.
Source →Second Lancet Study Published — 655,000 Excess Deaths Estimated
Burnham et al. published an updated cluster-survey estimating 655,000 excess Iraqi deaths since the 2003 invasion, of which 601,000 were attributed to violence. The paper was immediately dismissed by UK and US government spokespersons as 'not credible' despite passing peer review at The Lancet.
Source →Lancet 2006: Burnham et al. estimate ~655,000 excess deaths
A larger second survey estimates approximately 655,000 excess deaths. President Bush calls the methodology "not credible." Prime Minister Blair's spokesperson rejects the figure. Neither government commissions an independent methodological review or funds a replication study.
Source →ORB survey estimates ~1.2 million violent deaths
The Opinion Research Business poll estimates approximately 1.2 million violent deaths in Iraq since 2003, higher than Burnham et al. The range of credible estimates — from Iraq Body Count's conservative media-tracked figures to ORB's higher poll — illustrates genuine methodological disagreement.
Verdict
Roberts et al. (Lancet 2004) estimated ~98,000 excess deaths; Burnham et al. (Lancet 2006) estimated ~655,000. Both publicly dismissed by Bush and Blair without methodological counter-evidence. Donor non-disclosure (Open Society Institute) and pre-release political briefings raised transparency concerns. ORB 2007 produced higher estimates; WHO/COSIT IFHS 2008 produced lower estimates. Methodological debate among epidemiologists remains unresolved.
Frequently Asked Questions
Were the Lancet surveys suppressed?
The surveys were published in one of the world's most prominent medical journals and are freely available. They were not suppressed from publication. The suppression claim refers to: official dismissal without scientific counter-engagement; failure to commission independent replication; and possible influence from pre-release political briefings. These are real documented issues, though they do not establish that the specific casualty estimates were accurate.
How do the Lancet estimates compare with other surveys?
Roberts et al. 2004 estimated ~98,000 excess deaths; Burnham et al. 2006 estimated ~655,000. The WHO/COSIT Iraq Family Health Survey (2008) estimated ~151,000 violent deaths 2003-2006. The ORB poll (2007) estimated ~1.2 million violent deaths. Iraq Body Count's media-tracked civilian deaths were substantially lower. The range reflects genuine methodological differences, not a single suppressed truth.
Is cluster-sample methodology valid for conflict-zone surveys?
Cluster-sample household surveys are a validated and widely-used methodology for conflict-zone mortality estimation, employed by the same research group in Kosovo, the Democratic Republic of Congo, and other conflicts. The methodology is not inherently suspect; the disputes concern sample size, cluster selection, and confidence intervals in the specific Iraq surveys.
What were the transparency problems with the 2006 survey?
Sources
Show 6 more sources
Further Reading
- paperMortality after the 2003 invasion of Iraq: a cross-sectional cluster sample survey (Burnham et al.) — Gilbert Burnham et al. (2006)
- paperIraq Family Health Survey (WHO/COSIT 2008) — WHO / Iraq Ministry of Health (2008)
- paperMortality before and after the 2003 invasion of Iraq (Roberts et al., Lancet 2004) — Les Roberts et al. (2004)
- paperBody Count: Casualty Figures after 10 Years of the War on Terror — Physicians for Social Responsibility (2015)