
Estimating Influenza-Associated Deaths in the United States
Matthew R. Moore, MD, MPH, Eric Weintraub, MPH, Po-Yung Cheng, PhD, Xiaoping Jin, MPH, Carolyn B. Bridges, MD, Joseph S. Bresee, MD, MPH, and David K. Shay, MD, MPH
Corresponding author.All authors contributed to analysis and interpretation of the data and drafting of the commentary.
Abstract
Most estimates of US deaths associated with influenza circulation have been similar despite the use of different approaches. However, a recently published estimate suggested that previous estimates substantially overestimated deaths associated with influenza, and concluded that substantial numbers of deaths during a future pandemic could be prevented because of improvements in medical care.
We reviewed the data sources and methods used to estimate influenza-associated deaths. We suggest that discrepancies between the recent estimate and previous estimates of the number of influenza-associated deaths are attributable primarily to the use of different outcomes and methods. We also believe that secondary bacterial infections will likely result in substantial morbidity and mortality during a future influenza pandemic, despite medical progress.
ANNUAL OR SEASONAL INFLUenza epidemics are caused by influenza viruses that incorporate slight antigenic differences from recently circulating viruses (i.e., antigenic drift).1 By contrast, a pandemic is caused by influenza A viruses that contain a new hemagglutinin for which there is little or no preexisting human immunity (i.e., an antigenic shift).1 Among the four pandemics in the past 120 years, the 1918 pandemic caused the greatest morbidity and mortality.2 Data from previous influenza pandemics and epidemics provide useful information for preparing for future influenza pandemics. For example, understanding age-specific mortality rates from past pandemics has aided the US government in planning for the distribution of vaccines and antivirals during future pandemics.3–5 Such data, when used to inform policy decisions, are most useful when evaluated carefully in light of their strengths and limitations.
The Centers for Disease Control and Prevention (CDC) has estimated deaths associated with influenza epidemics for more than four decades. Estimates from a recent study that used data from the 1990–1991 through 1998–1999 respiratory illness seasons have been cited widely.6 That study used deaths coded for respiratory and circulatory causes and influenza virus surveillance data to estimate that approximately 36 000 influenza-associated deaths occurred annually in the United States during this period. Approximately 90% of these deaths occurred among people aged 65 years or older. These estimates are consistent with estimates made by several other groups,7,8 but are higher than estimates reported by Doshi and others.9,10
CAUSE-OF-DEATH CODING
In his recent study, Doshi examined trends in annual influenza-associated mortality and questioned whether higher mortality rates were associated with influenza pandemics rather than with seasonal epidemics.9 His two chief conclusions were that mortality associated with the next pandemic is unlikely to be greater than that associated with seasonal influenza and that previous influenza-modeling estimates overestimated mortality associated with influenza. His conclusions were based on a presentation of US mortality records for which only the specific code for influenza was used as the cause of death. For example, for the International Classification of Diseases, 10th Revision (ICD-10),11 this would have been code J10 or J11.
For several reasons, the number of influenza-related deaths cannot be determined solely by reports of influenza-coded deaths. First, most adult patients with symptoms consistent with influenza infection are not tested for influenza. Those who are generally receive rapid tests of only modest sensitivity. In addition, many influenza-associated deaths occur one or two weeks after the initial infection (when viral shedding has ended), either because of secondary bacterial infections12–14 or because the influenza has exacerbated chronic illnesses (e.g., congestive heart failure or chronic obstructive pulmonary disease).15 Even when influenza infection is confirmed by laboratory testing, those results are rarely reported on death certificates.16 For these reasons, we believe that Doshi's conclusion that influenza is associated with many fewer deaths than previously estimated is not supported by the weight of the available data.
The inability of death certificates to reliably and consistently attribute death to influenza has been understood for many decades, and this understanding led to the development of statistical models to better estimate influenza-associated deaths. This point is illustrated by a graph of the monthly number of deaths from 1962 through 1976 for which a pneumonia- or influenza-specific ICD code was listed as the underlying cause of death (Figure 1).
In the spring of 1968, the number of deaths for which pneumonia was listed as the underlying cause sharply decreased concurrently with a sharp increase in the number of deaths for which influenza was listed as the underlying cause. These changes in mortality coding practices occurred after the emergence of the new pandemic strain was detected in Asia and publicly announced but before the 1968 pandemic influenza A(H3N2) virus actually arrived in the United States. This change in coding practices continued through the summer of 1968 and into the peak of the 1968–1969 pandemic. During the summer of 1968 (June–August), when no significant circulation of influenza would be expected, the number of deaths coded as influenza was 1584% higher than in the summer before and the summer after the 1968 pandemic. Similarly, the number of deaths coded as pneumonia during the summer of 1968 was 40% lower than in the summers of 1967 and 1969.
We suggest that because physicians and medical examiners were aware that an influenza pandemic had begun worldwide, they were more likely to code deaths clinically compatible with pneumonia and influenza as being caused by influenza. However, it is simply not plausible that the 1968–1969 pandemic caused a decrease in the number of pneumonia deaths compared with the seasons before and after the pandemic. Rather, knowledge that a pandemic was under way resulted in diagnostic substitution of an influenza-specific ICD code for the nonspecific ICD codes for pneumonia used during nonpandemic years.
During the 1975–1976 influenza epidemic, a similar change occurred in the proportions of influenza and pneumonia ICD codes selected as the underlying cause of death. However, during this period, concern that a pandemic might emerge led to an increase in the use of the influenza-specific ICD code on death certificates. During the swine influenza vaccine campaign, the total number of deaths for which the underlying cause was listed as influenza was actually similar (7417 deaths) to the number reported during the 1968–1969 pandemic (7433 deaths). To avoid the effect of such artifacts on annual estimates of the influenza disease burden, it is common practice to combine pneumonia and influenza deaths and apply statistical methods to estimate the burden of influenza.17 The CDC's estimate of the number of deaths associated with the influenza epidemic for the 1975–1976 season (24 600 deaths) was close to the expected annual average for the 1972–1973 through 1991–1992 seasons (21 300 deaths).18 That these estimates would be of similar magnitude is expected, of course, because a pandemic did not occur during the 1975–1976 influenza season.
STATISTICAL MODELING
Because sensitive and specific influenza testing is seldom conducted prior to the death of individuals with influenza-compatible illnesses and because of the changes over time in the use of influenza-specific ICD codes, simply counting deaths for which influenza has been coded as the underlying cause on death certificates can lead to both over- and underestimates of the magnitude of influenza-associated mortality. Thus, it has been standard practice for decades in the United States and other developed countries with temperate climates to use statistical modeling techniques to estimate annual deaths associated with influenza.6,18–23
Figure 2 illustrates why statistical modeling techniques are commonly accepted for estimating influenza-associated deaths. The dotted line in this figure represents the percentage of respiratory specimens submitted to World Health Organization collaborating laboratories in the United States that tested positive for influenza A(H3N2). The solid line plots rates of deaths for which the underlying cause was attributed to pneumonia or influenza. Peaks in influenza A(H3N2) activity are clearly and consistently associated with peaks in rates of pneumonia and influenza deaths. Figure 3 displays the observed number of pneumonia and influenza deaths and the estimated numbers of influenza-associated deaths by influenza virus type and subtype. This graph shows that the CDC's statistical model only attributes deaths to influenza when influenza viruses are circulating and that it attributes deaths separately by type and subtype.
Rate of underlying pneumonia and influenza deaths and percentage of World Health Organization specimen testing positive for influenza A(H3N2) viruses, per week: United States, 1990–1991 through 1997–1998 respiratory illness seasons.

Numbers of influenza and pneumonia deaths and estimated influenza-associated deaths by influenza type and subtype, per week: United States, 1990–1991 through 1997–1998 respiratory illness seasons.
Finally, World Health Organization surveillance data reveals that when influenza viral activity begins early or late in the respiratory illness season, peaks in the rates of pneumonia and influenza deaths, respiratory and circulatory deaths, and all-cause deaths coincide with the peaks in influenza virus circulation. For example, when influenza viral activity peaked early in the 2003–2004 season, pneumonia and influenza deaths also peaked early. In three seasons when influenza activity peaked very late in the season (1982–1983, 1992–1993, 2001–2002), peaks in pneumonia and influenza deaths also occurred within two weeks of the peaks in influenza viral activity.
Contrary to Doshi's suggestion that estimates of influenza-associated deaths have varied dramatically in various publications,9 seasonal influenza-related death estimates are actually markedly similar, especially considering that they use a variety of statistical models.6–8 Of course, when different outcomes are modeled, somewhat different estimates of influenza-associated deaths are obtained. For example, the death estimates cited by Doshi from Thompson et al.6 were derived by modeling underlying pneumonia and influenza deaths, whereas the estimates by Dushoff et al.8 were based on modeling deaths for which pneumonia or influenza was listed anywhere on the death certificate. The Dushoff et al. estimates were therefore higher. Most importantly, from a policy perspective, the majority of influenza-associated death estimates made for the United States are in the same range (i.e., tens of thousands per year), demonstrating the importance of influenza prevention and control strategies.
PANDEMIC VARIATIONS
Even when consistent methods are used to estimate their effects, influenza pandemics and seasonal epidemics vary greatly in severity, primarily because of varying degrees of preexisting immunity to specific influenza viruses at the population level and the relative virulence of those viruses.24 For example, the 1957–1958 and 1968–1969 pandemics resulted in far fewer deaths than did the 1918–1919 pandemic,4,25 likely because of the specific HA, NA, and PB1 genes found in the 1918 virus.26,27 During several influenza epidemics that occurred after the 1920s, the rates of influenza-associated deaths exceeded the rates of deaths associated with the 1968–1969 pandemic and in some cases with the 1957–1958 pandemic.25,28–30
Another example of this phenomenon is that the estimated numbers of deaths associated with the 1968–1969 influenza pandemic (between 34 000 and 56 00025,31–33) are similar to recent annual estimates of deaths associated with seasonal influenza epidemics (from 33 000–51 0006,8). The similarity between death estimates for the 1968 pandemic and more recent seasonal epidemics may be explained partly by increases in the average age of the US population during the past several decades; most influenza deaths occur in older individuals. However, it is not known what other host factors may be involved. These findings reinforce the fact that year-to-year variability in annual estimates of influenza-associated deaths must be evaluated with accepted and consistent statistical methods.
Doshi states that the majority of deaths during the 1918–1919 pandemic was attributable to secondary bacterial complications and suggests that most of these complications are now preventable because of improvements in health care. Published data suggest that a substantial number of secondary bacterial infections occurred during the 1918–1919 pandemic,12,34–37 and some of these infections are now likely preventable. For example, pneumococcal conjugate vaccine is 18% to 30% effective in preventing pneumonia in children38 and therefore could reduce mortality associated with secondary pneumococcal pneumonia in a future pandemic. However, this vaccine is not licensed for use in adults, and even if it were used widely, it would be unlikely to prevent substantial mortality in the United States, because the seven serotypes included in the vaccine cause less than 20% of invasive pneumococcal disease among adults.39
Pneumococcal polysaccharide vaccine, which is recommended and licensed for use in all adults aged 65 years and older, is considerably less effective against invasive pneumococcal disease among persons with chronic illnesses, a population that is substantially larger today than it was during any of the 20th-century pandemics.40 There is little evidence that this vaccine is effective in reducing all-cause pneumonia and mortality.41 In addition, improvements in care of the critically ill have not been shown to reduce mortality from pneumococcal disease.42
Staphylococcus aureus, another cause of secondary bacterial pneumonia during pandemics36,43 and interpandemic periods,44,45 presents two important medical challenges. First, there is no vaccine for prevention of S. aureus pneumonia. Second, antimicrobial resistance has developed in S. aureus over the past 40 years, limiting treatment options. Multiple reports of community-associated methicillin-resistant S. aureus have described especially severe clinical presentations, including necrotizing pneumonia, septic shock, and death within 24 to 48 hours of illness onset, despite intensive antimicrobial therapy and supportive care.46–48 Thus, although many of the deaths that occurred during the 1918–1919 pandemic may have been associated with secondary bacterial infections, available data do not provide sufficient reassurance that antibiotics, intensive care units, and pneumococcal vaccines will lead to a substantial reduction in mortality during the next pandemic.
CONCLUSIONS
It has long been recognized that influenza is associated with substantial mortality during both epidemics and pandemics. Modeling estimates from the CDC and several other groups build on several decades of work devoted to best understanding how to use US vital statistics data to assess the health burden of influenza. Doshi's estimates of influenza deaths are lower than estimates produced by the CDC and other groups primarily because he used a narrow outcome and did not use statistical models developed to more accurately estimate the total number of influenza-associated deaths. These differences lead to substantially different conclusions regarding the effect of influenza on deaths in the United States during both seasonal epidemics and the three pandemics of the 20th century.
No one can predict the severity of any influenza season, including a pandemic season. On June 11, 2009, the World Health Organization (WHO) declared the start of the 2009 influenza pandemic. As of July 31, 2009, 168 countries and territories had reported at least one laboratory-confirmed case of pandemic H1N1 2009, and all continents had been affected by the pandemic. Over 162 000 cases were reported to the WHO, and the actual number of infected persons was certainly greater. By the time this piece is published, circulation of this virus will be reestablished in the Northern hemisphere. In order to plan to reduce the health effects of this and further pandemics in the United States and elsewhere, we must be ready to make the best estimates of influenza's impact using rigorous and sound methods and understand how mortality estimates for a pandemic compare with those for seasonal influenza. Progress is continuing to be made by the engaged scientific community in improving the methods used to make these estimates.
Acknowledgments
This study was funded by the Centers for Disease Control and Prevention.
References
Articles from American Journal of Public Health are provided here courtesy of American Public Health Association

