NCBI » Bookshelf » Health Services/Technology Assessment Text (HSTAT) » AHRQ Evidence Reports » Management of Acute Otitis Media: Evidence Report/Technology Assessment Number 15
 
hserta
AHRQ Evidence Reports
public health

Chapter  15:  Management of Acute Otitis Media: Evidence Report/Technology Assessment Number 15

A20985

Prepared for:
Agency for Healthcare Research and Quality
U.S. Department of Health and Human Services
2101 East Jefferson Street
Rockville, MD 20852


http://www.ahrq.gov/

Contract No. 290-97-0001

Prepared by:
Southern California Evidence-based Practice Center
Michael Marcy, M.D.
Principal Investigator
Glenn Takata, M.D., M.S.
Linda S. Chan, Ph.D.
Paul Shekelle, M.D., Ph.D.
Wilbert Mason, M.D., M.P.H.
Laura Wachsman, M.D.
Richard Ernst, Ph.D.
Joel W. Hay, Ph.D.
Pamal M. Corley, M.S.L.S.
Tricia Morphew, M.S.
Emily Ramicone, M.S.
Connie Nicholson
Investigators

AHRQ Publication No. 01-E010

May 2001

ISBN 1-58763-027-3
ISSN 1530-4396

On December 6, 1999, under Public Law 106-129, the Agency for Health Care Policy and Research (AHCPR) was reauthorized and renamed the Agency for Healthcare Research and Quality (AHRQ). The law authorizes AHRQ to continue its research on the cost, quality, and outcomes of health care and expands its role to improve patient safety and address medical errors.

This report may be used, in whole or in part, as the basis for development of clinical practice guidelines and other quality enhancement tools, or a basis for reimbursement and coverage policies. AHRQ or U.S. Department of Health and Human Services endorsement of such derivative products may not be stated or implied.

Prepared for:
Agency for Healthcare Research and Quality
U.S. Department of Health and Human Services
2101 East Jefferson Street
Rockville, MD 20852


http://www.ahrq.gov/

Contract No. 290-97-0001

Prepared by:
Southern California Evidence-based Practice Center
Michael Marcy, M.D.
Principal Investigator
Glenn Takata, M.D., M.S.
Linda S. Chan, Ph.D.
Paul Shekelle, M.D., Ph.D.
Wilbert Mason, M.D., M.P.H.
Laura Wachsman, M.D.
Richard Ernst, Ph.D.
Joel W. Hay, Ph.D.
Pamal M. Corley, M.S.L.S.
Tricia Morphew, M.S.
Emily Ramicone, M.S.
Connie Nicholson
Investigators

AHRQ Publication No. 01-E010

May 2001

ISBN 1-58763-027-3
ISSN 1530-4396

On December 6, 1999, under Public Law 106-129, the Agency for Health Care Policy and Research (AHCPR) was reauthorized and renamed the Agency for Healthcare Research and Quality (AHRQ). The law authorizes AHRQ to continue its research on the cost, quality, and outcomes of health care and expands its role to improve patient safety and address medical errors.

This report may be used, in whole or in part, as the basis for development of clinical practice guidelines and other quality enhancement tools, or a basis for reimbursement and coverage policies. AHRQ or U.S. Department of Health and Human Services endorsement of such derivative products may not be stated or implied.

Preface

The Agency for Healthcare Research and Quality (AHRQ), through its Evidence-based Practice Centers (EPCs), sponsors the development of evidence reports and technology assessments to assist public- and private-sector organizations in their efforts to improve the quality of health care in the United States. The reports and assessments provide organizations with comprehensive, science-based information on common, costly medical conditions and new health care technologies. The EPCs systematically review the relevant scientific literature on topics assigned to them by AHRQ and conduct additional analyses when appropriate prior to developing their reports and assessments.

To bring the broadest range of experts into the development of evidence reports and health technology assessments, AHRQ encourages the EPCs to form partnerships and enter into collaborations with other medical and research organizations. The EPCs work with these partner organizations to ensure that the evidence reports and technology assessments they produce will become building blocks for health care quality improvement projects throughout the Nation. The reports undergo peer review prior to their release.

AHRQ expects that the EPC evidence reports and technology assessments will inform individual health plans, providers, and purchasers as well as the health care system as a whole by providing important information to help improve health care quality.

We welcome written comments on this evidence report. They may be sent to: Director, Center for Practice and Technology Assessment, Agency for Healthcare Research and Quality, 6010 Executive Blvd., Suite 300, Rockville, MD 20852.

John M. Eisenberg, M.D.Douglas B. Kamerow, M.D.
DirectorDirector, Center for Practice and
Agency for Healthcare Research and Quality Technology Assessment
Agency for Healthcare Research and Quality

The authors of this report are responsible for its content. Statements in the report should not be construed as endorsement by the Agency for Healthcare Research and Quality or the U.S. Department of Health and Human Services of a particular drug, device, test, treatment, or other clinical service.

Structured Abstract

Objectives

Our objective with this report was to analyze the evidence on the initial management of uncomplicated acute otitis media (AOM) in children. We assessed three questions: What is the natural history of AOM without antibiotic treatment? Are antibiotics effective in preventing clinical failure? and What is the relative effectiveness of specific antibiotic regimens such as: (1) amoxicillin or trimethoprim-sulfamethoxazole vs. other antibiotics, (2) oral fluoroquinolones, (3) >60 mg/kg/day amoxicillin or amoxicillin-clavulanate vs. 40 mg/kg/day, (4) high-dose amoxicillin therapy twice a day vs. three times a day, and (5) short-term vs. long-term antibiotic therapy?

Search Strategy

The technical experts and project staff developed a literature search strategy that used MEDLINE, the Cochrane Library, HealthSTAR, International Pharmaceutical Abstracts, Cumulative Index to Nursing & Allied Health Literature, BIOSIS, and EMBASE. Headings included "om" (otitis media), "mastoiditis," "om w/effusion," "om, suppurative" with the subheading "drug therapy," and "anti-infective agents," including "antibiotics" and "other drugs." Text words included otitis media, antibiotic, antimicrobial, antibacterial, specific antibiotic names and natural history, natural course, untreated, spontaneous, and self-limited for the natural history search. Additional articles were identified by review of reference lists in proceedings, published articles, reports, and guidelines.

Selection Criteria

The selection criteria included human studies addressing AOM in children age 4 weeks to 18 years. Excluded were studies on patients with immunodeficiencies or craniofacial deficiencies, including cleft palate. Randomized clinical trials and cohort studies were included for the question on natural history. Randomized controlled trials were used to address the questions on antibiotic effectiveness.

Data Collection and Analysis

Two physician reviewers independently evaluated articles and abstracted data. They excluded articles that did not address any of the key questions or that had unabstractable data. They assessed the quality of the studies. Project staff developed evidence tables using the abstracted data. Meta-analyses were performed as appropriate. Twenty-four experts and consumers critiqued the draft of this evidence report.

Main Results

Clinical failure was defined generally as the failure to resolve or improve clinical signs and symptoms at specific time intervals. In children with AOM not initially treated with antibiotics, the reported rate of clinical failure at 24-48 hours was 7.7 percent in one study and at 24-72 hours was 26 percent in another study. The pooled estimated failure rate at 1-7 days was 18.9 percent and was 22.2 percent at 4-7 days. Compared with this failure rate, children treated with ampicillin or amoxicillin showed a reduction in clinical failure at 2-7 days of 12.3 percent. This result generally was robust to sensitivity analysis. Eight children with AOM would need to be treated with ampicillin or amoxicillin rather than no antibiotic treatment to avoid a case failure. The pooled comparisons of specific antibiotic regimens showed no difference in clinical failure rates. Adverse effects, primarily gastrointestinal, were more common in children on cefixime than those on ampicillin or amoxicillin and more common in children on amoxicillin-clavulanate (original formulation) than those on azithromycin.

Conclusions

There is a wide range of reported clinical failure rates in the first week in children with AOM who are not treated with antibiotics. The pooled estimates indicate that a majority of these children have clinical resolution within the first week after presentation. These studies, which generally are of small sample size, report few episodes of suppurative complications, regardless of antibiotic treatment. In general, the children in the natural history studies had close followup. Antibiotic treatment with ampicillin or amoxicillin produces a statistically significant improvement in failure rates compared with no antibiotic treatment of AOM. We found no difference in clinical failure rates in the antibiotic regimens assessed. Since we were unable to do subgroup analysis in the meta-analytic comparisons, we cannot generalize those findings to children in specific age groups, such as younger than or older than 2 years of age, or by otitis-prone status. Several studies suggest greater caution be taken with children younger than 2 years old.

Future Research

Randomized controlled studies still are needed to address definitively the initial key questions. Future research should focus on: (1) establishing uniform definitions of AOM and relevant outcomes, (2) establishing uniform diagnostic criteria, (3) strengthening internal and external validity, (4) addressing relevant influencing factors such as age and otitis-prone state, and (5) measuring long-term as well as short-term outcomes. Studies also should be of sufficient power to establish differences in antibiotic efficacy. In addition, future studies should address the bacterial resistance issue.

This document is in the public domain and may be used and reprinted without permission except those copyrighted materials noted for which further reproduction is prohibited without the specific permission of copyright holders.

Suggested Citation

Marcy M, Takata G, Shekelle P, et al. Management of Acute Otitis Media. Evidence Report/Technology Assessment No. 15 (Prepared by the Southern California Evidence-based Practice Center under Contract No. 290-97-0001). AHRQ Publication No. 01-E010. Rockville, MD: Agency for Healthcare Research and Quality. May 2001.

Summary

Overview

The objective of this report was to analyze the evidence on the initial management of uncomplicated acute otitis media (AOM) in children. AOM is one of the most common diagnoses in children. Data from the National Ambulatory Medical Care Surveys (NAMCS), which did not differentiate between AOM and otitis media with effusion, indicated that the number of office visits for AOM increased more than two-fold from 1975 to 1990. Gates (1996a) believed that the majority of these cases represented AOM. Based on national data from NAMCS and the National Hospital Ambulatory Medical Care Surveys, and several assumptions detailed in Appendix A, we estimated that 5.18 million episodes of AOM occurred in 1995 at a cost of approximately $2.98 billion, including direct and indirect costs and the costs of sequelae such as otitis media with effusion and chronic middle ear infection. These estimates suggest that increased effectiveness in treating AOM could achieve significant national cost savings.

AOM was defined by the Technical Expert Panel as the presence of middle ear effusion in conjunction with the rapid onset of one or more signs or symptoms of inflammation of the middle ear. Uncomplicated AOM was defined as AOM that is limited to the middle ear cleft. An episode of uncomplicated AOM was considered distinct from a previous episode of AOM and was eligible for initial treatment if the most recent course of antibiotics ended 4 weeks prior to the episode of AOM in question, or if there was documentation by an examiner that a prior episode of AOM had been cleared.

Various medical and surgical treatments have been used for AOM. There is controversy about the need for antibiotics, particularly in children older than 6 months of age with uncomplicated AOM. It is routine to use antibiotics for AOM in the United States, whereas in the Netherlands the standard practice is to observe selected children older than 2 years of age for 48 hours and selected children age 6 months to 2 years for 24 hours before initiating antibiotics. Antibiotics are prescribed if clinical resolution does not occur during the observation period. The presence of alternative treatment paradigms of questioned effectiveness suggests that an evidence-based analysis on the management of AOM is needed to determine the efficacy of antibiotic therapy.

Reporting the Evidence

The Technical Expert Panel limited the scope of this evidence report to three key clinical questions:

  • What is the natural history of AOM without antibiotic treatment?

  • Are antibiotics effective in preventing clinical failure?

  • What is the relative effectiveness of specific antibiotic regimens?

The regimens we analyzed were:

(1) amoxicillin or trimethoprim-sulfamethoxazole vs. other antibiotics,

(2) oral fluoroquinolones,

(3) 60 mg or higher per kg/day of amoxicillin or amoxicillin-clavulanate vs. the standard 40 mg per kg/day,

(4) high-dose amoxicillin therapy twice a day vs. three times a day, and

(5) short-term vs. long-term antibiotic therapy.

The Technical Expert Panel decided that this systematic review would focus on children ages 4 weeks to 18 years, who had uncomplicated AOM and were seeking initial treatment. The major outcomes included presence or absence of signs and symptoms within 48 hours, at 3 to 7 days, 7 to14 days, 14 days to 3 months, and after 3 months; presence or absence of adverse effects from antibiotic treatment; and presence or absence of bacteria and/or resistant bacteria.

Of a total of 41 factors that the Technical Expert Panel felt could influence outcomes apart from antibiotics, the panel ranked age (younger and older than 2 years) and otitis-prone state as the two most important factors. The otitis-prone child was defined as the child who had three or more episodes of AOM in a 6-month period or four or more episodes of AOM in a 12-month period.

Methodology

An 11-member Technical Expert Panel consisting of clinical experts, a consumer, and a representative of a managed care organization convened to:

  • advise the project in the ranking of proposed key questions and influencing factors,

  • guide the development of the scope and definition of AOM,

  • advise in development of the search strategy, and

  • review and comment on the analysis plan.

The Technical Expert Panel and project staff developed a literature search strategy. The initial strategy was developed for MEDLINE and was customized for other databases. Project staff searched MEDLINE (1966-March 1999), the Cochrane Library (through march 1999), HealthSTAR (1975-March 1999), International Pharmaceutical Abstracts (1970-March 1999), the Cumulative Index to Nursing & Allied Health Literature (1982-March 1999), BIOSIS (1970-March 1999), and EMBASE (1980-March 1999). Additional articles were identified by review of reference lists in proceedings, published articles, reports, and guidelines.

The initial module of search statements included an explode of "om" (otitis media), which included the headings "om, mastoiditis," "om w/effusion," and "om, suppurative" with the subheading "drug therapy." The next module included the explode of "om," with "om" as a text word. The anti-infectives module used an explode of the mesh heading for anti-infective agents, including antibiotics and other drug groups, and the text words antibiotic, antimicrobial, antibacterial, and specific antibiotic names. Combinations of these modules were used for the literature search. The search was limited to human or undesignated studies and to infant, child, preschool, adolescence, or undesignated subjects. For the natural history search, natural history, natural course, untreated, spontaneous, and self-limited were added as keywords. Two physicians independently screened all titles and/or abstracts for potential inclusion, evaluated the quality of the articles, and abstracted data from full-length articles onto predesigned forms. The selection criteria included human studies that addressed a key question about AOM in children ages 4 weeks to 18 years. Excluded were case reports, editorials, letters, reviews, practice guidelines, and studies on patients with immunodeficiencies or craniofacial deficiencies, including cleft palate. Randomized clinical trials and prospective and retrospective comparative cohort studies were included for the key question on natural history. Only randomized controlled trials were used to address the key questions on the effectiveness of antibiotics. The physician reviewers assessed the quality of controlled trials by using an established tool that focused on randomization, blinding, and reporting of subject withdrawals. They also noted approximation to the diagnostic criteria for AOM established by the Technical Expert Panel.

A physician reviewer also reviewed articles in 13 non-English languages with the assistance of a translator. An initial review of 97 non-English-language articles yielded only two eligible studies, both of which already were known to the project staff. Based on this outcome, the Technical Expert Panel advised the project staff to discontinue further screening of non-English-language citations. Based on peer reviewers' suggestions, the remaining five Dutch and Scandinavian articles were reviewed and no additional studies were found.

Meta-analyses were performed to determine the effectiveness of antibiotic vs. placebo or observational treatment of uncomplicated AOM and to determine the effectiveness of particular antibiotic regimens. Comparisons were established based on the type of antibiotics and the outcome variable under consideration. The technical experts decided to establish comparison groups by individual antibiotic, as this best fit the information required for clinical practice. A meta-analysis was performed for each comparison with three or more randomized controlled studies. Heterogeneity was measured for all meta-analyses, and a random effects model was used to estimate the absolute rate differences. Although subgroup and sensitivity analyses were initially planned based on age of the subject, otitis-prone status of the subject, study-design quality, and approximation to the Technical Expert Panel's diagnostic criteria for AOM, they could not be performed because an insufficient number of studies addressed these factors or because there was an insufficient number of studies within a comparison group.

This evidence report was critiqued by the Technical Expert Panel as well as a 25-member peer-review panel consisting of content experts, consumers, representatives of managed care organizations, an expert in pediatric pharmacology, and methodologists. All comments received from these individuals were reviewed and acted upon as appropriate.

Findings

Natural History of AOM

  • In children with AOM who were not initial treated with antibiotics, one study showed a clinical failure rate of 7.7 percent at 24 to 48 hours, and another study showed a failure rate of 26 percent at 24 to 72 hours -- that is, clinical resolution was 92.3 percent at 24 to 48 hours and 74 percent at 24 to 72 hours. The pooled estimate of failure at 1 to 7 days was 18.9 percent (95 percent confidence intervals, 9.9 percent and 28.0 percent) and at 4 to 7 days was 22.2 percent (95 percent confidence intervals, 10.1 percent and 34.3 percent).

  • A previous information synthesis estimated that 59 percent (95 percent confidence intervals, 53 percent and 65 percent) of children not treated with antibiotics had resolution of pain and fever within 24 hours of diagnosis of AOM, 87 percent (95 percent confidence intervals, 84 percent and 89 percent) of children had resolution of pain and fever within 2 to 3 days, and 88 percent (95 percent confidence intervals, 85 percent and 91 percent) of children had resolution of pain and fever within 4 to 7 days.

  • The available evidence on natural history of AOM shows that in studies with close followup, few episodes of mastoiditis or other suppurative complications are reported in children with AOM who are not treated initially with antibiotics.

Effects of Antibiotics on AOM

  • Meta-analysis demonstrated a reduction in the clinical failure rate within 2 to 7 days of 12.3 percent (95 percent confidence intervals, 2.8 percent and 21.8 percent) in favor of ampicillin or amoxicillin therapy compared with placebo or observational treatment. This result was generally robust to sensitivity analysis. Eight children with AOM would need to be treated with ampicillin or amoxicillin rather than no antibiotic treatment to avoid a case of clinical failure.

  • Previous meta-analyses have demonstrated minimal to modest benefits of antibiotics compared with observational intervention without antibiotics during the initial treatment of AOM for the following outcomes: pain and fever resolution at 2 days, pain resolution at 2 to 7 days, contralateral otitis media and 7- to14-day clinical resolution rate. The following outcomes did not appear to be affected by antibiotic use: pain resolution at 24 hours, pain and fever resolution at 4 to 7 days, tympanic membrane perforation, vomiting/diarrhea/rash, 1-month tympanometry, or recurrent AOM.

Relative Effects of Different Antibiotic Regimens

  • Meta-analyses did not demonstrate a significant rate difference in clinical failure rates in children with AOM treated with ampicillin or amoxicillin compared with children treated with penicillin, cefaclor, or cefixime.

  • Meta-analysis did not demonstrate a significant difference in clinical failure rates in children treated with trimethoprim-sulfamethoxazole compared with children treated with cefaclor for AOM.

  • Meta-analysis demonstrated that children treated with cefixime had an 8.4 percent greater rate of diarrhea than children treated with ampicillin or amoxicillin. Twelve children with AOM would need to be treated with ampicillin or amoxicillin rather than cefixime to avoid a case of diarrhea.

  • No comment can be made on the effect of oral fluoroquinolones compared with other antibiotics because no comparative, randomized controlled trials were found that addressed this question.

  • Although not establishing equivalency of effect, a single study demonstrated no difference in clinical effect of high-dose amoxicillin-clavulanate vs. standard-dose amoxicillin-clavulanate.

  • Although not establishing equivalency of effect, a single study did not demonstrate a difference in clinical effect of taking high-dose amoxicillin two times a day vs. three times a day.

  • Meta-analysis did not demonstrate a difference in clinical effect between short-duration therapy and long-duration therapy when comparing single-dose ceftriaxone therapy with 7 to 10 day amoxicillin therapy and azithromycin therapy for less than 5 days with 7 to 10 day amoxicillin-clavulanate therapy.

  • A previous meta-analysis demonstrated that short-acting oral antibiotic therapy of less than 2 days was not as effective as therapy lasting 7 days or longer.

  • Meta-analysis demonstrated that children treated with 7 to 10 day amoxicillin-clavulanate had a 19.2 percent (95 percent confidence intervals, 9.2 percent and 29.2 percent) greater rate of overall adverse effects and a 12.9 percent (95 percent confidence intervals, 4.5 percent and 21.2 percent) greater rate of gastrointestinal adverse effects than children treated with 5-day azithromycin. Eight children would need to be treated with azithromycin rather than amoxicillin-clavulanate to avoid a gastrointestinal adverse event. (Although not reported in the studies, the clavulanate concentration was most likely 31.25 mg per 125 mg of amoxicillin, i.e., original formulation.)

Limitations of the Literature

  • The diagnostic criteria for AOM were not uniform across studies.

  • Although some studies were of high quality, about one-half of the studies were not of adequate quality.

  • The AOM outcomes varied among studies, and the definition of common outcomes such as clinical failure were not uniform. This inconsistency made it difficult to compare results across studies.

  • The power of the studies to detect a difference appeared to be insufficient in most cases, although this was less important because the treatment effect sizes were generally less than 10 percent.

  • Although many studies had significant numbers of children younger and older than age 2 years, we could not do subgroup analysis because most of the studies did not report outcome by age. We were, therefore, unable to focus the findings of this study to children in specific age groups. Several studies suggest that greater caution should be taken with children younger than age 2 years; however, these studies do not answer this question definitively.

  • Because most of the studies did not report outcomes by otitis-prone status, we were unable to do subgroup analysis by this influencing factor.

  • Based on the exclusion factors of the investigations used in this analysis, the study findings are most applicable to children without comorbidities and with AOM of lesser severity.

Future Research

Randomized controlled studies of high internal validity and adequate generalizability are needed to adequately address the key clinical questions asked at the start of this systematic review, including the question of the role of antibiotics in the treatment of uncomplicated AOM. Placebo-controlled trials of adequate power with sufficient patient variation for subgroup analysis are needed. Close monitoring of patients in these studies with a priori plans for appropriate intervention should allay any concerns about suppurative complications and should be a focus of research. Future research should: (1) establish uniform definitions of AOM and relevant clinical, bacteriologic, and societal outcomes; (2) establish uniform diagnostic criteria for AOM; (3) strengthen internal and external validity; (4) address relevant influencing factors, such as age and otitis-prone state, and (5) measure long-term as well as short-term outcomes. Uniform definition and diagnostic criteria are needed to ensure that results across studies can be compared. Appropriate randomization and blinding methods would establish the internal validity of future research. Sufficient variation in future study populations in terms of influencing factors as well as sufficient number of cases may allow results to be applied more readily to specific patients or populations and to be generalized to other populations. Although not addressed in this evidence-based analysis, future research should consider the impact of bacterial resistance on AOM outcomes. Investigators should prioritize AOM outcomes based, in large part, on their importance to patients, their families, and society as a whole because they bear the burden of AOM.

Chapter 1. Introduction

Purpose

The purpose of this evidence-based report is to review the evidence on the natural history of acute otitis media (AOM) and the role of antibiotics in the treatment of uncomplicated AOM in children. The evidence compiled in this report is intended to aid the nominating organizations and others to develop clinical practice guidelines or medical review criteria for AOM. The report also will identify areas for future research.

Scope of Work

The nominating organizations to this topic of the evidence report initially proposed five broad areas of inquiry: (1) factors influencing the course of an episode of AOM, (2) variation in definitions of AOM used in studies, (3) the role of antibiotics, (4) followup, and (5) prevention. Based on degree of importance, including level of controversy and feasibility of answering the question, the Technical Expert Panel limited the scope of this evidence report to the natural history of AOM and the role of antibiotics in treatment of children ages 4 weeks to 18 years. The study also evaluated the influence of specific factors apart from antibiotics on the course of AOM.

Definition

Although readily recognized as a clinical condition, AOM appears to be without a standard definition. In 1985, Paparella, Bluestone, Arnold, et al. (1985), reporting on an international effort to define terms related to otitis media, stated "The panel recognizes the impossibility of recommending terms unanimously acceptable to all." The following four sets of references are often cited as sources for authoritative definitions of AOM and demonstrate the lack of uniform specificity:

  • Although not defining acute otitis media, Paparella, Bluestone, Arnold, et al. (1985) defined otitis media as "an inflammation of the middle ear (which may or may not be of infectious origin in contrast to infection, which implies a microbiologic etiology)." An earlier attempt by the same group (Senturia, Paparella, Lowery, et al., 1980) had resulted in 8 categories of otitis media out of 28 that were modified by the term "acute." The group defined "acute process" as the "initial 3 weeks" associated with "onset -- may be short and rapid or signs and symptoms may be subtle and onset slow and insidious."

  • In 1992, the Infectious Diseases Society of America (Chow, Hall, Klein, et al., 1992) offered the following definition of AOM: "inflammation of the middle ear as evidenced by the presence of fluid and accompanied by specific signs or symptoms such as ear pain, ear drainage, hearing loss, or nonspecific findings such as fever, lethargy, irritability, anorexia, vomiting, or diarrhea." Diagnostic criteria were embedded in a definition that emphasized middle ear inflammation.

  • The Agency for Health Care Policy and Research Otitis Media with Effusion in Young Children. Clinical Practice Guideline (Stool, Berg, Berman, et al., 1994a) mentioned two definitions of AOM within the text of their work: "inflammation of the middle ear with signs or symptoms of middle ear infection" and "fluid in the middle ear accompanied by signs or symptoms of ear infection." One emphasized middle ear inflammation, the other middle ear infection.

  • Bluestone and Klein (1996), in a standard text of pediatric otolaryngology, provided two definitions of AOM: "the rapid onset of signs and symptoms of acute infection within the middle ear" and "the rapid and short onset of signs and symptoms of inflammation in the middle ear." The first definition emphasized middle ear infection, the second middle ear inflammation.

In 1985, Paparella, Bluestone, Arnold, et al. (1985) concluded, "It is not the panel's purpose to force usages, but rather to suggest terms to improve clinical and scientific communication. It is appropriate and right and, therefore, incumbent upon every author or speaker to define his/her own terms when communicating with colleagues." For the purpose of systematic review for this evidence-based analysis, a consensus was required among the technical experts on the definition of AOM to evaluate the studies retrieved for analysis of the key questions. A definition would aid in understanding the condition and would describe in codified terms characteristics of the condition that make it unique from other conditions, alluding to etiology and pathophysiology. A well-structured definition also would provide a framework to develop diagnostic criteria to diagnose the presence of AOM in individual patients. This process is detailed in the Methodology section.

Epidemiology

Accurate estimates on the prevalence or incidence of AOM were not found because published population-based estimates are not available on the specific diagnosis of AOM. Data reported from the National Ambulatory Medical Care Survey (NAMCS) provided the best indication of prevalence and incidence of the disease, although nonsuppurative, suppurative, and unspecified otitis media were grouped into the term otitis media, and AOM and OME were not separated in the analyses (Schappert, 1992; Schappert, 1996; Woodwell, 1997a; Woodwell, 1997b; Woodwell and Schappert, 1995). Gates (1996a), commenting on the NAMCS data, stated, "For children, it is probably safe to presume that AOME (AOM with effusion) is the principal disorder noted in these surveys."

Schappert (1992) reported on the 1975-90 NAMCS data. Office visits by patients younger than 15 years of age with the principal diagnosis of otitis media constituted 70.6 percent in 1975; 78.9 percent in 1980; 81.9 in 1985; and 80.5 percent in 1990. From 1975 to 1990, the percentage of office visits with otitis media as the principal diagnosis increased in patients younger than age 15: from 7.3 to 17.4 percent for children younger than age 2; from 10.4 to 18.1 percent for ages 2 to 5; from 6.9 to 10.5 percent for ages 6 to 10; and from 2.6 to 5.2 percent for ages 11 to 14. The number of visits with a principal diagnosis of otitis media per 100 persons per year for the same time period (1975-90) increased from 31.5 to 102.1 for children younger than 2 years of age, 20.8 to 47.8 for those 2 to 5 years of age, 10.2 to 18.2 for those 6 to 10 years of age, and 3.3 to 8.0 for those 11 to 14 years of age.

From 1975 to 1990, the percentage of office visits with a principal diagnosis of otitis media increased from 8.1 to 14.3 percent for pediatricians, from 1.3 to 3.5 percent for general practitioners and family physicians, and 12.8 to 20.2 percent for otolaryngologists. The proportion of office visits for otitis media was higher for pediatricians compared with general practitioners and family physicians or otolaryngologists. In 1990, the number of visits with a principal diagnosis of otitis media per 100 persons per year in children younger than 2 years was 62.9 for pediatricians, 24.0 for general practitioners and family physicians, and 9.1 for otolaryngologists. In 1990, the number of visits with a principal diagnosis of otitis media per 100 persons per year in children 2 to 5 years old was 29.0 for pediatricians, 11.4 for general practitioners and family physicians, and 6.6 for otolaryngologists (Schappert, 1992).

The reports on the NAMCS data for 1993 to 1996 did not stratify by age (Schappert, 1996; Woodwell, 1997a; Woodwell, 1997b; Woodwell and Schappert, 1995). If the 1993-96 data were similar to that in 1975-90, it would be reasonable to conclude that the majority of these patients were younger than 15 years of age. Suppurative and unspecified otitis media was the third most frequently listed principal diagnosis in 1993, the sixth most frequent in 1994, the fourth most frequent in 1995, and the seventh most frequent in 1996 for ambulatory care visits to physician offices, hospital outpatient departments, and emergency departments (Schappert, 1996; Woodwell, 1997a; Woodwell, 1997b; Woodwell and Schappert, 1995). In 1996, visits for a principal diagnosis of otitis media and eustachian tube disorders occurred 82.8 percent of the time in physician offices, 5.3 percent in hospital outpatient departments, and 11.9 percent in emergency departments (Woodwell, 1997a).

Using the published NAMCS data and other published national data such as the National Health Interview Survey, an internal analysis estimated that 5.18 million episodes of AOM and 1.04 million episodes of OME or chronic middle ear infection following AOM occurred in 1995. Each episode of AOM entailed 1.75 visits to the physician, and each episode of OME or chronic middle ear infection entailed 5.1 visits to the physician. The analysis assumed that 20 percent of AOM episodes were followed by OME or chronic middle ear infection. (See Appendix A.)

The NAMCS data also provided information on the duration of office visits for otitis media. The percent of visits for otitis media of 6-15 minutes duration increased between 1975 and 1990 from 64 to 78 percent and was associated with a decrease in visits of less than 6 minutes in duration from 24 to 13 percent (Schappert, 1992). In terms of surgical procedures, the rate of ambulatory surgery visits per 10,000 population for those younger than 15 years of age for otitis media and eustachian tube disorders was 86.9 in 1994 and 83.9 in 1995, based on 498,000 and 484,000 visits respectively (Hall and Lawrence, 1997; Kozak, Hall, Pokras, et al., 1997). In 1995, the number of myringotomy with tympanostomy tube placements reported by NAMCS was 521,000 for a rate of 90.2 procedures per 10,000 children younger than 15 years of age (Hall and Lawrence, 1997).

In general, the NAMCS data demonstrated the importance of otitis media -- and by implication AOM -- based on the prevalence and incidence of the disease and the frequency and duration of visits and surgical interventions.

Risk Factors

Uhari, Mantysaari, and Niemela (1996) conducted a systematic review of studies on the risk factors for development of AOM. This review only searched for studies via MEDLINE and might not have been comprehensive in its scope. Based on the studies included in their study, Uhari, Mantysaari, and Niemela (1996) found the following factors to be associated with increased risk of AOM: family member having AOM, relative risk (RR) 2.63 (95 percent CI, 1.86 and 3.72); day care outside the home, RR 2.45 (95 percent CI, 1.51 and 3.98); family day-care setting vs. care at home, RR 1.59 (95 percent CI, 1.19 and 2.13); parental smoking, RR 1.66 (95 percent CI, 1.33 and 2.06); and pacifier use, RR 1.24 (95 percent CI, 1.06 and 1.46). Having at least one sibling and being in a day-care center also seemed to be associated with increased AOM risk; however, the actual relative risks were not reported. Breast-feeding for at least 3 months was associated with a decreased risk of AOM, RR 0.87 (95 percent CI, 0.79 and 0.95). Breast-feeding in general and breast-feeding for at least 6 months also seemed to be associated with decreased AOM risk; however, the actual relative risks were not reported. Being in a day-care center vs. a family day-care setting did not confer a significant risk for AOM.

Uhari, Mantysaari, and Niemela (1996) also examined the risk factors for recurrent AOM and found the following factors to be associated with an increased risk of recurrent AOM: having at least one sibling, RR 1.92 (95 percent CI, 1.29 and 2.85); child care outside of the home, RR 1.82 (95 percent CI, 1.21 and 2.73); parental smoking, RR 1.76 (95 percent CI, 1.36 and 2.28); and day-care center vs. care at home, RR 1.38 (95 percent CI, 1.19 and 1.61). Breast-feeding in general, RR 0.48 (95 percent CI, 0.32 and 0.72), and breast-feeding for 6 months or longer vs. breast-feeding for less than 6 months, RR 0.69 (95 percent CI, 0.49 and 0.97) were associated with a decreased risk of recurrent AOM. The following factors were not found to be significantly associated with recurrent AOM risk: family day-care setting vs. care at home, day-care center vs. family day-care setting, atopy or allergy, and breast-feeding for 3 months or longer vs. less than 3 months. Rosenfeld (1996) also cited the following factors as mentioned in the literature as risks for recurrence of AOM: young age (younger than 2 years old); multiple previous episodes; bottle feeding; history of ear infections in parents or siblings; and pacifier use.

Risk factors for the outcome of AOM at 2 months were studied by Froom, Culpepper, Bridges-Webb, et al. (1993). Children younger than age 13 months were less likely to be asymptomatic at 2 months than older children. In the study population, several factors had independent risk for poor symptomatic outcome 2 months following diagnosis of AOM. For children age 12 months or younger, the following factors were associated with poor 2-month outcome: history of serous otitis media, odds ratio (OR) 2.3 (95 percent CI, 0.95 and 5.70); episodes of AOM within the past 18 months, OR 1.9 (95 percent CI, 0.82 and 4.51); and male sex, OR 1.7 (95 percent CI, 1.00 and 3.00). For children age 13 months to 15 years, the following factors were associated with poor 2-month outcome: history of ear tubes, OR 2.3 (95 percent CI, 1.46 and 3.58); pus on examination, OR 2.2 (95 percent CI, 1.48 and 3.29); episodes of AOM within the past 18 months, OR 1.8 (95 percent CI, 1.31 and 2.37); and history of serous otitis media, OR 1.4 (95 percent CI, 1.00 and 1.88). Other studies found that bottle feeding, a history of ear infections in parents or siblings, and attendance at a day-care center were factors associated with persistent middle ear effusion after AOM.

Diagnosis

Related to the issue of a uniform definition of AOM is the diagnosis of AOM and the criteria by which the diagnosis is made. Hayden (1980) reviewed 43 full-length articles on AOM that were selected from six journals published from 1955 to 1979. Forty percent of these articles did not describe the criteria by which the diagnosis of AOM was established. In the 26 articles that did describe criteria for the diagnosis of AOM, 18 unique criteria sets were found, and identical criteria sets usually were found in studies performed by the same investigator. These findings, however, are expected considering the lack of a uniform definition.

Rosenfeld (1996) listed the following as possible diagnostic criteria for AOM: acute symptoms either alone, in the presence of middle ear effusion, or without resolution after 24 to 48 hours; purulent otorrhea; bulging tympanic membrane; and middle ear effusion in the presence of acute symptoms. The Otitis Media with Effusion in Young Children. Clinical Practice Guideline (Stool, Berg, Berman, et al., 1994a) stated that pneumatic otoscopy was an appropriate technique to establish the presence of middle ear effusion and that tympanometry could be used as a confirmatory test. Barnett, Klein, Hawkins, et al. (1998) found that acoustic reflectometry was as effective as tympanometry when compared to the gold standard of tympanocentesis.

Froom, Culpepper, Grob, et al. (1990) found that a large proportion of physicians in their study were unsure of the accuracy of their diagnosis of AOM. They reported diagnostic certainty in 58 percent of patients younger than age 12 months, 66 percent of patients age 13 to 30 months, and 73 percent of patients older than age 30 months. Studies from the University of Pittsburgh indicated that practitioners could be trained to diagnose the various forms of otitis media more appropriately (Kaleida and Stool, 1992). The validated otoscopist studies were based on an algorithm which in one study (Mandel, Rockette, Bluestone, et al., 1987) was felt to have potential for systematic bias as judged by the OME Guideline Panel (Culpepper, Long, and Sisk, 1994). As with the issue of the definition, this systematic review required a consensus on the diagnostic criteria for AOM to evaluate the studies retrieved for analysis of the key questions. This process is described in the Methodology section.

Alternatives for Treatment

Various medical and surgical treatments have been used for AOM. For the most part, medical treatment has concentrated on the administration of antibiotics, including penicillins, aminopenicillins, cephalosporins, carbacephems, macrolides, azalides, lincomycins, and combination antibiotics (Rosenfeld, 1996). However, the efficacy of antibiotics in comparison to observation has been in question. The Dutch standard of care is to observe the patient for 48 hours in select children older than age 2 years and for 24 hours in select children age 6 months to 2 years before initiating antibiotics (Froom, Culpepper, Jacobs, et al., 1997). Antibiotics are prescribed if clinical resolution does not occur during the observation period. Other issues pertinent to antibiotics are dose, schedule, and duration of treatment. Antihistamines and decongestants, although shown to be ineffective in the treatment of OME (Cantekin, Mandel, Bluestone, et al., 1983), and analgesics and antipyretics often are used as adjunctive therapies in the treatment of AOM and can be purchased over-the-counter without prescription. One topical analgesic has been shown to be effective in reducing the pain associated with AOM (Hoberman, Paradise, Reynolds, et al., 1997). Alternative medications also have been used and their effectiveness has been subjected to investigation (Barnett, Levatin, Klein, et al., 1999). Myringotomy plus amoxicillin has been shown to be no more effective than antibiotics alone (Kaleida, Casselbrant, Rockette, et al., 1991).

Rosenfeld (1996) suggested that AOM may be prevented through modification of environmental risk factors and through immunizations against both bacteria and viruses associated with AOM. Large doses of xylitol seemed to be effective in reducing the recurrence rate of AOM (Uhari, Kontiokari, and Niemela, 1998). Tympanostomy tubes (Casselbrant, Kaleida, Rockette, et al., 1992; Gebhart, 1981; Gonzalez, Arnold, Woody, et al., 1986) and adenoidectomy (Paradise, Bluestone, Rogers, et al., 1990) appeared effective in preventing recurrent otitis media.

The NAMCS data described practitioner followup patterns for management of AOM. In 1990, compared with 1975, return visits were scheduled to a greater extent (73.2 percent vs. 60.2 percent) for children age 0 to 5 years and to a less extent (46.6 percent vs. 58.3 percent) for those age 15 years or older. As noted above, the NAMCS data did not separate AOM from otitis media effusion (Schappert, 1992).

Outcomes

A wide range of short-term and long-term outcomes must be considered when assessing the effectiveness of treatments for AOM. The following are outcomes often measured in studies: total resolution of signs and symptoms of middle ear inflammation, persistent AOM, chronic OME, suppurative complications, chronic complications, hearing deficits, speech and language problems, behavior problems, and cognitive deficits (Rosenfeld, 1996). Suppurative complications include mastoiditis, petrositis, labyrinthitis, meningitis, subdural empyema, focal otitic encephalitis, brain abscess, and lateral sinus thrombosis (Bluestone and Klein, 1996). Sequelae of the disease include cholesteatoma, tympanosclerosis, chronic tympanic membrane perforation, and ossicular discontinuity and fixation (Bluestone and Klein, 1996; Rosenfeld, 1996).

Adverse effects of the treatments may occur. Antibiotics may lead to diarrhea, rash, anaphylaxis, and symptoms of the hematologic, cardiovascular, central nervous, renal, hepatic, and respiratory systems (Stool, Berg, Berman, et al., 1994b). Antimicrobial drug resistance also may increase with increased use of antibiotics (Dowell, Marcy, Phillips, et al., 1998). Antimicrobial drug resistance appears to be less common in the Netherlands (where antibiotics are not used as frequently for AOM) than in countries that use antibiotics routinely for AOM (Culpepper and Froom, 1997). Antihistamines and decongestants may lead to insomnia, drowsiness, behavior changes, changes in blood pressure, and seizures (Stool, Berg, Berman, et al., 1994). Myringotomy with tympanostomy tube insertion has the following possible adverse effects: external canal laceration, persistent otorrhea, granuloma formation, cholesteatoma, permanent perforation of the tympanic membrane, tympanic membrane flaccidity, retraction, tympanosclerosis, and tube intrusion into the middle ear cleft (Stool, Berg, Berman, et al., 1994).

Cost is another important outcome. Gates (1996b) estimated the cost of AOM for children age 0 to 4 years as $3.15 billion for the year 1994. Stool and Field (1989) estimated the cost of otitis media in general for children age 0 to 6 years as $2.2 to $3.4 billion for the year 1987. Using published NAMCS data, other published national data, and estimates from previously published cost analyses, an internal analysis estimated that the cost of AOM in 1995 was $2.98 billion. The estimated cost of AOM includes the cost of its sequelae. Based on findings by Berman, Roark, and Luckey (1994), it was assumed that OME or chronic middle ear infections followed an episode of AOM in 20 percent of cases. Costs for AOM and OME or chronic middle ear infections were estimated from the existent literature and included direct and indirect costs. The cost per episode for AOM was estimated at $214.19 and included 1.75 visits to a physician. The cost per episode for OME or chronic middle ear infection was estimated at $1,811 and included 5.1 visits to a physician. The estimated number of episodes of AOM and OME or chronic middle ear infection following AOM was described earlier. The $2.98 billion estimate is a minimum estimate because most of the assumptions were conservative. Sensitivity analysis indicated that the estimated national cost for 1995 could be as high as $6 billion. In any case, the national cost of AOM, whether accepting previous estimates or the internally derived estimate, is high. (See Appendix A.)

Ultimately, the importance of these outcomes is dependent on the viewpoint of the evaluator (Russell, Siegel, Daniels, et al., 1996). Furthermore, the perspective of the patient, parent, and physician must be taken into consideration. In general, the societal viewpoint is crucial in terms of balancing health-care costs against the nonhealth-care needs of society; but, the individual patient's condition and circumstances within the societal context also must be taken into account (Gold, Patrick, Torrance, et al., 1996). Quality of life and functional status may be more important than the individual medical outcomes listed above. For otitis media, including AOM, various paradigms for looking at quality of life and functional status are being developed (Alsarraf, Jung, Perkins, et al., 1998; Haggard and Smith, 1999a, 1999b; Rosenfeld, Goldsmith, Tetlus, et al., 1997).

Chapter 2. Methodology

Establishment of Conceptual Framework

The project team prepared a conceptual framework (Appendix B) for the management of AOM for the purpose of discussion and future development of the evidence report. It outlined 11 steps for the management of AOM: steps 1 through 6 related to initial evaluation and treatment and steps 7 through 11 related to followup care. Factors influencing outcomes, outcome measures, and decisions were noted as footnotes to the framework. The framework formed the basis on which key questions and the scope of the evidence report were developed. It was understood that not all steps could be addressed in this evidence report.

Nomination of Technical Experts

A total of 11 organizations were identified by the project team from whom nominations of technical experts and peer reviewers were solicited. The 11 organizations included: 3 topic-nominating partner -- the American Academy of Family Physicians, the American Academy of Pediatrics, and the American Academy of Otolaryngology-Head and Neck Surgery Foundation; 2 hearing and speech organizations -- the American Academy of Audiology (AAA) and the American Speech-Language-Hearing Association (ASHA); 1 multidisciplinary organization -- the Society for Ear Nose Throat Advances in Children (SENTAC); 2 managed care organizations -- PacifiCare Health Systems and Prudential HealthCare; 1 nurse practitioner organization -- the National Association of Pediatric Nurse Associates and Practitioners (NAPNAP); and 2 consumer groups -- Family Voices and Foundation for Accountability (FACCT). A letter of invitation to nominate technical experts and peer reviewers was faxed to each organization, together with a description of the tasks and commitments of each panel member.

Table 1. Technical expert panel
Technical ExpertArea of ExpertiseAffiliation/Location
Theodore G. Ganiats, M.D.Family medicineUniversity of California San Diego, CA
Martin C. Mahoney, M.D., Ph.D.Family medicineState University of New York Buffalo, NY
Margaretha Casselbrant, M.D., Ph.D.OtolaryngologyChildren's Hospital Pittsburgh, PA
Richard M. Rosenfeld, M.D., M.P.H.OtolaryngologySUNY Health Science Center Brooklyn, NY
Leonard B. Weiner, M.D.Pediatrics, infectious diseasesSUNY Health Science Center Syracuse, NY
F. Lane France, M.D.Pediatrics practice & ambulatory medicineTampa Bay Pediatrics Tampa, FL
Judith S. Gravel, Ph.D.AudiologyAlbert Einstein College of Medicine Bronx, NY
Joanne Roberts, Ph.D.Speech-language and audiologyFrank Porter Graham Child Development Center Chapel Hill, NC
Tony Arboleda, M.D.Health planMedPartners Medical Group Burbank, CA
Janice Goertz, R.N.,CPNPNurse practitionerPortage, MI
Jennifer Postley, B.A.ConsumerFamily Voice Los Angeles, CA
Upon receiving nominations from the agencies, 11 technical experts were identified to serve on the panel consisting of two family physicians, two otolaryngologists, two pediatricians (one specializing in ambulatory care and the other in pediatric infectious disease), one audiologist, one speech pathologist, one managed-care representative, one nurse practitioner, and one consumer. Table 1 lists the membership of the Technical Expert Panel.

Topic Assessment and Refinement

A draft workplan for the topic assessment and refinement phase was mailed to the technical experts and partners for review and comments. Two conference calls among all technical experts, partner liaisons, project staff, and the Task Order Officer were held to review data on existing literature, refine the causal pathway, specify patient populations and practice settings, and refine the key questions to be addressed in the evidence report. The conference calls were chaired by the Principal Investigator and were attended by all principal project staff, the technical experts, and the AHRQ Task Order Officer. Reference materials -- including a review of the existing literature, causal pathways, conceptual framework, and a list of potential questions -- were mailed to all participants prior to the calls.

The project staff compiled a summary of information on:

  • The incidence and prevalence of AOM, treatment and management alternatives, characteristics and size of the affected populations, and the most affected practice settings and providers.

  • The burden of illness associated with AOM, including morbidity, mortality, impact on developmental milestones, quality of life, loss of productivity, medical costs to treat the condition, and other economic costs or burdens associated with the condition.

  • The extent to which there is variation in practice associated with the prevention, diagnosis, treatment, or management of AOM.

Further, we reviewed and compiled a summary of six meta-analyses on otitis media that already had been conducted. Both summaries were distributed to the technical experts between the first and second conference call. The project staff also examined in detail the OME Guideline Panel's report Managing Otitis Media with Effusion in Young Children. Quick Reference Guide for Clicians (Stool, Berg, Berman, et al., 1994b) for parallel issues in AOM.

Identification of Key Questions

About 2 weeks before the first conference call, the following documents were distributed to the technical experts: (1) the preliminary conceptual framework for management of AOM,(2) the two-page letter nominating AOM as a topic for evidence analysis that was submitted to AHRQ by the three nominating agencies, (3) a list of the key questions included in the Request for Task Order by AHRQ, and (4) the draft workplan for topic assessment and refinement. Each technical expert was asked to submit a list of key questions within a week using the conceptual framework as a guide and to provide comments and any suggestions for revision of the conceptual framework and the draft workplan for topic assessment and refinement. The letter to the technical experts emphasized that not all steps in the framework would be addressed in the evidence report and that only three to five key questions would be selected.

The project staff compiled a master list of proposed key questions that incorporated the key questions submitted by the technical experts. The master list was forwarded to all technical experts and conference call participants and was used as the basis for discussion during the first conference call.

Table 2. Initial seven key questions for ranking by technical experts
Question 1: On the Natural History of AOM. What clinical characteristics (history, symptoms, physical findings) of children are associated with rapid improvement and with prolonged duration of morbidity during an episode of (uncomplicated) acute otitis media (AOM) that is initially managed WITHOUT antibiotics in terms of:
  1. Resolution of pain and/or fever at 24 hours, 2-3 days, and 4-7 days?

  2. Complete clinical resolution, excluding middle ear effusion (MEE), at 7-14 days?

  3. Prevalence of asymptomatic MEE at 2 weeks, 1 month, and 3 months?

  4. Incidence of acute suppurative complications (e.g., mastoiditis)?

Question 2: On Definition and Physician Diagnosis of AOM. How accurate is physician/health care provider diagnosis of acute otitis media?
  1. What is the definition of AOM or the criteria by which AOM is diagnosed?

    1. Is middle ear effusion a diagnostic standard for the diagnosis of AOM?

    2. Is inflammation of the tympanic membrane a diagnostic standard for the diagnosis of AOM?

    3. Is the presence of acute local or systemic symptoms a diagnostic standard for the diagnosis of AOM?

  2. What is the gold standard for establishing the diagnosis of AOM?

  3. Is it possible to improve the diagnostic accuracy of physicians and other health care providers in identifying AOM? Reduce false-positive diagnoses?

  4. What is the value or utility of parental involvement in diagnosis, for example, with home diagnostics such as acoustic reflectometry or otoscopy, compared with diagnosis without such parental involvement?

Question 3: On Antibiotic Treatment of AOM. Are antibiotics (compared to placebo) effective (in terms of statistical significance and magnitude of absolute clinical benefit above and beyond natural history) in treatment of AOM with respect to the following outcome indicators:
  1. Resolution of pain and/or fever at 24 hours, 2-3 days, and 4-7 days?

  2. Complete clinical resolution, excluding middle ear effusion (MEE), at 7-14 days?

  3. Prevalence of asymptomatic MEE at 2 weeks, 1 month, and 3 months?

  4. Incidence of acute suppurative complications (e.g., mastoiditis)?

To what degree is selective initial use of antibiotics for (uncomplicated) AOM attributable to:
  1. Clinical characteristics, including hearing and/or speech delay?

  2. Age of the child?

  3. Provider degree of diagnostic uncertainty for true AOM?

  4. Parent reliability (low vs. high) to report symptom resolution or progression at 48-72 hours if antibiotics are initially withheld?

  5. Parent preference concerning antibiotic therapy?

  6. Parent education?

Question 4: On Antibiotic Regimen for AOM. Does the specific antibiotic regimen make a difference?
  1. (Antibiotic class) Are antibiotics with broader coverage than amoxicillin or trimethoprim sulfa more cost-effective or cost-beneficial in the initial treatment of AOM?

  2. (Antibiotic class) Should antibiotic selection be determined on the basis of local or regional bacterial resistance pattern?

  3. (Antibiotic class) What is the utility of fluoroquinolones in treatment of AOM in childhood? What are the side effects?

  4. (Dose of antibiotic) What is the value of using 60-80 mg/kg/d of amoxicillin or amoxicillin-clavulanate vs. the standard 40 mg/kg/d? (Schedule of antibiotic) Is twice-a-day high-dose amoxicillin therapy as effective as three times a day amoxicillin therapy in the initial treatment of AOM?

  5. (Schedule of antibiotic) Is twice-a-day high-dose amoxicillin therapy as effective as three times a day amoxicillin therapy in the initial treatment of AOM?

  6. (Length of treatment) What is the comparative efficacy of short- vs. long-term antibiotic therapy in children younger than 2 years of age and those older than 2 years of age?

  7. Is the use of a single injection of ceftriaxone or the use of other cephalosporin for treatment of AOM more or less likely than 7-10 days of oral amoxicillin to predispose to creation of a penicillin/cephalosporin-resistant pneumococcal nasopharyngeal flora? Does the risk-benefit justify the use of a single injection of ceftriaxone?

  8. How long after an antibiotic is used is it reasonable for it to be used again to treat AOM in terms of reducing the likelihood of developing resistance to antibiotics?

Question 5: On Non-Antibiotic Pharmaceutical Treatment of AOM. What is the effectiveness (or cost-effectiveness) of non-antibiotic treatments of AOM?
  1. Do any of the new nonsteroidal anti-inflammatory drugs hasten the resolution of AOM or decrease the incidence or duration of subsequent otitis media with effusion?

  2. Do oral and/or topical analgesics reduce the duration of pain in AOM?

  3. Do anti-inflammatory nasal sprays, such as cromolyn or beclomethasone, for relief of allergic rhinitis reduce the incidence of AOM?

Question 6: On Followup Strategies. What are the appropriate (and/or cost-effective) clinical followup strategies (including type, schedule, and frequency of strategies) for children with AOM?
  1. Is the effectiveness of followup dependent on age group?

  2. Is the effectiveness of followup dependent on clinical severity (single episode of AOM, recurrent AOM, persistent AOM)?

  3. Is the effectiveness of followup dependent on clinical characteristics (e. g., do children with speech-language delay or developmental delay have better outcomes with more intense followup)?

  4. Is the effectiveness of followup dependent on parent characteristics (including compliance)?

What are the indications for change in therapy at followup if followup is effective in improving outcomes in children with AOM?
  1. Does tympanocentesis in children with AOM who are still symptomatic after 48 or 96 hours of treatment lead to a change in therapy that improves outcomes?

  2. Does audiometry during followup lead to a change in therapy that improves outcomes?

Question 7: On Prevention of AOM. What is the role of each of the following preventive strategies in managing sporadic or recurrent AOM?
  1. Do vaccines reduce the occurrence of AOM?

  2. Do risk-factor modification measures (interruption of secondhand smoke exposure, hygienic measures) reduce the occurrence of AOM?

  3. Do prophylactic antibiotics reduce the occurrence of AOM?

  4. Do surgical procedures such as tympanostomy tube insertion and adenoidectomy reduce the occurrence of AOM?

  5. Do anti-inflammatory nasal sprays, such as cromolyn or beclomethasone, for relief of allergic rhinitis reduce the incidence of AOM?

AOM=acute otitis media; MEE=middle ear effusion.

During the first conference call, many suggestions for revisions, additions, and deletions were made. The taped conference call was reviewed by the Task Order Manager during revision of the key questions. The project staff incorporated the suggestions and compiled a new set of seven key questions for ranking by the technical experts (Table 2).

The new set of seven key questions -- together with a form to record rankings, the summary of information on the incidence, alternatives for treatment, and impact/costs of AOM; the summary of published meta-analyses; and preliminary counts of citations by key questions -- was sent to the technical experts about 1 week before the second conference call. The technical experts were advised to use the background materials as references to rank five of the seven key questions, using "5" as the most important and "1" as the least important. The main criteria to be used in ranking were importance and feasibility. Importance was to be determined by the potential impact on the outcomes associated with the management of AOM. The importance of a question might be diminished if a recent evidence analysis of high quality already existed. Feasibility was determined by the availability of published studies and the time required to complete the evidence analysis for that question. Technical experts were asked to submit the ranking to the Task Order Coordinator before the second conference call.

Table 3. Rankings of initial key questions by technical experts
Technical ExpertKey Question for Ranking
Q1 Natural HistoryQ2 Definition and DiagnosisQ3 Antibiotic vs. No AntibioticQ4 Antibiotic RegimenQ5 Non-Antibiotic TreatmentQ6 Followup StrategyQ7 Prevention
T15430012
T24325100
T31054032
T45012034
T55012034
T65423010
T73041052
T82154030
T90540123
T103152400
T110524031
Total Rank3323342762418

Note: The technical expert numbers were assigned randomly and do not correspond to the listing order.

A summary of the rankings by the technical experts is presented in Table 3. The top-ranked question was Question 3 on antibiotic treatment with 34 rank points, followed closely by Question 1 on natural history with 33 points, and by Question 4 on antibiotic regimen with 27 points. The next two questions were Question 6 on followup strategy and Question 2 on definition and diagnosis with 24 and 23 points, respectively. The last two questions were Question 7 on prevention and Question 5 on non-antibiotic treatment with 18 and 6 points, respectively. An analysis of the rankings showed significantly diverse opinions of the experts on the importance of the key questions (Kendall coefficient of concordance is 0.21, p=0.03). A review of the ranking pattern of the experts revealed that the experts strongly agreed on the importance of Questions 3 (antibiotic treatment) and 1 (natural history) and on the least importance of Question 5 (non-antibiotic treatment), but their opinions varied with respect to the other questions. The scoring of Question 2 on definition and diagnosis was particularly polarized with four technical experts ranking it 4 or 5 and four technical experts not ranking it at all.

Table 4. Final version of the three key questions
Question 1: On the Observational or No Treatment or Natural History of AOM.
  1. During an episode of uncomplicated acute otitis media (AOM) that is initially managed WITHOUT any active intervention (pharmacologic or surgical) other than topical or systemic medications (that do not contain antibiotics) given for symptomatic relief (e.g., analgesics, antipyretics, antihistamines, decongestants, ear or nose drops), what proportion of children have the outcomes delineated in the Scope of the Evidence Report?

  2. To what degree are the above outcomes attributable to the influencing factors delineated in the Scope of the Evidence Report?

Question 3: On Antibiotic Treatment of AOM.
  1. Are antibiotics effective (in terms of statistical significance and magnitude of absolute clinical benefit above and beyond placebo/observational/no treatment/natural history) in the initial 1 treatment of uncomplicated AOM with respect to the outcomes delineated in the Scope of the Evidence Report?

  2. When antibiotics are used in the initial 1 treatment of uncomplicated AOM, which of the influencing factors delineated in the Scope of the Evidence Report are associated with better outcomes compared with placebo/observational/no treatment/natural history?

Question 4: On Antibiotic Regimen for AOM. Does the specific antibiotic regimen make a difference?
  1. (Antibiotic class) Is treatment with antibiotics other than amoxicillin or trimethoprim sulfa more effective or result in lower total cost in the initial 1 treatment of uncomplicated AOM?

  2. (Antibiotic class) What is the utility of oral fluoroquinolones in the initial 1 treatment of uncomplicated AOM in childhood? What are the side effects?

  3. (Dose of antibiotic) What is the value of using > 60 mg/kg/d of amoxicillin or amoxicillin-clavulanate vs. the standard 40 mg/kg/d in the initial 1 treatment of uncomplicated AOM?

  4. (Schedule of antibiotic) Is twice a day high-dose amoxicillin therapy as effective as three times a day amoxicillin therapy in the initial 1 treatment of uncomplicated AOM?

  5. (Length of treatment) What is the comparative effectiveness of short- vs. long-term antibiotic therapy in children younger than two years of age and those older than two years of age in the initial 1 treatment of uncomplicated AOM?

1

An episode of uncomplicated AOM may be considered distinct from a previous episode of AOM and eligible for "initial" treatment if the most recent course of antibiotic ended 4 weeks prior to the episode of AOM in question or if there is documentation by an examiner that a prior episode of AOM has been cleared.

During the second conference call, the ranking of the key questions was discussed. The project team proposed to work on the first three ranked questions for this evidence report as they were related to a single theme. Some discussions took place regarding the importance of the other questions, especially those on prevention and diagnosis. Due to the time limit of the study, the group decided to focus only on the set of three questions dealing with antibiotic treatment: Key Questions 1, 3, and 4 (Table 4).

Several issues were brought up during the discussion and were addressed during the revision of the key questions and the drafting of the causal pathways:

  • One issue related to the difference between "natural history of acute otitis media when nothing is done, including not seeking care from the health care provider" and "observational treatment prescribed by the health care provider." It was decided that the issue brought up an important point, and Question 1 was retitled to reflect this fact.

  • Another issue concerned the real objective of Question 3b. The technical experts discussed whether it was more important to address the amount of influence of the listed factors on the "selective initial use of antibiotics" or to address the "effectiveness of the initial use of antibiotics." The former is an analysis of the prescribing pattern (which is a process variable), and the latter is an analysis of the effectiveness of initial use of antibiotics (which is an outcome variable). Question 3b was thus reworded to address the impact of these factors on outcome.

  • On the issue of defining uncomplicated AOM, there were several suggestions, including "inflammation of the middle ear cleft" to "one sign and one symptom" to "definitions used by the different studies." The project team decided that a definition and diagnostic criteria had to be established before the study could continue because it would affect the search strategy. The experts were polled to establish the best definition to use for this evidence report. Several of the technical experts felt that we might have to accept whatever definition of AOM was found in any given study because they would be quite disparate; however, the project staff felt it important to establish a standard definition for comparison.

  • Subquestions in Question 4 that addressed complicated AOM rather than uncomplicated AOM were discussed: (4b) Would antibiotic selection based on local or regional bacterial resistance pattern improve the outcome of antibiotic treatment of AOM? and (4h) How long after an antibiotic is used is it reasonable for it to be used again to treat AOM in terms of reducing the likelihood of developing resistance to antibiotics? They were not included because this evidence report was limited to uncomplicated otitis media.

  • The definition of endpoints for the study was discussed. The group decided to leave them open to definitions used by different studies. However, it was decided that it would be important to define the most appropriate endpoints before the literature search and then compare the definitions with those found and/or used in the literature.

  • The next discussion topic was on the age of the child to be included in the evidence report. It was decided to exclude the neonate. Epidemiologically, a neonate is a newborn up to 28 days old. For this evidence report, studies on children between age 28 days and 18 years were included.

  • The following factors that might affect outcomes were added: gender, ethnicity, presence of ear infection in sibling, craniofacial problems, and cost. In addition, based on information from review of literature, project staff added race, sibling(s) in day care, pacifier use, presence of sibling(s), and atopy or allergy. In this report, the term "influencing factors" included both risk factors and effect modifiers that might actually or potentially affect the outcomes.

Identification of Causal Pathways, Study Populations, Practice Settings, and Target Audience

Table 5. Causal pathways for key questions
graphic element
Table 6. Preliminary literature search on seven initial key questions
Key QuestionSearch TopicMEDLINE (1966- 1998)
Natural HistoryAOM and natural history or untreated7
AOM and outcome & process assessment95
AOM and persistent110
AOM and recurrent284
AOM and complications322
Definition & DiagnosisAOM and blood, microbiology, csf, classification, cytology, parasitology, diagnosis, radiography, radionuclide imaging, urine, virology525
AOM and sensitivity/specificity/false-negative/false-positive/predictive/likelihood/randomized controlled trial/blinded methods468
AOM and diagnosis/diagnostic techniques and procedures/laboratory techniques498
AOM and sensitivity/specificity/predictive value/likelihood63
AOM and medical history taking5
AOM and physical exam39
AOM and tympanogram29
AOM and tympanocentesis93
AOM and acoustic reflectometry9
AOM and diagnostic techniques otological124
AOM and otoscopes/otolaryngology (MeSH 1998+)5
AOM and decisionmaking/judgment/problem solving/decision support techniques/physician's practice patterns/referral and consultation/evidence-based medicine45
Antibiotic TherapyAOM and antibiotics790
Non-Antibiotic TherapyAOM and steroids22
AOM and analgesics29
AOM and antihistamines/decongestants44
AOM and tympanostomy/middle ear ventilation/tympanostomy/tube insertion111
Followup StrategyAOM and combination of therapies and followup studies77
PreventionAOM and antibiotic prophylaxis/preventive medicine/immunoprophylaxis136
Review Articles
GeneralAOM and review articles and human and English172
Cost 1AOM and cost 152
Meta-analysisAOM and meta-analysis27
AOM and information synthesis (meta-analysis, decision analysis, cost effectiveness analysis, cost-benefit analysis)29
Incidence/PrevalenceAOM and incidence/prevalence251 (1966- 1998)
148 (1987- 1998)
Randomized Control Trials (RCTs)
RCTAOM and RCT as publication type198 (1966- 1998)
129 (1987- 1998)
AOM and RCT (very broad strategy)617 (1966- 1998)
441 (1987- 1998)

1 From HealthSTAR, 59 citations from 1966- 1998.

In preparation of the second conference call with the technical experts and partners, a draft of the contents necessary to develop causal pathways for the key questions was distributed. Based on the discussion with the technical experts and the common theme of the three key questions, the project staff proposed a definition for AOM, developed a causal pathway for the key questions (Table 5), and specified the scope of each domain to be addressed in the evidence report. A preliminary search of MEDLINE also was conducted and summarized (Table 6) according to the initial seven proposed key questions. The information was provided to the technical experts to assist them with their ranking of the key questions.

The three key questions, definition of AOM, and the scope of the evidence report have gone through several revisions as a result of conference discussions and polling. The initial and revised versions of these three documents are included in Appendices C, D, and E, respectively.

During the second conference call, the technical experts provided input regarding the patient populations, practice settings, and target audience for the evidence report. The study population included all children between 28 days and 18 years with uncomplicated AOM. The interventions of interest included placebo or observation with no treatment or antibiotic treatment. Influencing factors included demographic, environmental, clinical, pharmaceutical, and cost factors. All health care settings and types of providers were included. The endpoints of the study included four short-term and four long-term indicators. Short-term indicators at 48 hours included disappearance of signs (discharge, inflammation of the tympanic membrane), symptomatic relief of pain and/or fever, resolution of acute suppurative complications, and complete clinical resolution (except middle ear effusion). Long-term indicators at 3 months included absence of asymptomatic middle ear effusion, resolution of suppurative complications (e.g., mastoiditis), absence of speech and/or hearing problems, and absence of recurrence of AOM.

Refinement of Key Questions, Definition of AOM, and Scope

Table 7. Technical expert's responses to four issues related to definition of acute otitis media January 7, 1999
Expert Number
1234567891011
1. Definition of Rapid Onset:
(a) Within 48 hoursxx.xxxx.xxx
(b) Within 7 days.......x...
(c) Other (72 hours)..x........
2. GI symptoms to be included?
(a) Yes..xx 2.......
(b) Nox 1x..xxxxxxx
3. Hearing loss included?
(a) Yesx.x..x.xx 5x 5x
(b) No.x.x 3x.x 4.x 5x 5.
4. The two signs for MEE
(a) Agreex 6xx 7.xx.xx 10x 10x
(b) Disagree...x 8..x 9....

Notes:

x Answer checked by expert.

1

GI findings can occur, but to have rapid onset of GI findings and an abnormally colored ear doesn't make it for me.

2

GI symptoms should be included on the list because they may be the only manifestation of acute illness in an infant or young child. Anorexia (secondary to nausea) and vomiting may be direct vestibular manifestations of middle ear infection or fluid. Diarrhea is not as easy to justify, and if the panel feels strongly about removing diarrhea from the symptom list I have no objection. Be aware, however, that "traditional" AOM definitions have always included diarrhea as a qualifying symptom.

3

Hearing loss is a manifestation of middle ear effusion, not acute infection. Further, not all middle ear fluid is accompanied by hearing loss, and not all hearing loss caused by middle ear fluid is readily perceptible to parents or clinicians. Traditional AOM definitions have never included hearing loss as a qualifying symptom.

4

Anyone with AOM will have hearing loss at diagnosis.

5

We are concerned about including hearing loss as a clinical finding. First, it is highly unlikely that a formal audiologic evaluation would be administered when a child presents to the physician with acute OME. Clinical symptoms (fever, irritability, otorrhea, otologia) could prevent a reliable hearing test (audiogram and tympanogram) from being obtained. During the course of the episode when the acute clinical symptoms had subsided, an audiologic evaluation would be more appropriate. Second, without a direct measure of hearing (that is, obtaining an audiogram) there is no way to determine if hearing loss exists. Parent report has been demonstrated to be a highly inaccurate means of detecting hearing loss (Rosenfeld et al.). Further, we are not uncertain if studies examining hearing loss and OM have specifically examined hearing loss during AOM. However, if hearing loss stays in as a clinical finding, please delete "older children." Hearing loss, when present, occurs in both young children as well as older children, and can be reliably assessed in infants and young children. Therefore, hearing loss would be a clinical finding regardless of the age of the child.

6

Need to clarify one or both signs.

7

Change 3(b) to full or bulging with red or white opacification.

8

Middle ear fluid with AOM generally manifests as a full or bulging tympanic membrane, which is opaque and has limited or absent mobility to pneumatic otoscopy. Changes in tympanic membrane color are NOT indicative of effusion. Changes in lucency are also NOT indicative, unless accompanied by reduced mobility.

9

Suggest that OME and inflammation with changes go under part two.

10

We agree with the addition with of the two clinical signs, but suggest that position of the TM (e.g., bulging, retracted) be included as a third clinical sign (Karma Penttila, Sipila, et al., 1989).

More Comments on Definition of Acute Otitis Media
Comment 1: I continue to be troubled by the AOM definition as it seems to confuse the terms "symptom" & "sign."
To clarify:Symptom - change in normal function
Sign - physical finding, evidence
Specifically, the current AOM definition (12/23) seems to mix signs & symptoms in items #2 & 3. Symptoms would include ear pulling, irritability, otalgia (subjectively) & hearing loss (subjectively), while signs include otalgia, otorrhea, fever, and hearing loss (objectively). Also, the basic elements which define inflammation (e.g., redness, pain, fever, swelling) are not consistently addressed in the present definition.
Comment 2: Revised proposed AOM definition. I still have some problems with the wording. As noted in a prior e-mail, I recommend the following definition:
"Acute otitis media is defined as: 1) signs of middle-ear effusion (new onset or pre-existing) accompanied by 2) rapid and short onset (within 48 hours) of clinical findings including one or more of the following: otalgia (ear pulling in an infant), otorrhea, fever, irritability, anorexia, vomiting, or diarrhea."
In contrast to your proposed definition, the one above puts emphasis on middle-ear effusion (by placing it first) and eliminates ambiguity about middle-ear effusion duration (your definition implies recent onset, yet AOM can develop on a pre-existing effusion of long duration).
Table 8. Questionnaire to poll technical experts on four unresolved issues related to definition of AOM, key questions and scope
  1. In the definition of AOM, should we add "excluding retracted tympanic membrane" to statement (1)? That is, would you prefer to state AOM is defined as (1) presence of middle ear effusion as indicated by limited or absent mobility of the tympanic membrane, excluding retracted tympanic membrane, with or without....?"

Yes___No___No preference___
Comments:
  • 2

    In the definition of AOM, the majority of you defined rapid onset as "within 48 hours." Now we need to define the beginning and end points of the 48-hour period. Please write down the beginning and end points to define rapid onset. (e.g., Rapid onset is defined as less than or equal to 48 hours from the time the acute signs or symptoms -- otalgia, otorrhea, irritability, or fever -- were first noticed by the parent to the time the parent first contacted the physician's office, whether by phone or in person.)

  • 3

    In the key questions, we need to define "initial treatment" or "initially managed." We are proposing the following options: [circle (a), (b), and/or (c)]

a)An episode of uncomplicated AOM may be considered distinct from a previous episode of acute otitis media and eligible for "initial treatment" if the most recent course of antibiotic ended 2 weeks prior to the episode of AOM in question.
b)An episode of uncomplicated AOM may be considered distinct from a previous episode of AOM and eligible for "initial treatment" if the most recent course of antibiotic ended 4 weeks prior to the episode of AOM in question.
c)An episode of uncomplicated AOM may be considered distinct from a previous episode of AOM and eligible for "initial treatment" if there is documentation by an examiner that a prior AOM has been cleared.
Comments:
  • 4

    One of the influencing factors in the scope is "otitis prone," which is used to replace "prior history of recurrent AOM" and "multiple previous episodes." How would you define "otitis prone"? [circle one]

a)> three episodes in 6 months or > four episodes in 12 months
b)Other (please specify and write rationale)
Table 9. Technical expert's responses to four unresolved issues1 related to definition, key questions, and scope
ExpertIssue 1Issue 2Issue 3Issue 4
1Yes<=48 hours from point signs/symptoms noted by parent and health system contacted 4ba
2Yes<=48 hours from point of initial signs/symptomscfour episodes in 12 months
3Yes<=48 hours from point signs/symptoms noted by parent and health system contacteda and ca 7
4No<=48 hours from point signs/symptoms noted by parent and health system contactedb 6 and ca 8
5No preference 2<=48 hours from onset of acute signs or symptoms until diagnosis confirmed by practitionerb and ca
6Yes<=48 hours from point signs/symptoms noted by parent and health system contactedb and ca
7No 3<=48 hours from point signs/symptoms noted by parent and health system contacted5ba
8No<=48 hours from point signs/symptoms noted by parent and health system contactedaa
9No preference<=48 hours from point signs/symptoms noted by parent and health system contactedca
10Yes<=48 hours from point signs/symptoms noted by parent and health system contactedca
1

Issues: Issue 1: In the definition of AOM, should we add "excluding retracted tympanic membrane" to statement (1)? Issue 2: In the definition of AOM, the majority of you defined rapid onset as "within 48 hours..." Please write down the beginning and end points to define rapid onset. Issue 3: In the key questions, we need to define "initial treatment" or "initially managed." We are proposing the following options [circle (a), (b), and/or (c)]: (a) An episode of uncomplicated AOM may be considered distinct from a previous episode of AOM and eligible for "initial treatment" if the most recent course of antibiotic ended 2 weeks prior to the episode of AOM in question. (b) An episode of uncomplicated AOM may be considered distinct from a previous episode of AOM and eligible for "initial treatment" if the most recent course of antibiotic ended 4 weeks prior to the episode of AOM in question. (c) An episode of uncomplicated AOM may be considered distinct from a previous episode of AOM and eligible for "initial treatment" if there is documentation by an examiner that a prior AOM has been cleared. Issue 4: One of the influencing factors in the scope is "otitis prone," which is used to replace "prior history of recurrent AOM" and "multiple previous episodes." How would you define "otitis prone?" [circle one]: (a) three episodes in 6 months or four episodes in 12 months; (b) other (please specify and write rationale).

2

"I remain troubled by the definition. For example, a child with stable OME who develops febrile rotavirus diarrhea meets the definition (whether they have any of the 1) a, b, or c findings). I'm not sure how that can work."

3

"Unless there is evidence to support its use in diagnosis, remove acoustic "reflectometry" from Definition as well as in Scope of the Evidence Report: Monitoring during episode. (See section on acoustic reflectometry in Clin. Pract. Guideline 12 on OME, Stool, et al., 1994, p. 34-35.)

4

"I always thought 'within 48 hours' referred to the speed of onset, not the duration. If we go with duration, I think your example is fine. If we go with speed, I have a hard time coming up with the right words."

5

"I Agree with above, but change 'physician' to 'examiner' (to include family physician, otolaryngologist, pediatrician, nurse practitioner, PA, etc.)."

6

"AOM within 4 weeks of a prior episode would classify as recurrence."

7

"Patient should also be asymptomatic."

8

"In the context of an 'influencing factor' you may wish to expand this definition to include episodes of OME, not just AOM." "Episodes should also be 'well documented and separate.'"

OME=otitis media effusion.

Each technical expert was mailed a revised proposed definition, revised key questions with rationale, scope of project, and causal pathways and was asked to submit any comments within 2 weeks. The technical experts were polled specifically on four issues related to the definition of AOM that were still unsettled.Table 7 provides a summary of their responses to the four questions, including their specific comments. Based on the comments received, the key questions, definition, and scope were revised further. The next set of their revisions and the reasons for changes are provided in Appendices C.2, D.2, and E.2. These three revised documents were mailed again to the panel of experts for review and further comments, together with a questionnaire (Table 8) polling them on four more issues that were still unresolved. Their responses are summarized in Table 9.

Based on the responses to the unresolved issues, the three documents were revised further. The next set of revisions of the key questions, definition, and scope (Appendices C.3, D.3, and E.3) were distributed to the panel of experts for review and for discussion at the third conference call and resulted in more changes. The final revisions of the three documents are included in Appendices C.4, D.4, and E.4.

The short version of the final definition of AOM is as follows: Acute otitis media is the presence of middle ear effusion in conjunction with the rapid onset of one or more signs or symptoms of inflammation of the middle ear.

The long version of the final definition is as follows:

  • Presence of middle ear effusion as demonstrated by the actual presence of fluid in the middle ear as diagnosed by tympanocentesis or the physical presence of liquid in the external ear canal as a result of tympanic membrane perforation or indicated by limited or absent mobility of the tympanic membrane as diagnosed by pneumatic otoscopy, tympanogram, or acoustic reflectometry with or without the following: (a) opacification, not including erythema, (b) a full or bulging tympanic membrane, or (c) hearing loss, and rapid onset (i.e., up to 48 hours from the onset of acute signs or symptoms first noted by the parent or guardian to the time of contact with the health system) of one or more of the following signs or symptoms, with or without anorexia, nausea, or vomiting: (a) otalgia (or pulling of ear in an infant), (b) otorrhea, (c) irritability in the infant or toddler, or (d) fever.

Literature Search

We conducted the literature search on seven databases: MEDLINE, the Cochrane Library, HealthSTAR, International Pharmaceutical Abstracts (IPA), Cumulative Index to Nursing and Allied Health Literature (CINAHL), BIOSIS, and EMBASE. We also searched for relevant articles in symposiums and reference lists of published articles, reports, and guidelines.

The MEDLINE database is produced by the U.S. National Library of Medicine and is widely recognized as the premier source for bibliographic coverage of biomedical literature. It encompasses information from Index Medicus, Index to Dental Literature, and International Nursing, as well as other sources of coverage in the areas of allied health, biological and physical sciences, humanities and information science as they relate to medicine and health care, communication disorders, population biology, and reproductive biology. The MEDLINE database includes citations and abstracts since 1966.

The Cochrane Library contains several databases: (1) The Cochrane Database of Systematic Reviews containing Cochrane reviews published by the Cochrane Collaboration, an international organization dedicated to applying evidence-based medicine principles to the review of important clinical topics; (2) The Cochrane Controlled Trials Register, which is a bibliographic database of controlled trials; (3) The Database of Abstracts of Reviews of Effectiveness (DARE), which includes structured abstracts of systematic reviews that have been critically appraised by reviewers at the NHS Centre for Reviews and Dissemination in York and by other reviewers (e.g., the American College of Physicians' Journal Club and the journal Evidence-Based Medicine); and (4) The Cochrane Review Methodology Database, which is a bibliography of articles on the science of research synthesis.

The HealthSTAR database contains citations and abstracts (when available) of journal articles, monographs, technical reports, meeting abstracts and papers, book chapters, government documents, and newspaper articles on health services, technology, administration, and research. It focuses on both the clinical and nonclinical aspects of health care delivery. Topics covered include evaluation of patient outcomes; effectiveness of procedures, programs, products, services and processes; and health services research. It is produced cooperatively by the U.S. National Library of Medicine and the American Hospital Association. HealthSTAR replaces the former Health Planning and Administration database. The database includes citations and abstracts since 1975.

The IPA is produced by the American Society of Health System Pharmacists. It provides worldwide coverage of pharmaceutical science and health-related literature. Coverage includes drug therapy, toxicity, and pharmacy practice, as well as legislation, regulation, technology, utilization, biopharmaceutics, information processing, education, economics, and ethics as related to pharmaceutical science and practice. The database currently contains over 300,000 records and includes citations since 1970.

The CINAHL database is produced by CINAHL Information Systems. It provides comprehensive coverage of the English-language journal Literature for Nursing and Allied Health Disciplines. Material from more than 950 journals is included in CINAHL. Also included are health care books, nursing dissertations, selected conference proceedings, standards of professional practice, and educational software. There is selective coverage of journals in biomedicine, the behavioral sciences, management, and education. The database currently contains over 250,000 records. In total, more than 500 journals are regularly indexed; online abstracts are available for more than 150 of these titles. The database includes citations since 1982.

BIOSIS Previews, produced by BIOSIS, is the world's most comprehensive reference database in the life sciences. It covers original research reports and reviews in biological and biomedical areas. Nearly 7,000 serials are monitored for inclusion. In addition, the database covers content summaries, books (including software from 1992 to present), and information from meetings. Content summaries include notes and letters, technical data reports, reviews, U.S. patents from 1986 to 1989, translation journals, meeting reports from 1980 to present, bibliographies, nomenclature rules, and taxonomic keys. The BIOSIS Previews database includes the contents of Biological Abstracts (1969 to present), Biological Abstracts/RRM (1980 to present), and BioResearch Index (1969 to 1979). The BIOSIS database includes citations since 1970.

EMBASE, the Excerpta Medica database produced by Elsevier Science, is a major biomedical and pharmaceutical database indexing more than 3,800 international journals. EMBASE is one of the most widely used biomedical and pharmaceutical databases. The database currently contains more than 6 million records, with more than 400,000 citations and abstracts added yearly. The EMBASE database contains citations since 1980.

The project librarian developed an overall search strategy incorporating the input from the technical experts and following the scope of the project. The initial search strategy was developed for MEDLINE and then customized for the other databases. The MEDLINE search strategy used both controlled vocabulary terms and keywords. The strategy was organized into modules or clusters of search statements. The initial module (called om with sh dt or otitis media with subheading drug therapy) included using what is referred to as an "explode" of om, which includes the controlled vocabulary headings om, mastoiditis, om w/effusion, om, suppurative with the subheading drug therapy. The next module (called om) included the explode of om as well as om as a text word. The anti-infectives module used explode of the mesh heading for anti-infective agents, which includes antibiotics and other drug groups as well as the text words antibiotic, antimicrobial, and antibacterial. The antibiotics module included the names of specific antibiotics previously identified, which were entered as text words. The search involved a combination of the om module with the anti-infectives module and another combination of the om module with the antibiotics module. We also used either the om with dt set or the om with anti-infectives set or the om with antibiotics as a keyword set in the search. From this set editorials, letters, reviews, practice guidelines, consensus development conferences, and case reports were excluded, except when the case report was also a randomized controlled trial or clinical trial. This set was then limited to human or undesignated. In other words, animal studies were excluded. The final set was limited to infant, child, preschool, adolescence, or undesignated. Newborn, adult, middle age, and aged were excluded.

For the search for natural history, natural history, natural course, and untreated were added as keywords. During the third telephone conference with the technical experts, an expert advised adding "spontaneous" and "self-limited" as keywords to the search. Adding these terms, however, uncovered no additional articles.

The first MEDLINE search resulted in 2,284 titles/abstracts. Two subsequent MEDLINE alerts (additions of new articles after the last update) added another 27 titles/abstracts. Additional titles/abstracts included 217 from the Cochrane Library search, 11 from the HealthSTAR search, 88 from the CINAHL search, 248 from the IPA search, 745 from the BIOSIS search, and 2,418 from the EMBASE search. Further screening of and removal of duplicates from BIOSIS and EMBASE resulted in retaining 154 titles/abstracts from BIOSIS and 421 from EMBASE. The search strategy included the following criteria: publication years after 1966, all languages, keywords, human or non-human study, and search hierarchy. The ending date of all searches was March 31, 1999. All databases were searched using the Ovid search system through the World Wide Web with the exception of the Cochrane Library. The files searched included the Cochrane Database of Systematic Reviews, DARE, and The Cochrane Controlled Trials Register.

EndNote software (EndNote Windows Version 3.0, 1st Edition. Niles Software Inc., Berkeley, CA) was used to keep a complete record of all titles/abstracts and to identify duplications. It was able to store, organize, and track references by source (e.g., identified in MEDLINE), search strategy (date of search, index code specifying search criteria used), and a unique identification (UI) code for each article (assigned by source used to find article). Electronic removal of duplicate citations was supplemented by manual cross-checking. In the event an article was identified through an expert panel member or reference checking, the title and author of the reference were entered into MEDLINE through the Ovid search system (Ovid Technologies, Inc. 1998, Version: 7.8 Millennium source ID 1.3932.1.156.1.7, Revision: 1.303.2.8) to determine the UI. If a UI could not be found for the article, an alternate identification code was assigned.

EndNote assigned a record number to each new reference added to the master file. This number would not change once an article was added to the list and was used, in addition to the UI, to sort references for article retrieval and review.

Upon completion of the literature search and duplicate checking, the master list generated from EndNote was exported to a Microsoft Excel spreadsheet for data export for analysis. Codes including status of article retrieval, reviewer, and the results of the review were added.

Review of Retrieved Abstracts Against Screening Criteria

After retrieval of titles and abstracts from the literature search, two physician reviewers reviewed the abstracts against the inclusion/exclusion criteria to determine eligibility for inclusion in the evidence synthesis as defined in the scope and key questions. Titles/abstracts were not masked prior to review. A predesigned screening form (Appendix F) was used to record the reviews. Instructions for screening also were provided (Appendix F). The screening results for each title/abstract were matched between the two reviewers by the Task Order Coordinator. Discrepancies on inclusion or exclusion were resolved in conference among the two reviewers and the coordinator. The data were entered into a Microsoft Excel database from which interrater reliability statistics of agreement and agreement adjusted for chance (kappa statistic) were calculated. Summary reports indicated those abstracts that passed the screening criteria and those that failed, along with the reasons for failure.

Table 10. Preliminary screening results of titles and abstracts from seven databases
SourceTotal Title/AbstractBefore ResolutionAfter Resolution
RejectAcceptUnsureRejectAccept
MEDLINE2,3221,800 (78%)259 (11%)263 (11%)1,931 (83%)391 (17%)
Cochrane Library217161 (74%)46 (21%)10 (5%)163 (75%)54 (25%)
HealthSTAR115 (46%)1 (9%)5 (46%)9 (82%)2 (18%)
CINAHL8879 (90%)1 (1%)8 (9%)83 (94%)5 (6%)
IPA248210 (85%)27 (11%)11 (4%)239 (96%)9 (4%)
BIOSIS15441 (27%)75 (49%)38 (25%)53 (34%)101 (66%)
EMBASE421204 (48%)101 (24%)116 (28%)223 (53%)198 (47%)
All Sources 13,4612,500 (72%)510 (15%)451 (13%)2,701 (78%)760 (22%)

1Citations from each source are not independent.

CINAHL=Cumulative Index to Nursing and Allied Health Literature; IPA=International Pharmaceutical Abstracts.

The results of the screening of titles/abstracts before and after resolution of discrepancies regarding inclusion/exclusion for the seven databases are presented in Table 10. A total of 3,461 titles/abstracts were screened; 2,500 (72 percent) were excluded; 510 (15 percent) were identified for further review; and 451 (13 percent) required resolution. After resolution, 2,701 (78 percent) were excluded and 760 (22 percent) required pulling articles for further review.

Retrieval and Review of Full Articles

The titles/abstracts identified as requiring further review were forwarded to the library for full article retrieval. Libraries at both the Los Angeles County - University of Southern California Medical Center and at the University of Southern California Health Sciences Campus were the primary sources of the articles. Those not found were retrieved through the Inter-Library Loan Program.

Because a large number of titles/abstracts had inadequate information for full evaluation, a second screening with the full articles was conducted. Like the first screening, two physician reviewers independently reviewed each article and filled out a screening form. Articles were not masked prior to review. Discrepancies on inclusion/exclusion were resolved through conference calls.

Table 11. Results of secondary screening of 760 articles
EnglishNon-English
Total Number of Articles Number of Articles obtained, not reviewed Number reviewed Number rejected Number accepted487 0 487 415/487 (85%) 72/487 (15%) 273 176 97 95/97 (98%) 2/97 (2%)
For Rejected Articles: Reason of Rejection R1=Not a study R2=Nonhuman subjects R3=Not on acute otitis media R4=Not in age range of study R5=Study population not in scope R6=Study design not appropriate R7=Not addressing any key questions 1 R8=Duplicate of other studies R9=Data not abstractable, require contacting author415 56 (13%) 2 (0%) 41 (10%) 1 (0%) 0 (0%) 25 (6%) 228 (55%) 28 (7%) 34 (8%)95 19 (21%) 2 (2%) 16 (17%) 11 (12%) 0 (0%) 1 (0%) 37 (39%) 9 (9%) 0 (0%)
For Accepted Articles: Key Questions Addressed (n=74) Key Question 1: Natural History of AOM 2 Key Question 3. Use of Antibiotics 3 Key Question 4a: Amoxicillin or TMP-SMZ 4 vs. others Key Question 4b: Oral fluoroquinolones vs others Key Question 4c: High-dose vs. standard-dose amoxicillin Key Question 4d: Bid vs. tid high-dose amoxicillin Key Question 4e: Short- vs. long-term antibiotic therapy72 10 8 34 0 1 1 352 0 0 0 0 0 0 2
1

163 of the 228 addressed potential key questions.

2

Four articles were added to Key Question 1 after review of references of other articles.

3

One article was added to Key Question 3 after review of references of other articles.

4 TMP-SMZ: trimethoprim-sulfamethoxazole

Table 11 presents the results of secondary screening of the 760 articles that were pulled for review. The 760 articles consisted of 487 in English and 273 in non-English languages. Of the 487 English articles, 415 (85 percent) were further excluded with 72 articles (15 percent) included for quality review and data abstraction. Of the 415 exclusions, 56 (13 percent) were rejected because they were not research studies (R1), 2 (0.5 percent) were nonhuman studies (R2), 41 (10 percent) did not address the problem of AOM (R3), 1 was not in the study age range (R4), 25 (6 percent) did not use the appropriate study design (R6), 228 (55 percent) did not address any of the key questions (R7), 28 (7 percent) were duplicate studies, and 34 (8 percent) required contact with the investigators for further data breakdown or for abstracts (R9).

Of the 72 English articles eligible from the electronic search, 10 addressed the natural history question (Key Question 1), 8 addressed the use of antibiotic question (Key Question 3), 34 addressed the comparison of amoxicillin or ampicillin with other antibiotics (Key Question 4a), none addressed the comparison of oral fluoroquinolones with other antibiotics, 1 addressed the comparison of high dose vs. standard dose of amoxicillin, 1 compared twice a day vs. three times a day of amoxicillin, and 35 compared short-term versus long-term antibiotic therapy.

Table 12. Distribution of 273 non-English articles by language
LanguageFirst Batch 1 N=2,875Second Batch 2 N=585Total
Japanese2279101
French171229
German141024
Russian13316
Italian61622
Spanish41721
Danish7310
Portuguese1910
Polish808
Dutch426
Swedish303
Norwegian202
Romanian202
Czech011
Finnish101
Hebrew101
Turkish011
Ukrainian101
Unknown14014
Total120153273
1

First batch included MEDLINE, Cochrane, IPA, CINAHL, and HealthSTAR.

2

Second batch included BIOSIS and EMBASE.

Table 13. Results of reviewing 97 non-English articles
LanguageNumber Articles ReviewedRejectAcceptR1R2R3R4R5R6R7R8R9
Japanese2020041276
French17152211101
German13130544
Italian5501112
Spanish440112
Russian131302524
Danish770115
Polish880116
Dutch33012
Swedish330111
Norwegian22011
Romanian1101
Hebrew1101
Total979522021611379

Reason for Rejection:

R1=Case report/editorial/letter/clinical practice/overview/practice guidelines/consensus statements

R2=Nonhuman subjects

R3=Study condition NOT acute otitis media

R4=Not within age range of study

R5=Study population is on immunodeficiencies or craniofacial deficiencies

R6=Study design not appropriate

R7=Not addressing any key questions

R8=Duplicate of other studies in the database

R9=Data not abstractable from article, required contacting author

The distribution of the 273 non-English articles by language is presented in Table 12. It should be noted that of the 273 non-English articles, 120 were from the first batch of articles retrieved from MEDLINE, Cochrane, IPA, CINAHL, and HealthSTAR. The other 153 articles were from the second batch retrieved from BIOSIS and EMBASE. The first batch of non-English articles were reviewed to determine the yield of eligible articles. Non-English articles were reviewed by a project member with the assistance of a translator. The results of the review of 97 non-English articles are presented in Table 13. Twenty-three non-English articles were not reviewed from the first batch because 3 were not retrievable, 14 lacked a language designation, and 6 lacked translators.

The screening and review of the 97 non-English articles resulted in the use of 2 articles for one of the key questions, a yield rate of two percent. The results were presented to the Technical Expert Panel during the last conference call and it was decided unanimously that the yield was too low to warrant further screening and review of the second batch of non-English articles.

Finalization of Articles for Inclusion

The last activity in searching for articles was the identification and review of potential articles from references of studies and/or articles. The tables of contents from the second to sixth Proceedings of the International Symposium on Recent Advances in Otitis Media were screened by the literature reviewer, and a total of seven articles were retrieved for review of potential inclusion. This process yielded the inclusion of one additional article (Ostfeld, Segal, Kaufstein, et al., 1988) for Key Question 1. The screening of references of other articles, also by the literature reviewer, resulted in the retrieval and review of another 23 articles, 5 of which addressed the key questions. Among the five, articles by Townsend (1964), Thalin, Densert, Larsson, et al. (1986), and Bollag and Bollag-Albrecht (1991) were added to the articles for Key Question 1. The Thalin, Densert, Larsson, et al. (1986) article also was added to the articles for Key Question 3. The Howie and Owen (1987) study was added to the list of articles for Key Question 4a, and the article by Stickler, Rubenstein, McBean, et al. (1967) was added to the list for Key Question 4e.

Further review of articles found that the article by Cohen, de La Rocque, Boucherat, et al. (1997) in French reported results of the same study as the article by Cohen, Bingen, Varon, et al. (1997) in English except that different outcomes were reported. Based on the peer reviewers' comments on the draft evidence report, the study by van Buchem, Peeters, and van't Hof (1985) was added to the list of studies addressing the natural history question. Three Dutch and three Danish articles were reviewed with the assistance of translators; no additional articles were found for inclusion. Three of the six articles were duplicates of the English-language articles that already had been reviewed. Two of these were review articles and one was not retrievable.

Combining all the sources, including the electronic databases, searches of reference lists, and peer reviewers' comments, a total of 80 studies in 85 articles were included in answering the key questions. Of the 80 studies, 74 were randomized controlled trials and 6 were observational cohort studies; 15 addressed Key Question 1, 8 addressed Key Question 3, 35 addressed Key Question 4a, none addressed Key Question 4b, 1 each addressed Key Questions 4c and 4d, and 36 addressed Key Question 4e.

The remaining 680 articles that were not included in addressing the key questions in this evidence report are listed in the bibliography.

Review and Assessment of Study Quality

The criteria for the assessment of study quality were established prior to the review of articles. The criteria developed by Jadad, Moore, Carroll, et al. (1996) were used to evaluate the quality of randomized controlled trials. The Jadad score had a range of 0 to 5. For a given study, 1 point was awarded if it was randomized, 1 point if it was double-blind, and 1 point if it described withdrawals and dropouts. An extra point was awarded if the method of randomization and/or double-blinding was appropriate; conversely, one point was subtracted if the method was inappropriate. The criteria used to evaluate the quality of cohort studies and case-control studies were based on the work by the McMaster University Group (Sackett, 1981; Trout, 1981; Tugwell, 1981). The quality of cohort studies was evaluated against eight components, which included presence or absence of a clear definition of the study cohort, an early inception point, a clear pathway of patient entry, complete followup, description of dropouts, objective outcome criteria, "blind" outcome assessment, and adjustment for extraneous factors. An Article Quality Review Form (Appendix G.1) was developed. The quality of definition of AOM was evaluated using the three components of the proposed definition established by the Technical Expert Panel: middle-ear effusion, rapid onset, and signs/symptoms of inflammation. The form collected data on the study design, the key questions and subquestions being addressed, quality of definition of AOM, and quality of study. Instructions also were prepared for reviewing the quality of articles and completing the quality review form (Appendix G.2).

Quality reviews were carried out in the same manner as the screening of articles for inclusion/exclusion. Articles were not masked prior to review. Two physician reviewers independently evaluated the quality of the articles and filled out the quality review forms. The Task Order Coordinator matched the reviews of the two reviewers and resolved minor discrepancies. Conferences were held to resolve discrepancies whenever needed. During these meetings, participants determined the disposition of each article in terms of eligibility for inclusion into analysis and finalized resolutions for all items.

Data Abstraction

Of the articles eligible for inclusion in the Evidence Report, data abstraction was carried out by two physician reviewers. Data abstracted included parameters necessary to define study groups, inclusion/exclusion criteria, influencing factors, and outcome measures to be used in analysis. A sequential resolution strategy was used to match and resolve the screening and review results of the two reviewers. Telephone conferences were held among the two reviewers and the Task Order Coordinator, who was a health services researcher, to resolve discrepancies and refine instructions. The data abstraction form used is included in Appendix H.

Procedures to Reduce Bias, Enhance Consistency, and Check Accuracy

The following procedures were used to minimize biases:

  • Two physician reviewers screened and reviewed titles/abstracts and full articles in every stage of the selection process to reduce selection bias. Their percentage of agreement on inclusion/exclusion was 90 percent.

  • Completeness of the retrieved articles was assessed by cross-checking with studies used in other meta-analyses and references listed in review articles. EndNote was used to check batches of articles added to the master list for duplication. The software checked for duplicate references by comparing author, year, title, and reference type. Following the importation of the first literature search, subsequent references were examined for duplication using this EndNote feature prior to their addition to the master list. After the master list was completed, a second check was performed to ensure there were no duplicate entries. This was done manually by scanning the master list after sorting by author and title.

  • Multiple sources and unpublished material identified by the expert panel and internal content experts were searched. Funnel plots -- scatter plots of sample size vs. the estimated effect size from each study -- were studied to assess the extent of publication bias. When publication bias existed, a "bite" would be taken out of the funnel plot, typically at the null effect level.

  • To reduce bias in the assessment of study quality, explicit preset criteria by Jadad, Moore, Carroll, et al. (1996) were used for study quality. Inter-rater reliability was used to assess the extent of bias in assessing study quality. Because of time and resource constraints, original authors were not contacted for additional information regarding study quality and reporting.

The mechanisms used to enhance consistency include the use of predesigned forms with explicit instructions and continuous and prompt resolution of discrepancies. After data collection, each of the variables collected on the data abstraction forms was entered into a Microsoft Excel spreadsheet. Cross-checking of variables for individual studies abstracted by each data collector identified discrepancies, which were then resolved by rechecking the article or consensus. The accuracy of study reviews was checked by using two data extractors who independently collected data from each article, cross-checked data entry by random sampling, and resolved any inconsistencies.

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is f3639_F001.jpg.

   Figure 1. Percent of titles/abstracts requiring resolution over time

Figure 1 displays the trend of consistent improvement in the decrease in the percent of the 23 screened batches of titles/abstracts requiring resolution over time. Twenty-two batches contained 100 abstracts; the last batch contained 84.

Review of Results of Literature Review

Project staff provided the Technical Expert Panel with a summary report from the literature review that included the number of abstracts reviewed, articles retrieved, eligible studies identified, and reasons for exclusion. Their comments on the search strategy and analysis, which were discussed in the third conference call, aided in planning supplemental analyses.

Ranking of Influencing Factors

Table 14. Ranking of 41 influencing factors for analysis by technical experts
Factor ID#Influencing FactorTotal Rank
1Age of child79.0
23Otitis prone73.0
5Attendance at day care center54.5
9Tobacco smoke exposure48.0
25Prior antibiotic use and when used36.0
30Presence of tube35.5
7Feeding mode -- bottle vs. breast25.0
22Middle ear effusion24.0
21Purulent otorrhea21.0
12Otalgia and severity19.5
41Cost of treatment15.0
36Setting (public, private, PPO, HMO, etc.)15.0
24Underlying viral infection14.0
11Season of the year14.0
29Atopy or allergy13.0
19Tympanic membrane inflammation12.0
10Ear infections in parents or siblings12.0
18Hearing loss11.0
20Retracted TM10.0
14Pulling of ear in an infant9.0
16Irritability9.0
32Parent/caretaker preference9.0
17Fever8.5
3Ethnicity/race8.0
26Concurrent use of non-antibiotics6.0
15Otorrhea5.0
2Gender4.0
4Presence of sibling(s)4.0
8Pacifier use3.0
6Sibling(s) in day care center2.0
40Type of method to monitor episode1.0
35Skill to diagnose1.0
38Frequency of monitoring of episode1.0
39Primary person monitoring episode0.0
37When monitoring is done during episode0.0
13Hearing deficit and severity0.0
33Parent/caretaker education0.0
27Prior hearing deficit0.0
34Type of examiner0.0
28Inability to express symptoms0.0
31Parent/caretaker availability0.0

HMO=health maintenance organization; PPO=preferred provider organization; TM=tympanic membrane.

In preparation for the supplemental analysis, another poll was taken among the technical experts to prioritize the 41 influencing factors identified in the analytical framework. The Technical Expert Panel was asked to rank the top 10 influencing factors using the scale of 1 to 10, 10 being the most important influencing factor that should be used to further stratify supplemental analysis. Based on the total score of the 11 experts, the two most important risk factors were the age of the child (defined as younger or older than 2 years) and otitis-proneness or otitis-prone state (defined as having had three or more documented episodes of AOM in a6-month period or four or more documented episodes of AOM in a 12-month period). The results of the polling are presented in Table 14.

Preparation of Evidence Tables

An evidence table was prepared for each key question. Each evidence table provides a comprehensive tabular display of data abstracted from the literature, including the name of the first author, year of publication, language of study (if other than English), study design and its quality score, number of components addressed in the definition of AOM (according to the three preestablished criteria by the technical experts), when and where the study took place, inclusion and exclusion criteria, interventions compared, important influencing factors, sample sizes, outcome measures and their definitions, and study results. A total of five evidence tables were prepared and are included in the Evidence Tables section.

Supplemental Analysis

To address Key Question 1 on natural history, project staff analyzed data from the placebo or observational arm of randomized clinical trials, as well as data from nontrials (including prospective and retrospective single or comparative cohort studies). Incidence rates of each outcome indicator at each time point were estimated by pooling data from studies addressing the same patient population. For Key Question 3 on antibiotic use, only randomized controlled trials were used in meta-analysis.

Table 15. Comparisons for key question 3, antibiotics vs. no antibiotics
Question 3:The general principle agreed upon was to separate amoxicillin-clavulanate, penicillin G, penicillin V, erythromycin estolate, triple sulfonamide, and erythromycin estolate-triple sulfonamide from ampicillin/amoxicillin and each other. Penicillin G is oxidized in the stomach and is not well absorbed. Penicillin V does not cover Haemophilus Influenzaewell. Erythromycin estolate is quite different from the other antibiotics. Triple sulfonamide is no longer in common usage.
Comparison
Number of articles
ampicillin or amoxicillin vs. placebo amoxicillin-clavulanate vs. placebo penicillin G plus sulfisoxazole vs. placebo penicillin V vs. placebo erythromycin estolate vs. placebo triple sulfonamide vs. placebo erythromycin estolate-triple sulfonamide vs. placebo
6 1 1 2 1 1 1

The next major factor for consideration in the meta-analyses for each comparison was the outcome variables. A meta-analysis was performed on outcome measures that were considered clinically homogeneous, such as failure rate of antibiotics at 2-7 days. The assumption was that the 2-day failure rate reported in one study was clinically the same as the 7-day failure rate reported in another study.

Further subdivision of the articles within each comparison into subgroups for meta-analysis according to major influencing factors was considered but was not feasible due to the small number of articles. A sensitivity analysis was planned to evaluate the influence of age, otitis proneness, language, time, place, study-design quality, and appropriateness of definition of AOM. This was also not feasible due to the small number of articles in each comparison group.

Table 16. Comparisons for key question 4a: amoxicillin or trimethoprim-sulfamethoxazole vs. other anitibiotics
Question 4: The general principle agreed upon was to compare by individual antibiotic rather than by antibiotic class, spectrum, or pharmacokinetics.
  • penicillin

  • amoxicillin-clavulanate

  • cephalexin

  • cephradine

  • cefuroxime axetil

  • cefaclor

  • loracarbef

  • cefixime

  • ceftriaxone

  • erythromycin estolate

  • clarithromycin

  • clindamycin

  • penicillin V and sulfisoxazole

  • triple sulfonamide

  • penicillin G plus triple sulfonamide

  • erythromycin ethylsuccinate-sulfisoxazole

  • erythromycin ethylsuccinate-acetyl sulfafurazole

  • oxytetracycline and procaine penicillin plus benzathine penicillin G injection plus sulfisoxazole

3 0 2 1 2 5 1 5 3 2 2 1 2 1 1 1 1 1
Trimethoprim-sulfamethoxazole vs.Number of Articles
  • amoxicillin-clavulanate

  • cephalexin

  • cephradine

  • cefuroxime axetil

  • cefaclor

  • loracarbef

  • cefixime

  • ceftriaxone

  • erythromycin estolate

  • erythromycin ethylsuccinate

  • clarithromycin

  • clindamycin

  • penicillin-sulfisoxazole

  • triple sulfonamide

  • erythromycin ethylsuccinate-sulfisoxazole

  • erythromycin ethylsuccinate-acetyl sulfafurazole

1 0 0 0 3 0 1 0 0 0 0 0 0 0 0 0
Table 17. Comparisons for key question 4e: short-term vs. long-term antibiotic therapy
Question 4e:The general principle agreed upon was to compare by individual antibiotic stratified by therapy duration < 5 days vs. 5 days.
  • amoxicillin (<5d) vs. amoxicillin (7-10d)

  • penicillin V (<5d) vs. penicillin V (7-10d)

  • penicillin V (5d, either 25mg/kg/d or 50 mg/kg/d) vs. penicillin V (7-10d)

  • benthazine penicillin G/procaine penicillin G/potassium penicillin G (Bicillin) (1 dose) vs. tetracycline (7-10d)

  • benthazine penicillin G/procaine penicillin G/potassium penicillin G (Bicillin) (1 dose) vs. benthazine penicillin/procaine penicillin G/potassium penicillin G (Bicillin) (1 dose) plus triple sulonamide (7d)

  • amoxicillin-clavulanate (5d, either 45 mg/kg/d or 80 mg/kg/d) vs. amoxicillin-clavulanate (7-10d, either 40 mg/kg/d or 45 mg/kg/d or
    80 mg/kg/d)

  • cefaclor (<5d) vs. cefaclor (7010d)

  • cefaclor (5d) vs. amoxicillin (7-10d)

  • cefaclor (5d) vs. cefaclor (7-10d)

  • cefuroxime axetil (5d) vs. amoxicillin-clavulanate (7-10d)

  • cefuroxime axetil (5d) vs. cefixime (7-10d)

  • cefpodoxime proxetil (5d) vs. amoxicillin-clavulanate (7-10d)

  • cefpodoxime proxetil (5d) vs. cefaclor (7-10d)

  • cefpodoxime proxetil (5d) vs. cefixime (7-10d)

  • cefprozil (5d) vs. cefprozil (7-10d)

  • ceftibuten (5d) vs. ceftibuten (10d)

  • ceftriaxone (1 dose) vs. amoxicillin (7-10d)

  • ceftriaxone (1 dose) vs. amoxicillin-clavulanate (7-10d)

  • ceftriaxone (1 dose) vs. cefaclor (7-10d)

  • ceftriaxone (1 dose) vs. cefuroxime axetil (7-10d)

  • ceftriaxone (1 dose) vs. trimethoprim-sulfamethoxazole (7-10d)

  • azithromycin (<5d) vs. amoxicillin-clavulanate (7-10d, either 40 mg/kg/d or 45 mg/kg/d)

  • azithromycin (<5d) vs. cefaclor (7-10d)

  • azithromycin (<5d) vs. clarithromycin (7-10d)

  • azithromycin (5d) vs. amoxicillin-clavulanate (7-10d)

3 1 1 with two 5-day arms 1 2 2 1 1 1 1 1 2 1 1 1 1 3 2 1 1 1 5 2 1 3
The articles eligible for analysis for each key question were grouped by comparisons. Each comparison consisted of articles that were considered homogeneous from the standpoint of clinical practice. The first grouping was based on the type of antibiotics being compared in each study. The number of comparisons and the number of articles for each comparison are presented in Table 15 for Key Question 3, Table 16 presents the same for Key Question 4a, and Table 17 for Key Question 4e. The grouping of antibiotics was done first by internal experts and then discussed with the Technical Expert Panel during the fourth conference call. Meta-analyses or quantitative syntheses were performed for comparisons involving three or more articles.

The DerSimonian and Laird random effects model (DerSimonian and Laird, 1986) was used to pool effect sizes across studies. This method produces a summary measure that is a weighted mean. It weights each study's measure by the inverse of the sum of the within-study variance and the between-study variance. This approach allows both sampling variation and between-study heterogeneity to affect the pooled estimate. Among the three effect measures -- rate difference, relative risk, and odds ratio -- the Technical Expert Panel and the project staff chose as most suitable the rate difference and its 95 percent confidence limits, which are presented both numerically and graphically. It should be noted that the absolute rate difference was used rather than the relative rate difference to measure the effect size throughout the report.

In addition to the pooled estimate, we report the Q statistic and p-value for the Chi-squared test of heterogeneity, which tests the null hypothesis that the individual study results are homogeneous (Laird and Mosteller, 1990). Because the test is known to lack power to detect heterogeneity, we protected against spurious conclusions resulting from combining clinically heterogeneous patients or treatments in two ways, regardless of the outcome of the Chi-squared test of heterogeneity. First was the use of random effects estimates that incorporate some between-study variance even if the Chi-squared test does not reject. Second, subgroup analyses and sensitivity analyses were planned to assess the impact of possible heterogeneity on the conclusions, but these were not feasible because of the small number of studies in each comparison group.

When necessary, we had planned to conduct meta-regression analysis for comparisons where multiple arm studies where used more than once. However, we did not have any multiple-arm studies that were used more than once in our comparisons using the same outcome indicator.

We also had planned to conduct a power analysis for those comparisons where the rate difference was 10 percent or higher but did not reach statistical significance. However, none of the comparisons that did not reach statistical significance was 10 percent or higher; thus, a power analysis was not performed.

To prepare for a meta-analysis for each comparison, data were abstracted from the evidence table (one meta-analysis for each outcome measure). The following data elements were entered in an SAS program to be converted into an SAS data set: the study ID number, author, year of publication, number of adverse outcomes in the experimental group, total number of patients in the experimental group, number of adverse outcomes in the control group, and total number of patients in the control group. An SAS macro software program that was developed by RAND statistical staff was used to perform all meta-analyses; the beta-test version of the software package "MetaGraphs" (1998, Belmont Research, Inc., 84 Sherman Street, Cambridge, MA 02140) was used for the graphing.

The following statistics were generated from the SAS macro program: (a) study-level statistics (incidence rate, relative risk, risk difference, number needed to treat [NNT], odds ratio, and their 95 percent CI); (b) crude estimates and their 95 percent CI for all studies combined; (c) fixed effects estimates and their 95 percent CI for all studies combined; (d) random effects estimates and their 95 percent CI based on the DerSimonian and Laird method for pooling study results and the Chi-squared test of homogeneity; and (e) weight for each study for both fixed effects model and random effects model in calculation of risk difference and relative risk.

To use MetaGraphs for graphing, the data were entered into ASCII files using the UltraEdit-32 software. Funnel plots were produced for the purpose of screening possible publication bias and the shrinkage plots were generated to display the effect size of each study and compare it against the overall model estimate, together with their 95 percent confidence limits.

Summary of Characteristics of Articles in Evidence Report

Of the 80 studies used in the evidence report, 40 (50 percent) were published in the 1990s, 25 (31 percent) in the 1980s, 8 (10 percent) in the 1970s, and 7 (9 percent) in the 1960s. The earliest article was published in 1964 and the latest in 1998. Forty-one studies (51 percent) were conducted in the United States. Six studies did not specify either a lower or upper age limit, although they all stated that the subjects were children (Bollag and Bollag-Albrecht, 1991; Froom, Culpepper, Grob, et al., 1990; Howie and Ploussard, 1972; Laxdal, Merida, and Jones, 1970; Tilyard, Dovey, and Walker, 1997; and Townsend, 1964). Of the six studies, four were observational cohort studies and two were randomized controlled trials. All addressed Key Questions 1 and 3. The otitis-prone status of the study population, the other influencing factor considered important by the Technical Expert Panel, was not reported in 64 percent (51/80) of the studies.

Of the 80 studies, 74 were randomized controlled trials. Their study-design quality was evaluated using the Jadad score (Jadad, Moore, Carroll, et al., 1996). Of the 74 studies, 6 (8 percent) had the highest score (5 on the Jadad scale); 12 (16 percent) scored 4; 21 (28 percent) scored 3; 26 (35 percent) scored 2; 8 (11 percent) scored 1; and 1 (1 percent) scored 0. Project staff evaluated the study-design quality of the six observational cohort studies by the presence or absence of eight components of study quality. Of the six studies, two studies addressed four of the eight components, one study addressed three, two studies addressed two, and one study addressed one. Of the 74 randomized controlled studies, 30 (41 percent) mentioned double-blinding, 52 (70 percent) described the characteristics of the dropouts, 28 (38 percent) used appropriate randomization methods, and 17 (23 percent) used appropriate blinding strategies.

For definition of AOM, none of the 80 studies used all three components (middle-ear effusion, rapid onset, and signs/symptoms of inflammation) of the proposed definition established by the Technical Expert Panel; 18 (22.5 percent) used two components; 34 (42.5 percent) used only one component; and 28 (35 percent) used none. Of the 80 studies, 42 (52.5 percent) included the middle ear effusion component, 2 (2.5 percent) included the rapid onset component, and 26 (32.5 percent) included the signs/symptoms of inflammation component.

With respect to the Technical Expert Panel's criterion that an "initial" episode of AOM be separated by at least 4 weeks from the end of an antibiotic course of treatment for the last episode of AOM, 21 of 74 (28 percent) randomized controlled trials and 6 of 6 (100 percent) cohort studies did not address this issue. Many of the other studies also did not address this issue: 9 of the 15 (60 percent) studies on natural history; 3 of the 9 (33 percent) studies on the effects of antibiotics on AOM; 12 of the 34 (35 percent) studies on ampicillin or amoxicillin or trimethoprim-sulfamethoxazole vs. other antibiotic, the single study on high-dose vs. standard-dose amoxicillin; and 5 of the 36 (14 percent) studies on short-duration vs. long-duration. Of the studies that addressed duration of the initial AOM episode, 17 met the criterion of 4 weeks or longer. None required that the last episode of AOM be documented as having cleared.

Identification of Peer Reviewers

In the letter to the 11 organizations requesting nominations for technical experts, nominations for peer reviewers also was requested. As of November 3, 1998, a total of 21 nominations for the Peer Review Panel were received. On November 16, 1998, a letter was mailed to the Ambulatory Pediatric Association (APA) and to the American Association of Health Plans (AAHP) requesting nomination of peer reviewers. Nine additional experts expressed interest to serve on the Peer Review Panel and submitted their curriculum vitae.

Experts in systematic reviews and meta-analysis were selected from a pool of experts maintained by the Southern California Evidence-based Practice Center who were not involved with this project.

Table 18. Peer Review Panel
Technical ExpertArea of ExpertiseAffiliation/Location
Alfred O. Berg, M.D., M.P.H.Family MedicineUniversity of Washington, Seattle, WA
Larry Culpepper, M.D.,M.P.H.Family MedicineBoston Medical Center, Boston, MA
Robert Ruben, M.D.OtolaryngologyMontefiore Medical Center, Bronx, NY
Stanford T. Shulman, M.D.Pediatrics, Infectious DiseaseChildren's Memorial Hospital, Chicago
Elizabeth Susan Hodgson, M.D.Pediatrics, AmbulatorySt. Peter's Pediatric Faculty Group PracticeNew Brunswick, NJ
Jerome Klein, M.D.Pediatrics, Infectious DiseaseBoston Medical Center, Boston, MA
Lisa L. Hunter Ph.D.AudiologyUniversity of Minnesota, Minneapolis, MN
Terese Finitzo, Ph.D.AudiologyDallas, TX
Carol Rudy, M.S.N.,C.P.N.P.Nurse PractitionerSpokane, WA
Tracy Lieu, M.D.Health PlanHarvard Pilgrim Health Care, Boston, MA
Michael Siegel, M.D.Health PlanPrudential Health Care Plan, CA
Fran Goldfarb, M.A.ConsumerFamily Voices, Los Angeles, CA
Mark P. Haggard, Ph.D.Epidemiology and Outcomes MethodsInstitute for Hearing Research, UK
Anne G.M. Schilder, M.D., Ph.D.OtolaryngologyUniversity Medical Center Utrecht, TheNetherlands
Hanan S. Bell, Ph.D.Methodology reviewerSeattle, WA
Vic Hasselblad, Ph.D.Meta-analysis reviewerDuke University, Durham, NC
Katherine Harris, Ph.D.Cost-analysis reviewerRAND, Santa Monica, CA
Lynne Haverkos, M.D.Government reviewerNICHD
Robin Yurk, M.D., M.P.H.ConsumerThe Foundation for Accountability, Portland, OR
Peer Reviewer #20Otolaryngologist
Peer Reviewer #21Nurse practitioner
Peer Reviewer #22Pediatric pharmacologist
Peer Reviewer #23Pediatrician
Peer Reviewer #23Methodology reviewer
The Principal Investigator, the Task Order Manager, and the Task Order Coordinator, in consultation with the Task Order Officer, determined the relative mix of reviewers across the three domains (methodology, user, and clinical). Due to the possible difference in perspective regarding antibiotic use for AOM between U.S. and non-U.S. health care providers, the Peer Review Panel was broadened to include non-U.S. experts. The criteria for their inclusion were that they be experts in the field of AOM as represented by at least two peer-reviewed publications related to AOM in the past 5 years and that they represented different professional or academic disciplines. The Peer Review Panel (Table 18) had a total of 24 members consisting of family physicians, pediatricians, otolaryngologists, experts in infectious diseases and/or otitis media, a pediatric pharmacologist, audiologists, speech-language pathologists, nurses, health plans, consumers, systematic review methodologists, meta-analysts, a health economist, and non-U.S. experts in otitis media.

Peer Review Process

Table 19. Instructions for reviewing draft evidence report
Enclosed is a draft evidence report on the management of acute otitis media. You may make your comments either directly on the draft evidence report, or on a separate sheet of paper. If you choose to record your comments on a separate piece of paper, please use the page and paragraph number to identify to which part of the report your comments pertain. We ask that you consider the following questions while you read this report. We realized that some of the questions may not pertain to your area of expertise. Please feel free to comment only on those that you feel most suited to answer.
1. Overall evaluation Is it clear what we did? You may agree or disagree with our methods, findings, or conclusions, but you should be able to understand what we did in order to produce this report.
2. Methodology Are the methods we used appropriate: (a) for identifying the key questions of interest from the panel of technical experts? (b) for searching and reviewing the identified literature? (c) for synthesizing the literature?
3. Evidence (a) Did we miss any crucial pieces of information in our literature search? (b) Does the evidence support the conclusions?
4. Utility Would you find this information to be useful if you had to develop clinical practice guidelines or medical review criteria for management of acute otitis media in children?
A copy of the draft evidence report was mailed to each peer reviewer on the panel together with an instruction sheet (Table 19) for reviewing the draft evidence report. The Panel was asked to respond within 3 weeks. The 24 peer reviewers responded with comments. A copy of the draft evidence report also was mailed to the members of the Technical Expert Panel. Upon receipt of all responses from the peer reviewers and technical experts, the project staff compiled a summary of the comments and changes and revised the draft evidence report. The revisions and comments from peer reviewers were sent to the Task Order Officer for approval. Once the revisions were approved, a final evidence report and a draft manuscript were produced and submitted to the technical experts and Task Order Officer for final approval.

Chapter 3. Results

Natural History

To understand the true effect of an intervention on a clinical condition such as AOM, the natural history of that condition without intervention must be known. The timing of processes and intermediate outcomes, as well as the ultimate outcomes of acute otitis media (AOM) without intervention, must be known. Also important are influencing factors, either genetic, familial, cultural, or environmental, that may be difficult to control and that may affect the outcomes of AOM apart from, in addition to, or in interaction with the interventions of interest. The Technical Expert Panel decided to concentrate on age and otitis-prone state as such influencing factors to analyze. To properly estimate the marginal effects of an intervention on the outcomes of AOM, the natural history of AOM without intervention should be clearly understood.

The question we asked was: During an episode of uncomplicated AOM that is initially managed without any active intervention (pharmacologic or surgical) other than topical or systemic medications (that do not contain antibiotics) given for symptomatic relief (e. g., analgesics, antipyretics, antihistamines, decongestants, ear or nose drops), what proportion of children have the outcomes delineated in the Scope of the Evidence Report (Appendix E.4). To what degree are the above outcomes attributable to the influencing factors delineated in the Scope of the Evidence Report (Appendix E.4).

Previous Information Syntheses

Rosenfeld (1999a) assessed the natural history question in a previous information synthesis. As in the present analysis, Rosenfeld (1999a) evaluated children from epidemiologic studies, untreated control groups in randomized clinical trials, and cohort studies with an untreated group. Rosenfeld (1999a) assessed the same set of studies as in the present evidence-based analysis except for the inclusion of Fry (1958) and the absence of Tilyard, Dovey, and Walker (1997). We excluded Fry (1958) from our analysis because we could not extract the data on children from the data on adults in that study. Data were then pooled to calculate outcome estimates. Rosenfeld (1999a) estimated that 59 percent (3 studies; 315 children; 95 percent confidence limits, 53 percent and 65 percent) of children had relief of pain and fever within 24 hours of diagnosis. We note that one study used in this estimate (Burke, Bain, Robinson, et al., 1991) reported on resolution of pain and fever separately, and another study (Thalin, Densert, Larsson, et al., 1986) reported on pain and ear discharge, but not fever. To include the data in the estimate, an assumption must be made that those without pain did not have fever. Rosenfeld (1999a) estimated that 87 percent (5 studies; 808 children; 95 percent confidence limits, 84 percent and 89 percent) had relief of pain and fever within 2-3 days. Data from the Thalin, Densert, Larsson, et al. (1986) study was used in this estimate. Relief of pain and fever at 4-7 days was estimated to be 88 percent (5 studies; 503 children; 95 percent confidence limits, 85 percent and 91 percent). Again, data from the estimates in two studies -- Burke, Bain, Robinson, et al. (1991) and Thalin, Densert, Larsson, et al. (1986) -- were included in this estimate.

Finally, clinical resolution within 7-14 days of diagnosis was estimated at 73 percent (4 studies; 270 children; 95 percent confidence limits, 65 percent and 78 percent) based on the absence of all presenting signs and symptoms except middle ear effusion. The numerator used from one study (Halsted, Lepow, Balassanian, et al., 1968) appears to include success as judged by clinical or bacteriologic failure rather than clinical failure alone. In another study (Mygind, Meistrup-Larsen, Thomsen, et al., 1981) used in this estimate, the denominator is not clear from the report, and the initial denominator was used. Finally, Rosenfeld (1999a) found two cases of acute mastoiditis in 1,802 patients managed without antibiotics out of 2,368 patients, predominantly children, in six observational studies. (Although we mention some concerns about the data in these estimates, we also acknowledge that the direction and general magnitude of the estimates would not change with exclusion of that data. These same concerns apply to the use of these data in Rosenfeld (1999b), which is mentioned in the previous meta-analyses section Antibiotics vs. No Antibiotics in this chapter.)

Observation or Placebo

As proxies for natural history, we used the observational arm of cohort studies and the observational or placebo arm of randomized controlled trials of AOM. The treatment arm of such trials could be of any modality, antibiotic, myringotomy, etc., as long as the control arm consisted solely of observation or placebo.

Study Populations

Nine randomized controlled trials and six cohort studies were identified that address the natural history of AOM (Evidence Table 1). Eight of the randomized controlled trials had a placebo group, and one (Laxdal, Merida, and Jones, 1970) had an observational group that was treated symptomatically. All cohort studies had a group of subjects who were treated without antibiotics at the discretion of the investigators.

With respect to the age of the subjects, of the nine randomized controlled trials, three studies had no children under 2 years of age (Burke, Bain, Robinson, et al, 1991; Thalin, Densert, Larsson, et al., 1986; van Buchem, Dunk, and van't Hof, 1981), one had about one-fifth of the study population under 2 years of age (Appelman, Claessen, Touw-Otten, et al., 1991), two had approximately one-half of their study populations under 2 years of age (Kaleida, Casselbrant, Rockette, et al., 1991; Laxdal, Merida, and Jones, 1970), and two had at least three-fourths of the study population under 2 years of age (Halsted, Lepow, Balassanian, et al., 1968; Howie and Ploussard, 1972). Mygind, Meistrup-Larsen, Thomsen, et al. (1981) reported a mean age of 3.9 years for their study population but did not stratify any further. Of the cohort studies, one study had almost 90 percent of the total 2 years of age or younger (Ostfeld, Segal, Kaufstein, et al., 1988) and two studies had more than one-fourth of their total subjects younger than 30 months of age (Froom, Culpepper, Grob, et al., 1990; Tilyard, Dovey, and Walker, 1997). In the Thalin, Densert, Larsson, et al. (1986) study, all patients were older than 2 years of age. One study reported mean ages for their subjects as a whole, but not specifically for the groups not treated with antibiotics (Bollag and Bollag-Albrecht, 1991). Another study did not report on the ages of the patients (Townsend, 1964).

With regard to the otitis-prone state, four of the nine studies described their study populations with respect to this influencing factor. Appelman, Claessen, Touw-Otten, et al. (1991) reported that 12 percent of their study population had three or more episodes of AOM prior to the study; Burke, Bain, Robinson, et al. (1991) reported 47 percent; and Kaleida, Casselbrant, Rockette, et al. (1991), 21 percent. Thalin, Densert, Larsson, et al. (1986) reported that 27 percent of their patients had more than 10 episodes of AOM, and 23 percent of their patients had no prior episodes of AOM. None of the cohort studies referred to their subjects' past experiences with AOM.

Outcomes

The outcomes reported for these nine randomized controlled trials and six cohort studies share some commonalities but also many differences (Evidence Table 1). Outcome descriptors often relate to success or failure, pain or otalgia, fever, otoscopic findings, middle ear exudates or otorrhea, middle ear effusion, tympanometry results, relapse, recurrence, need for further intervention such as placement of pressure equalizing tubes, and suppurative complications such as mastoiditis.

Table 20. Key question 1: selected outcomes
Author/YearOutcome(s) Measured 1Time(s) Measured
Randomized Controlled Trials
Halsted/1968early improvement24-72 hours
resolved14-18 days
recurrence1 year
Laxdal/1970excellent7 days
good14 days
fair21 days
poor21 days
failure7 days
Howie/1972improvement/failure2-7 days
fever2-7 days
nonsterile exduate2-7 days
Mygind/1981satisfactory course of acute phase7 days
symptom free2 days
otorrhea>5 days
middle ear effusion1 week, 1 month, 3 months
contralateral otitis media1 week
relapse1 week, 1-3 months
van Buchem/1981pain>24 hours, >7 days
abnormal otoscopy>7 days, >14 days
otorrhea>24 hours, >7 days
relapse6 months
Thalin/1986complete resolution30 days
failure30 days
relapse30 days
Appelman/1991irregular course>3 days
tympanometry1 month
Burke/1991failure7 days
pain2 days, 5-7 days
fever2 days, 5-7 days
abnormal otoscopy>7 days
middle ear effusion1 month, 3 months
recurrence1 year
Kaleida/1991treatment failure24-48 hours, 1 year
middle ear effusion2 weeks, 6 weeks
recurrence2-6 weeks
Cohort Studies
Townsend/1964complication1 year
Ostfeld/1988otorrhea24 months
chronic middle ear effusion24 months
recurrence24 months
pressure equalizing tube placement24 months
mastoiditis24 months
Froom/1990recovery2 months
Bollag/1991mastoiditis2 months
hearing deficit2 weeks
Tilyard/1997failure30 days
van Buchem/1985cure14 days
severe course3-4 days
persistent discharge14 days

1 See Table 21 for definitions for outcome measures related to success or failure of treatment

Table 21. Key question 1. Terms and definitions: success and failure
Author/YearTerm(s)Definition(s)Time Measured
SUCCESS
Randomized Controlled Trials
Halsted/1968early improvementdecreased symptoms24-72 hours
resolvedasymptomatic and normal tympanic membrane appearance14-18 days
Laxdal/1970excellentno evidence of middle ear inflammation7 days
goodsigns of otitis media resolved14 days
gairsigns of otitis media resolved21 days
Howie/1972improvementabsence of exudate2-7 days
Mygind/1981satisfactory course of acute phase(1) not crying from pain after 1day (2) no analgesics after 1day (3) no otitis symptoms after 2days (4) otorrhea <6 days (5) no contralateral otitis first week1 week
Thalin/1986complete resolutionnot clear if refers to "satisfactory" defined as normal otomicroscopy and normal audiogram and/or tympanogram30 days
Cohort Studies
Townsend/1964recovery(1) tympanic membrane normal (2) pneumatic otoscopy normal (3) audiogram and hearing per parents and teacher normal1 year
Van Buchem/1985curenot severe course and without persistent discharge14 days
Froom/1990recoverybased on pain, ear drainage, hearing problem, or other2 months
FAILURE
Randomized Controlled Trials
Laxdal/1970poorpersistent signs of minimal infection21 days
failureno improvement or deterioration7 days
Howie/1972failurepresence of xudates2-7 days
Thalin/1986failureRemaining nonnegligible symptoms (pain, fever, etc.) or insufficient resolution of infectious signs during the medical treatment period7 days
Appelman/1991irregular courseotalgia or > 38 degrees Centigrade>3 days
Burke/1991failuresecond-line antibiotic required, presumably due to nonresolution or recurrence of symptoms1 week
Kaleida/1991initial treatment failure"severe" criterion present >24 hours or >38 degrees Centigrade oral or 38.5 degrees Centigrade rectal or >6 otalgia score24-48 hours
ultimate treatment failurecumulative >180 days middle ear effusion in same ear or > four severe AOM episodes or > five any AOM or new otitis media with effusion within 6 months or fourth myringotomy in 6 months or fifth in 12 months or suppurative complication or cholesteatoma or an allergic reaction to penicillin1 year
Cohort Studies
Townsend/1964complicationpurulent progression of disease or serous otitis media1 year
Van Buchem/1985Severe coursePersistent high temperature or severe pain3-4 days
persistent dischargePersistent discharge14 days
Froom/1990no or uncertain recoverybased on pain, ear drainage, hearing problem, or other2 months
Tilyard/1997failurereturn <10 days with same problem or change antibiotic within 30 days30 days
The differences in the actual outcomes measured were due both to the outcome selection, measurement description, and the time of measurement relative to the start of the study (Table 20). Forty-eight outcomes are listed in Table 20. In those cases where outcomes seemed to be shared, the description of those outcomes was not always the same. In addition, in those cases where the outcomes seemed to have the descriptors of the same meaning such as success or failure but not the same time of measurement, a reading of the actual definition of those descriptors revealed differences (Table 21). Terms used for the meaning success included "early improvement," "resolved," "excellent" or "good," "improvement," "satisfactory course of acute phase," "recovery," and "cure." In some studies, the reviewer had to assume that the opposite of failure was success. Terms used for failure included "failure," "poor," "irregular course," "complication," and "no" or "uncertain recovery." Some definitions of success or failure were quite detailed (Kaleida, Casselbrant, Rockette, et al., 1991; Mygind, Meistrup-Larsen, Thomsen, et al., 1981). For the most part, the definitions of success or failure were nonspecific and relied solely on: symptoms; signs; signs and symptoms; signs, symptoms, and tympanic membrane appearance, specifically; or signs, symptoms, tympanic membrane appearance, and absence of middle ear effusion, specifically. Of the definitions of success and failure listed in Table 21, each is unique to the study in which it is described.

Results

This report concentrates on failure of clinical resolution, pain, fever, and middle ear effusion in the natural history of AOM, mastoiditis, and other suppurative complications. The estimates for the other outcomes noted in Table 20 may be found in Evidence Table 1.

Table 22. Key question 1: failure1 rate in the placebo or observational group
Author/YearTime Measured/Influencing FactorFailure Rate
Randomized Controlled Trials
Halsted/196824-72 hours7/27 (26%)
14-18 days0/21 (0%)
Laxdal/19707 days18/48 (38%)
0-3 years old46% (denominator not reported)
3-6 years old38% denominator not reported)
6-9 years old25% (denominator not reported)
9-14 years old0% (denominator not reported)
Howie/19722-7 days92/116 (79%)
Mygind/19817 days31% (denominator not reported)
Thalin/19867 days12 (count only, denominator unknown)
Appelman/1991>3 days10/54 (18%)
<2 years old7/12 (58%)
>2 years old3/42 (7%)
Burke/19917 days17/118 (14%)
3-5 years old10/66 (15%)
6-9 years old7/52 (13%)
<2 prior AOM 26/55 (11%)
>2 prior AOM7/48 (15%)
Kaleida/199124-48 hours38/492 (7.7%)
<2 years age25/254 (9.8%)
>2 years age13/238 (5.5%)
1 year46/170 (27.1%)
<2 years age30/82 (36.6%)
>2 years age16/88 (18.2%)
Cohort Studies
Townsend/19641 year11/189 (5.8%)
Van Buchem/198514 days20/465 (4.3%)
Froom/19902 months40/4 19 (9.5%)
0-12 months old5/39 (12.8%)
13 30 months old7/69 (10.1%)
>31 months old28/311 (9.0%)
Tilyard/19971 month8/74 (10.8%)
<2 years old4/29 (14%)
2 5 years old4/22 (18%)
6-15 years old0/12 (0%)
>15 years old0/11 (0%)
1

See definition of success and failure in Table 21

2

AOM=acute otitis media

For those randomized controlled trials that evaluate some descriptor of success or failure in a placebo or observational group, the following statements may be made while cognizant of the differences in definition of success or failure as noted above and in Table 21. (See Table 22 and Evidence Table 1.) Early failure in a placebo group monitored at 24-72 hours was reported as 7.7 percent by Kaleida, Casselbrant, Rockette, et al. (1991) and 26 percent by Halsted, Lepow,

Balassanian, et al. (1968). Appelman, Claessen, Touw-Otten, et al. (1991) reported a failure rate of 18 percent measured after 3 days. Failure monitored at 7 days was reported as 8 percent by Thalin, Densert, Larsson, et al. (1986), 14 percent by Burke, Bain, Robinson, et al. (1991), and 38 percent by Laxdal, Merida, and Jones (1970). An unsatisfactory clinical course of the acute phase (7 days) was reported for 31 percent of the placebo group by Mygind, Meistrup-Larsen, Thomsen, et al. (1981). Thalin, Densert, Larsson, et al. (1986) reported 12 subjects in their placebo group failing therapy at 7 days but did not specify a denominator. According to the definition of failure by Howie and Ploussard (1972) as the presence of middle ear exudate at 2-7 days, that group reported a rate of failure of 79 percent in the placebo group and 57 percent in the antibiotic group. Failure in the placebo group at 14-18 days was 0 percent (Halsted, Lepow, Balassanian, et al. 1968) and failure for the placebo group at 1 year was 27.1 percent (Kaleida, Casselbrant, Rockette, et al. 1991). The cohort study (Tilyard, Dovey, and Walker 1997) reported a failure rate of 10.8 percent in their group not treated with antibiotics at 1-month measurement, (Froom, Culpepper, Grob, et al. 1990), a failure rate of 9.5 percent at 2-month measurement, and a failure rate of 5.8 percent at 1-year measurement (Townsend 1964).

Pooling the failure data at 1-7 days from the randomized controlled studies in cases where denominators were certain, we calculated a failure rate of 18.9 percent (five studies; 739 children; 95 percent CI, 9.9 percent and 28.0 percent) for those not initially receiving antibiotics (Appelman, Claessen, Touw-Otten, et al., 1991; Burke, Bain, Robinson, et al., 1991; Halsted, Lepow, Balassanian, et al., 1968; Kaleida, Casselbrant, Rockette, et al., 1991; Laxdal, Merida, and Jones, 1970). In other words, 81.1 percent of these children with AOM not initially treated with antibiotics would have clinical resolution within 1-7 days of presentation. The pooled estimate for the failure rate at 3-7 days was 22.2 percent (three studies; 220 children; 95 percent CI, 10.1 percent and 34.3 percent) (Appelman, Claessen, Touw-Otten, et al., 1991; Burke, Bain, Robinson, et al., 1991; Laxdal, Merida, and Jones, 1970). During this time, 77.8 percent of children would have clinical resolution. (See Evidence Table 1 for data on individual studies.) We did not pool the data at 1-3 days because only two studies were available (Halsted, Lepow, Balassanian, et al., 1968; Kaleida, Casselbrant, Rockette, et al., 1991).

Table 23. Key question 1: presence of pain and/or fever in the placebo or observational group
Author/YearTime Measured/Influencing FactorNumber of patients with Symptom
Randomized Controlled Trials
Pain
van Buchem/1981>24 hours11/49 (28%)
>7 days4/38 (10%)
Burke/19912 days56/117 (48%)
5-7 days29/114 (25%)
Fever
Howie/19722-7 days0/116 (0%)
Burke/19912 days19/93 (20%)
5-7 days8/70 (11%)
Pain or Fever
Mygind/19812 days38% (denominator not reported)
van Buchem/1981>24 hours11/40 (28%)
>7 days4/38 (10%)
Thalin/19867 days12 (count only, denominator unknown)
Appelman/1991>3 days10/54 (18%)
<2 years old7/12 (58%)
>2 years old3/42 (7%)
Kaleida/199124-48 hours38/492 (7.7%)
<2 years old25/254 (9.8%)
>2 years old13/238 (5.5%)
The presence of pain or otalgia was a common outcome reported in the randomized controlled studies (Table 23). Twenty-eight percent of the placebo group had pain at 24 hours and 10 percent had pain at 7 days (Van Buchem, Dunk, van't Hof, et al. 1981). 48 percent had pain at 2 days and 25 percent had pain at 5-7 days (Burke, Bain, Robinson, et al. 1991). Initial treatment failure was based on presence of fever or pain (Kaleida, Casselbrant, Rockette, et al. 1991). This study found 7.7 percent of children with nonsevere AOM in their placebo group had fever or pain at 24-48 hours. Howie and Ploussard (1972) reported that none of the placebo group had fever at 2-7 days; Burke, Bain, Robinson, et al. (1991) reported that 20 percent of the placebo group had fever at 2 days and 11 percent had fever at 5-7 days. Mygind, Meistrup-Larsen, Thomsen, et al. (1981) reported that 38 percent of the placebo group had pain and fever at 2 days. Twenty-eight percent of the placebo group had pain and fever at 24 hours, and 10 percent had pain and fever at 7 days (van Buchem, Dunk and van't Hof 1981); 18 percent had pain and fever at 3 days (Appelman, Claessen, Touw-Otten, et al. 1991). Despite the variability of the studies, it appears that children with AOM not treated with antibiotics experience a significant decrease in pain and fever during the first week of the clinical condition.

Table 24. Key question 1: presence of middle ear effusion in the placebo or observational group
Author/YearTime Measured/Influencing FactorNumber of Patientst with Symptom
Randomized Controlled Trials
Howie/19722-7 days92/116 (79%)
Mygind/19811 week50% (denominator not reported)
1 month32% (denominator not reported)
3 months24% (denominator not reported)
Thalin/198530 days41% (denominator not reported)
Burke/19911 month41/116 (35%)
3 months31/111 (28%)
Kaleida/19912 weeks255/408 (63%)
<2 years old143/209 (68%)
>2 years old112/1 19 (56%)
6 weeks169/328 (52%)
<2 years old99/175 (57%)
>2 years old70/153 (46%)
Cohort Study
Ostfeld/198724 months42% (denominator not reported)
The presence of middle ear effusion also was reported in many of the studies (Table 24). Asymptomatic middle ear effusion is an expected part of the clinical course of AOM (Rosenfeld, 1996). Persistence of middle ear effusion beyond 3 months, however, is not considered normal. Fifty percent of children in the placebo group had middle ear effusion at 1 week in the study of Mygind, Meistrup-Larsen, Thomsen, et al. 1981); at 1 month and 3 months, 32 percent and 24 percent of patients, respectively, had middle ear effusion. In Burke, Bain, Robinson, et al. (1991), middle ear effusion occurred in 35 percent of the placebo group at 1 month, and 28 percent of these patients at 3 months. In Kaleida, Casselbrant, Rockette, et al. (1991), 63 percent had a middle ear effusion at 2 weeks, and 52 percent at 6 weeks. A cohort study found 42 percent with chronic middle ear effusion at 24-month followup (Ostfeld, Segal, Kaufstein, et al. 1988). In general, these studies indicate that middle ear effusion is quite common after AOM.

Several of the studies reported estimates of these outcome measures by age group or otitis-prone state (Evidence Table 1, Tables 22, 23, and 24). Laxdal, Merida, and Jones (1970) reported that 46 percent of children 0-3 years of age failed to improve by 7 days in the observational group, while none of the children 9-14 years of age in the observational group failed to improve. In Burke, Bain, Robinson, et al. (1991), 15 percent of children 3-5 years of age had no improvement of symptoms by 1 week, while 13 percent of those 6-9 years of age had no symptomatic improvement. Kaleida, Casselbrant, Rockette, et al. (1991) reported that in patients in the placebo group, the initial failure rate was 9.8 percent in children younger than 2 years of age compared with 5.5 percent of children 2 years of age or older. Kaleida, Casselbrant, Rockette, et al. (1991) also found that at 1-year followup, 37 percent of those younger than 2 years of age in the placebo group and 18 percent of those 2 years of age or older met their criteria for failure. Burke, Bain, Robinson, et al. (1991) also found that children in the placebo group with one or two previous episodes of AOM had an 11 percent rate of symptomatic failure compared with 15 percent of children with more than two previous episodes of AOM. In the prospective questionnaire study, 12.8 percent of those aged 0-12 months who were not on antibiotics failed to recover by 2 months, whereas 10.1 percent of those 13-30 months of age and 9.0 percent of those older than 30 months failed to recover (Froom, Culpepper, Grob, et al. 1990). In the retrospective cohort study (Tilyard, Dovey, and Walker 1997), 14 percent of those younger than 2 years of age without antibiotic treatment failed to recover, as did 18 percent of those 2-5 years of age, and 0% of those 6 years of age and older (Table 22). A significant difference was seen for the resolution of pain and fever as reported by Appelman, Claessen, Touw-Otten, et al. (1991): 58 percent with pain or fever after 3 days in those younger than 2 years of age and 7 percent in those 2 years of age or older (Table 23). As shown in Table 24, 57 percent of children younger than 2 years of age in the placebo group of Kaleida, Casselbrant, Rockette, et al. (1991) had a middle ear effusion at 6 weeks, whereas that was true of 46 percent of those 2 years of age or older.

Table 25. Mastoiditis/suppurative complications and AOM: no antibiotic and associated antibiotic arms from cohort and randomized controlled studies1
Article/YearTime of Study; LocaleAntibioticAgeOtitis-Prone StatusDenominatorMastoiditisOther Suppurative Complication
Cohort Studies 2
Bollag/19912/86-2/88; Switzerlandnonemean 51.0 m 3 (SEM 35.9 m)not addressed15300 (meningitis)
3/88-2/89; Switzerlandnonemean 68.6 m 3 (SEM 38.9 m)not addressed5600(meningitis)
Ostfeld/19883/81-2/83; Locale not notednone<6 m=110 4 pts 7-12 m=166pts 13-24m=75pts >24 m=46ptsnot addressed39720 (meningitis)
antibiotics "for associated medical conditions"<6 m=87 4 pts 7-12 m=116pts 13-24 m=67pts >24 m=26ptsnot addressed19630 (meningitis)
Randomized Controlled Studies
Burke/199110/86-4/87, 10/87-4/88, 10/88-4/89; Southampton, Bristol, and Portsmouth, Englandplacebo3-5 y=66pts 6-9 y=52ptsprevious AOM: 0-2 55 >2 48111 500 (meningitis)
10/86-4/87, 10/87-4/88, 10/88-4/89; Southampton, Bristol, and Portsmouth, Englandamoxicillin>3 y < 10 ynot specified for this group 6110 500 (meningitis)
Kaleida/19915/81-8/85; Pittsburgh, U.S.A.placebo<2 y=136pts 2-5 y=107pts 6-12 y=30ptsprevious AOM in last year: 0/98 1-2/120 >2/55170 from the nonsevere group0 70 7
5/81-8/85; Pittsburgh, U.S.A.amoxicillin<2 y=133pts 2-5 y=108pts 6-12 y=22ptsprevious AOM in last year: 0 105 1-2 100 >2 58169 from the nonsevere group1 70 8
Thalin/19867/84-6/85; Halstad, Swedenplacebo2-15 y 9not specified for this group 10159 1100
7/84-6/85; Halstad, Swedenpenicillin VK2-15 y 9not specified for this roup 10158 1100
van Buchem/19811/79-3/79; Tilburg, The Netherlandsplacebo2-12 y 12not addressed40 1300
1/79-3/79; Tilburg, The Netherlandsamoxicillin2-12 y 12not addressed47 1300
Mygind/198111/77-4/78; Copenhagen, Denmarkplacebomean 4.1 ynot addressed7700
11/77-4/78; Copenhagen, Denmarkpenicillin VKmean 3.7 ynot addressed72 141 140
Laxdal/19701/66-9/68; Saskatchewan, Canadanone<14 y 15not addressed480 160 16
1/66-9/68; Saskatchewan, Canadapenicillin G or ampicillin<14 y 15not addressed940 160 16
1

Mixed-treatment arms are not reported in this table.

2

In addition to these two cohort studies, van Buchem, Peeters, van't Hof (1985) mention two cases of mastoiditis in a 17-month study period for which the authors estimate a denominator of 4,860 children with AOM based on a 3-month convenience sample.

3

Lower age limit was not specified.

4

Lower and upper age limits were not specified. Counts are estimated from Figure 1 in Ostfeld, Segal, Kaufstein, et al. (1987).

5

This is the denominator for the 3-month follow up.

6

Of the total group (placebo plus amoxicillin), 53 percent of patients had 0-2 previous episodes of AOM, and 47 percent had >2 previous episodes of AOM.

7

These counts are by implication because no episodes of mastoiditis were reported in the "Complications" section of "RESULTS" nor any other suppurative complications in the placebo group.

8

It is not clear from the article if this child with unilateral paresis of the marginal mandibular nerve was in the nonsevere or severe group. She was on antimicrobial treatment.

9

Of the total group (placebo and penicillin VK), 51 episodes of AOM involved children 2 years old, and 266 episodes of AOM involved older children.

10

Of the total group (placebo and penicillin VK), 23 percent of the children had their first episode of AOM and as many as 27 percent had suffered from AOM more than 10 times.

11

The article does not indicate the denominators for serious complications. These were the denominators at the start of the study.

12

Of the total group (placebo and amoxicillin), 18 were 2 years old, and 153 were older.

13

Reference to "Complications" is reported for an observation period of 2 years, but a 2-year denominator is not reported. These were the denominators at the start of the study.

14

Mastoiditis occurred sometime after the "immediate period after treatment", so the choice of denominator was unclear. The denominator "72" was at the start of study. Denominators at 1 month and 3 months were not reported by study group.

Lower-age limit was not specified. Of the total group (no antibiotic and antibiotic), 50 percent were < 3 years old, 25 percent were 3-6 years old, 18 percent were 6-9 years old, and 7 percent were > 9 years old.

16

These counts are by implication because authors report "no serious complications."

The following articles of no antibiotic treatment of AOM do not report mastoiditis or suppurative complications as outcomes:

1. Cohort studies: Froom, Culpepper, Grob, et al. (1990); Tilyard, Dovey, and Walker (1997); Townsend (1964) [The author mentions 1 case of mastoiditis in a child in the symptomatic treatment plus myringotomy group that included 2 cases but does not comment on the presence or absence of suppurative complications in the other treatment groups, including the 218 cases that were treated symptomatically.]

2. Randomized controlled studies: Appelman, Claessen, Touw-Otten, et al. (1991); Halsted, Lepow, Balassanian, et al. (1968); Howie and Ploussard (1972)

Mastoiditis and other suppurative complications are important outcomes to consider. Clinical failure based on signs and symptoms -- including pain, fever, and middle ear effusion -- are important, but serious complications would have greater weight in the treatment decision of AOM. Table 25 summarizes the information on mastoiditis and other suppurative complications found in the literature retrieved on natural history. Of the six cohort studies, two report specifically on the occurrence of suppurative complications in their study populations. Bollag and Bollag-Albrecht (1991) report no episodes of mastoiditis or meningitis in the two small cohorts that they followed. Ostfeld, Segal, Kaufstein, et al. (1988) noted two cases of mastoiditis in the 397 patients not treated with antibiotics and three cases of mastoiditis in the 296 patients treated with antibiotics; none of their patients had meningitis. In addition to these two cohort studies, van Buchem, Peeters, and van't Hof (1985) mention two cases of mastoiditis in a 17-month period for which they estimated a denominator of 4,860 children with AOM based on a 3-month convenience sample. Townsend (1964) mentions one case of mastoiditis in the symptomatic treatment plus myringotomy group of his study, which included two patients, but he does not comment explicitly on suppurative complications in the other treatment groups, including the 218 who were treated symptomatically.

The six randomized controlled studies listed in Table 25 have smaller sample sizes. No cases of mastoiditis or other suppurative complications were reported in the placebo or antibiotic arms of these studies. Of interest, two of these studies (Kaleida, Casselbrant, Rockette, et al., 1991; Ostfeld, Segal, Kaufstein, et al., 1988) included large proportions of children younger than 2 years of age. The footnotes to Table 25 detail some of the problems with these studies in addition to their small sample sizes and nonpopulation-based sample selection.

Despite these cautions, it appears that placebo or no antibiotic treatment in the setting of studies with close followup of patients is not necessarily associated with a high risk of mastoiditis or suppurative complications.

The natural history results must be considered in light of the role of antibiotic intervention in the "no antibiotic" treatment groups. Although the placebo or observational groups in all the studies were not treated initially with antibiotics, all nine of the randomized controlled trials and two of the six cohort studies mention clinical circumstances that would allow the investigator to administer antibiotics to children in the placebo or observational groups. Persistent symptoms or complications were common reasons for giving antibiotics to children in the placebo or observational groups. The majority of these studies had close followup of children, which allowed for timely clinical assessment. Most of the studies did not state explicitly how many children received antibiotics from these groups; however, in view of the criteria given for administering antibiotics, the numbers were probably small. (The only exception would be the Howie and Ploussard (1972) study where the investigators decided arbitrarily to give a majority of children in the placebo group amoxicillin starting at 2-5 days.) In most cases, the children in the placebo or observational group who received antibiotics were not removed from the study; in any case, the administration of antibiotics would not have had an effect on the early outcomes. This discussion also applies to the results on antibiotics vs. no antibiotics.

Antibiotics vs. No Antibiotics

We asked the following: Are antibiotics effective (in terms of statistical significance and magnitude of absolute clinical benefit above and beyond placebo/observational/no treatment/natural history) in the initial treatment of uncomplicated AOM with respect to the outcomes delineated in the Scope of the Evidence Report (Appendix E.4)? When antibiotics are used in the initial treatment of uncomplicated AOM, which of the influencing factors delineated in the Scope of the Evidence Report (Appendix E.4) are associated with better outcomes when compared with placebo/observational/no treatment/natural history?

Before asking which antibiotics are effective in treating AOM, we first ask if antibiotics have any marginal benefit in the treatment of AOM compared with natural history. In the scientific setting, the randomized controlled trial is the ideal method to answer this question by comparing the effect of antibiotics to that of placebo or observational treatment as proxies for natural history.

Previous Meta-Analyses

Del Mar, Glasziou, and Hayem (1997); Rosenfeld, Vertrees, Carr, et al. (1994); and Rosenfeld (1999b) have conducted quantitative syntheses assessing the marginal benefit of antibiotics in the treatment of AOM compared with placebo or observational therapy. Del Mar, Glasziou, and Hayem (1997) and Rosenfeld, Vertrees, Carr, et al. (1994) meet the validity criteria for systematic reviews of Oxman, Cook, and Guyatt (1994). Rosenfeld's (1999b) methodology is not described in detail, but it follows the guidelines of Oxman, Cook, and Guyatt (1994). A quantitative synthesis by Damoiseaux, van Balen, Hoes, et al. (1998) attempted to evaluate the effectiveness of antibiotic treatment of AOM in children younger than 2 years old, but examination of the report reveals that data from one of the four studies (Halsted, Lepow, Balassanian, et al., 1968) included children older than 2 years; in another study (Englehard, Cohen, Strauss, et al., 1989), the placebo group is treated with myringotomy as well. For these reasons, the results of the Damoiseaux, van Balen, Hoes, et al. (1998) quantitative synthesis will not be reported.

Table 26. Summary of Del Mar, Glasziou, and Hayem (1997) meta-analysis
TitleLiterature SourcesPaper TrailQuestionsResultsAuthor Conclusions/Reviewer Comments
TitleLiterature SourcesPaper TrailQuestionsResultsAuthor Conclusions/Reviewer Comments
Are antibiotics indicated as initial treatment for children with acute otitis media? A meta-analysis.Index Medicus manual search, 1958- 1965; MEDLINE, 1966-8/94; Current Contents, 1966-8/94; References of all retrieved articles; Not noted if non-English language articles were included.Does not explain in detail the process of article selection and does not provide much descriptive information about the articles1). Do antibiotics in the treatment of AOM affect the resolution of pain: (a) at 24 hours? (b) at 2-7 days? 2). Do antibiotics in the treatment of AOM affect the incidence of tympanic membrane perforation? 3). Do antibiotics in the treatment of AOM affect the incidence of vomiting, diarrhea, or rash? 4). Do antibiotics in the treatment of AOM affect the resolution of deafness: (a) at 1 month? (b) at 3 months? 5). Do antibiotics in the treatment of AOM affect the incidence of contralteral AOM? 6). Do antibiotics in the treatment of AOM affect the incidence of recurrent AOM?1. (a) no, 124/318 vs. 125/315 1. (b) yes, less pain, 90/929 vs. 131/914, RD 41% of who still had pain at 24 hours (14%-60%) 2) possibly fewer perforations but not statistically significant, 7/190 vs. 14/191 3) yes, more vomiting, diarrhea, or rash, 57/345 vs. 38/353, OR 1.97(1. 19-3.25) 4) a) no, 64/183 vs. 66/193 4) b) possibly fewer deaf but not statistically significant, 38/182 vs. 49/188 5) yes, less contralateral AOM, 35/329 vs. 56/337, RD 43% (9%-64%) 6) no, 187/864 vs. 175/804 "Many doctors and their patients may be disinclined to use antibiotics at first presentation of otitis media for so little benefit. Others may regard any potential benefit as worth the inconvenience of purchasing and administering the drugs and the risk of their (usually) minor complications." "...17 children must be treated at first presentation to prevent one child experiencing pain after 2-7 days..." (Pain resolves spontaneously within 24 hours in 60% and within 2-7 days in 86% without antibiotics.)
(Results are graphically displayed as ORs and in tabular counts with associated statistics, but the actual Ors and confidence intervals are not all reported. Two results are reported as RDs.)The authors acknowledge the results may not be generalizable to "Third World communities". The authors suggest research to identify subgroups of children who would benefit from antibiotics. Very little discussion of the study's weaknesses by the authors. The authors do not calculate the "file drawer" effect estimate.
RD-rate differencePublished criticisms: 1) incorrect use of OR to calculate number needed to treat; using RD, the NNT is 23 (15-56) 2) diagnostic criteria that were not reported varied widely among the studies
OR-odds ratioPossible RCTs Published Since Analysis: 11?
Inclusion CriteriaQuality Control
RCTs, antimicrobial drugs vs. placebo controlYes (per Chalmers, Adams, Dickersin, et al., 1990) scores of 11, 10,10, 9, 8, 5, 5, and 2 (0-11 possible)
Exclusion CriteriaArticles/Patients
none noted6/1833 (The number of articles used for each analysis ranged from two to six)
Concerning the Del Mar, Glasziou, and Hayem (1997) meta-analysis, we comment on several issues (Table 26). Studies were quantitatively synthesized without regard to antibiotic type. Del Mar, Glasziou, and Hayem (1997) looked at the presence of specific signs and symptoms at various points in time. For this reason, the Howie and Ploussard (1972) study was excluded from the meta-analysis because it did not report on these signs and symptoms. The study by Laxdal, Merida, and Jones (1970) also was excluded because it reported only on recurrences. Laxdal, Merida, and Jones (1970), however, do not specify recurrence as a criteria for inclusion in the study. Based on the studies included in their meta-analysis, Del Mar, Glasziou, and Hayem (1997) concluded that for children who had pain at 24 hours, the rate difference in pain at 2-7 days was 41 percent favoring antibiotic therapy (95 percent CI, 14 percent and 60 percent). In this group of children, the risk difference of contralateral otitis media was 43 percent favoring antibiotic therapy (95 percent CI, 9 percent and 64 percent). Del Mar, Glasziou, and Hayem (1997) did not demonstrate an effect of antibiotics on pain at 24 hours, tympanic membrane perforation, vomiting/diarrhea/rash, tympanometry at 1 month, tympanometry at 3 months, or recurrent AOM. They report no significant heterogeneity within the comparisons. Age and otitis-prone status are addressed by the following sentence in their discussion referring to the study by Burke, Bain, Robinson, et al. (1991): "Although we found some evidence of prolonged symptoms with placebo treatment among young children, those with previous episodes of otitis media, and those with bilateral AOM, the differences were small" (Del Mar, Glasziou, and Hayem, 1997).

Table 27. Summary of Rosenfeld, Vertrees, Carr, et al. (1994) meta-analysis
TitleLiterature SourcesPaper TrailQuestionsResultsAuthor(s)'s Conclusions/Reviewer(s)'s Comments
TitleLiterature SourcesPaper TrailQuestionsResultsAuthor(s)'s Conclusions/Reviewer(s)'s Comments
Clinical efficacy of antimicrobial drugs for acute otitis media: Meta-analysis of 5400 children from thirty-three randomized trials1MEDLINE, 1/66-6/92 inclusive (English and foreign); Current Contents/Life Sciences, 3 months through 6/29/92; bibliographies of textbooks, review articles, source articles, symposium publications; three trials included in the analysis were from non-English language reportsIncludes details on numbers of articles at each stage of selection and some descriptive information on included articles1) Are antimicrobial drugs more efficacious than placebo or no drug for the clinical resolution of AOM? 2) What is the efficacy of various antimicrobials vs. amoxicillin or ampicillin for the same end point? 3) How does study design affect observed rates of AOM control? 4) How do patient characteristics affect observed rates of AOM control?1) Comparisons with placebo/no drug: vs. PCN RD 15.7(4.7-26.7) vs. aminoPCN RD 12.9(6.8-19.0) vs. any ABX RD 13.7(8.2-19.2) 2) a) Comparisons with aminopenicillins: AMP vs. PCN RD −6.8(−15.2-1.5) AMP vs. PCN/SSX RD 0.9(−7.6-9.4) AminoPCN vs. ERY RD 3.1(−3.9-10.2) AminoPCN vs. TMP-SMX 0.2(−8.8-9.2) AMX vs. CFC RD 6.4(−10.2-22.9) AMX vs. CFX RD −3.9 (−10.4-2.6) 2) b) Comparisons with cefaclor: vs. ERY/SSX RD 7.0(−6.5-20.4) vs. AMX/CLV RD 2.8(−1.3-6.8) vs. CFX RD 1.2(−2.4-4.7) 3) RD was unrelated to year, publication year, outcome assessment day, requirement of MEE resolution for primary control, duration of treatment, cointerventions, other antimicrobial drugs, blinding protocol, compliance check, or the quality score. Diagnostic certainty as an independent variable had no significant impact on the regression analysis of RD as the dependent variable. 4) RD was unrelated to bilateral AOM and days since prior antibiotics.1) "Should antibiotics be part of the initial empiric therapy for AOM in children? Our meta-analysis suggests that the answer is a qualified yes....Six of every seven children with AOM either do not need antibiotics for primary control or will not respond to antibiotic therapy..." (spontaneous 81% resolution of symptoms without antibiotics) 2) "We did not detect any significant differences in comparative clinical efficacy for standard- vs. extended-spectrum antibiotics..."
primary end point: clinical response to antimicrobial therapy defined by absence or presence of presenting signs and symptoms 7-14 days after initiation of therapy including improved TM appearance if reported (somewhat vague description) secondary end point: presence or absence of MEE after resolution of acute infection as close to 30 days after initiation of therapy(ORs also reported for the primary end point.) (None of the RDs for the secondary end point were significant.)The authors note that these results apply to children older than 4 weeks of age for initial treatment of uncomplicated AOM and not to other situations.
Good discussion of study weaknesses by the authors. The authors do not calculate the "file drawer" effect estimate.
Possible RCTs Published Since Analysis: 25?
Inclusion CriteriaQuality Control
RCT; assessment of antimicrobial drugs; initial treatment; simple AOMYes (per Marchant and Shurin, 1982) score of 0.62+/-0.20 (0-1 possible)
Exclusion CriteriaArticles/Patients
studies of specific pathogens; myringotomy; OM not described; unable to extract data for ages 4 weeks to 18 years; most patients had treatment failure; most patients otitis prone33/5400 (each meta-analysis utilized at most 5 studies) (47% did not describe randomization procedure; control group could be another antibiotic; only 4 study arms out of 69 were placebo/no drug; double-blind not required; primarily industry funded (61%); included studies with length of treatment 2 days.)

RD=rate difference, OR=odds ratio,ABX=antimicrobial, AMP=ampicillin, AMX= amoxicillin, CFC=cefaclor, CFX=cefixime,CLV=clavulanate,ERY=erythromycin, PCN=penicillin,TM=tympanic membrance, MEE=middle ear effusion,TMP=trimethoprim,SMX=sulfamethoxazole, SSX=sulfisoxazole

Rosenfeld, Vertrees, Carr, et al. (1994) compared placebo or no drug treatment to two specific antibiotic classes as well as to all antibiotics (Table 27). Clinical response was defined by "the absence of all presenting signs and symptoms of AOM at the evaluation point closest to 7-14 days after therapy was started." For this reason, studies by Howie and Ploussard (1972), van Buchem, Dunk, and van't Hof (1981), and Thalin, Densert, Larsson, et al. (1986) were excluded from this meta-analysis. Synthesizing the data for two studies, the rate difference between those on penicillins and those on no antibiotic was 15.7 percent (95 percent CI, 4.7 percent and 26.7 percent). One of the two penicillin arms in this meta-analysis was actually penicillin-sulfisoxazole, and the authors explain in the methods section that "some clinicians consider penicillin-sulfisoxazole to be a standard-spectrum agent." (Rosenfeld, Vertrees, Carr, et al., 1994) Synthesizing data from three studies, the rate difference was 12.9 percent (95 percent CI, 6.8 percent and 19 percent) for aminopenicillins vs. no antibiotic; synthesizing data from four studies, the rate difference was 13.7 percent (95 percent CI, 8.2 percent and 19.2 percent) for any antibiotic vs. no antiobiotic (Rosenfeld, Vertrees, Carr, et al., 1994). The comparison groups were statistically homogeneous. The investigators acknowledge that these results may not be applicable to the "otitis-prone condition," although age as a specific influencing factor is not addressed (Rosenfeld, Vertrees, Carr, et al., 1994).

Table 28. Summary of Rosenfeld (1999b) meta-analysis
TitleLiterature SourcesPaper TrailQuestionsResultsAuthor Conclusions/Reviewer Comments
TitleLiterature SourcesPaper TrailQuestionsResultsAuthor Conclusions/Reviewer Comments
What to expect from medical therapy. (Only the acute otitis media meta-analyses will be summarized here.)MEDLINE, 1996 through July 1998; manual search of symposium proceedings, published otitis media meta-analyses, book chapters, bibliographies of retrieved articlesDoes not describe the number of articles initially retrieved from the literature search and the reasons for article rejection.1) Are antimicrobials efficacious in the symptomatic relief of AOM pain and fever at 24 hours? 2) Are antimicrobials efficacious in the symptomatic relief of AOM pain and fever at 2-3 days? 3) Are antimicrobials efficacious in the symptomatic relief of AOM pain and fever at 4-7 days? 4) Are antimicrobials efficacious in the complete clinical resolution of AOM within 7-14 days? 5) Are antimicrobials efficacious in the resolution of OME 4-6 weeks after AOM treatment? 6) Are antimicrobials efficacious in the resolution of OME 3 months after AOM treatment?Antibiotics vs. placebo/no antibiotic RD 0 (−7-8) (three studies; 633 subjects) 2) Antibiotics vs. placebo/no antibiotic RD 4 (2-7) (five studies; 1,241 subjects) 3) Antibiotics vs. placebo/no antibiotic RD 5 (−3-14) (four studies; 785 subjects) 4) Antibiotics vs. placebo/no antibiotic RD 13 (8- 19) (four studies; 612 subjects) 5) Antibiotics vs placebo/no antibiotic RD 3(−2-8) (5 studies, 1,447 subjects) 6) Antibiotics vs placebo/no antibiotic RD 5(−6-16) (2 studies, 371 subjects)The author mentions that the results might not be generalizable to children with immune deficiencies, cleft palate, craniofacial anomalies, preexisting OME, complicated AOM, and concurrent bacterial infections, and that the 24 hour findings may not be generalizable to very young children. The author also mentions that the subjects in these studies may have less severe disease.
Because the results are presented in a textbook, details of the methodology are not presented (e.g., as the number of articles retrieved from the initial literature search and actual quality scores). Also, no measure of heterogeneity is presented; the author assumes that the random effects model will adjust for any heterogeneity. The chapter does have a good discussion on the importance, validity, and generalizability of each result.
Inclusion CriteriaQuality Control
Randomized controlled trialQuality scores are not reported. A statement is made that all of the studies in these meta-analyses were randomized and all but one were blinded.
Exclusion CriteriaArticles/Patients
Not mentionedSee "ANSWER(S)"

RD=rate difference

OME=otitis media effusion

Rosenfeld (1999b) extended the approach taken by Rosenfeld, Vertrees, Carr, et al. (1994) (Table 28) and synthesized the data without regard to the individual antibiotic. The assumption was that Rosenfeld (1999b) used the same methodology as Rosenfeld, Vertrees, Carr, et al. (1994) and the quality of the methods was the same as for the 1994 study. The studies that were excluded from Rosenfeld, Vertrees, Carr, et al. (1994) (Howie and Ploussard, 1972; Thalin, Densert, Larsson, et al., 1986; and van Buchem, Dunk, and van't Hof, 1981) were included in this present study due to the difference in outcomes being assessed. The difference in relief of pain and fever at 24 hours was derived from three studies and was 0 percent (95 percent CI, 7 percent and 8 percent). Aggregating five studies, Rosenfeld (1999b) found a rate difference of 4 percent in pain and fever relief when comparing the antibiotic groups to the untreated groups at 2 days (95 percent CI, 2 percent and 7 percent). Comparing antibiotic with no treatment, the rate of difference was 5 percent for pain and fever relief at 4-7 days -- based on four studies (95 percent CI, 3 percent and 14 percent). Using four studies, the rate difference was 13 percent in complete clinical resolution at 7-14 days in favor of antibiotic therapy (95 percent CI, 8 percent and 19 percent). The Rosenfeld (1999b) meta-analysis demonstrated minimal relief of pain and fever at 2 days -- but not at 24 hours or 4-7 days -- and a modest favorable difference in clinical resolution at 7-14 days for those children on antibiotics compared with those not on antibiotics. Rosenfeld (1999b) found that antibiotics were not effective in the resolution of otitis media with effusion following AOM when measured 4-6 weeks and 3 months after treatment of AOM. It was noted that the prevalence of otitis media with effusion following AOM does decrease with time (Rosenfeld 1999b).

Comparisons

The general principle agreed upon was to compare individual antibiotics with placebo or observational treatment (Table 15). The project staff felt that practitioners choose an individual antibiotic, not an antibiotic class, when prescribing an antibiotic for treatment of AOM.

Individual antibiotics have unique characteristics whose marginal effects on treatment of AOM may be lost by grouping. These marginal effects may be due to antibacterial spectrum, pharmacokinetics, bioavailability, and minimum inhibitory concentrations to specific organisms. In addition, previous meta-analyses (described above) grouped all antibiotics together without regard to antibacterial spectrum or pharmacokinetic properties (Del Mar, Glasziou, and Hayem, 1997; Rosenfeld, 1999b; Rosenfeld, Vertrees, Carr, et al., 1994). The project staff decided that specific comparisons would not need to be repeated unless new studies had been subsequently published that may have had significant effect on the estimate.

Ampicillin or Amoxicillin vs. Placebo or Observation

Study populations

The randomized controlled trials comparing ampicillin or amoxicillin with placebo or observational treatment include Halsted, Lepow, Balassanian, et al. (1967); Laxdal, Merida, and Jones (1970); Howie and Ploussard (1972); van Buchem, Dunk, and van't Hof (1981); Burke, Bain, Robinson, et al. (1991); and Kaleida, Casselbrant, Rockette, et al. (1991). The age and otitis-prone status of the study populations in these investigations are described in the Natural History section of this chapter.

Outcomes

The outcomes assessed in these studies are as described in the Natural History section. Rosenfeld (1999b) examined the issue of pain and fever resolution, middle ear effusion, and clinical resolution of symptoms at 7-14 days. An outcome common to three or more of the studies that has not been evaluated is clinical success or failure at 2-7 days. The difficulties with using success or failure as an outcome are detailed in the Natural History section. In particular, Howie and Ploussard (1972) defined failure as the presence of exudate at 2-7 days -- a definition which was unlike those of the other studies -- that included some measure of sign or symptom resolution. van Buchem, Dunk, and van't Hof (1981) did not measure clinical success or failure at 2-7 days, and it was not included in this meta-analysis. Another difficulty was that the data in Kaleida, Casselbrant, Rockette, et al., (1991) used the number of episodes as a denominator rather than the number of unique patients. Episodes are not independent of each other because a patient could have more than one episode of AOM within the study period. The failure of a patient to respond during one episode of AOM is not independent from that patient's response during a subsequent episode of AOM.

Results

Table 29. Comparison 1: Meta-Analysis 1.1 -- Key question 3: ampicillin/amoxicillin vs. placebo; outcome indicator: failure rate at 2-7 days of treatment
Study (First Author)YearRisk Factor 1 Age <2 yrRisk Factor 2 Otitis Prone (Prior episodes)Amoxicillin/Ampicillin Sample SizePlacebo Sample SizeAmoxicillin Failure Rate (%)Placebo Failure Rate (%)Rate Difference (%)95% CI of Rate Difference (%)
Halsted196775% <2 yrNot addressed302733.325.97.4(−16.2, 31.0)
Laxdal197049% <3 yrNot addressed494810.237.5−27.3(−43.4, −11.2)
Howie1972100% <2.5 yrNot addressed3611652.879.3−26.5(−44.4, −8.6)
Burke19910% <2 yr47%>2 episodes1141181.814.4−12.7(−19.4, −5.9)
Kaleida199150% <2 yrNot addressed4884923.97.7−3.8(−6.7, −0.9)
Random effects estimates71780113.632.9−12.3(−21.8, −2.8)
Test of heterogeneity Chi-square test value51.37341.0018.83
Test of heterogeneity Chi-square test p value<0.001<0.0010.002
NNT=−8 (−36, −5)

CI=confidence interval

NNT=number needed to treat

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is f3639_F002.jpg.

   Figure 2. Shrinkage plot for outcome=failure rate at 2-7 days of treatment Comparison 1: Meta-analysis 1.1=ampicillin/amoxicillin vs. placebo

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is f3639_F003.jpg.

   Figure 3. Funnel plot for outcome=failure rate at 2-7 days of treatment Comparison 1: Meta-analysis 1.1=ampicillin/amoxicillin vs. placebo

Table 30. Comparison 1: Meta-Analysis 1.2 -- Key question 3: ampicillin/amoxicillin vs. placebo; outcome indicator: failure rate at 2-7 days of treatment (excluded Howie studies)
Study (First Author)YearRisk Factor 1 Age <2yrRisk Factor 2 Otitis Prone (Prior episodes)Amoxicillin/Ampicillin Sample SizePlacebo Sample SizeAmoxicillin Failure Rate (%)Placebo Failure Rate (%)Rate Difference (%)95%CI of Rate Difference (%)
Halsted196775% <2yrNot addressed302733.325.97.4(−16.2, 31.0)
Laxdal197049% <3yrNot addressed494810.237.5−27.3(−43.4, −11.2)
Burke19910% <2yr47%>2 epi1141181.814.4−12.7(−19.4, −5.9)
Kaleida199150% <2yrNot addressed4884923.97.7−3.8(−6.7, −0.9)
Random effects estimates6816856.119.3−9.7(−19.2, −0.2)
Test of heterogeneity Chi-square test value16.6324.3313.71
Test of heterogeneity Chi-square test p value0.001<0.0010.003NNT=−10 (−437, −5)

CI=confidence interval

NNT=number needed to treat

Table 31. Comparison 1: Meta-Analysis 1.3 -- Key question 3: ampicillin/amoxicillin vs. placebo; outcome indicator: failure rate at 2-7 days of treatment (excluded Howie, and Kaleida studies)
Study (First Author)YearRisk Factor 1 Age <2yrRisk Factor 2 Otitis Prone (Prior episodes)Amoxicillin/Ampicillin Sample SizePlacebo Sample SizeAmoxicillin Failure Rate (%)Placebo Failure Rate (%)Rate Difference (%)95%CI of Rate Difference (%)
Halsted196775%<2yrNot addressed302733.325.97.4(−16.2, 31.0)
Laxdal197049%<3yrNot addressed494810.237.5−27.3(−43.4, −11.2)
Burke19910%<2yr47%>2 epi1141181.814.4−12.7(−19.4, −5.9)
Random effects estimates19319312.525.0−12.9(−27.5, 1.7)
Test of heterogeneity Chi-square test value16.229.695.89
Test of heterogeneity Chi-square test p value<0.0010.0080.053

CI=confidence interval

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is f3639_F004.jpg.

   Figure 4. Shrinkage plot for outcome=failure rate at 2-7 days of treatment Comparison 1: Meta-analysis 1.2=ampicillin/amoxicillin vs. placebo (excluding Howie study)

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is f3639_F005.jpg.

   Figure 5. Shrinkage plot for outcome=failure rate at 2-7 days of treatment Comparison 1: Meta-analysis 1.3=ampicillin/amoxicillin vs. placebo (excluding Howie and Kaleida studies)

A meta-analysis was performed to synthesize the data from Halsted, Lepow, Balassanian, et al. (1967); Laxdal, Merida, and Jones (1970); Howie and Ploussard (1972); Burke, Bain, Robinson, et al. (1991); and Kaleida, Casselbrant, Rockette, et al. (1991) with respect to failure at 2-7 days comparing placebo or observational treatment with ampicillin or amoxicillin (Table 29, and Figures 2 and 3). This collection of studies is statistically heterogeneous, suggesting the presence of differences in the populations studied and/or research methods employed. Therefore, caution is advised in interpreting overall summary measures. The random effects model calculates a rate difference of −12.3 (95 percent CI, 21.8 and −2.8). In other words, eight children with AOM would have to be treated with ampicillin or amoxicillin to avoid a case of clinical failure. Sensitivity analyses removing various studies did not materially effect the point estimate of −12.3. Subgroup analysis by age or otitis-prone status was not possible (Tables 30 and 31, Figures 4 and 5).

Other Antibiotics vs. No Antibiotics

Other treatment regimens that were compared were the following: amoxicillin-clavulanate, penicillin G plus sulfisoxazole, penicillin V, erythromycin estolate, triple-sulfonamide, and erythromycin estolate-triple sulfonamide vs. placebo or observation.

Study Populations

Appelman, Claessen, Touw-Otten, et al. (1991) compared amoxicillin-clavulanate with placebo or observational treatment; Halsted, Lepow, Balassanian, et al. (1967) compared penicillin G plus sulfisoxazole; Laxdal, Merida, and Jones (1970) and Mygind Meistrup-Larsen, Thomsen, et al. (1981), penicillin V; Howie and Ploussard (1972) compared erythromycin-estolate, triple sulfonamide, and erythromycin-estolate-triple-sulfonamide. The issues regarding the age of these populations and their otitis-prone state are discussed in the Natural History section of this chapter.

Outcomes

The issues regarding these outcomes are the same as those described in the Natural History section.

Results

Sixteen percent of patients on amoxicillin-clavulanate had pain or fever after 3 days compared with 18 percent of those on placebo; for children younger than 2 years of age, 58 percent in the placebo group had pain or fever after 3 days compared with 27 percent in the amoxicillin-clavulanate group (Appelman, Claessen, Touw-Otten, et al., 1991). Twenty-two percent of those taking penicillin G plus sulfisoxazole were not improved at 24-72 hours compared with 26 percent in the placebo group (Halsted, Lepow, Balassanian, et al., 1968). At 14-18 days, none of the placebo group had failed while 8 percent in the penicillin G plus sulfisoxazole had not resolved. However, the denominator was small in this study. In the Laxdal, Merida, and Jones (1970) study, 38 percent failed in the observational group and 24 percent failed in the penicillin V group. In the Mygind, Meistrup-Larsen, Thomsen, et al. (1981) study, 79 percent of those on penicillin V were symptom-free by 2 days, and 86 percent had satisfactory clinical course during the acute phase; in the placebo group, the proportions were 62 percent and 69 percent. Howie and Plousard (1972) looked exclusively at the presence of exudate at 2-7 days and found that exudate was present in 79 percent of the placebo group, 76 percent of those taking erythromycin-estolate, 70 percent of those taking triple-sulfonamide, and 49 percent of those taking erythromycin-estolate-triple-sulfonamide. In general, these studies showed a modest effect of antibiotics other than ampicillin or amoxicillin on clinical failure rates (Evidence Table 2).

Antibiotic vs. Antibiotic

Having established that antibiotics have some marginal effect on treatment of AOM, it is valid to ask if certain antibiotic regimens have greater marginal effect than others. We asked: Does the specific antibiotic regimen make a difference in outcome? The possibilities for antibiotic comparisons are limitless. These possibilities depend, in part, on differences of antibiotic, dosage, schedule, duration, and other factors. The Technical Expert Panel chose five antibiotic treatments to evaluate.

Previous Meta-Analyses

Rosenfeld, Vertrees, Carr, et al. (1994) conducted a meta-analysis that investigated the clinical efficacy of antibiotics in the treatment of AOM (Table 27). The meta-analysis had good internal validity based on the criteria of Oxman, Cook, and Guyatt (1994). The primary outcome evaluated was clinical response defined by the absence of all presenting signs and symptoms of AOM at the evaluation point closest to 7-14 days after therapy was started (Rosenfeld, Vertrees, Carr, et al., 1994). The primary control rate for standard spectrum antibiotics -- defined as penicillin, erythromycin, or any aminopenicillin -- was 76.6 percent (95 percent CI, 59.9 percent and 93.3 percent) based on 26 study arms. For extended-spectrum antibiotics -- defined as antibiotics resistant to most beta-lactamases such as amoxicillin-clavulanate, trimethoprim-sulfamethoxazole, erythromycin-sulfisoxazole, penicillin-sulfisoxazole, or any cephalopsorin -- the primary control rate was 85.9 percent (95 percent CI, 73.1 percent and 98.7 percent) based on 39 study arms. Rosenfeld, Vertrees, Carr, et al. (1994) also looked at several specific comparisons: ampicillin vs. penicillin, ampicillin vs. penicillin-sulfisoxazole, aminopenicillin vs. erythromycin, aminopenicillin vs. trimethoprim-sulfamethoxazole, amoxicillin vs. cefaclor, and amoxicillin vs. cefixime. The rate differences for all six of these comparisons was not significant (Table 27) and all but one comparison (amoxicillin vs. cefaclor) were statistically homogeneous (Rosenfeld, Vertrees, Carr, et al., 1994).

Comparisons

The general principle agreed upon was to compare individual antibiotics with amoxicillin or trimethoprim-sulfamethoxazole (Table 16). (For the purposes of these comparisons, amoxicillin and ampicillin are grouped together.) The rationale for comparing individual antibiotics was the same as the one used for the analysis of antibiotics vs. no antibiotics (Key Question 3).

Antibiotics Other than Amoxicillin or Trimethoprim-Sulfamethoxazole

Traditionally, the first-line antibiotics for treatment of AOM have been amoxicillin and trimethoprim-sulfamethoxazole (Rosenfeld, 1996). A question arose as to whether antibiotics other than these added any marginal benefit to the treatment of AOM. Many of the other antibiotics in question had theoretical benefits in terms of bacterial spectrum, pharmacokinetics, bioavailability, and minimum inhibitory concentrations to specific organisms; however, they also had greater costs and more possible side effects.

Penicillin vs. Ampicillin or Amoxicillin

Study Populations

Three randomized controlled trials were evaluated that compared penicillin with ampicillin or amoxicillin (Bass, Cashman, Frostad, et al. 1973; Laxdal, Merida, and Jones, 1970; and Nilson, Poland, Thompson, et al. 1969). In one study (Milson, Poland, Thompson, et al., 1969), 79 percent of children were younger than 2 years of age; 49 percent of those children in the second study (Laxdal, Merida, and Jones, 1970) were younger than 3 years of age; and subjects in the third study (Bass, Cashman, Frostad, et al., 1973) ranged in age from 2 months to 12 years, but numbers for specific age strata were not reported. The otitis-prone status of the study patients was not addressed in any of these studies.

Outcomes

Table 32. Key Question 4a: meta-analysis comparisons (terms and definitions; success and failure)
Author/YearTerm(s)Definition(s)Time Measured
Penicillin vs. Ampicillin or Amoxicillin
SUCCESS
Laxdal/1970excellentno evidence of middle ear inflammation7 days
goodsigns of otitis media resolved14 days
fairsigns of otitis media resolved21 days
Bass/1973therapeutic effectivenessno therapeutic failure, untoward reaction, or relapse4 weeks
FAILURE
Nilson/1969unsatisfactory(1) marked injection >1/3 of TM or (2) marked decrease TM mobility on pneumatic otoscopy or (3) fluid level or bubbles or (4) otorrhea or (5) perforation or (6) marked distortion or obliteration of bony landmarks or (7) any degree of TM distension10-12 days
Laxdal/1970poorpersistent signs of minimal infection21 days
failureno improvement or deterioration7 days
Bass/1973therapeutic failureno improvement after 48 hours or exacerbation after initial improvement during 14 days of observation with repeat of therapy<14 days
Cefaclor vs. Ampicillin or Amoxicillin
SUCCESS
Berman/1983satisfactorytotal resolution of effusion with normal mobility or residual serous effusion>5 days
Jacobson/1979curedno fever, TM near normal appearance, no ear pain on exam1 week
McLinn/1980curedisappearance or improvement of signs and symptoms during therapy and elimination or reduction to insignificant numbers of pathogen10-21 days
Giebink/1984satisfactoryabsence of fever, irritability, otalgia, and TM erythema3 days after ending antibiotic
Ploussard/1984satisfactorysigns and symptoms had improved or disappearedat end of therapy
FAILURE
Jacobson/1979improvement without cureno fever, TM slowly resolving but some inflammation remaining1 week
no improvementfever, pain, TM unaltered or worse1 week
McLinn/1980failureno improvement of signs and symptoms of infection and persistence of pathogen on culture10-21 days
Berman/1983failureotoscopic findings of persistent bacterial infections (e.g. yellow or red immobile, bulging TM) with symptoms such as irritability and fever>5 days
Ploussard/1984unsatisfactoryno improvement of signs and symptoms at end of therapy>3 days to end of therapy
Cefixime vs. Ampicillin or Amoxicillin
SUCCESS
McLinn/1987favorable=cure or improvementabsence of fever, irritability, otalgia, and TM erythema10 days
Leigh/1989cureall symptoms resolved10-14 days
improvementsignificant improvement in symptomatology but without complete resolution10-14 days
Johnson/1991successabsence of fever, otorrhea, earache, and irritability3-5 days
Principi/1991cure, early outcomenormalization of clinical, otoscopic, and tympanometric findingsmidtreatment and 15 days
improvement, early outcomerelief of acute signs and symptoms with ear effusion by otoscopy and tympanometrymidtreatment and 15 days
cure, late outcomenot failure at early outcome and resolution of otitis media with effusion per otoscopic tympanometric findings30, 60, and 90 days
Owen/1993improvedTM with dull appearance and decreased mobility or a dry perforation4-6 days, 10-13 days, 31-38 days
FAILURE
McLinn/1987failurebacteriologic failure in those with repeat tympanocentesis or clinical failure including recurrence or inability to resolve fever and/or significant otalgia during therapy10 days
Leigh/1989failureno response to therapy10-14 days
Johnson/1991failurepersistent fever, pain, irritability, or otorrhea3-5 days
bacteriologic failurepathogen not eradicated3-5 days
Principi/1991failurepersistence of signs and symptoms of AOM and/or need to discontinue treatment due to adverse effectsmidtreatment and 15 days
Owen/1993bacterial failurepresence of bacterial pathogen in culture obtained while on or <24 hours after discontinuation of study medication4-6 days if without dry perforation, 10 days at discretion of investigator
clinical failurecontinued or recurrent symptoms with red or yellow, bulging TM or purulent drainage with persistent perforation4-6 days, 10-13 days, 31-38 days
Cefaclor vs. Trimethoprim-sulfamethoxazole
SUCCESS
Blumer/1984satisfactoryabsence of fever and otalgia and improved otologic exam9-10 days
Marchant/1984bacterial eradicationeradication of pathogens from the middle ear3-6 days
symptomatic improvementdecreased irritability per parent or guardian or absence of fever3-6 days
FAILURE
Howie/1985unsatisfactorybulging eardrum or middle-ear drainage14 days
As seen in Evidence Table 3, the outcomes measured in these three studies were not uniform. The only outcome common to all three studies was failure at 7-14 days of treatment. The definitions of failure were not uniform across the studies (Table 32).

Results

Table 33. Comparison 2: Meta-Analysis 2.1 -- Key question 4a: penicillin vs. ampicillin/amoxicillin; outcome indicator: failure rate at 7-14 days of treatment
Study (First Author)YearRisk Factor 1 Age <2yrRisk Factor 2 Otitis Prone (Prior episodes)Penicillin Sample SizeAmoxicillin or Ampicillin Sample SizePenicillin Failure Rate (%)Amoxicillin Failure Rate (%)Rate Difference (%)95% CI of Rate Difference (%)
Nilson196979%<2yrNot addressed9610128253(−9, 16)
Laxdal197049%<3yrNot addressed4549241014(−1, 29)
Bass19732mo-12yrNot addressed1001001192(−6, 10)
Random effects estimates24125020.614.44.5(−1.8, 10.7)
Test of heterogeneity Chi-square test value10.859.861.97
Test of heterogeneity Chi-square test p value0.0040.0070.374

CI=confidence interval

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is f3639_F006.jpg.

   Figure 6. Shrinkage plot for outcome=failure rate at 7-14 days of treatment Comparison 2: Meta-analysis 2.1=penicillin vs. ampicillin/amoxicillin

A meta-analysis was performed that synthesized the data on failure at 7-14 days from the three studies. The statistical test for heterogeneity was insignificant. The calculated rate difference was 4.5 percent (95 percent CI, −1.8 percent and 10.7 percent), which indicated no significant difference (Table 33 and Figure 6).

The study by Laxdal, Merida, and Jones (1970) indicated that for children younger than age 3 years and those age 3-6 years, ampicillin might be more effective than penicillin in treating AOM. The authors reported a 15 percent failure rate for ampicillin vs. a 32 percent for penicillin in children younger than age 3, and 0 percent failure vs. 30 percent for children age 3-6 years, respectively. However, denominators were not provided for these estimates (Laxdal, Merida, and Jones, 1970) (Evidence Table 3). Nilson, Poland, Thompson, et al. (1969) provided estimates stratified by bacterial isolate, which suggested that ampicillin might be more effective than penicillin V in treating patients whose cultures yielded Haemophilus influenzae (29 percent failure vs. 67 percent, respectively) (Evidence Table 3). Due to lack of information reported in the studies, meta-analysis by subgroups was not performed.

Cefaclor vs. Ampicillin or Amoxicillin

Study Populations

Five randomized controlled trials compared ampicillin or amoxicillin with cefaclor (Berman and Lauer, 1983; Giebink, Batalden, Russ, et al., 1984; Jacobson, Metcalf, Parkin, et al., 1979; McLinn, 1980; and Ploussard, 1984). The study by Berman and Lauer (1983) focused exclusively on infants age 1-3 months and in the study by Ploussard (1984), 84 percent of the subjects were younger than 2 years of age. McLinn (1980) reported that 45 percent of the subjects were younger than 2 years of age, and Giebink, Batalden, Russ, et al. (1984) reported 44 percent. Jacobson, Metcalf, Parkin, et al. (1979) listed an age range of 1-12 years and a mean age of 3.9 years. Giebink, Batalden, Russ, et al. (1984) reported that 41 percent of their study subjects had more than five previous episodes of AOM. The other studies did not address the otitis-prone state of their subjects.

Outcomes

As seen in Evidence Table 3, the outcomes had some commonalities and several differences. Two outcome indicators that were common to more than two studies in this group were failure rate at 3-7 days and failure rate at 5-21 days. As seen in Table 33, the definition of failure or its equivalent term was somewhat different among studies.

Results

Table 34. Comparison 3: Meta-Analysis 3.1. Key question 4a: cefaclor vs. ampicillin/amoxicillin; outcome indicator: failure rate at 3-7 days of treatment
Study (First Author)YearRisk Factor 1 Age <2 yrRisk Factor 2 Otitis Prone (Prior episodes)Cefaclor Sample SizeAmoxicillin or Ampicillin Sample SizeCefaclor Failure Rate (%)Amoxicillin Failure Rate (%)Rate Difference (%)95%CI of Rate Difference (%)
Jacobson19791-12 yrNot addressed131515132(−24, 28)
Berman19831-3 moNot addressed19212629−2(−30, 25)
Giebink198444% <2 yr41%>5 episodes313023176(−14, 26)
Ploussard198484% <2 yrNot addressed2729014−14(−26, −1)
Random effects estimates909514.616.8−5.4(−15.2, 4.4)
Test of heterogeneity Chi-square test value14.851.793.05
Test of heterogeneity Chi-square test p value0.0020.6160.383

CI=confidence intervals

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is f3639_F007.jpg.

   Figure 7. Shrinkage plot for outcome=failure rate at 3-7 days of treatment Comparison 3: Meta-analysis 3.1=cefaclor vs. ampicillin/amoxicillin

The meta-analysis synthesized data from four studies for the outcome on failure at 3-7 days of treatment (Table 34 and Figure 7). Although the four studies appeared to be quite different with regard to the age of the study populations, the test for heterogeneity was insignificant. The rate difference was −5.4 percent for cefaclor vs. ampicillin or amoxicillin (95 percent CI, −15.2 percent and −4.4 percent), which indicates lack of statistical significance.

Table 35. Comparison 3: Meta-Analysis 3.2. Key question 4a: cefaclor vs. ampicillin/amoxicillin; outcome indicator: failure rate at 5-21 days of treatment
Study (First Author)YearRisk Factor 1 Age <2yrRisk Factor 2 Otitis Prone (Prior episodes)Cefaclor Sample SizeAmoxicillin or Ampicillin Sample SizeCefaclor Failure Rate (%)Amoxicillin Failure Rate (%)Rate Difference (%)95% CI of Rate Difference (%)
Jacobson19691-12yrNot addressed131515132(−24, 28)
McLinn198045% <2yrNot addressed6466594(−13, 4)
Berman19831-3moNot addressed19212629−2(−30, 25)
Giebink198444% <2yr41%>5 episodes313023176(−14, 26)
Ploussard198484% <2yrNot addressed2729014−14(−26, −1)
Random effects estimates15416115.813.00.5(−5.7, 6.8)
Test of heterogeneity Chi-square test value15.5619.703.16
Test of heterogeneity Chi-square test p value0.0040.0010.531

CI=confidence intervals

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is f3639_F008.jpg.

   Figure 8. Shrinkage plot for outcome=failure rate at 5-21 days of treatment Comparison 3: Meta-analysis 3.2=cefaclor vs. ampicillin/amoxicillin

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is f3639_F009.jpg.

   Figure 9. Funnel plot for outcome=failure rate at 5-21 days of treatment Comparison 3: Meta-analysis 3.2=cefaclor vs. ampicillin/amoxicillin

Five studies were eligible for the meta-analysis that evaluated failure at 5-21 days (Table 35 and Figures 8 and 9). The studies were not statistically heterogeneous. The rate difference was 0.5 percent (95 percent CI; −5.7 percent and −6.8 percent), indicating no significant differences.

The Berman and Lauer (1983) study, which evaluated infants 1-3 months of age, also showed no difference in terms of treatment failure after 5 days of treatment (Evidence Table 3). Subgroup analysis by quantitative synthesis could not be performed by age or otitis-prone status due to lack of information reported in this group of studies.

Cefixime vs. Ampicillin or Amoxicillin

Study populations

Five randomized controlled trials were evaluated for the comparison of cefixime with ampicillin or amoxicillin (Johnson, Carlin, Super, et al., 1991; Leigh, Robinson, and Millar, 1989; McLinn, 1987; Owen, Anwar, Nguyen, et al., 1993; and Principi and Marchisio, 1991). The study by McLinn (1987) included 61 percent of subjects younger than 2 years of age, and the Principi and Marchisio (1991) study included 40 percent in that age group. The subjects in the Johnson, Carlin, Super, et al. (1991) study had a mean age of 1.5 years and in the Owen, Anwar, Nguyen, et al. (1993) study, a mean age of 1.8 years. The mean age of subjects in the Leigh, Robinson, and Millar (1989) study was 4.9 years. Twenty-seven percent of children in the Johnson, Carlin, Super, et al. (1991) study had more than three prior episodes of AOM, and 26 percent in the Owen, Anwar, Nguyen, et al. (1993) study had more than two episodes. In the Principi and Marchisio (1991) study, 38 percent had one or more episodes of AOM; in the McLinn (1987) study, that number was 62.5 percent. Leigh, Robinson, and Millar (1989) did not address the otitis-prone status of their patients.

Outcomes

As seen in Evidence Table 3, a wide range of outcomes was measured in these five studies, and they were not always overlapping. Common outcomes included failure at 10-15 days, recurrence at 3-5 weeks, diarrhea, vomiting, and rash. Table 33 shows the differences in definition of failure.

Results

Table 36. Comparison 4: Meta-Analysis 4.1. Key question 4a: cefixime vs. ampicillin/amoxicillin; outcome indicator: failure rate at 10-15 days of treatment
Study (First Author)YearRisk Factor 1 Age <2yrRisk Factor 2 Otitis Prone (Prior episodes)Cefixime Sample SizeAmoxicillin or Ampicillin Sample SizeCefixime Failure Rate (%)Amoxicillin Failure Rate (%)Rate Difference (%)95% CI of Rate Difference (%)
McLinn198761%<2yr62.5%>1 episodes3034330(−8, 9)
Leigh19896m-16yrNot addressed15015055−1(−6, 4)
Principi199140%<2yr38%>1 episodes202010100(−19, 19)
Owen19932m-6yr26%>3 episodes746126233(−12, 17)
Random effects estimates27426510.08.9−0.1(−4.2, 3.9)
Test of heterogeneity Chi-square test value16.5811.490.21
Test of heterogeneity Chi-square test p-value0.0010.0090.976

CI=confidence interval

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is f3639_F010.jpg.

   Figure 10. Shrinkage plot for outcome=failure rate at 10-15 days of treatment Comparison 4: Meta-analysis 4.1=cefixime vs. ampicillin/amoxicillin Comparison 4: Meta-analysis 4.1=cefixime vs. ampicillin/amoxicillin

Four studies were used for the meta-analysis on failure at 10-15 days of treatment (Table 36 and Figure 10). The studies were statistically homogeneous. The calculated rate difference was −0.1 percent (95 percent CI, −4.2 percent and 3.9 percent), indicating that the rate difference was not statistically different from 0.

Table 37. Comparison 4: Meta-Analysis 4.2. Key question 4a: cefixime vs. ampicillin/amoxicillin; outcome indicator: recurrence at 3-5 weeks of treatment
Study (First Author)YearRisk Factor 1 Age <2 yrRisk Factor 2 Otitis Prone (Prior episodes)Cefixime Sample SizeAmoxicillin or Ampicillin Sample SizeCefixime Failure Rate (%)Amoxicillin Failure Rate (%)Rate Difference (%)95% CI of Rate Difference (%)
McLinn198761% <2 yr62.5% >1 episodes3034330(−8, 9)
Johnson19912m-13 yr27% >3 episodes202015150(−22, 22)
Principi199140% <2 yr38% >1 episodes2020505(−5, 15)
Random effects estimates70745.03.11.6(−5.1, 8.4)
Test of heterogeneity Chi-square test value1.833.040.37
Test of heterogeneity Chi-square test p-value0.4010.2910.832

CI=confidence intervals

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is f3639_F011.jpg.

   Figure 11. Shrinkage plot for outcome=recurrence at 3-5 weeks of treatment Comparison 4: Meta-analysis 4.2=cefixime vs. ampicillin/amoxicillin

Three studies were synthesized for the analysis on recurrence at 3-5 weeks (Table 37 and Figure 11). The studies were not heterogeneous. The rate difference (1.6 percent) was insignificant (95 percent CI, −5.1 percent and 8.4 percent).

Table 38. Comparison 4: Meta-Analysis 4.3. Key question 4a: cefixime vs. ampicillin/amoxicillin; outcome indicator: diarrhea as an adverse event
Study (First Author)YearRisk Factor 1 Age <2yrRisk Factor 2 Otitis Prone (Prior episodes)Cefixime Sample SizeAmoxicillin or Ampicillin Sample SizeCefixime Failure Rate (%)Amoxicillin Failure Rate (%)Rate Difference (%)95% CI of Rate Difference (%)
McLinn198761% <2yr62.5% >1 episodes606017152(−11,15)
Leigh19896m-16yrNot addressed1501501339(3, 15)
Johnson19912m-13yr27% >3 episodes595134294(−13, 22)
Principi199140% <2yr38% >1 episodes202015150(−22, 22)
Owen19932m-6yr26% >3 episodes9193291415(3, 26)
Random effects estimates38037421.014.38.4(3.8, 13.1)
Test of heterogeneity Chi-square test value15.7026.362.95
Test of heterogeneity Chi-square test p value0.003<0.0010.567
NNT=12 (8, 27)

CI=confidence intervals

NNT=number needed to treat

Table 39. Comparison 4: Meta-Analysis 4.4. Key question 4a: cefixime vs. ampicillin/amoxicillin; outcome indicator: vomiting as an adverse event
Study (First Author)YearRisk Factor 1 Age <2yrRisk Factor 2 Otitis Prone (Prior episodes)Cefixime Sample SizeAmoxicillin or Ampicillin Sample SizeCefixime Failure Rate (%)Amoxicillin Failure Rate (%)Rate Difference (%)95% CI of Rate Difference (%)
McLinn198761% <2yr62.5% >1 episodes606012210(1, 19)
Leigh19896m-16yrNot addressed150150101(−1, 3)
Johnson19912m-13yr27% >3 episodes5951863(−7, 12)
Principi199140% <2yr38% >1 episodes2020505(−5, 15)
Owen19932m-6yr26% >3 episodes9193742(−4, 9)
Random effects estimates3803745.81.62(0, 4)
Test of heterogeneity Chi-square test value11.267.543.79
Test of heterogeneity Chi-square test p value0.0240.1100.435

CI=confidence interval

Table 40. Comparison 4: Meta-Analysis 4.5. Key question 4a: cefixime vs. ampicillin/amoxicillin; outcome indicator: rash as an adverse event
Study (First Author)YearRisk Factor 1 Age <2yrRisk Factor 2 Otitis Prone (Prior episodes)Cefixime Sample SizeAmoxicillin or Ampicillin Sample SizeCefixime Failure Rate (%)Amoxicillin Failure Rate (%)Rate Difference (%)95% CI of Rate Difference (%)
McLinn198761% <2 yr62.5% >1 episodes606015213(4, 23)
Leigh19896m-16 yrNot addressed15015012−1(−4, 1)
Johnson19912m-13 yr27% >3 episodes5951221012(−1, 26)
Owen19932m-6 yr26% >3 episodes919314104(−6, 13)
Random effects estimates36035412.44.75.8(−2.4, 13.9)
Test of heterogeneity Chi-square test value36.719.9012.11
Test of heterogeneity Chi-square test p value<0.0010.0190.007

CI=confidence limits

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is f3639_F012.jpg.

   Figure 12. Shrinkage plot for outcome=diarrhea as an adverse effect Comparison 4: Meta-analysis 4.3=cefixime vs. ampicillin/amoxicillin

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is f3639_F013.jpg.

   Figure 13. Funnel plot for Outcome=diarrhea as an adverse effect Comparison 4: Meta-analysis 4.3=cefixime vs. ampicillin/amoxicillin

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is f3639_F014.jpg.

   Figure 14. Shrinkage plot for outcome=vomiting as an adverse effect Comparison 4: Meta-analysis 4.4=cefixime vs. ampicillin/amoxicillin

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is f3639_F015.jpg.

   Figure 15. Shrinkage plot for outcome=rash as an adverse event Comparison 4: Meta-analysis 4.5=cefixime vs. ampicillin/amoxicillin

The five studies in this comparison group were included in three meta-analyses that looked at adverse effects presumably secondary to the antibiotics (Tables 38-40 and Figures 12-15). For diarrhea as the outcome, there was no heterogeneity in the rate difference; however, the heterogeneity of the incidence rates within antibiotic groups was significant. The rate difference was 8.4 percent (95 percent CI, 3.8 percent and 13.1 percent), favoring ampicillin or amoxicillin when compared with cefixime. Twelve children would need to be treated with ampicillin or amoxicillin rather than cefixime to avoid one case of diarrhea. For vomiting as the outcome, there was no heterogeneity statistically. The rate difference between cefixime and ampicillin or amoxicillin was 2 percent (95 percent CI, 0 percent and 4 percent), indicating no significant differences. For rash as the outcome, statistical heterogeneity existed in the incidence rates and rate difference. However, the rate difference of 5.8 percent (95 percent CI, −2.4 percent and 13.9 percent) was not significant.

The persistence of Haemophilus influenzae was reported as 0 of 10 in the cefixime group and 5 of 13 in the amoxicillin group in the Johnson, Carlin, Super, et al. (1991) study and 3 of 34 and 9 of 35, respectively, in the Owen, Anwar, Nguyen, et al. (1993) study. Subgroup analysis based on age or otitis-prone status was not reported in any of the studies and was not performed.

Other Antibiotics vs. Ampicillin or Amoxicillin

Other treatment regimens we compared with ampicillin or amoxicillin included: cephalexin, cephradine, cefuroxime-axetil, ceftriaxone, loracarbef, erythromycin-estolate, erythromycin-ethylsuccinate, clarithromycin, clindamycin, triple sulfonamide, penicillin G plus sulfisoxazole, penicillin V plus sulfisoxazole, penicillin V plus triple sulfonamide, procaine-penicillin-benthazine-penicillin-G plus sulfisoxazole, erythromycin-ethylsuccinate-sulfisoxazole, erythromycin-ethylsuccinate-acetyl-sulfafurazole, and erythromycin-sulfisoxazole.

Study populations

The studies varied in age of subjects. Four studies were very clear in what proportion of subjects were younger than 2 years of age (Brodie, Griggs, and Cunningham, 1990; Halsted, Lepow, Balassanian, et al., 1967; Nilson, Poland, Thompson, et al., 1969; and Scholz and Noack, 1998). The majority of the remaining studies reported the mean age or age range.

Outcomes

Various outcomes were measured in these studies. The definitions for success and failure were not uniform (Evidence Table 3).

Results

Table 41. Key Question 4a. Studies not in meta-analytic comparisons: synopsis
Author/YearComparator AntibioticAgeOtitis ProneResult
Ampicillin or Amoxicillin vs.:
Bass/1967Procaine PCN+Bicillin+sulfisoxazole PCN V+sulfisoxazole Oxytetracycline<5 years (70%); mean 3.6 yearsNot addressedNo difference for failure <14 days for any comparator antibiotic
Halsted/1967, 1968PCN G+sulfisoxazole<2 years (75%)Not addressedNo difference for failure at 24-72 hours
Nilson/1969PCN V+sulfonamide (also PCN V)<6 months (15%); 6-12 months (27%); 1-<2 years (36%); 2-3 years (21%)Not addressedNo difference in unsatisfactory outcome at 10-12 days
Bass/1973PCN V+sulfisoxazole Erythromycin estolate (also PCN V)<3 years ("half")Not addressedNo difference in failure at <14 days or relapses
Feigin/1973ClindamycinMean 1.6 yearsNot addressedNo difference in response at 3-4 days
Nassar/1974CephalexinMean 4.9 yearsOtitis prone (52%)No difference in failure at 14 days
Stechenberg/1976CephalexinMean 1.5 yearsNot addressedNo difference in clinical response by 10 days
McLinn/1979CephradineMean cephradine 1.9 years and amoxicillin 2.4 yearsNot addressedNo difference in initial improvement or in overall outcome at 10 days or recurrence through 12 months
Rodriguez/1985Erythromycin sulfisoxazoleMean 3.2 yearsNot addresssedNo difference in failure at 10-14 days, recurrence at 30 days, or persistent middle ear effusion at 10-14 or 28 days
Table 41. Key Question 4a. Studies not in meta-analytic comparisons: age and otitis prone status
Brodie/1990Cefuroxime axetil<2 years (36%)Not addressedNo difference for failure 1-4 days; no difference stratified by age
Foshee/1992LoracarbefMean loracarbef 3.36 years and amoxicillin 3.59 yearsNot addressedNo difference in failure at 7-10 days
Coles/1993ClarithromycinMean clarithromycin 5.8 years and amoxicillin 5.3 yearsNot reportedNo difference in failure at 6-9 days
Pukander/1993ClarithromycinRange 1-12 yearsNot addressedNo difference in failure at 48 hours
Kara/1998Cefuroxime-axetil (also ceftriaxone)Range 6 months-6 yearsNot addressedNo difference in failure at 5 days
Lenoski/1968EES; Triple sulfonamide (also EES+triple sulfonamide)<3 years (58%)Not addressedNo difference in failure at 14 days but numbers small; no difference stratified by age but numbers small
Scholz/1998Erythromycin estolate<2 years (14%)Not addressedNo difference in failure at 9-11 days nor recurrence up to 41 days
Feldman/1990Amoxicillin-clavulanateMean 60 monthsNot addressedFailure at 12-16 days was 7 of 101 in the TMP-SMX and 18 of 101 for amoxicillin-clavulanate, p=0.03

PCN=penicillin

EES=erythromycin ethylsuccinate

TMP-SMX=trimethoprim-sulfamethoxazole

All comparisons in this group showed no difference in various failure rates measured at various points in time. A few looked at age-stratified outcomes. No difference was found between cefuroxime-axetil and ampicillin when stratified by age (Brodie, Griggs, and Cunningham, 1990). Lenoski, Wingert, and Wehrle (1968), who compared erythromycin-ethylsuccinate with ampicillin, presented the failure at day 14, stratified by age. No difference was noted for subjects younger than 3 years of age, but the number of patients in the study was small. For those 3 years or older, none of the children on erythromycin-ethylsuccinate failed therapy, while 36 percent of those on ampicillin failed; again, the number of patients in the study was small. None of these studies stratified the findings by otitis-prone status (Evidence Table 3 and Table 41).

Cefaclor vs. Trimethoprim-Sulfamethoxazole

Study populations

Three studies were eligible for this comparison (Blumer, Bertino, and Husak, 1984; Howie, Dillard, and Lawrence, 1985; and Marchant, Shurin, Turcyzk, et al., 1984). All children in the Marchant, Shurin, Turcyzk, et al. (1984) study were younger than 2 years of age. The subjects in the Blumer, Bertino, and Husak (1984) study ranged from 3 months to 7 years of age. Howie, Dillard, and Lawrence (1985) did not report on the ages of their patients. In the Blumer, Bertino, and Husak (1984) study, 38 percent of the patients were described as having recurrent otitis. In the other two studies, the issue of otitis-prone status was not addressed.

Outcomes

Some of the outcomes for each study are listed in Evidence Table 4. Of note, the Marchant, Shurin, Turcyzk, et al. (1984) study looked at bacterial persistence. The common outcome among these three studies was failure rate at less than 14 days of treatment. The definitions of failure are found in Table 33.

Results

Meta-analysis of the data from the three studies on the failure rate at less than 14 days of treatment comparing cefaclor with trimethoprim-sulfamethoxazole yielded a pooled rate difference of 5.5 percent (95 percent CI, −1.6 percent and 12.6 percent), a rate that was not statistically significant. Although the studies showed significant heterogeneity among failure rates, their rate differences were not significantly heterogeneous.

Data from the Marchant, Shurin, Turcyzk, et al. (1984) study showed that cefaclor had an overall bacterial persistence rate of 30 percent while that for trimethoprim-sulfamethoxazole was 5 percent; however, the number of subjects was small (Evidence Table 3).

Amoxicillin-Clavulanate and Ceftriaxone vs. Trimethoprim-Sulfamethoxazole

Study populations

Two studies compared trimethoprim-sulfamethoxazole with amoxicillin-clavulanate or ceftriaxone (Barnett, Teele, Klein, et al., 1997 and Feldman, Sutcliffe, and Dulberg, 1990). One study (Barnett, Teele, Klein, et al., 1997) accounted for the otitis-prone status of their patients in the analysis.

Outcomes

As with the studies in the meta-analytic comparisons, the outcomes in this group also were diverse and nonuniform in the selection and definition of success and failure.

Results

No trend was observed favoring amoxicillin-clavulanate or ceftriaxone over trimethoprim-sulfamethoxazole or vice versa. In the Barnett, Teele, Klein, et al. (1997) study, those identified as otitis prone had a failure rate of 24 percent in the ceftriaxone group and 23 percent in the trimethoprim-sulfamethoxazole group. The respective numbers for the patients who were not otitis prone were 26 percent and 19 percent. The Barnett, Teele, Klein, et al. (1997) data suggested that the otitis-prone status of the child did not have an effect on the outcome of failure at 14 days.

Utility of Oral Fluoroquinolones

No studies were found that compared oral fluoroquinolones with another antibiotic in the initial treatment of uncomplicated AOM in childhood.

High Dose vs. Standard Dose of Amoxicillin-Clavulanate

As the incidence of bacterial resistance to antibiotics increases, modifications in treatment of AOM must be considered. These modifications may include use of different or new antibiotics or the use of familiar antibiotics in new ways. One proposal has been to increase the dosage of amoxicillin or amoxicillin-clavulanate. The question we posed was: What is the value of using > 60 mg/kg/day of amoxicillin or amoxicillin-clavulanate vs. the standard 40 mg/kg/day in the initial treatment of uncomplicated AOM?

Study Populations

One study compared high-dose amoxicillin-clavulanate with standard-dose amoxicillin-clavulanate in the treatment of AOM in children, 43 percent of whom were younger than 2 years of age. The issue of otitis-prone status was not addressed (Bottenfield, Burch, Hedrick, et al., 1998).

Outcomes

The study assessed clinical response at the end of therapy, recurrence at 22-28 days, and adverse effects (Bottenfield, Burch, Hedrick, et al., 1998).

Results

The children on high-dose amoxicillin-clavulanate had a failure rate of 31 percent at the end of therapy, while those on standard dose had a 32 percent failure rate. Sixteen percent of the high-dose group had recurrence at 22-28 days, while 21 percent of the standard-dose group had recurrence. In the high-dose group, 50 percent experienced an adverse effect compared with 47 percent of those on the standard dose; this was true for vomiting specifically, 6 percent vs. 8 percent, respectively. Results were not reported by age (Evidence Table 4).

Amoxicillin Therapy Twice a Day vs. Three Times a Day

Compliance with antibiotic treatment of AOM has been an issue. One proposal to increase compliance is to decrease the daily dosages of antibiotics from three to two.

Study Populations

One study was identified that addressed the issue of high-dose amoxicillin two times a day vs. three times a day (Principi, Marchisio, Bigalli, et al., 1986). Fourteen percent of the patients were younger than 1 year old, and 67 percent were 1-5 years of age. Six percent had had three or more prior episodes of AOM, and 29 percent had had one or two prior episodes.

Outcomes

Principi, Marchisio, Bigalli, et al. (1986) looked at clinical cure or failure and presence of unilateral or bilateral effusion at 15 days and clinical cure, presence of unilateral or bilateral effusion, and recurrence at 30 days, 60 days, and 90 days.

Results

Reported outcomes were stratified by laterality of disease (Evidence Table 4). The only statistically significant difference between twice-daily amoxicillin and thrice-daily amoxicillin was the presence of bilateral effusion at 30 days followup in the group with initial unilateral disease. At 60-day and 90-day followup, this difference was not observed. The authors (Principi, Marchisio, Bigalli, et al. 1986) also noted that the persistence of middle ear effusion at 90 days "was independent of the number of previous episodes of the disease and of the age of the child at entry," although the data were not reported.

Short-Term Vs. Long-Term Antibiotic Therapy

As already noted, compliance with antibiotic treatment of AOM has been an important issue to the practitioner and patient. Another proposal to increase compliance is to decrease the duration of therapy. The question we posed was: What is the comparative effectiveness of short-term vs. long-term antibiotic therapy in children younger than 2 years of age and those older than 2 years of age in the initial treatment of uncomplicated AOM?

Previous Meta-Analyses

Table 42. Summary of Kozyrskyj, Hildes-Ripstein, Longstaffe, et al. (1998) meta-analysis
TitleLiterature SourcesPaper TrailQuestionsResultsAuthor Conclusions/Reviewer CommentsSourceInclusion CriteriaQuality ControlAuthorsExclusion CriteriaArticles/Patients
Treatment of Acute Otitis Media With a Shortened Course of Antibiotics: A Meta-analysis.MEDLINE, 1/66-7/97; EMBASE, 1/74-7/97; Current Contents, 1/97-7/97; Science Citation Index searches; reference lists of relevant publications; no language restrictions and two trials included in the analysis were from non-English language reportsincludes details on numbers of articles at each stage of selection and detailed descriptive information on included articles.1) Are short-acting antibiotics given for 48 hours or less as effective as antibiotics given for at least 7 days in treatment of AOM? 2) Are short-acting antibiotics given for more than 48 hours but < 5 days as effective as antibiotics given for at least 7 days of treatment of AOM? 3) Is ceftriaxone as effective as antibiotics given for 10 days treatment of AOM? 4) Is 3-5 days of azithromycin as effective as 10 days of another antibiotic in treatment of AOM? stratifications: older and younger than 2 years; perforated and nonperforated tympanic membranes primary outcome: treatment failure noted by lack of clinical resolution or relapse or recurrence of AOM during a 31-day period following therapy initiation as defined by improvement or resolution of presenting signs and symptoms secondary outcome: cumulative number of treatment failures, relapses, and recurrences from diagnosis until final evaluation at 1-3 months (MEE was not counted a treatment failure.)1) OR for treatment failure at less than one month 2.99(1.04-8.54) 2) a) OR for treatment failure at 8-10 days 1.38(1.15-1.66) 2) b) OR for treatment failure at 20-30 days 1.22(0.98-1.54) (Results 2) a) did not change with quality of study, adequacy of concealment of treatment allocation, exclusion of children with chronic or recurrent OM. 2) b) results for the most part were also not affected.) 3) OR for treatment failure at one month or less and at 3 months or less 1.25 (0.90-1.72) and 0.91 (0.57-1.47) respectively 4) OR for treatment failure 1.09 (0.86-1.38) OR for gastrointestinal side effects for short course versus long course short-acting antibiotics 0.54 (0.43-0.66) when amoxicillin-clavulanate was included in the analysis. Children on azithromyicin also had less likelihood of gastrointestinal side effects OR 0.26 (0.19-0.37)1) Short-acting antibiotics for < 48 hours is not as effective. 2) "Our meta-analysis results indicate that at an early evaluation point (8 to 19 days) a reduction in treatment from 10 to 5 days of short-acting antibiotics may slightly increase the risk of a child experiencing signs and symptoms or relapse or reinfection...However, by 30 days following initiation of therapy, a longer course of short-acting antibiotics was comparable to a 5-day course in terms of these outcomes...13 children would require treatment with a long course of antibiotics to prevent 1 excess failure following treatment with a shorter course....the risk difference at 1 month following treatment dropped to 2.3%...44 children requiring treatment with a longer course of antibiotics to prevent 1 failure following treatment." 3) Ceftriaxone was comparable. 4) Azithromycin was comparable. The authors state that subgroup samples were too small to assess the proposed stratifications. Good discussion of plausibility of results and weaknesses of the study by the authors. Possible RCTs published since analysis: 4?JAMArandomized controlled trials; treatment of AOM; comparing different durations of antibiotic treatment, fewer than 7 days vs at least 7 days; patients 4 weeks to 18 years age; no antimicrobial therapy at time of diagnosis; an assessment of clinical resolution of AOMYes (per Moher, Jadad, Nichol, et al., 1995) average score 2.66(SD,0.97) (0-5 possible) Also rated for concealment of treatment allocation. 9 trials in 8 articles reported adequate concealmentKozyrskyj, Hildes-Ripstein, Longstaffe, et al., 1998planned surgical cointervention except myringotomy subsequent to treatment failure or tympanocentesis (use of a second antibiotic was deemed a treatment failure and not excluded)29 with 32 trials/9073 (each meta-analysis utilized at most 5 studies) (only 31% of studies on short-acting antiiotics excluded children with chronic or recurrent OM)

AOM=acute otitis media

MEE=middle ear effusion

OM=otitis media

OR=odds ration

RCT=randomized controlled trial

A meta-analysis was conducted that compared short-duration with long-duration antibiotic therapy for the treatment of AOM (Kozyrskyj, Hildes-Ripstein, Longstaffe, et al. 1998) (Table 42). The meta-analysis met the validity requirements listed in Oxman, Cook, and Guyatt (1994). The primary outcome evaluated was treatment failure, which was defined as the lack of clinical resolution or relapse or recurrence of AOM, during a 31-day period following the initiation of therapy. Clinical resolution meant that the presenting signs or symptoms of AOM had improved or resolved. The meta-analysis also looked at "the cumulative number of treatment failures, relapses, and recurrences reported from time of diagnosis until a final evaluation point between 1 to 3 months." Antibiotics in the short-duration arms of the comparison were grouped by "pharmacokinetic behavior" into short-acting oral antibiotics (i.e., penicillin V potassium, amoxicillin, cefaclor, cefuroxime), oral azithromycin, and intramuscular ceftriaxone. Duration of the short-acting oral antibiotics also was stratified into 48 hours or less and greater than 48 hours. Subgroup analyses that were based on two age groups (younger than and older than age 2 years) could not be conducted because the number of subjects was too small (Kozyrskyj, Hildes-Ripstein, Longstaffe, et al., 1998).

Synthesizing two studies on short-acting antibiotics given for 48 hours or less vs. long-duration therapy, the odds ratio was 2.99 (95 percent CI, 1.04 percent and 8.54 percent), which indicates a significant difference in risk when looking at treatment failure at less than 1 month followup; however, only two studies were quantitatively synthesized in this comparison. Comparing short-acting antibiotics given for more than 48 hours and less than 5 days vs. therapy of at least 7 days with treatment failure at 8-10 days as the outcome, the odds ratio was 1.38 (95 percent CI, 1.15 percent and 1.66 percent), which indicates a significant difference in risk. In the previous comparison, if the outcome was treatment failure at 20-30 days, the odds ratio was reduced to 1.22 (95 percent CI, 0.98 percent and 1.54 percent), indicating no significant difference in risk. These last two results were not affected by study quality, adequacy of treatment allocation concealment, or exclusion of subjects with chronic or recurrent otitis media.

The comparison of ceftriaxone to antibiotic duration of 10 days yielded an odds ratio for treatment failure at less than 1 month followup of 1.25 (95 percent CI, 0.90 percent and 1.72 percent), indicating no significant difference in risk. For treatment failure at less than 3 months followup, the odds ratio was 0.91 (95 percent CI, 0.57 percent and 1.47 percent), indicating no significant difference in risk. The meta-analysis on treatment for 3-5 days with azithromycin vs. 10-day therapy with another antibiotic yielded an odds ratio of 1.09 (95 percent CI, 0.86 percent and 1.38 percent), indicating no significant difference in risk.

It was concluded that treatment with short-acting antibiotics given for less than 48 hours was not as effective as antibiotic therapy given for at least 7 days (Kozyrskyj, Hildes-Ripstein, Longstaffe, et al., 1998), and that decreasing the duration of therapy from 10 days to 5 days might slightly increase the risk of treatment failure at 8-10 days (although by 30 days that difference would no longer exist). The latter conclusion is invalid because the difference in risk between 5-day and 10-day therapies at 20-30 days was not significant. In other terms, for the previous comparison, 13 children would need to be treated with the longer-duration therapy to prevent one excess failure that would occur with the 5-day treatment relative to 8-10 day treatment failure. Ceftriaxone and 3- to 5-day azithromycin seemed comparable to 10-day antibiotic treatment.

Comparisons

Our analysis compared short-duration with long-duration antibiotic therapy of AOM. The short-duration arm was stratified into those regimens of less than 5-day duration and those with 5-day duration (Table 17). (For these comparisons, amoxicillin and ampicillin were grouped together.) The rationale for comparing individual antibiotics was the same as that provided for other parts of the analysis.

Ceftriaxone (1 dose) vs. Amoxicillin (7-10 days)

Study populations

Table 43. Comparison 9: Meta-Analysis 9.1. Key Question 4e: Ceftriaxone (1 dose) with amoxicillin (7-10d) outcome indicator: failure rate at 5-10 days of treatment
Study (First Author)YearRisk Factor 1 Age <2yrRisk Factor 2 Otitis Prone (Prior episodes)Ceftriaxone Sample SizeAmoxicillin Sample SizeCeftriaxone Failure Rate (%)Amoxicillin Failure Rate (%)Rate Difference (%)95% CI of Rate Difference (%)
Varsano19886 mo-8 yr58% >2 epidoes222218145(−17, 26)
Green19935 mo-5 yr18% >2 episodes105107633(−3, 8)
Kara19986 mo-6 yrNot addressed25251688(−10, 26)
Random effects estimates15215410.55.13.4(−1.6, 8.5)
Test of heterogeneity Chi-square test value3.652.790.30
Test of heterogeneity Chi-square test p value0.1610.2480.862

CI=confidence intervals

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is f3639_F016.jpg.

   Figure 16. Shrinkage plot for outcome=failure rate at 5-10 days of treatment Comparison 9: Meta-analysis 9.1=ceftriaxone (1 Dose) vs. ampicillin/amoxicillin (7-10 days)

Three randomized controlled trials compared ceftriaxone single-injection therapy to 7- to 10-days of amoxicillin therapy (Green and Rothrock, 1993; Kara, Ozuer, Kilic, et al. 1998; and Varsano, Frydman, Amir, et al., 1988) (Table 43 and Figure 16). In the Varsano, Frydman, Amir, et al. (1988) study, the mean age was 2 years. The mean age of patients in the Green and Rothrock (1993) study was 1.8 years. The patients in the Kara, Ozuer, Kilic, et al. (1998) study ranged in age from 6 months to 6 years, but the mean age or age distribution was not reported. Fifty-eight percent of patients in the Varsano, Frydman, Amir, et al. (1988) study had more than two previous episodes of AOM, compared to 18 percent in the Green and Rothrock (1993) study. The Kara, Ozuer, Kilic, et al. (1998) study did not address the issue of the otitis-prone state.

Outcomes

Table 45. Key Question 4e. Meta-analysis comparisons: terms and definitions; success and failure
Author/YearTerm(s)Definition(s)Time Measured
Ceftriaxone (1 injection) vs. Amoxicillin (7-10 days)
SUCCESS
Varsano/1988satisfactoryresolution of middle ear fluid and of signs and symptoms of AOM or persistence of some degree of effusion but without erythema or bulging and with no fever or pain7 days, 30 days
Green/1993Successfulresolution of AOM symptoms and no return of symptoms within 10 days of emergency department visit10 days, measured at 90 days
FAILURE
Varsano/1988failure, earlypersistence or recurrence of fever and/or pain with otoscopic signs of acute ear infection or spontaneous otorrhea during the first 10 days7 days
Green/1993unsuccessfulnot successful10 days, measured at 90 days
failurepersistence or recurrence of symptoms within 10 days of initiating treatment10 days, measured at 90 days
Kara/1998no improvement or treatment failurebased on "resolution of symptoms and clinical and tympanometric appearance of the tympanic membrane"5 days
Azithromycin (<5 days) ves. Amoxicillin-Clavulanate (7-10 days)
SUCCESS
Pestalozza/1992curednormalization of clinical, otoscopic, and tympanometric findings3-5 days, 12-14 days, 30 days
improvedrelief of acute signs and symptoms with persistent middle ear effusion3-5 days, 12-14 days, 30 days
Daniel/1993curedresolution of signs and symptoms of primary infection3-5 days, 10-12 days
improvementsigns and symptoms subsided but with incomplete resolution3-5 days, 10-12 days
Schaad/1993curedisappearance of baseline symptoms of infection7-20 days
Principi/1995bacterial eradicationbaseline pathogen not isolated upon repeat sampling or no culturable material obtainable because of clinical cure10-14 days, aspirate only if no improvement
curedall pretreatment signs and symptoms disappeared10-14 days
ImprovedImprovement or partial disappearance of pretreatment signs and symptoms10-14 days
Arguesdas/1996satisfactorycomplete resolution of initial symptoms regardless of middle ear fluid10-11 days
FAILURE
Pestalozza/1992failedno change or worsening of pretreatment signs3-5 days, 12-14 days, 30 days
Daniel/1993failureno apparent clinical response3-5 days, 10-12 days
Schaad/1993failureno change in or worsening of symptoms from baseline7-20 days
Principi/1995bacterial persistencebaseline pathogen present in post therapy sample10-14 days, aspirate only if no improvement
failedno change or worsening of pretreatment signs and symptoms10-14 days
Arguesdas/1996failurebacteriologic or clinical failure10-11 days
bacteriologic failureinability to sterilize the middle ear fluid in patients with persistent ear drainage or who had repeated tympanocentesisat discretion of investigator
The studies looked at different types of outcomes (Evidence Table 5). The outcome common to all three studies was failure rate at 5-10 days, but the definitions of failure were different. In particular, one study (Green and Rothrock, 1993) defined two terms, one failure and the other unsuccessful. Unsuccessful included both failed cases and cases with complications (Table 45).

Results

Table 44. Comparison 9: Meta-analysis 9.2. Key Question 4e: Ceftriaxone (1 dose) vs. amoxicillin (7-10d) outcome indicator: failure rate at 5-10 days of treatment (criterion of failure relaxed to include complications in Green study)
Study (First Author)YearRisk Factor 1 Age <2yrRisk Factor 2 Otitis Prone (Prior episodes)Ceftriaxone Sample SizeAmoxicillin Sample SizeCeftriaxone Failure Rate (%)Amoxicillin Failure Rate (%)Rate Difference (%)95% CI of Rate Difference (%)
Varsano19886 mo-8 yr58% >2 episodes222218145(−17, 26)
Green19935 mo-5 yr18% >2 episodes1051071091(−7, 9)
Kara19986 mo-6 yrNot addressed25251688(−10, 26)
Random effects estimates15215412.09.52.5(−4.4, 9.5)
Test of heterogeneity Chi-square test value1.120.400.51
Test of heterogeneity Chi-square test p value0.5700.8190.775

CI=confidence intervals

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is f3639_F017.jpg.

   Figure 17. Shrinkage plot for outcome=failure rate at 5-10 days of treatment Comparison 9: Meta-analysis 9.2=ceftriaxone (1 Dose) vs. ampicillin/amoxicillin (7-10 days) (criterion of failure relaxed to include complications in Green study)

The meta-analysis on failure at 5-10 days synthesized data from three of the eligible studies. The studies were statistically homogeneous. Using "failure" rather than "unsuccessful" as the outcome in one study (Green and Rothrock, 1993), the estimated combined rate difference was 3.4 percent (95 percent CI, −1.6 percent and 8.5 percent) (Table 43 and Figure 16). Also, the results were not sensitive to the choice of outcome in that study (Green and Rothrock, 1993). Subgroup analysis by age or otitis-prone status was not possible (Table 44 and Figure 17).

Azithromycin (<5 days) vs. Amoxicillin-Clavulanate (7-10 days)

Study populations

Five randomized controlled trials were eligible for the comparison of less than 5-day azithromycin therapy vs. 7- to 10-day amoxicillin-clavulanate therapy (Arguedas, Loaiza, Herrera, et al., 1996; Daniel, 1993; Pestalozza, Cioce, and Facchini, 1992; Principi, 1995; and Schaad, 1993). In the Pestalozza, Cioce, and Facchini (1992) study, patients had a mean age of 3 years. The proportion of patients younger than 2 years of age was 1 percent in the Daniel (1993) study, 7.5 percent in the Schaad (1993) study, and 25 percent in the Principi (1995) study. Arguedas, Loaiza, Herrera, et al. (1996) reported an age range of 6 months to 12 years. In the Principi (1995) study, 10 percent of the subjects had recurrent otitis media. The other studies did not report on the otitis-prone status of their subjects.

Outcomes

The outcomes measured in these studies are somewhat similar in terms of the global clinical outcome (Evidence Table 5). The common outcome in this comparison was failure at 10-14 days. (The definitions are found in Table 45).

Results

Table 46. Comparison 10: Meta-analysis 10.1. Key question 4e: azithromycin (<5d) vs. amoxicillin-clavulanate (7-10d) outcome indicator: failure rate at 10-14 days of treatment
Study (First Author)YearRisk Factor 1 Age <2yrRisk Factor 2 Otitis Prone (Prior episodes)Azithromycin Sample SizeAmox-Clav Sample SizeAzithromycin Failure Rate (%)Amox-Clav Failure Rate (%)Rate Difference (%)95%CI of Rate Difference (%)
Pestalozza199211 mo-9 yrNot addressed1515000(−, −)
Daniel19931% <2 yrNot addressed10354606(1, 10)
Schaad19937.5% <2 yrNot addressed192189313(−0, 5)
Principi199525% <2 yr10% recurrent203182862(−3, 7)
Arguedas19966 mo-12 yrNot addressed474504−4(−10, 2)
Random effects estimates5604853.61.92.1(−0.6, 4.8)
Test of heterogeneity Chi-square test value12.6610.645.34
Test of heterogeneity Chi-square test p value0.0130.0310.254

Amox-Clav=amoxicillin-clavulanate

Cl=confidence interval

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is f3639_F018.jpg.

   Figure 18. Shrinkage plot for outcome=failure rate at 10-14 days of treatment Comparison 10: Meta-analysis 10.1=Azithromycin (<5d) vs. amoxicillin-clavulanate (7-10d)

Synthesizing data on failure at 10-14 days for all five of these studies using a random effects model, the pooled rate difference is 2.1 percent (95 percent CI, 0.6 percent and 4.8 percent), indicating no significant differences (Table 46 and Figures 18 and 19). Although the failure rates were heterogeneous among studies, no statistical heterogeneity existed for rate differences.

Principi (1995) stratified some of their results by age (Evidence Table 4). For those younger than 2 years of age, the 10- to 14-day failure rate was 18 percent (11 of 61 subjects) for the short-duration group and 10 percent (5 of 49 subjects) for the long-duration group. For children 2 years and older, the respective findings were 3 percent (5 of 154) and 5 percent (7 of 149). The differences were not statistically significant. Similar calculations were done for "not cured" at 10-14 days and for adverse effects. The numbers were small in those subjects younger than 2 years of age. Schaad (1993) showed that age stratification did not reveal any significant differences between age groups or between therapeutic groups. Here again, the numbers of patients younger than 2 years of age were small.

Azithromycin (5 days) vs. Amoxicillin-Clavulanate (7-10 days)

Study populations

Three randomized controlled trials compared 5-day azithromycin therapy to 7-10 day amoxicillin-clavulanate therapy (Aronovitz, 1996; Khurana, 1996; McLinn, 1996). The Aronovitz (1996) study population was 2 years of age or older. The mean age of the patients in the Khurana (1996) study was 5.6 years and 53 percent were 5 years old or younger. The age range for the McLinn (1996) study population was 1-15 years. Fifteen percent of the Khurana (1996) population had more than two prior episodes of AOM. The other two studies did not address the otitis-prone status.

Outcomes

Some of the outcomes found in these three studies are listed in Evidence Table 5. Common outcomes included any type of adverse effects and gastrointestinal adverse effects.

Results

Table 47. Comparison 11: Meta-Analysis 11.1. Key question 4e: azithromycin (5d) vs. amoxicillin-clavulanate (7-10d) outcome indicator: any mention of adverse events
Study (First Author)YearRisk Factor 1 Age <2yrRisk Factor 2 Otitis Prone (Prior episodes)Azithromycin Sample SizeAmox-Clav Sample SizeAzithromycin Failure Rate (%)Amox-Clav Failure Rate (%)Rate Difference (%)95%CI of Rate Difference (%)
Aronovitz19960% <2 yrNot addressed8584431−27(−38, −17)
Khurana19966 mo-12 yr15% >2 episodes263260717−10(−16, −5)
McLinn19961-15 yrNot addressed340334931−22(−28, −16)
Random effects estimates6886786.826.0−19.2(−29.2, −9.2)
Test of heterogeneity Chi-square test value4.4317.3212.49
Test of heterogeneity Chi-square test p-value0.109<0.0010.002
NNT=−5 (−11, −3)

NNT=number needed to treat

CI=confidence interval

Amox-Clav=amoxicillin-clavulanate

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is f3639_F020.jpg.

   Figure 20. Shrinkage plot for outcome=any mention of adverse events Comparison 11: Meta-analysis 11.1=Azithromycin (5 d) vs. amoxicillin-clavulanate (7-10 d)

In terms of adverse effects, the meta-analysis calculated a pooled rate difference of −19.2 percent (95 percent CI, −29.2 percent and −9.2 percent). Five children with AOM would need to be treated with azithromycin rather than amoxicillin-clavulanate to avoid an adverse event. However, the outcomes reported in the studies in this comparison were heterogeneous statistically for the rate differences and for incidence rates within the amoxicillin-clavulanate group (Table 47 and Figure 20).

Table 48. Comparison 11: Meta-Analysis 11.2. Key question 4e: azithromycin (5d) vs. amoxicillin-clavulanate (7-10d) outcome indicator: GI-related adverse events
Study (First Author)YearRisk Factor 1 Age <2yrRisk Factor 2 Otitis Prone (Prior episodes)Azithromycin Sample SizeAmox-Clav Sample SizeAzithromycin Failure Rate (%)Amox-Clav Failure Rate (%)Rate Difference (%)95%CI of Rate Difference (%)
Aronovitz19960% <2 yrNot addressed8584430−26(−37, −16)
Khurana19966 mo-12 yr15% >2 epi263260615−9(−14, −4)
McLinn19961-15 yrNot addressed340334829−21(−26, −15)
Random effects estimates6886786.118.7−18.0(−28.0, −8.0)
Test of heterogeneity Chi-square test value3.1919.8313.48
Test of heterogeneity Chi-square test p-value0.203<0.0010.001
NNT=−6 (−13, −4)

NNT=number needed to treat

CI=confidence interval

Amox-Clav=amoxicillin-clavulanate

An external file that holds a picture, illustration, etc., usually as some form of binary object. The name of referred object is f3639_F021.jpg.

   Figure 21 Shrinkage plot for outcome=gastrointestinal (GI) related adverse events Comparison 11: Meta-analysis 11.2=Azithromycin (5 d) vs. amoxicillin-clavulanate (7-10 d)

The next comparison examined the gastrointestinal adverse effects, which also showed highly heterogeneous results for both the rate differences and within the amoxicillin-clavulanate group. The random effects estimate of the pooled rate difference was −18.0 percent (95 percent CI, −28.0 percent and −8.0 percent). In other words, six children would need to be treated with azithromycin rather than amoxicillin-clavulanate to avoid a gastrointestinal adverse event. (Although not reported in the studies, the clavulanate concentration was most likely 31.25 mg per 125 mg of amoxicillin.) Subgroup analysis by age and otitis-prone status was not possible. (Table 48 and Figure 21).

In addition, individual studies (Aronovitz, 1996; McLinn, 1996) showed no differences in 11-day and 30-day failure rates between azithromycin (5 days) and amoxicillin-clavulanate (10 days).

Other Short-Duration vs. Long-Duration Comparisons

Table 49. Key question 4e. Studies not in meta-analytic comparisons: synopsis
AuthorAgeOtitis ProneResult 1
Amoxicillin (<5 days) vs.
Amoxicillin (7-10 days)
Chaput de Saintonge/1982>2 years (100%)>1 episode in previous excluded from studyNo difference in sign and symptom resolution days 3 and 15, failure at 15 days, recurrences, complications
Bain/1985>2 years (100%)History of otitis media 75%No difference in earache at 1 day, of 5 days, or 10 days; resolution of eardrum findings at 7 days or recurrence at 1 year
Puczynski/1987>2 years (100%)Not addressedSignificantly greater failure in the single dose group 3 of 7 vs. 0 of 10
Penicillin V (<5 day) vs.
Penicillin V (7-10 day)
Meistrup-Larsen/1983Mean 4.5 yearsNot addresssedNo difference in unsatisfactory course at 14 days, but small numbers
Penicillin V (5 day) vs.
Penicillin V (7-10 day)
Ingvarsson/1982<2 years (24%)Not addressedNo difference in not healed, which includes serous otitis media or relapses or therapeutic failure at 28-30 days nor in the individual components; higher percentage not healed if <2 years
Benthazine Penicillin G (1 dose) vs. tetracycline (7-10 day) or Benthazine Penicillin (1 dose) plus Triple-sulfonamide (7 day)
Rubenstein/1965<2 years (48%)Not addressedFailure 4 of 79 (5%) vs. 10 of 78 (13%); no difference between bicillin and bicillin+triple-sulfonamide
Benthazine Pencillin G (1 dose) vs. Benthazine Pencillin (1 dose) plus Triple-sulfonamide (7 day)
Stickler/1967<2 years (45%)Not addressedNo difference in 2 week clinical failure
Amoxicillin-clavulanate (5 day) vs. Amoxicillin-clavulanate (7-10 day, either twice-a-day or three-times-a-day)
Hoberman/1997<2 years (39%)Not addressedNo difference in failure at 12-14 days or 32-38 days
Cohen/1998<2.5 years (100%) mean 1.1 years>3 episodes (9%), 2 episodes (11%), 1 episode (23%)Greater failure at 12-14 days in shorter duration group (23% vs. 12 %)
Cefaclor (<5 day) vs.
cefaclor (7-10 day)
Jones/1986>2 years (100%) mean 5.7 yearsHistory of otitis media (77%)No difference in earache > 4 days or resolution of ear signs or recurrence within 6 weeks
Cefaclor (5 day) vs.
Amoxicillin (7-10 day)
Ploussard/1984<2 years (84%)Not addressedNo difference in unsatisfactory outcome or recurrence but numbers small; all unsatisfactory outcomes and recurrences occurred in <2 year old patients
Cefaclor (5 day) vs.
Cefaclor (7-10 day)
Hendrickse/1988<2 years (53%)Otitis prone (20% 2 )With intact TM no difference in failure at <5 days or 6-10 days; reinfection at 14-30 days, or 31-60 days, or 61-90 days; persistent middle ear effusion rate at 10-15 days 30 days, 60 days, 90 days; with perforated TM no difference in reinfection or middle ear effusion rate but 46% to 8% difference in 6-10 day failure rate
Cefuroxime-axetil (5 day) vs. Cefuroxime-axetil (10 day) vs. Amoxicillin-clavulanate (7-10 day)
Gooch/1996Mean 3.5 yearsPrior episode (84%) Prior episode within 1 year (84%)No difference in clinical failure after 3 days, recurrence 14-18 days after treatment end, or bacteriologic failure
Cefpodoxime-proxetil (5 day) vs. Amoxicillin-clavulanate (7-10 day)
Cohen/1997 (article 426 and 2325)Mean 1.5 years <2 years (75%)Not addressed Recurrent acute otitis media (25%)Difference in nasopharyngeal pneumococcus persistence of (59% vs. 36%, p=0.01); no difference in nasopharyngeal H. influenzae persistence; both 2-6 days after treatment end No difference in failure 4 days after treatment end and at 17 days nor in serous otitis media at 1 month after treatment 24% vs. 18% with new acute otitis media at 1 month after treatment end
Cefpodoxime-proxetil (5 day) vs. Cefaclor (7-10 day)
Adams/1995Mean 3.5 yearsNot addresedNo difference in failure at 11-13 days or relapse at 3 weeks
Cefpodoxime-proxetil (5 day) vs. Cefixime (7-10 day)
Boulesteix/1995Range 6 months-6 yearsOtitis prone excludedNo difference in unsatisfactory course at 8-10 days and 30-40 days or relapse at 30-40 days
Cefprozil (5 day) vs. Cefprozil (7-10 day)
Kafetzis/1997Mean 4.1 years>2 episodes (3%) 2 episodes (6%) 1 episode (24%)No difference in failure at 28-32 days or relapse after end of treatment
Ceftibuten (5 day) vs. Ceftibuten (10 day)
Simon/1997Mean 3.7 yearsNot addressedMore failure with the short-duration group (22% vs. 2%) and more recurrence at 14 days (14% versus 8%)
Ceftriaxone (1 dose) vs. Amoxicillin-clavulanate (7-10 day)
Bauchner/1996<1.5 years (34%)>2 prior episodes (11%) 1 prior episode (25%)Unimproved or worse in 50 of 267 (19%) vs. 28 of 271 (10%); parents dissatisfacton with antibiotic significant with 8% vs. 11%
Varsano/1997Mean 2.7 yearsOtitis prone 2 (13%)No difference failure at 11 days or relapses at 12-30 days; higher recurrence at 31-90 days in amoxicillin-clavulanate group; more diarrhea and vomiting with amoxicillin-clavulanate
Ceftriaxone (1 dose) vs. Cefaclor (7-10 day)
Chamberlain/1994>1.5 years (100%) mean 3 years<4 AOM per year (100% by exclusion of others) mean 1.4 episodes/yearNo difference in failure at 14 days, recurrence at <14 days or 90 days, or persistent effusion 90 days
Ceftriaxone (1 dose) vs. Cefuroxime-axetil (7-10 day)
Kara/1988 (also vs. amoxicillin)Range 6 months-6 yearsNot addressedNo difference in failure at day 5 but very small numbers
Ceftriaxone (1 dose) vs. Trimethoprim-sulfamethoxazole (7-10 day)
Barnett/1997Mean ceftriaxone 17.3 months and TMP-SMX 18 months>3 prior episodes (41%)Equivalent noncured rates at 14 days and 28 days but not at 3 days; otitis-prone status did not have an effect; those who failed appeared to be of younger mean age
Azithromycin (<5 day) vs. Cefaclor (7-10 day)
Rodriguez/1996Mean 4 yearsNot addressedNo difference in failure at 10-14 days; less failure in azithromycin at 25-30 days
Azithromycin (<5 day) vs.
Clarithromycin (7-10 day)
Arguedas/1997Mean 4.2 yearsNot addressedNo difference in clinical failure by end of therapy
Azithromycin (5 day) vs. Amoxicillin-clavulanate (7-10 day)
Aronovitz/1996<2 years (0%)Not addressedNo difference in failure rate at 11 days or 30 days. Relapse assessed at 15-35 days was higher in the amoxicillin-clavulanate group, (21 %), compared to the azithromycin group, (5 %).
Khurana/1996Range 6 months-12 years>2 episodes (15%)No difference in failure rate at 3 days or relapse before 14 days, recurrence after 14 days, or total unsatisfactory response.
McLinn/1996Range 1-15 yearsNot addressedNo difference in failure rate at 11 days or 30 days.
1

comparative results report short-duration result then long-duration result

2

meets technical expert panel of otitis prone

The treatment regimens we compared were the following: amoxicillin (<5 days) vs. amoxicillin (7-10 days), penicillin V (<5 days) vs. penicillin V (7-10 days), penicillin V (5 days) vs. penicillin V (7-10 days), benthazine penicillin G (1 dose) vs. tetracycline (7-10 days), benthazine penicillin G (1 dose) vs benthazine penicillin G (1 dose) plus triple-sulfonamide (7 days), amoxicillin-clavulanate (5 days) vs. amoxicillin-clavulanate (7-10 days), cefaclor (<5 days) vs. cefaclor (7-10 days), cefaclor (5 days) vs. amoxicillin (7-10 days), cefaclor (5 days) vs. cefaclor (7-10 days), cefuroxime-axetil (5 days) vs. amoxicillin-clavulanate (7-10 days), cefpodoxime-proxetil (5 days) vs. amoxicillin-clavulanate (7-10 days), cefpodoxime-proxetil (5 days) vs. cefaclor (7-10 days), cefpodoxime-proxetil (5 days) vs. cefixime (7-10 days), cefprozil (5 days) vs. cefprozil (7-10 days), ceftibuten (5 days) vs. ceftibuten (10 days), ceftriaxone (1 dose) vs. amoxicillin-clavulanate (7-10 days), ceftriaxone (1 dose) vs. cefaclor (7-10 days), ceftriaxone (1 dose) vs. cefuroxime-axetil (7-10 days), azithromycin (<5 days) vs. cefaclor (7-10 days), and azithromycin (<5 days) vs. clarithromycin (7-10 days) (Table 49).

Study populations

Fourteen of these studies reviewed indicated that the proportion of subjects were younger or older 2 years of age. Nine studies reported a mean age alone. Two studies only reported an age range. In nine studies, at least 20 percent of the subjects appeared to have been younger than 2 years of age (Bauchner, Adams, Barnett, et al., 1996; Cohen, de La Rocque, Boucherat, et al., 1997; Cohen, Levy, Boucherat, et al., 1998; Hendrickse, Kusmiesz, Shelton, et al., 1988; Hoberman, Paradise, Burch, et al., 1997; Ingvarsson and Lundgren, 1982; Ploussard, 1984; Rubenstein, McBean, Hedgecock, et al., 1965; Stickler, Rubenstein, McBean, et al., 1967). Thirteen studies indicated the proportion of subjects who had previous episodes of AOM, and three studies excluded patients with varying degrees of previous episodes (Bain, Murphy, and Ross, 1985; Boulesteix, Durbreuil, Moutot, et al., 1995; Chamberlain, Boenning, Waisman, et al., 1994). Twelve studies did not address the issue of otitis-prone status.

Outcomes

Many different outcomes were measured in these studies (Evidence Table 5).

Results

Nineteen of these 24 studies did not demonstrate any difference in effectiveness between the short-duration and long-duration therapy in the outcomes measured. Puczynski, Stankiewicz, and O'Keefe (1987) found, however, a significantly greater failure rate in the single-dose amoxicillin group compared with the 10-day amoxicillin group. Rubenstein, McBean, Hedgecock, et al. (1965) found a higher failure rate in those treated with long-duration tetracycline compared with a single dose of benthazine penicillin G. Cohen, Levy, Boucherat, et al. (1998) found a greater failure rate at 12-14 days in the 5-day duration of the amoxicillin-clavulanate group vs. the long-duration group. Henrickse, Kusmiesz, Shelton, et al. (1988) found a higher failure rate among those with a perforated tympanic membrane who were on short-duration cefaclor therapy at 6-10 days. Simon (1997) found a higher failure rate with short-duration ceftibuten therapy compared with long-duration ceftibuten therapy.

Only three studies looked specifically at the effect of age or otitis-prone status on any of the outcomes. Paradise (1997) reports in an editorial on age-stratified results from the Hoberman, Paradise, Burch, et al. (1997) study that, compared with 5-day treatment, 10-day treatment had significantly improved outcomes at days 12-14 and 32-38 for children younger than 2 years and at days 12-14 for children 2-5 years old. Paradise (1997) only reports on the twice-a-day amoxicillin-clavulanate regimen for 10 days and not the three-times-a-day amoxicillin-clavulanate regimen for 10 days. Ingvarsson and Lundgren (1982) stratified the "not healed" results by age. For treatment with the 5-day penicillin V, 25 percent of the children younger than 2 years were not healed and 20 percent of those 2 years and older were not healed. For treatment with the 10-day penicillin V, the respective findings were 33 percent for children younger than 2 years and 20 percent for those 2 years or older. In the Barnett, Teele, Klein, et al. (1997) study, those identified as otitis prone had a failure rate of 24 percent in the ceftriaxone group and a 23 percent failure rate in the trimethoprim-sulfamethoxazole group. The respective numbers for the patients who were not otitis prone were 26 percent and 19 percent. The data suggests that the otitis-prone status of the child did not have an effect on the outcome of failure at 14 days (Barnett, Teele, Klein, et al., 1997).

Chapter 4. Conclusions

Natural History

Observation or Placebo

It is difficult to come to conclusions about the natural history of AOM without intervention because of the few studies available -- less than half are of adequate quality and most of the literature lacks uniformity in the definition of outcomes, the specific outcomes monitored, and the time of measurement. In addition, most of the studies did not report results, including adequate information on denominators, stratified by the influencing factors of age and otitis-prone state, thought to be of importance by the Technical Expert Panel. The studies eligible for the natural history question represent a heterogeneous collection of investigations with respect to the primary influencing factors of age and otitis-prone state. Most of the studies report close followup of patients and clinical criteria for administering antibiotics to the placebo or observational group in the case of persistent or worsening symptoms or complications. Few patients in the placebo or observational groups appeared to require antibiotics.

Clinical failure rate at 24-48 hours was 7.7 percent for nonsevere cases of AOM not treated with antibiotics in the study by Kaleida, Casselbrant, Rockette, et al. (1991); at 24-72 hours, clinical failure occurred in 26 percent of children with AOM not treated with antibiotics in Halsted, Lepow, Balassanian, et al. (1968). Pooling the data on failure rates from 4 to 7 days yielded an estimate of 22.2 percent (three studies; 220 children; 95 percent CI, 10.1 percent and 34.3 percent); that is, 77.8 percent of these children not initially treated with antibiotics for AOM would have clinical resolution. The pooled estimate for failure from 1 to 7 days yielded an estimate of 18.9 percent (five studies; 739 children; 95 percent CI, 9.9 percent and 28.0 percent); that is, 81.1 percent of these children would have clinical resolution. Rosenfeld (1999a) had estimated that 73 percent of children with AOM not initially treated with antibiotics would have clinical resolution by 7-14 days after diagnosis. Failures as defined by recurrences and other factors, including presence of serous otitis media in one study (Townsend, 1964), may accrue up to a year from the onset of the initial episode of AOM; those estimates were as low as 5.8 percent in the cohort study by Townsend (1964) and as high as 27.1 percent in the randomized controlled trial by Kaleida, Casselbrant, Rockette, et al. (1991). The proportion with pain and fever in children with AOM not treated with antibiotics decreased rapidly in the time periods reported. Van Buchem, Dunk, van't Hof, et al. (1981) reported 28 percent had pain after 24 hours, and Burke, Bain, Robinson, et al. (1991) reported that 48 percent had pain at 2 days. At 5-7 days, 25 percent (Burke, Bain, Robinson, et al., 1991) reported pain and at more than 7 days, 10 percent of children still reported pain (van Buchem, Dunk, van't Hof, et al., 1981.) A similar discrepancy in findings existed for the presence of fever: 0 percent at 2-7 days (Howie and Ploussard, 1972), and 20 percent at 2 days, and 11 percent at 5-7 days (Burke, Bain, Robinson, et al., 1991).

In studies reporting on pain or fever, most children with AOM were without either symptom by 3 days (Appleman, Claessen, Touw-Otten, et al., 1991; Kaleida, Casselbrant, Rockette, et al., 1991; Mygind, Meistrup-Larsen, Thomsen, et al., 1981; van Buchem, Dunk, van't Hof, et al., 1981). As estimated by Rosenfeld (1999a), the pooled data indicate that 59 percent (three studies; 315 children; 95 percent CI, 53 percent and 65 percent) of children not treated with antibiotics did not have pain or fever within 24 hours of diagnosis of AOM, 87 percent (five studies; 808 children; 95 percent CI, 84 percent and 89 percent) of children did not have pain or fever by 2-3 days, and 88 percent (five studies; 503 children; 95 percent CI, 85 percent and 91 percent) of children did not have pain or fever by 4-7 days.

Asymptomatic middle ear effusion was confirmed as a common condition following AOM in children not treated with antibiotics. At 3 months, the cited studies show 24 percent (Mygind, Meistrup-Larsen, Thomsen, et al., 1981) and 28 percent (Burke, Bain, Robinson, et al., 1991) of children with middle ear effusion. The evidence suggests that younger children compared with older children had a greater likelihood of failing to meet the definitions of clinical success or resolution when not treated with antibiotics for AOM. The threshold appears to be sometime around 2-3 years of age based on the studies of Laxdal, Merida, and Jones (1970) and Kaleida, Casselbrant, Rockette, et al. (1991). Only one study looked at the possible effect of otitis-prone state (defined as more than two episodes of prior AOM) and found little difference in rates of treatment failure at 1-week evaluation (Burke, Bain, Robinson, et al., 1991). The one study that looked at age and resolution of pain and fever suggests a significant association with age: 58 percent of those under 2 years of age with pain or fever at more than 3 days compared with 7 percent of children 2 years or older among those not treated with antibiotics for AOM (Appelman, Claessen, Touw-Otten, et al., 1991). In the one study that looked at the presence of middle ear effusion in relation to age in children with AOM not treated with antibiotics, the findings suggest a greater propensity to middle ear effusion with younger age (Kaleida, Casselbrant, Rockette, et al., 1991).

The available evidence on natural history of AOM shows that few episodes of mastoiditis or other suppurative complications were reported in children with AOM not initially treated with antibiotics. It is important to note that the children in these studies had close followup and intervention as appropriate. In these studies, the number of suppurative complications reported was comparable whether or not the child was initially treated with antibiotic.

Antibiotics vs. No Antibiotics

Previous Meta-Analyses

Del Mar, Glasziou, and Hayem (1997) found favorable rate differences in the children with AOM treated with antibiotics in terms of pain at 2-7 days (41 percent) (95 percent CI, 14 percent and 60 percent), and contralateral otitis media (43 percent) (95 percent CI, 9 percent and 64 percent). They did not find any differences in pain at 24 hours, tympanic membrane perforation, vomiting/diarrhea/rash, 1-month tympanometry, or recurrent AOM. Rosenfeld, Vertrees, Carr, et al. (1994) found a rate difference of 12.9 percent (95 percent CI, 8.2 percent and 19.2 percent) in favor of children with AOM treated with aminopenicillins compared with those not treated with antibiotics, and 13.7 percent (95 percent CI, 8.2 percent and 19.2 percent) in favor of children treated with any antibiotic compared to no antibiotic. Rosenfeld (1999a) found that pain and fever relief at 24 hours was not related to antibiotic use in children with AOM (rate difference of 0 percent, 95 percent CI, −7 percent and 8 percent), but pain and fever relief at 2 days was improved by 4 percent (95 percent CI, 2 percent and 7 percent) with antibiotic use. The difference in pain and fever relief at 4-7 days, however, was not significant. Clinical resolution at 7-14 days was 13 percent (95 percent CI, 8 percent and 19 percent) higher in those on antibiotics vs. those not on antibiotics.

Ampicillin or Amoxicillin vs. Placebo or Observation

The present analysis adds to the prior meta-analytic studies (Del Mar, Glasziou, and Hayem, 1997; Rosenfeld, 1999b; Rosenfeld, Vertrees, Carr, et al., 1994) by assessing the efficacy of specific antibiotics. Because of differences in definitions of treatment failure and the units of analysis, sensitivity analyses were performed, and the results indicate that ampicillin or amoxicillin was beneficial in the treatment of AOM compared with placebo (with pooled rate differences of −9.7 percent to −12.9 percent). The results were generally insensitive to the studies included, except that as the number of studies decreased, the 95 percent confidence limits increased. About eight children with AOM would need to be treated with ampicillin or amoxicillin to prevent a case of clinical failure. Subgroup analyses based on age or otitis-prone status were not possible.

Other Antibiotics vs. No Antibiotics Comparisons

Other treatment regimens we compared to placebo or observational treatment included: amoxicillin-clavulanate, pencillin G plus sulfisoxazole, penicillin V, erythromycin estolate, triple sulfonamide, and erythromycin estolate plus triple sulfonamide.

In general, there appears to be a trend of modest improvement in specific outcomes with antibiotic administration compared to placebo or observational treatment in terms of pain and fever and other symptom resolution and presence of exudate. No statements can be made regarding the effect of age or otitis-prone status on these comparisons.

Antibiotic vs. Antibiotic

Penicillin vs. Ampicillin or Amoxicillin

The results of the three individual studies showed a pooled rate difference minimally favoring ampicillin or amoxicillin compared with penicillin, although each was statistically insignificant. The quantitative synthesis affirms that the effects of penicillin and ampicillin or amoxicillin on treatment of AOM are not different based on these three studies. The three studies do not allow for subgroup meta-analysis of the data by age or otitis-prone status, although data from one of the studies suggests that ampicillin may be more effective than penicillin in children under 6 years of age (Laxdal, Merida, and Jones, 1970). Another study suggests that ampicillin was more effective than penicillin if Haemophilus influenzae grew from culture (Nilson, Poland, Thompson, et al., 1969), but this finding must be tempered by the fact that this study was conducted 30 years ago -- before the recent rise in bacterial resistance to antimicrobial agents.

Cefaclor vs. Ampicillin or Amoxicillin

The meta-analyses looking at cefaclor vs. ampicillin or amoxicillin show statistically insignificant rate differences in terms of failure at 3-7 days and at 5-21 days. This finding is in accord with the results of the individual studies. One study suggests that this finding also is true in infants 1-3 months of age (Berman and Lauer, 1983). The reported data from these five studies, however, do not allow for any further subgroup analysis on age or otitis-prone status.

Cefixime vs. Ampicillin or Amoxicillin

The meta-analyses comparing cefixime to ampicillin or amoxicillin demonstrate insignificant rate differences with respect to failure at 10-15 days, recurrence rate at 3-5 weeks, incidence of vomiting, and incidence of rash. The incidence of diarrhea was higher among those on cefixime and was statistically significant. Twelve children with AOM would need to be treated with ampicillin or amoxicillin rather than cefixime to avoid a case of diarrhea. Subgroup analysis based on age or otitis-prone status was not possible using these five studies.

Other Antibiotics vs. Ampicillin or Amoxicillin Comparisons

None of the following antibiotics showed any difference in failure rates measured at various points in time compared with ampicillin or amoxicillin: cephalexin, cephradine, cerufoxime-axetil, ceftriaxone, loracarbef, erythromycin-estolate, erythromycin-ethylsuccinate, clarithromycin, clindamycin, triple sulfonamide, penicillin G plus sulfisoxazole, penicillin V plus sulfisoxazole, penicillin V plus triple sulfonamide, procaine-penicillin-benthazine-penicillin G plus sulfisoxazole, erythromycin-ethylsuccinate-sulfisoxazole, erythromycin-ethylsuccinate-acetyl-sulfafurazole, and erythromycin-sulfisoxazole. This also was true in the one study that stratified the outcome by age, but the numbers were very small in that comparison. None of the studies stratified by otitis-prone status.

Trimethoprim-Sulfamethoxazole vs. Cefaclor

No difference was seen between cefaclor and trimethoprim-sulfamethoxazole in terms of failure at less than 14 days of treatment. No comment can be made regarding the role of age or otitis-prone state.

Amoxicillin-Clavulanate and Ceftriaxone vs. Trimethoprim-Sulfamethoxazole

No difference was seen based on the few studies that studied the comparisons of amoxicillin-clavulanate and ceftriaxone with trimethoprim-sulfamethoxazole.

Utility of Oral Fluoroquinolone

No studies were available that compared oral fluoroquinolone with another antibiotic for the treatment of AOM in children.

High-Dose Amoxicillin or Amoxicillin-Clavulanate vs. Standard-Dose Amoxicillin or Amoxicillin-Clavulanate

In the single study on high-dose amoxicillin-clavulanate vs. standard-dose of the same antibiotic, no difference in effectiveness could be demonstrated. We note, however, that showing a lack of difference is not the same as establishing equivalence of effect. No comment can be made on the influence of age or otitis-prone status.

High-Dose Amoxillin or Amoxicillin-Clavulanate Twice a Day vs.Three Times a Day

In the single study on high-dose amoxicillin prescribed twice a day vs. three times a day, no difference in effectiveness could be demonstrated. We note, however, that showing a lack of difference is not the same as establishing equivalence of effect. Although the authors comment that age and the number of previous episodes of AOM had no influence on the outcomes, the data were not presented; therefore, we can not comment directly on the influence of these factors.

Short-Term vs. Long-Term Antibiotic Therapy

Ceftriaxone (One dose) vs. Amoxicillin (7-10 days)

No difference in failure rate at 5-10 days was found comparing single-injection ceftriaxone with 7-10 days of amoxicillin therapy for the treatment of AOM.

Azithromycin (<5 days) vs. Amoxicillin-Clavulanate (7-10 days)

No difference in failure rate at 10-14 days was found in comparing less than 5-day azithromyicn therapy to 7-10 days of amoxicillin-clavulanate therapy.

Azithromycin (5 days) vs. Amoxicillin-Clavulanate (7-10 days)

Amoxicillin-clavulanate was associated with a statistically greater proportion of adverse effects, predominantlygastrointestinal effects, compared with azithromycin therapy. Eight children would need to be treated with azithromycin rather than amoxicillin-clavulanate to avoid a case of diarrhea. (Although not reported in the studies, the clavulanate concentration was most likely 31.25 mg per 125 mg of amoxicillin.) These meta-analyses, however, were associated with significant statistical heterogeneity. The source of that heterogeneity is not clear.

Other Short-Duration vs. Long-Duration Comparisons

We compared the following antibiotic treatments: penicillin V (<5 days) vs. penicillin V (7-10 days), penicillin V (5 days) vs. penicillin V (7-10 days), benthazine penicillin G (one dose) vs. tetracycline (7-10 days), benthazine penicillin G (one dose) vs. benthazine penicillin (one dose) plus triple-sulfonamide (7 days), amoxicillin-clavulanate (5 days) vs. amoxicillin-clavulanate (7-10 days), cefaclor (<5 days) vs. cefaclor (7-10 days), cefaclor (5 days) vs. amoxicillin (7-10 days), cefaclor (5 days) vs. cefaclor (7-10 days), cefuroxime-axetil (5 days) vs. amoxicillin-clavulanate (7-10 days), cefuroxime-axetil (5 days) vs. cefxime (7-10 days), cefpodoxime-proxetil (5 days) vs. amoxicillin-clavulanate (7-10 days), cefpodoxime-proxetil (5 days) vs. cefaclor (7-10 days), cefpodoxime-proxetil (5 days) vs. cefixime (7-10 days), cefprozil (5 days) vs. cefprozil (7-10 days), ceftriaxone (one dose) vs. amoxicillin-clavulanate (7-10 days), ceftriaxone (one dose) vs. cefaclor (7-10 days), ceftriaxone (one dose) vs. cefuroxime-axetil (7-10 days), azithromycin (<5 days) vs. cefaclor (7-10 days), and azithromycin (<5 days) vs. clarithromycin (7-10 days).

The majority of studies of these treatments -- 19 of 24 -- show no difference in effectiveness between the short-duration and long-duration therapies evaluated. Only two of these studies looked at the effect of age on outcome, and only one looked at the effect of otitis-prone status on outcome. Paradise (1997) reported results suggesting that clinical failure at 12-14 days and 32-38 days was significantly higher for children younger than 2 years old and at 12-14 days for children 2-5 years old in the 5-day amoxicillin-clavulanate group than the group taking amoxicillin-clavulanate twice a day for 10 days. Ingvarsson and Lundgren (1982) reported results suggesting that although the difference in failure was not significant between the short-duration penicillin and long-duration penicillin groups in general, there appeared to be a higher percentage of failure in the short-duration group of those younger than 2 years of age. Barnett, Teele, Klein, et al. (1997) reported that otitis-prone status did not seem to have an effect on failure rate, but those who failed appeared to be of younger mean age. The former two studies suggest that age may be an important influencing factor to consider when prescribing shorter-duration antibiotic therapy for AOM.

General Conclusions

Table 50. Summary of Comparisons and Meta-Analysis Performed for Key Questions 3, 4a, and 4e
ComparisonMeta-analysisRate Difference in % (95% CI)Test of HeterogeneityNumber Needed to Treat (NNT) (95% CI)
Q-ValueP-Value
1 (Q3) Ampicillin or Amoxicillin vs. Placebo1.1 Failure rate at 2-7 days of treatment (5 studies)−12.3 (−21.8, −2.8)18.830.002−8 (−36, −5)
1.2 Failure rate at 2-7 days of treatment, excluding Howie studies (4 studies)−9.7 (−19.2, −0.2)13.710.003−10(−437, −5)
1.3 Failure rate at 2-7 days of treatment, excluding Howie and Kaleida studies (3 studies)−12.9 (−27.5, 1.7)5.890.053ND
2 (Q4a) Penicillin vs. Amoxicillin or Ampicillin2.1 Failure rate at 7-14 days of treatment (3 studies)4.5 (−1.8, 10.7)1.970.374ND
3 (Q4a) Cefaclor vs. Amoxicillin or Ampicillin3.1 Failure rate at 3-7 days post treatment (4 studies)−5.4 (−15.2, 4.4)3.050.383ND
3.2 Failure rate at 5-21 days post treatment (5 studies)0.5 (−5.7, 6.8)3.160.531ND
4 (Q4a) Cefixime vs. Amoxicillin or Ampicillin4.1 Failure rate at 10-15 days of treatment (4 studies)−0.1 (−4.2, 3.9)0.210.976ND
4.2 Recurrence rate at 3-5 weeks of treatment (3 studies)1.6 (−5.1, 8.4)0.370.832ND
4.3 Incidence of diarrhea (5 studies)8.4 (3.8, 13.1)2.950.56712 (8, 27)
4.4 Incidence of vomiting (5 studies)2.0 (0.0, 4.0)3.790.435ND
4.5 Incidence of rash (4 studies)5.8 (−2.4, 13.9)12.110.007ND
9 (Q4e) Ceftriaxone (1 dose) versus Amoxicillin (7-10d)9.1 Failure rate at 5-10 days of treatment (3 studies)3.4 (−1.6, 8.5)0.300.862ND
9.2 Failure rate at 5-10 days of treatment (criterion of failure is relaxed to include complications in Green study).2.5 (−4.4, 9.5)0.510.775ND
10 (Q4e) Azithromycin (<5d) versus Amoxicillin-Clavulanate (7-10d)10.1 Failure rate at 10-14 days of treatment (5 studies)2.1 (−0.6, 4.8)5.340.254ND
11 (Q4e) Azithromycin (5d) versus Amoxicillin-Clavulanate (7-10d)11.1 Any mention of adverse events (3 studies)−19.2 (−29.2, −9.2)12.490.002−5 (−11, −3)
11.2 GI related adverse events (3 studies)−18.0 (−28.0, −8.0)13.480.001−6 (−13, −4)

ND=Not Done due to non-significant result.

This evidence report supports the following general conclusions (Table 50):
  • In children not initially treated with antibiotics, clinical failure at 24-48 hours was 7.7 percent in one study (i.e., 92.3 percent clinical resolution), and 26 percent at 24-72 hours in another study (i.e., 74 percent clinical resolution). The pooled estimate for clinical failure at 1-7 days was 18.9 percent (95 percent CI, 9.9 percent and 28.0 percent) and for 22.2 percent at 4-7 days (95 percent CI, 10.1 percent and 34.3 percent).

  • A previous information synthesis estimated that 59 percent (95 percent CI, 53 percent and 65 percent) of children not treated with antibiotics had resolution of pain and fever within 24 hours of AOM diagnosis, 87 percent (95 percent CI, 84 percent and 89 percent) of children had resolution of pain and fever by 2-3 days, and 88 percent (95 percent CI, 85 percent and 91 percent) of children had resolution of pain and fever by 4-7 days.

  • The available evidence on natural history of AOM shows that in studies with close followup, few episodes of mastoiditis or other suppurative complications are reported in children with AOM not initially treated with antibiotics.

  • Antibiotics in comparison to placebo or observational treatment may have a modest benefit on symptom resolution and failure rates, as variously defined, in children with AOM. For example, about eight children with AOM would need to be treated with ampicillin or amoxicillin rather than no antibiotic treatment to avoid a clinical failure.

  • Previous meta-analyses have demonstrated minimal to modest benefits of antibiotics compared to observational intervention without antibiotics during the initial treatment of AOM for pain and fever resolution at 2 days, pain resolution at 2-7 days, contralateral otitis media, and clinical resolution rate at 7-14 days. Pain resolution at 24 hours, pain and fever resolution at 4-7 days, tympanic membrane perforation, vomiting/diarrhea/rash, 1-month tympanometry, and recurrent AOM did not appear to be affected by antibiotic use.

  • The study was not able to demonstrate any clinical benefits of other antibiotics in comparison with ampicillin or amoxicillin and to trimethoprim-sulfamethoxazole. However, cefixime was shown to cause greater incidence of diarrhea than ampicillin or amoxicillin. Twelve children would have to be treated with ampicillin or amoxicillin rather than cefixime to avoid a case of diarrhea.

  • No comment can be made on the marginal effect of oral fluoroquinolones compared with other antibiotics in the treatment of AOM.

  • Although not establishing equivalency of effect, a single study was unable to demonstrate a difference in clinical effect of high-dose amoxicillin-clavulanate vs. standard-dose amoxicillin-clavulanate.

  • Although not establishing equivalency of effect, a single study was unable to demonstrate a difference in clinical effect of taking high-dose amoxicillin two times a day vs. three times a day.

  • We could not demonstrate any difference in clinical failure rates between short-duration therapy and long-duration therapy of AOM. A previous meta-analysis demonstrated that short-acting antibiotic therapy of less than 2 days was not as effective as therapy that lasted 7 days or longer.

  • Azithromycin given for 5 days led to fewer adverse events, particularly gastrointestinal, than 7-10 days of amoxicillin-clavulanate. Eight children with AOM would need to be treated with azithromycin rather than amoxicillin-clavulanate to avoid a gastrointestinal adverse event. (Although not reported in the studies, the clavulanate concentration was most likely 31.25 mg per 125 mg of amoxicillin, i.e., original formulation.)

Caveats

Estimates generated by quantitative synthesis are subject to error. The issue of heterogeneity is always open to question, particularly with regard to study subjects and treatment regimens. The definitions of AOM found in the studies varied as did the diagnostic criteria in terms of establishing the presence of middle ear effusion, rapid onset, and specific signs and symptoms and in establishing an initial or new episode of AOM. Very few studies rated the severity of AOM. In this evidence-based analysis, the choice of outcomes and the definition of clinical failure also varied from one study to another. Statistical heterogeneity characterized several of our meta-analytic comparisons. We used the random effects model in all cases to provide a more conservative estimate of significance.

Another problem was that most of the studies in this evidence-based analysis had small numbers of subjects. For the most part, the individual studies were unable to establish the significance of any treatment effects seen. Among the antibiotic regimen comparisons, less than 10 percent appeared to be of sufficient statistical power to detect a difference. Relevant to this study, Pogue and Yusuf (1998) pointed out that meta-analysis of trials with small subject numbers may overestimate treatment effects.

Although we are confident that the literature search for this report was thorough, it is possible that some studies were missed, particularly with regard to the comparative analysis of antibiotic treatments. Our search of the non-English literature, which ended with a screening and review of those non-English reports found in five of the seven databases, was not exhaustive. Although that search yielded only two studies, it is possible that non-English citations from other sources may have yielded further studies for the analysis.

Studies of poor quality, particularly those with inadequate randomization procedures or those not double-blind, may inflate estimates of treatment benefit (Moher, Jones, Cook, et al., 1998; Schulz, Chalmers, Hayes, et al., 1995). Although all of the studies included in the meta-analyses were randomized, many studies did not adhere to protocols that would strengthen the internal validity of the findings. Because many of the studies did not report their procedures for randomization, it is difficult to determine whether the randomization process was appropriate in those trials. A large number of studies also were not double-blind. About one-half of the studies were not of adequate quality based on the Jadad scale. Because of the small numbers of studies in each of our meta-analyses, the sensitivity analysis we had planned was not possible.

The generalizability of the findings of this evidence-based analysis is difficult to assess. Looking at the natural history studies, we previously noted the wide range in percentage of subjects 2 to 2-and-a-half years old or younger reported in both the randomized controlled trials and the cohort studies. Only two of the nine randomized controlled trials addressing natural history reported any outcome stratified as 2 years or younger and older than 2 years (Appelman, Claessen, Touw-Otten, et al., 1991; Kaleida, Casselbrant, Rockette, et al., 1991), and only the Kaleida, Casselbrant, Rockette, et al. (1991) study reported early failure rate stratified in this manner. Two of the six cohort studies on natural history reported results stratified for younger and older than 2 years of age (Froom, Culpepper, Grob, et al., 1990; Tilyard, Dovey, and Walker, 1997), with clinical failure rates at 2 months and 1 month, respectively.

One might assume that results stratified by age were not reported because there was no difference, but we hesitate to make this presumption as the two studies that do report by age indicate that children younger than 2 years old do not resolve their clinical symptoms as quickly as older children. On the other hand, we also would not make any conclusions based only on these two studies because one was of very small sample size (Appelman, Claessen, Touw-Otten, et al., 1991) and the other studied children with nonsevere AOM in the placebo group (Kaleida, Casselbrant, Rockette, et al., 1991), using episodes as the unit of analysis.

The question on antibiotics vs. no antibiotics used the same randomized controlled trials just described and, thus, have the same difficulties with reporting outcomes by age. The studies on the clinical effectiveness of specific antibiotic regimens suffer the same problems with regard to reporting outcomes by subject age. We have reported in the individual results sections the wide range in percentage of subjects 2-3 years old or less. In the studies on ampicillin or amoxicillin or trimethoprim-sulfamethoxazole vs. other antibiotics, three studies report outcomes on children younger than 2 years old, one exclusively studying infants younger than 3 months old and another exclusively children younger than 2 years old. Four of the studies on short-duration vs. long-duration therapy of AOM report on age-stratified outcomes. Although the study by Brodie, Griggs, and Cunningham (1990) showed no difference in 1-to 4- day clinical failure rates in those younger and older than 2 years old (all on antibiotics) we cannot presume that results by age were not reported because there were no differences. For example, the Hoberman, Paradise, Burch, et al. (1997) study did not report any outcomes by age in their initial article, but later in an editorial, one of the investigators reported clinical cure or improvement rates at 12-14 days and 32-38 days, suggesting that children younger than 2 years do not do as well as older children (Paradise, 1997). Unfortunately, this investigator did not report on those younger than 2 years old in a third treatment arm of that study.

The remaining three studies also suggest higher clinical failure rates in children younger than 2 years old on antibiotics (Ingvarsson and Lundberg, 1981; Principi, 1995; Schaad, 1993). Most of the studies did not address the otitis-prone status of the child, and even fewer reported outcomes stratified by this influencing factor. Appleman, Claessen, Touw-Otten, et al. (1991) was an exception because this study recruited only patients with recurrent otitis media into their trial. Although many studies had significant numbers of children younger and older than 2 years, we cannot generalize the findings of this study to children in specific age groups because most of the studies did not report outcome by age. Several studies suggest greater caution be taken with children younger than 2 years old; however, these studies do not definitively answer this question. Similarly, we cannot generalize the study findings to children by otitis-prone status.

Two other issues -- although not specifically cited for assessment in the present analysis by the Technical Expert Panel -- that may be significant influencing factors are the degree of severity of AOM and increasing bacterial resistance to antibiotics. Kaleida, Casselbrant, Rockette, et al. (1991) was one of the few studies that explicitly defined severity and treated those with low severity and high severity with different therapeutic regimens. Many of the studies excluded those children with AOM that one might label high severity (i.e. those with complications, comorbid or concurrent conditions, or strong indications for antibiotic). In addition, many of the studies excluded children with acute or chronic perforation of the tympanic membrane. The study findings are, therefore, most applicable to children with AOM of lesser severity without comorbidities.

The majority of studies in this evidence-based analysis do not explicitly address the issue of bacterial resistance. As Klein (1998) notes, group A streptococci and streptococcus pneumonia developed resistance to sulfonamides in the 1940s; Staphylococcus aureus to penicillins, macrolides, and tetracyclines in the 1950s; gram-negative enteric bacilli to aminoglycosides, chloramphenicol, and tetracyclines in the 1960s; Haemophilus influenzae to beta-lactamase-susceptible penicillins in the 1970s; and more recently, S. pneumonia to penicillins, cephalosporins, and macrolides in the 1980s.

Our study did not look at the issue of bacterial resistance and its effect on outcome of AOM. It might have been possible to stratify the studies based on the decade of conduct as a proxy to bacterial resistance pattern, but the prevalence of bacterial resistance also may differ based on locale (McCracken, 1998). A consensus conference convened by the Centers for Disease Control and Prevention has made recommendations with regard to treatment of AOM in light of this issue (Dowell, Butler, Giebink, et al., 1999).

Outcomes measured varied in studies, making comparison difficult. In addition, similar outcomes were defined differently in studies. Most of the clinical outcomes measured were short term rather than long term. The studies in this analysis did not address speech and language development, an obvious long-term outcome. Some of the studies measured adverse effects such as rash, diarrhea, and vomiting. Studies tended to concentrate on clinical outcomes. The studies do not measure the costs and benefits to the family and to society of AOM treatment alternatives.

Another influencing factor that was not controlled in any of the studies in the present evidence-based analysis was the use of antipyretics and analgesics by the study subjects. The investigators should control the use of antipyretics and analgesics in some manner, especially in cases when fever and otalgia or pain are outcome measures.

Chapter 5. Future Research

Key Questions

Randomized controlled studies of high internal validity and adequate generalizability are still needed to adequately assess the key questions asked at the start of this systematic review. There is still a need to adequately address the role of antibiotics in the initial treatment of AOM in children compared to placebo or observational treatment, especially in terms of various influencing factors such as age and otitis-prone status. Close monitoring of patients in these studies with a priori plans for appropriate intervention should allay any concerns about suppurative complications and should also be a focus of research. Strong consideration should be given to establishing uniform criteria -- based on bacterial spectrum, pharmacokinetics, bioavailability, minimum inhibitory concentrations to specific bacteria, and other relevant factors, including cost -- to guide investigators in the comparison of antibiotics. In addition, bacterial resistance is an increasingly important factor and should be considered in future studies comparing antibiotics with one another in treating AOM.

Definition and Diagnostic Criteria

It is critical to establish a definition of AOM that is acceptable to both researchers and practitioners. The diversity of definitions that presently exists makes it difficult to generalize findings or to apply findings to specific patient populations. The tasks in this area are to determine what terms are needed and uniform definitions for those terms. Accuracy of diagnosis also must be investigated and is an important research issue because comparability of assessment across studies depends on accuracy of diagnosis as the primary inclusion criteria for subject recruitment. In addition, all terms describing the specific structures, processes, and outcomes related to the management of AOM must be defined to facilitate rational decisionmaking with respect to this clinical condition.

Quality of Studies

Future studies on antibiotics in the treatment of AOM should strengthen the factors related to the internal validity of the studies. In particular, assignment of subjects to treatment groups should be performed using appropriate methods of randomization. Studies also should be conducted in a double-blind fashion: this is a particular weakness in the studies in this evidence-based analysis. Relative to both these issues is the maintenance of allocation concealment. Studies should account for all subject withdrawals and use appropriate denominators in analysis.

Editors of study reports should require that documentation of studies allow the reader to readily assess the internal validity of the study. Several groups, culminating in the Consolidated Standards of Reporting Trials discussions, have recommended guidelines for reporting controlled trials (Begg, Cho, Eastwood, et al., 1996), and controlled trials on AOM should follow these guidelines for reporting. Improved reporting on subject characteristics, treatment description, and outcome definition would increase the generalizability of findings and improve the entire process of evidence synthesis used in this report.

Study Subjects

The issue of subject selection must be a conscientious balance between the generalizability of findings and the applicability of findings to specific patients or patient populations rather than a matter of convenience, even in the setting of a randomized controlled trial.

Future studies should try to include sufficient numbers of subjects in randomized controlled trials to allow generalization of the findings to other patient populations. Future studies also should include sufficient variation in study population to evaluate important influencing factors such as age and otitis-prone state. The data should be available for secondary analysis to provide results that may be more applicable to more specific patient populations (e.g., based on age or otitis-prone status).

Study Outcomes

In future studies, outcomes should be defined in detail; agreed upon by researchers, practitioners, and patients; and adhered to in all forms of communication to promote rational discussions of the treatment of AOM. All outcomes should be uniformly measured in all studies on AOM as the resources of the investigator allow. They also should be prioritized so that investigators with limited resources can decide which outcomes to measure. If pain and fever remain as relevant AOM outcomes, the effect of analgesics and antipyretics also should be considered. Future studies should assess the long-term outcomes of AOM, as well as the short-term outcomes that most studies presently concentrate on. To make informed decisions in the treatment of AOM, information must be available on all relevant outcomes and not just those that are most convenient to measure. Because bacterial resistance to antibiotics is growing, bacteriologic outcomes should be considered along with clinical outcomes. Finally, future studies are needed to assess the cost-effectiveness of alternative treatments of AOM using a societal perspective that looks at direct and indirect costs and also incorporates the viewpoint of the patient and family and measures of quality of life and functional status.

Acronyms and Abbreviations

AAA: American Academy of Audiology

AAHP: American Association of Health Plans

ABX: antimicrobial

AHCPR: Agency for Health Care Policy and Research

AHRQ: Agency for Healthcare Research and Quality

AMP: ampicillin

AMX: amoxicillin

AOM: acute otitis media

AOME: acute otitis media with effusion

APA: Ambulatory Pediatric Association

BID: two times a day

CBA: cost-benefit analysis

CEA: cost-effectiveness analysis

CFC: cefaclor

CFX: cefixime

CI: confidence interval

CINAHL: Cumulative Index to Nursing and Allied Health Literature

CLV: clavulanate

DARE: Database of Abstracts of Reviews of Effectiveness

DZ: disease

EES: erythromycin ethylsuccinate

ENT: ear, nose, and throat

EPI: episode

ER: emergency room

ERY: erythromycin

FACCT: Foundation for Accountability

GI: gastrointestinal

HMO: health maintenance organization

HZ: history

ICE: incremental cost effectiveness

IPA: International Pharmaceutical Abstracts

ME: middle ear

MEE: middle ear effusion

NAMCS: National Ambulatory Medical Care Survey

NAPNAP: National Association of Pediatric Nurse Associates and Practitioners

NHAMC: National Hospital Ambulatory Medical Care Survey

NHIS: National Health Interview Survey

NNT: number needed to treat

OM: otitis media

OR: odds ratio

PCN: penicillin

PE: pressure equalization

PMEE: persistent middle ear effusion

PPO: preferred provider organization

QALY: quality-adjusted life-years

QID: four times a day

RCT: randomized controlled trial

RR: relative risk

RX: prescription

SENTAC: Society for Ear, Nose, and Throat Advances in Children

SSX: sulfisoxazole

TID: three times a day

TMP-SMX: trimethoprim-sulfamethoxazole

TX: treatment

UI: unique identification

URI: upper respiratory infection

Evidence Tables

Appendices

Appendix A. Economic Burden of Illness

The Societal Cost Burden of Acute Otitis Media

Previous Estimates of the National Cost of Otitis Media

Table 51. Estimates of the U.S. National Cost of Otitis Media
StudyDefinition of IllnessAge GroupDate of EstimateNational Cost Estimate (Billions)Approximate National Cost in 1995 Prices (Billions) 2
Stool and Field (1989)Otitis media0-6 years1987 1$2.2-$3.4$4.05-$5.58
Berman, Byrns, Bondy, et al. (1994)Persistent middle ear effusion0-1 years1992$1.37-$4.92 3$1.59-$5.71 4
Stool, Berg, Berman, et al (1994)Otitis media with effusion2 years1991$1.09$1.49 4
Gates (1996b)Acute otitis media0-4 years1994 1$3.15$3.49
This reportAcute otitis media0-17 years1995$2.98$2.98
1

Date not specified by author(s).

2

Inflated as possible by components of the Consumers Price Index and the Employment Cost Index.

3

Inferred from authors' findings.

4

No separate adjustments for medical and non-medical components of costs.

The medical literature was reviewed to identify estimates of the annual national cost burden of AOM in the U.S. Three estimates of the cost of otitis media (OM) were found (Gates, 1996b; Stool and Field, 1989; Stool, Berg, Berman, et al., 1994 ). A fourth study reported the cost per episode of "persistent middle ear infection" and an estimate of the total annual number of episodes of the illness (Berman, Roark, and Luckey, 1994). These figures yielded a fourth estimate. The four estimates are summarized in Table 51. To provide for comparability, each was inflated to 1995 price levels using the medical care component of the Consumers Price Index and the Employment Cost Index.

As the table indicates, the four estimates of the national cost burden differed with respect to definition of illness and age group for which costs were derived. They also differed with respect to specification of the scope of costs and the pricing of cost components. The estimates are described in detail in the following attachment to this appendix.

The National Cost of AOM in 1995

At the conclusion of the literature review, the annual national cost of AOM in children younger than18 years of age was estimated from existing data summaries and published reports of costs and utilization per episode of illness. Because of the dearth of usable epidemiological and cost-related data, it was necessary to employ a number of assumptions to derive the cost estimate. The principal features and underlying assumptions of the estimate are the following: Otitis media with effusion (OME) and chronic (or persistent or recurrent) middle ear infections were considered possible complications of AOM or the results of unsuccessful treatment of AOM. Because the costs of complications of an illness and of treatment failures are conventionally and correctly regarded as costs of the illness, the cost of episodes of OME/chronic middle ear infection that follow episodes of AOM was considered a cost of AOM. National illness costs were derived for the year 1995. Certain data used in deriving and validating the estimates were not yet available for 1996 and later years when the report was begun. The cost estimate was constructed to be as consistent as possible with published data on national medical care utilization for middle ear infections.

The major results and implications of the cost estimation procedure are these:
  • The baseline estimated total national cost estimate of AOM was $2.98 billion in 1995. The figure is shown in Table 51.

  • The estimated direct cost of AOM was $1.96 billion (65.8 percent of the total) in 1995, and the estimated indirect cost was $1.02 billion (34.2 percent of the total). The large percentage of indirect costs in the total suggests that AOM imposes a considerable economic burden on patients' families.

  • Medical care prices rose 12.5 percent from 1995 to the first quarter of 1999 and workers'earnings per hour rose 14.7 percent. Applying these inflators to the estimates of direct and indirect costs suggests that the annual national cost of OM increased to $3.38 billion in early 1999 because of price increases alone.

  • Seventy percent of the direct cost of AOM and 63 percent of the total cost was attributable to episodes of OME/chronic middle ear infection progressing from AOM. These figures imply that effective treatments for AOM and prevention of subsequent infection would achieve significant national cost savings.

  • The analytic procedure produced an estimate of 5.18 million treated episodes of AOM in 1995, 2.22 million treated episodes of OME/chronic middle ear infection, and 1.04 million episodes of treated OME/chronic middle ear infection assumed to be progressions or complications of AOM. Although these values were constrained to yield national ambulatory care visit totals reported by NAMCS, the estimated total number of episodes of OM, 7.40 million, is smaller than the number conjectured in other cost estimates.

  • Insofar as it is comparable to it, the cost estimate itself is smaller than the estimated cost of AOM assumed by Gates (1996b). The lower value is due partly to the generally conservative assumptions used here and partly to what seems to be an exaggerated estimate of the annual prevalence of AOM used by Gates.

The cost estimates have important limitations, primarily due to conflicting epidemiological evidence regarding the prevalence of AOM and OME. In particular:

  • The annual national numbers of ambulatory care visits for OM implied by epidemiological studies of OM are 50 percent or higher than national visit totals reported from NAMCS and the National Hospital Ambulatory Medical Care Surveys (NHAMCS). Because the epidemiological studies were conducted in small geographic areas and nearly all of them were performed before 1990, it was considered that NAMCS and NHAMCS data yielded more reliable estimates of the national prevalence of OM than the epidemiological literature. However, it has been claimed -- although without hard supporting evidence -- that NAMCS reports understate the true national visit totals (Glass, Lew, Gangarosa, et al., 1991). If the claim is true, the national cost estimate is biased downward.

  • To deduce the annual numbers of episodes of AOM and OME/chronic middle ear infection following AOM in the under-18-year-old age group from NAMCS and NHAMCS data, it was necessary to employ two major assumptions. The first was that OME/chronic middle ear infection represents 30 percent of all episodes of OM. The second was that 20 percent of the episodes of AOM progress to OME/chronic middle ear infection. Little empirical evidence exists with which to confirm or reject either assumption.

  • Sensitivity analyses of the national cost estimate showed that variations of 10 percent in most of the price and utilization parameters changed the estimate by 4 percent or less. However, the cost estimate was sensitive to the assumed national ambulatory care visit total for AOM, the percentage of episodes of OM classifiable as OME/chronic middle ear infection, and the percentage of episodes of AOM that progress to OME/chronic middle ear infection. Sensitivity analyses indicated that plausible values of these three parameters raise the estimated national cost of AOM to as much as $6 billion in 1995 prices. Thus, it is reasonable to believe that the true annual national cost of AOM was $3 billion to $6 billion in 1995.

Cost-Effectiveness Studies of Therapies for AOM

Literature Search

Table 52. Summary of Cost-Effectiveness Studies of Therapies for Acute Otitis Media
StudyBranthaver, Greiner, and Eichelberger (1997)Landholt and Kotschwar (1994)
Authors' definition of illnessAcute otitis mediaAcute, nonrecurrent otitis media
MethodologyCost-effectiveness analysis? Unclear.Cost-minimization analysis
Analytic techniqueObserved data, decision-analysis modelRetrospective data-based cost and severity of illness analyses
Location and date of studyRockville, MD [2 Kaiser-Permanente (KP) clinics], September-December, 1990Location not specified in US, 1991
PerspectivePayer (HMO)Payer
Patient populationChildren 0-7 yearsChildren 6 mo.−12 yr (N=50)
Interventions5 antibiotic therapy alternatives
  • AM: amoxicillin monotherapy

  • ACP: amoxicillin-clavulanate potassium

  • CM: cefaclor monotherapy

  • ES: erythromycin-sulfisoxazole

  • TS: trimethoprim-sulfamethoxazole

2 antibiotic therapies:
  • AC: amoxicillin/clavulanate (N=25)

  • CP: cefpodoxime-proxetil (N=25)

Dose and scheduleNot specifiedAC: 40mg/kg, 3 doses/day, 10 days CP: 10mg/kg, 2 doses/day, 10 days
Duration of therapyUnclear (varies with outcome), up to 8 weeksNot specified - 14 days (?)
Period of observation8 weeksNot specified - 14 days (?)
Direct costsMedications, MD visitsMD visits, medications, antidiarrheals, diapers, electrolytes, antifungals
Indirect costsExcludedExcluded
Source of therapy efficacy estimatesKP recordsAuthors' data
Source of utilization estimatesKP records, authorsAuthors' data
Source of unit cost estimatesKP recordsAuthors
Definition of health well-being or health outcomeHealth outcomes defined only as "cure" and "failure".Otitis media severity score, clinical cure rate
Source of health well-being/health outcome estimatesKP recordsAuthors' data
Treatment side effects considered?YesYes
Baseline resultsFew details reported. Observed costs per case of all 5 therapies apparently nonsignificantly different. TS and CM said to be most effective therapies (yield highest cure rates), ES least effective.Mean direct costs/episode:
  • AC: $108.55

  • CP: $109.29

Not significantly different. Also non-significant differences in mean OM severity scores and cure rates.
Sensitivity analysis resultsNo sensitivity analysisNo sensitivity analysis
RemarksLittle specific information provided by authors. Numerical analysis cannot be verified by readers because of sketchy and incomplete reporting of estimates and statistical tests.Methodology consistent with pharmacoeconomic standards except for lack of sensitivity analysis and failure to include lost parental work time in cost estimates. Results based on exceptionally small sample.
StudyOh, Maerov, Pritchard, et al. (1996)Weiss and Melman (1988)
Authors' definition of illnessAcute otitis mediaAcute otitis media
MethodologyCost-utility analysisCost-minimization analysis
Analytic techniqueDecision-analysis modelDecision-analysis model
Location and date of studyOntario, 1992Not stated. US national? 1987-88?
PerspectiveNot specified -- health insurer/payer?Patient's family (uninsured)
Patient populationChildren 2 months - 18 yearsNot specified
InterventionsSecond-line antibiotic therapy, 3 alternatives:
  • CM: cefaclor monotherapy

  • AC: amoxicillin-clavulanate

  • ES: erythromycin-sulfisoxazole

First-line antibiotic therapy, 2 alternatives:
  • AM: amoxicillin monotherapy

  • CM: cefaclor monotherapy

Dose and scheduleCM: 3 doses/day, 40 mg/kg each AC: 3 doses/day 40 & 10 mg/kg, each ES: 3 doses/day, 50 & 150 mg/kg eachNot specified
Duration of therapyTwo courses of medicationTwo courses of medication
Period of observation30 days from first MD visitNot specified
Direct costsDrug, MD visit, lab testsDrug, MD visits
Indirect costsExcludedParental lost work time
Source of therapy efficacy estimatesLiteratureLiterature
Source of utilization estimatesMail survey of 17 pediatriciansAuthors
Source of unit cost estimatesOntario Health Insurance PlanAuthors
Definition of health well-being or health outcomeQuality-adjusted life-days (QALDs, Max=30)None. Patient well-being/health Outcome assumed the same for each treatment alternative.
Source of health well-being/health outcome estimatesPatient quality of life estimated by 17 pediatricians in mail surveyNA
Treatment side effects considered?YesNo
Baseline resultsExpected QALDs per case and cost per QALD
  • CM: 28.15, $3.837

  • AC: 27.98, $4.253

  • ES: 28.03, $4.281

CM dominates other therapies, is the most cost-effective intervention.
Expected costs of AM and CM therapies $68.57 and $72.83 per case. AM therapy the more cost-effective intervention but unclear whether difference in mean costs is statistically significant.
Sensitivity analysisPerformed by Monte Carlo simulations. Analysis supports C as most cost-effective intervention.No sensitivity analysis
RemarksMethodology consistent with pharmacoeconomic standards, but quality of life estimates given by very small sample of MDs. Parents probably better judges of quality of life.Presentation and discussion of estimates vague. No statistical test of premise that AM and CM are equally effective. No statistical test of equality of costs per case. No sensitivity analysis.
The literature search for economic evaluations of therapies for treating OM identified nine studies published since 1965.1 All nine were cost-effectiveness, cost-utility, cost-minimization, or similar analyses. One of the nine was undertaken in Nigeria (Amadasun, 1997), and it was not used in the cost-analysis because of potential differences in medical care costs and practice between that country and the U.S. Three of the remaining four studies defined OM either nonspecifically or as a recurrent illness (Banz, Schwicker, and Thomas, 1998; Berman, Roark, and Luckey, 1994; Bisonni, Lawler, and Pierce, 1991; Callahan, 1988). Only four studies explicitly addressed treatments for AOM (Branthaver, Greiner, and Eichelberger, 1997; Landholt and Kotschwar, 1994; Oh, Maerov, Pritchard, et al., 1996; Weiss and Melman, 1988), and they are discussed here. The salient characteristics of the four studies are summarized in Table 52.

Overview of Methods and Materials in the Literature

Except in the broadest terms, the four economic evaluations of antibiotic treatments for AOM have little in common. All four studies were performed using standard decision-analysis or decision-tree models. In three studies, amoxicillin-clavulanate combination therapy was compared with one or more other antibiotic therapies. In the fourth (Weiss and Melman, 1988), amoxicillin monotherapy was compared with cefaclor monotherapy. Three of the four were performed, or seemed to have been performed, from the payer's perspective. The fourth was conducted from the perspective of the child's family under the assumption that the family was uninsured (Weiss and Melman, 1988).

The studies differed considerably in virtually all other respects. One was a cost-effectiveness analysis, one a cost-utility analysis, and two were cost-minimization analyses (Table 52). Only two of the three studies specified the dosage and schedule of antibiotic treatments. The cost-of-therapy estimates were derived from: a very large sample of patient records, very small samples of patient records, a small sample of pediatricians, and estimates of the authors. In two of the four studies, estimates of the efficacy of treatment were deduced from patient records. In the other two, they were taken from the literature on clinical trials of antibiotics for OM. The health-related physical outcomes of treatment were defined as the patient's quality-adjusted life-days in one study, as treatment cure and failure rates in another, as an OM severity score and clinical cure rate (but not used in the analysis) in the third, and left unspecified in the fourth (a cost-minimization analysis). The time frame over which costs and health outcomes were measured appeared to range from 2 to 8 weeks but was not expressly stated in any of the four studies.

Because payers are usually concerned only with direct costs, the three studies conducted from the health plan payer's perspective excluded indirect care-giving costs, although one of the three presented estimates of hours of lost parental work time caused by care-giving (Landholt and Kotschwar, 1994). Only one study estimated the direct costs of treatment side effects. None of the studies examined or estimated the costs of long-term sequelae of failed treatments such as recurrences of illness, surgery, or patient hearing loss and related learning disabilities. Only one of the three studies performed a sensitivity analysis of the results derived from its model (Oh, Maerov, Pritchard, et al., 1996).

Results

Findings as to the most cost-effective antibiotic therapy for AOM differ. In two studies it was concluded that cefaclor monotherapy was more cost-effective than amoxicillin monotherapy, amoxicillin-clavulanate, and erythromycin-sulfisoxazole (Branthaver, Greiner, and Eichelberger, 1997; Oh, Maerov, Pritchard, et al., 1996). By contrast, amoxicillin monotherapy was judged more cost-effective than cefaclor monotherapy in one of the other two studies (Weiss and Melman, 1988). In the fourth analysis, amoxicillin-clavulanate and cefpodoxime-proxetil were deemed equally cost-effective (Landholt and Kotschwar, 1994).

The specific results of the studies differ as well. For example, Oh, Maerov, Pritchard, et al. (1996) found that cefaclor monotherapy and amoxicillin-clavulanate produced nearly identical quantities of health benefits per patient measured as quality-adjusted patient-days, but that direct treatment costs with cefaclor monotherapy were 10 percent lower per patient than the direct costs of amoxicillin-clavulanate. Conversely, Weiss and Melman (1988) concluded that cefaclor monotherapy yielded a 5 percent higher treatment cost per patient than amoxicillin monotherapy. And finally, Branthaver, Greiner, and Eichelberger (1997) reported that there seemed to be no differences in the direct costs per patient of five antibiotic therapies, including amoxicillin monotherapy, amoxicillin-clavulanate, and cefaclor monotherapy, but that cefaclor monotherapy and trimethoprim-sulfamethoxazole produced a higher cure rate than the other antibiotics. These conflicting findings make it unclear whether the treatment cost of cefaclor monotherapy is higher than, lower than, or the same as the treatment cost of amoxicillin and other antibiotics.

Conclusion

The evaluative economic literature on antibiotic treatments for AOM is too small, its methodologies too varied, and its findings too inconsistent to provide a clear-cut guide for choosing the most cost-effective antibiotic therapy. One possible reason for the inconsistencies in results is that the total treatment costs of antibiotics like amoxicillin and cefaclor may not be greatly different. Two of the four studies discussed here did claim that there appeared to be nonsignificant differences in the total treatment costs of alternative antibiotics (Oh, Maerov, Pritchard, et al., 1996; Weiss and Melman, 1988). Even the two studies that favored one antibiotic over another did not report large differences in efficacy and treatment costs, and it is conceivable that true efficacy rates and direct treatment costs do not differ materially among several of the antibiotic alternatives (Oh, Maerov, Pritchard, et al., 1996; Weiss and Melman, 1988). The issue should be explicitly addressed in future research.

Other research problems and issues also should be addressed in new cost-effectiveness analyses of antibiotic therapies for AOM. Some of these are the following:

  • Large, national representative databases should be used for determining medical care utilization and prices. The studies discussed here all employed small local databases, and their estimates of illness and treatment costs might be unrepresentative of costs in the United States as a whole.

  • A societal perspective should be adopted, and indirect illness and treatment costs should be incorporated in evaluative studies. The national cost estimate of AOM illness suggests that indirect costs constitute nearly half of the total treatment costs of AOM. A national cost burden that large should not be ignored, and the inclusion of indirect costs may have substantial effects on the results of cost-effectiveness analyses. For example, Landholt and Kotschwar (1994) noted that amoxicillin-clavulanate caused an average of 32 hours of lost parental work time per patient in their sample (chiefly due to adverse side-effects), and that cefpodoxime-proxetil caused an average of only 16 hours of lost work time per patient. Had this time been priced and included in their analysis, it would have altered their conclusion that amoxicillin-clavulanate and cefpodoxime-proxetil are equally cost-effective. Finally, if direct treatment costs are approximately the same for all antibiotic therapies, payers have no disincentives to sanction or provide therapies with low indirect costs. Hence, the selection of low indirect-cost antibiotic treatments for AOM would benefit patients' parents without penalizing payers.

  • A standard generic measure of the health benefits of treatment, such as quality-adjusted or healthy life-years (or days), should be adopted and used in cost-effectiveness analyses. There are three reasons for this. First, a standard generic measure of treatment benefits would provide for comparability of study results. Second, the conventional two-treatment cutoff-point methodology in cost-effectiveness analysis requires the definition of a cutoff point, typically the maximum amount that society pays for a quality-adjusted or healthy year of life. As a practical matter, it is not feasible to define a meaningful cutoff point when the measure of treatment benefits for AOM is the rate of cures, a symptom severity score, or any sort of illness-specific health outcome. Third, an illness-specific or other idiosyncratic measure of treatment benefits makes it impossible for decisionmakers to allocate spending among treatments for AOM and other illnesses in a rational manner. The decisionmaker must have estimates of how its population's overall health benefits are affected when it provides or sanctions treatments for many illnesses. Unless health benefits are (or can be) defined identically for all illnesses, there are no ways to determine how a shift in spending -- for example, to more expensive or less expensive treatments for AOM -- affects the population's aggregate level of health and well-being. Quality of life in AOM recently has become a research issue (Alsarraf, Jung, Perkins, et al., 1998; Rosenfeld, Goldsmith, Tetlus et al., 1997;), but only one of the four studies attempted to estimate and incorporate patients' quality-adjusted survival time into its cost-effectiveness analysis (Oh, Maerov, Pritchard, et al., 1996).

  • The costs and health benefits of treatment failures and complications should be recognized and incorporated into evaluations of treatments for AOM. The economic impact of hearing loss on children's learning abilities and subsequent lifetime earnings capabilities should be rigorously evaluated. Unless the probability or risk of progression of AOM to more serious illness is deemed independent of the mode of treatment, the effects of disease progression on costs and patients' health outcomes should be accounted for in cost-effectiveness analyses. According to the cost-of-illness estimates obtained here, the cost per case of OME is up to 10 times as large as the treatment cost of AOM. Even small differences in treatment failure rates may therefore have large effects on the relative cost-effectiveness of different antibiotics for AOM. Although two of the studies discussed here found that cefaclor was a cost-effective antibiotic for AOM (Branthaver, Greiner, and Eichelberger, 1997; Oh, Maerov, Pritchard, et al., 1996), it has been reported that cefaclor was associated with an especially high recurrence rate of illness (Kaplan, Wandstrat, and Cunningham, 1997). If that is the case, the high cost and adverse health consequences of recurrent illness argue prima facie against the cost-effectiveness of cefaclor therapy.

Attachment to Appendix A: Technical Report on the Societal Cost Burden of Acute Otitis Media

Previous Estimates of the Societal Cost of Otitis Media in the United States

A review of the economic literature identified four estimates of the annual cost of OM in the United States. Each is a prevalence estimate derived as the product of an estimated cost per patient and an estimated annual prevalence of the illness.

Review of Literature

Gates (1996b) placed the annual national total cost of AOM at $3.15 billion in the 0-4 year age group at an unspecified date in the early or mid- 1990s. The estimated cost per episode of illness was $233.50 ($100 in direct medical costs, $25 in travel expenses, and $107.50 in lost parental wages due to caregiving), and the total annual number of episodes of illness was assumed to be 14 million.2 However, Gates also assumed an average of 2.5 physician visits per episode of illness, so that the total national number of physician visits would have been 35 million for the 0-4 year age group alone. There are no national data that are consistent with so large a number. Data from the 1995 NAMCS indicate a national total of 24.781 million ambulatory care visits for "otitis media and eustachian tube disorders" in all age groups (Schappert, 1997), and the number of visits received by children in the 0-4 year age group for AOM would have been somewhat smaller still. This suggests that Gates' estimate of the national cost burden of AOM is exaggerated by more than 50 percent.

The most often-cited estimate of the national cost of OM is by Stool and Field (1989). Stool and Field put the cost at $2.4-3.3 billion in the 0-6 year age group in an unspecified year -- apparently in the middle or late 1980s. Like the Gates study, Stool and Field may have intended their estimate as an approximation of the true figure rather than as a precise calculation. The direct medical cost per episode was assumed to be $91, the average cost of surgery was placed at $37-$75, and lost parental wages were set at $18-$36. The total annual number of episodes of illness was unreferenced but assumed to be 16.8 million. Like Gates' assumed prevalence, the figure of 16.8 million episodes seems excessively high, and it almost certainly biases the Stool and Field estimate of the national cost of OM upward. Otherwise, the large difference in the cost per episode between the Stool and Field and Gates estimates -- $100 or more -- is due to Gates' inclusion of parental travel costs in the calculation and his imputation of a much larger value of lost parental wages.

In the third study, Berman et al. (1994) used the decision-tree method to estimate the total cost per case (including parental travel expenses and lost wages) of persistent middle ear effusion (PMEE) for a hypothetical 13-month-old boy. Priced at Colorado Medicaid reimbursement levels in 1992, the cost per case was $720-$1,372, varying with the assumed treatment regimen. Priced at private practice reimbursement levels in Denver in the same year, the cost was $1,265-$2,588, also varying with the assumed treatment regimen. Although Berman et al. did not give a national cost estimate, they conjectured an annual national total of 1.9 million cases of PMEE in the group younger than age 2 on the assumption of 9.3 million cases of AOM in the age group, 20 percent of which result in PMEE. At 1.9 million cases per year, the annual medical cost of PMEE in the 0-1 year age group would have been $1.37-$4.92 billion, depending on the treatment regimen and whether utilization was priced at Colorado Medicaid payment levels or private practice payment levels in the Denver area.

The only estimate of the national cost of OM using a data-based estimate of costs per case was prepared for the guidelines on treating OME by Stool et al. (1994). Claims data from more than 100 health insurers were used to estimate the direct costs of OME in the 2-year-old age group in 1991. Including estimates of lost parental wages, the total cost of OME was put at $406 per child for medical treatment only, $2,174 for a child undergoing myringotomy with tube insertion, and $3,433 per child undergoing adenoidectomy. The estimated overall average cost per child was $1,330. The annual national prevalence of OME in the 2-year-old age group was set at 821,700 episodes, so that the national total cost of OME was estimated at $1.09 billion in 1991.

Assessment of Literature

The four studies imply that the annual national cost of OM runs into several billions of dollars, but in other respects their results cannot be easily summarized. Only one of the four expressly estimated the national cost of AOM. The Gates and Stool and Field estimates assume prevalences of illness that seem to be at odds with the only available national data on the utilization of ambulatory care visits for OM. The estimates from the Berman et al. and Stool et al. studies are restricted to episodes of illness in very young children. All of the studies omitted the indirect cost of unpaid family caregiving services provided by unemployed parents and by employed parents during nonworking hours.

On balance, the national cost estimates are overstated insofar as they embody inflated estimates of the prevalence of OM. They also are understated to the extent that they are restricted to very young age groups of children, do not include all forms of OM, and exclude the indirect costs of unpaid family caregiving services.

Estimating the National Cost of AOM in Children Younger Than 18

Methodology: Background

The societal cost of an illness is conventionally defined as the total value (priced as an aggregate opportunity cost) of all goods and services consumed, destroyed, or foregone as a result of the illness and its treatment. In addition, the societal cost of a treatment encompasses not only the value of resources consumed by the treatment itself, but also the value of resources consumed, destroyed, or foregone due to treatment complications and failures. For this report, OME and chronic middle ear infections were considered the consequences of unsuccessful treatments of AOM. In cost-of-illness studies and cost-effectiveness analyses, it is customary to regard the costs of treatment failures and sequelae as costs of the initial illness and its treatment. Thus, the cost of AOM was defined as the societal cost of all forms of OM and not just of AOM alone.

The national cost of OM was estimated with the same two-step method employed in the four studies described above. That is, estimates of the cost per episode of OM were multiplied by estimates of the total number of episodes of illness. We assumed that we could estimate the total annual number of episodes of OM as the product of age-specific (and possibly sex-specific) episode rates of OM and the sizes of the relevant-age cohorts of children in the United States. We reviewed the epidemiological literature for age-specific annual episode rates of illness.

Two limitations were imposed on the review: it was restricted to findings on U.S. samples of children, and it was narrowed to studies performed after 1990. The reasoning was as follows.

First, a substantial body of epidemiological research on OM has been performed outside the United States, particularly in Northern Europe. Nevertheless, it is well known that the incidence and prevalence rates of OM vary with race, climate, urban and rural location, frequency of contact with other children (such as in day care centers), and other factors. Because it is unclear that these influences are the same in the United States and other countries, estimates of the incidence and prevalence rates of OM obtained outside the United States and Canada may not be applicable to this country. Therefore, non-U.S., non-Canadian studies were consequently omitted from the review.

Second, there is significant evidence that the prevalence rate of OM in this country increased dramatically from the mid- 1970s to 1990. The indications are mixed as to whether the upward trend in the prevalence rate has leveled off in the 1990s. In any event, it seemed likely that episode rates of OM derived before 1990 would give downward-biased estimates of the episode rates prevailing in the mid- or late 1990s. This is not to say that all such studies are biased. If a pre- 1990s study focused on a sample of children with predispositions to OM, its episode rates might have considerably overrepresented national rates at the time it was performed but give accurate estimates of rates in the mid- and late 1990s. Nevertheless, although epidemiological studies conducted as early as the late 1970s were reviewed, they were set aside on grounds that they were not clearly applicable to recent experience in the United States.

Only one relevant epidemiological study of OM has been performed in the U.S. since the mid- 1980s (Yawn and Lydick, 1996). The study, conducted in Rochester, MN in 1994-95, reported the numbers of episodes of illness per child within 1-year age cohorts for children aged 12 and younger. However, when these episode rates were multiplied by the sizes of 1-year age cohorts in the 0-12-year U.S. population in 1995 (Day, 1996), they produced a total of 36.3 million episodes of OM, and it is not possible to reconcile this estimate with the NAMCS estimate of 24.781 million ambulatory care visits for "otitis media and eustachian tube disorders" in the same year (Schappert, 1997). The Yawn et al. estimates were obtained by telephone interviews with parents. Thus, many responses may have been inaccurate or, if they were accurate, many of the reported episodes of infection may not have received medical care.3 For this report it was taken as a working hypothesis that the NAMCS estimate is correct and thus that the Yawn et al. episode rates greatly exaggerate the national number of treated cases of OM. We therefore concluded that all published estimates of the rates of episodes of OM per child significantly bias estimates of the national number of treated episodes of OM in the mid- 1990s.

Because the epidemiological literature appeared not to yield demonstrably reliable rates for episodes of illness (and none at all in the 13- to 17-year-old age group), the total national number of episodes of AOM in 1995 was estimated from NAMCS and other national data and from individual studies in which the number of physician visits per episode of illness was reported.

The dearth of data and information sources made it necessary to use a number of assumptions and simplifications to derive both the national number of episodes of OM and the cost per episode. In summary, the principal features and premises of the estimation procedure were these:

  • National illness costs were derived for the year 1995. Certain data used in deriving and validating the estimates were not yet available for 1996 and later years when the report was begun.

  • The estimated national cost of OM refers to children younger than 18 years of age.

  • The estimates of total national medical care utilization for OM were constructed to be as closely consistent as possible with the available (NAMCS and other) reports of national utilization for ear infections.

  • Episodes of OME/chronic middle ear infection that result from unsuccessful treatments of AOM were considered complications of AOM, and their cost was consequently considered a cost of AOM.

Estimates of the National Numbers of Episodes of AOM and OME/Chronic Middle Ear Infection in 1995

It was assumed that the 1995 (NAMCS) national total of 24.781 million ambulatory visits for OM and eustachian tube disorders were for OM and its complications. No age distribution of the visits has been published. Thus, to estimate the number of visits by patients aged 17 and younger, it was assumed that the age distribution of visits was identical to the national age distribution of acute ear infections as reported by the National Health Interview Survey (NHIS) in 1995. According to the 1995 NHIS, there were 23.568 million acute ear infections in the United States, 82. 195 percent of which occurred in the 17-year old and younger age group (Benson and Marano, 1998). Hence, it was assumed that 20.38 million (24.781 million x 0.82 196) ambulatory care visits were provided nationally in 1995 to children under 18 with OM.

It was next assumed that the total number of ambulatory care visits for OM is the sum of the numbers of visits for AOM and OME/chronic middle ear infections. To estimate the numbers of episodes of AOM and OME/chronic middle ear infection from the total number of ambulatory care visits for OM, the following method was employed. Let

  • A=

  • total annual number of episodes of AOM

  • O=

  • total annual number of episodes of OME/chronic middle ear infection

  • k=

  • fraction of all episodes of OM that are episodes of OME/chronic middle ear infection

  • T=

  • total number of ambulatory care visits for OM

  • Va=

  • average number of ambulatory care visits/episode for AOM

  • Vo=

  • average number of ambulatory care visits/episode for OME/chronic middle ear infection. Then

A·Va + O·Vo=T

O=k·(A+O).

Assuming that the values of all variables other than A and O are known or estimable, the solution of the equation system is

(1) A=(1-k)T/[(1-k)Va + kVo]

(2) O=kA/(1-k).

These two relations were used to estimate the numbers of episodes of AOM and OME/chronic middle ear infusion.

Table 53. Estimated Costs Per Episode of Acute Otitis Media
Cost ComponentCost ($)AssumptionsSource
Direct Costs114.69
Physician Visits75.691.75 visits/episode 2/3 of visits to pediatricians, 1/3 to family/general practitioners Mean charge/visit=$48.07 Physicians paid 90% of chargesBranthaver et al (1997); Gates (1996b); Kaplan et al (1997); Landholt and Kotschwar (1994); Stool and Field (1989)Oh et al (1996); Weiss and Melman (1988); Nelson and Woodwell (1998); Gonzalez (1995)
Drugs19.621 course of antibiotics Mean costs in 2 Medicaid plansWhite et al (1996); Berman et al (1997)
Laboratory5.63--Kaplan et al (1997)
Travel8.75$5/physician visitBerman et al (1994); Gates (1996); Kaplan et al (1997); author
Paid in-home care, supplies5.00--Landholt and Kotschwar (1994); Kaplan et al (1997); Yawn et al (1996)
Indirect Costs99.50
Lost parental wages54.504 hours @ $11.35/hour plus 20% fringe benefitsGates (1996); Kaplan et al (1997); Landholt and Kotschwar (1994); Stool and Field (1989); Weiss and Melman (1988); Yawn et al (1996)
Unpaid caregiving services, excluding lost work time45.006 hours @ $7.50/hourAuthor
Total Cost214.19
The total number of ambulatory care visits (T) was set at 20.38 million as above. Published estimates of the mean number of physician visits per episode of AOM range from 1 to 2.5 (Table 53). Absent compelling reasons for other assumptions, the base-case mean rate for this report was placed at Va=1.75 visits per episode -- the midpoint of the range. Stool et al. (1994) reported an estimate of 5.1 physician visits per episode for OME from a large sample of insurance plan claims data in 1991. No other estimates of the visit rate were found. Hence, it was assumed that the mean rate of physician utilization for an episode of OME/chronic middle ear infection was set at Vo=5.1 visits. The percentage of all episodes of OM that are episodes of OME/chronic middle ear infection is poorly known. To estimate the cost of OME for the Stool et al. (1994) report, Lewin-VHI assumed that the percentage ranges from 25 to 35 and used a base-case figure of 30. The same percentage was employed for the base case here. Hence, k=0.3.

The base-case values of T, Va, Vo, and k applied to the equations (1) and (2) yielded an estimated 5.18 million annual episodes of AOM and 2.22 million episodes of OME/chronic middle ear infection. Following Berman et al. (1994), it was next assumed that 20 percent of all treated episodes of AOM progress to OME/chronic middle ear infection. Under that assumption, 1.04 million episodes of OME/chronic middle ear infection (approximately 47 percent of the total number of episodes) were complications of or the results of failed treatments for AOM. The cost of 1.04 million episodes of OME/chronic middle ear infection was therefore attributed to AOM.

Estimated Cost per Episode of AOM

The cost per treated episode of AOM has been estimated in seven studies published since the late 1980s (Branthaver et al., 1997; Gates, 1996b; Kaplan et al., 1997; Landholt and Kotschwar, 1994; Oh et al., 1996; Stool and Field, 1989; Weiss and Melman, 1988). The costs range from $39 to $233.50, varying with the date and geographic location of the estimate and with the items of direct and indirect cost included by authors. After inflating them to mid- 1990s price levels, the majority of the estimates cluster at roughly $125-$130 per episode. Even so, they differ sufficiently in composition and assumptions (such as the number of physician visits per episode) to make them dubiously representative of the average national cost per episode of AOM.

Direct cost per episode

To estimate the direct cost per treated episode of AOM, it was assumed as above that patients received an average of 1.75 physician office or clinic visits. In 1995, private family and general practitioners charged an average of $45.87 for an office visit with an established patient, and pediatricians in private practice charged $49.17 (Gonzalez, 1996). It was then assumed that:

  • two-thirds of the children with AOM visited pediatricians and one-third visited family/general practitioners (Nelson and Woodwell, 1998);

  • (private) physicians were paid 90 percent of their billed charges; and

  • payments per visit -- $41.28 and $44.25 respectively -- are reasonable estimates of the societal costs per visit for treating AOM.

The assumptions yield a mean cost per visit of $43.25 and a cost of $75.69 per episode of AOM for physician services.

The standard premise in all seven studies of AOM treatment costs is that (successfully) treated patients receive one or two courses (or prescriptions) of antibiotics, most commonly amoxicillin or cefaclor. It was assumed conservatively that patients received an average of only one course of treatment. The mean cost of one course of first-line antibiotics for AOM was said to be $16. 19 in the Tennessee Medicaid plan in 1993 (White, Holiman, Tepedino, et al., 1996) and $20.27 in the Colorado Medicaid plan in 1991-92 (Berman, Byrns, Bondy, et al., 1997). Other reports or estimates of drug costs are taken from much smaller samples of data and vary widely with the specific drugs prescribed by physicians. The Tennessee and Colorado Medicaid plan costs were therefore inflated to 1995 levels by the drug component of the Consumers Price Index (U.S. Bureau of the Census, 1998) and averaged. The resulting cost, $ 19.62, was taken as a reasonable estimate of the societal cost of antibiotics for an episode of AOM.

Only one estimate of laboratory costs per episode, $5.63 in a Charleston, WV, practice in 1994 (Kaplan et al., 1997), has been reported in the recent literature. It was used as an approximation of the costs of laboratory services. Family travel costs have been estimated by authors or derived from data in three recent studies. The costs were priced at $7.70, $7.59, and $10 per physician visit (Berman et al., 1994; Gates, 1996b; Kaplan et al., 1997). Although it is hard to conjecture an average cost of travel to providers, the direct cost per round trip was placed conservatively at $5 per physician visit or $8.75 per episode. Families also may pay for in-home care for the child and buy supplies such as antidiarrheals, electrolytes, and extra diapers for children experiencing the adverse side effects of antibiotic therapy. There are two reports of these costs -- $0.77 for baby sitters (Kaplan et al., 1997) and $1.79-$6.82 for other supplies (Landholt and Kotschwar, 1994). Yawn et al. (1996) gave the figure of about 30 minutes of unnamed "special child arrangements" per episode of OM. They did not assign a cost to the arrangements, but it seems unlikely that the cost would exceed $3-$4 per episode. The total cost of paid inhome care and nonmedical supplies was therefore set at $5 per episode of AOM.

Together, the preceding assumptions yield an average total direct cost of $114.69 per episode of treated AOM. The estimates are summarized in Table 53.

Indirect cost per episode

All published estimates of the indirect cost of AOM limit the scope of the cost to foregone parental wages. The common assumption or observation is that an employed parent leaves work to take the sick child to visit a physician. The estimates of lost work time and lost wages (i.e., the value of labor product forgone by society because of the child's illness) differ markedly, possibly because of interstudy differences in work force participation rates. Yawn et al. (1996), and Weiss and Melman (1988) gave estimates of 0.4-0.5 work days lost per episode of AOM, but Landholt and Kotschwar (1994) put the average family work time loss at only 0.6-1.3 hours per episode. Kaplan et al. (1997) gave an apparently data-based estimate of $34.38 in lost parental wages per episode of illness. Stool and Field (l989) and Gates (1996b) conjectured costs of $18-$36 and $107.50 per episode, respectively.

Unpaid caregiving services for AOM include travel services by parents, communication with physicians, shopping services for prescriptions and other supplies, and all exceptional child care (feeding, attending, administering drugs, doing laundry, etc.) caused by illness. Because there are no conclusive ways of knowing whether the typical or average caregiver of a sick child is employed, the relatively conservative assumption was made that 4 work hours or 0.5 work days per child are lost due to caregiving for an episode of AOM. In 1995 the average hourly earnings of employed workers was $11.35, excluding fringe benefits (U.S. Bureau of the Census, 1996). Consequently, given a fringe benefit rate of 20 percent, the average indirect cost of societal lost work product was $54.50 per episode of AOM.

There are no estimates of the indirect cost of unpaid family caregiving services by unemployed parents or by employed parents during weekends or other nonworking hours. Any imputation of this cost must therefore be speculative. It was assumed conservatively that the family devotes an hour of unpaid caregiving each day over a 10-day course of illness. As above, 4 hours were provided by a parent who left work, and the remaining 6 were provided with no loss of work time. In 1995, the mean hourly wage rate for paid inhome health care services was $10.91 (U.S. Bureau of the Census, 1996). However, because a high level of caregiving skill is probably not necessary for a child with OM, the hourly opportunity cost of unpaid services was set at $7.50, approximately the average of $10.91 and the hourly minimum wage. The estimated opportunity cost of unpaid caregiving services was therefore $45.00 (6 × $7.50) per episode of AOM.

Total cost per episode of AOM

The preceding estimates yield a total cost of $214. 19 per episode of AOM, including $99.50 in indirect costs. The estimates, assumptions, and sources are summarized in Table 53.

Estimated Cost per Episode of OME/Chronic Middle Ear Infection

Berman et al. (1994) put the average cost, including all direct costs and the indirect cost of lost parental wages, of an episode of OME/recurrent or persistent middle ear infection at $720-$2,588 for a "hypothetical 13-month-old boy" in the Colorado study in 1992. The wide range occurred because of variations in treatment and differences in the payment mechanism (Medicaid or private fee-for-service).

The only data-based estimate of the cost of OME is by Lewin-VHI and is reported in Stool et al. (1994). It was used here to estimate the cost per episode of OME/chronic ear infection. The estimate was derived from a sample of health insurance claims (from more than 100 different insurers) for 1,898 patients. Mean direct, indirect, and total costs (payments to providers) per episode of illness were placed at $1,060, $270, and $1,330 per episode, respectively, in 1991. Unfortunately, the figures obtained by Lewin-VHI have several shortcomings. First, the cost estimates were made only for 2-year-old children, and the authors remark that costs were "similar [but] not identical" for other age groups. Second, the costs of drugs were not observed but conjectured on the basis of prescription patterns obtained from "practice surveys [and] an unpublished study." Third, indirect costs were defined only as foregone wage and salary income when parents left work to transport children to medical providers. Moreover, the authors assumed rather than observed the durations of missed work time. Any of these features of the cost calculations might give distorted estimates of the true costs per case.

The Lewin-VHI estimate of direct cost per episode of illness was inflated to 1995 price levels by the medical care component of the Consumer's Price Index. The estimate of indirect cost per episode of illness was inflated by the percentage change in average national hourly earnings from 1991 to 1995 (U.S. Bureau of the Census, 1992, 1996). The 1995 estimates of direct, indirect, and total costs per episode of OME were $1,321, $299, and $1,620.

Estimated indirect cost per episode of unpaid caregiving services

The indirect cost of unpaid family caregiving services provided to children with OME/chronic ear infections by unemployed parents and employed parents during nonworking hours has never been estimated and must also be conjectured. Recent studies place the average duration of an episode of OME at 17-23 days (Casselbrant et al., 1985; Klein et al., 1990; Teele et al., 1990; Paradise et al., 1997). Because all of the estimates refer to children aged 7 or younger and the duration of illness appears to decline with age, the average length of illness for all children aged 17 and younger was conservatively set at 17 days. In the absence of more complete data, it was consequently assumed that families provide an average of 1.5 (nonworking) hours per day of unpaid caregiving services to children with OME/chronic middle ear infection over 17 days of illness. Lewin-VHI (Stool et al., 1994) reported that 55 percent of their sample of 2-year-olds continued treatment for OME for at least 3 months. Hence, the estimate of 25.5 hours of nonworking caregiving time per episode of OME may be conservative. The level of required caregiving skill may be higher than that needed for AOM, but the imputed hourly wage rate for unpaid care was set at $7.50 as before. Thus, the total opportunity cost of unpaid caregiving services was $ 191.25 per episode of illness.

Total cost per episode of OME/chronic middle ear infection

The assumptions given here yield a total cost of $1,811.25 for an episode of OME/chronic middle ear infection in 1995.

The estimated direct and indirect costs per episode of illness were $1,321 and $490.25, respectively.

Estimated Total National Cost of OM in 1995

To summarize, the procedures described here yielded the following estimates for the 0- to 17-year age group:

  • Total annual number of episodes of AOM: 5.18 million.

  • Number of episodes of OME/chronic middle ear infection attributable to AOM: 1.04 million.

  • Direct, indirect, and total costs per episode of AOM: $114.69, $99.50, and $214. 19, respectively.

  • Direct, indirect, and total costs per episode of OME/chronic middle ear effusion: $1,321.00, $490.25, and $1,811.25, respectively.

  • In 1995, the estimated total national cost of AOM and its complications was therefore $2.983 billion [(5.18million)·$214. 19 + (1.04 million)·$1,811.25]. The total direct cost was $1.961 billion and the total indirect cost was $1.022 billion.

  • Direct and indirect costs accounted for approximately 66 percent and 34 percent, respectively, of total illness costs.

Sensitivity analysis

Table 54. Sensitivity analysis of estimated total annual national cost of acute otitis media in < 18-year age group: variations in total costs with respect to variations in the total annual national number of ambulatory care visits for otitis media, the percentage of episodes of otitis media that are episodes of otitis media with effusion/chronic ear infection, and the percentage of episodes of acute otitis media that progress to otitis media with effusion/chronic ear infection (Costs in millions of dollars) 1
Episodes of OME/Chronic Middle Ear Infection as Percentage of All Episodes of OMPercentage of Episodes of AOM That Progress to OME/Chronic Ear Infection
10203040
Annual Number of Ambulatory Care Visits for OM=20.37 Million (Base Case)
103,4765,0686,6618,254
252,3343,4034,4735,542
302,0462,9833,9214,858
351,7912,6123,4324,253
501,1761,7142,2532,791
Annual Number of Ambulatory Care Visits for OM=25 Million
104,2666,2218,17510,130
252,8654,1775,4906,802
302,5113,6624,8125,963
352.1983,2054.2125,219
501,4432,1042,7653,426
Annual Number of Ambulatory Care Visits for OM=30 Million
105,1197,4659,81012,156
253,4385,0136,5888,163
303,0134,3945,7757,155
352,6383,8465,0556,263
501,7312,5253,3184,111
Annual Number of Ambulatory Care Visits for OM=35 Million
105,9728,70911,44514,182
254,0105,8487,8659,523
303,5155,1266,7378,348
353,0774,4875,8977,307
502,0202,9453,8714,796
Annual Number of Ambulatory Care Visits for OM=50 Million
108,53212,44116,35020,259
255,7298,35410,97913,604
305,0227,3239,62411,925
354,3966,4108,42510,439
502,8854,2085,5306,852
1

Circled figure is the total cost derived from base-case assumptions.

Because of the large number of assumptions necessary to produce the cost estimate, a sensitivity analysis of the underlying parameter values was performed. Selected results of the analysis are presented in Table 54. The cost estimate was found to be relatively insensitive to nearly all of the parameters used in deriving it. For the most part, variations in the values of the parameters by given percentages (P) cause percentage variations in the cost estimate of size 0.4P or less.

However, the cost estimate is particularly sensitive to the values of the three parameters represented in Table 54: the total annual national number of ambulatory care visits for OM, the percentage of episodes of OME/chronic middle ear infection, and the percentage of episodes of AOM that progress to episodes of OME/chronic middle ear infection. Unfortunately, these three parameters cannot be estimated reliably either because of sketchy empirical information or, in the case of the visit totals, conflicting implications of the epidemiological evidence.

For example, although the NAMCS data on ambulatory care visit totals seem more accurate than the visit totals implied by epidemiological studies of OM, it has been suggested that the national numbers of ambulatory care visits compiled by NAMCS significantly understate the true totals (Glass et al., 1991). Although there exists no hard evidence that supports the claim, it remains a possibility that the 20.37 million visits figure used to estimate costs is biased downward.

In addition, Teele et al. (1980) reported that 40 percent of treated AOM patients exhibit symptoms of illness for at least 1 month and that 20 percent exhibit symptoms for at least 2 months. This could mean that the true percentage of the episodes of AOM that progress to OME/chronic middle ear infection is somewhat higher than the base-case percentage (20) used in the analysis here.

The figures in Table 54 show that the estimate of the total national cost of AOM increases with the assumed total number of ambulatory care visits for OM and with the percentage of episodes of AOM assumed to progress to OME/chronic middle ear effusion. Hence, the base-case national cost estimate of $2.983 billion is most likely to understate rather than overstate the true annual national cost of AOM. It may not be unrealistic to assume that the true annual national total of ambulatory care visits for OM is 30 million in the <18-year age group and that 30 percent of the episodes of AOM progress to OME/chronic middle ear infection. Under those assumptions and the premise that OME/chronic middle ear infection represents 25-35 percent of all episodes of OM, the estimated national cost of AOM is $5.055-$6.588 billion (Table 54). Although there are no ways of verifying the correctness of these assumptions, it seems reasonable to think that the annual national cost of AOM is at least $3 billion and may be as much as $6 billion.

Review of Epidemiology: Number of Episodes of Otitis Media per Child per Year

Background

A review of the epidemiological literature on OM was conducted to determine whether it provided reliable estimates of the annual rate of episodes of illness per child. The review was limited to studies performed in the United States and Canada during or after the late 1970s. As stated in the preceding section, studies performed elsewhere were deemed of doubtful relevance to the occurrence of OM in the United States. Studies published before 1980 also were excluded because of the apparently large increase in OM attack rates after 1975. For example, data from the NAMCS show that, depending on age and sex, the annual number of office visits per child for OM increased by 125-250 percent from 1975 to 1990 in the 0- to 5-year old age group (Schappert, 1992). Similarly, data from the National Health Interview Surveys (NHIS) indicate that the annual prevalence rate of acute ear infections in the 0- to 4-year old age group increased by 28-84 percent from 1982 -- the first year that these infections were reported -- to 1990, also depending on sex (National Center for Health Statistics, 1985; Adams and Benson, 1991). An epidemiological study performed in the early 1980s in Montreal also described an 11-26 percent increase over a 3-year period in the number of episodes per child of OM among 3- and 7-year-olds (Croteau et al., 1990). This evidence strongly implies that the prevalence and incidence rates of OM estimated before 1980 are likely to give downward-biased estimates of the current prevalence and incidence rates of OM.

It is not altogether clear that upward trends in the incidence and prevalence rates of OM have stabilized since 1990. At present, the only longitudinal data pertinent to the issue are NAMCS and NHIS data, and these have been published only up to the mid- 1990s. According to NAMCS and NHAMCS estimates, the total national number of ambulatory care visits for suppurative and unspecified OM (all ages) peaked at 20.033 million in 1989, fell to 16.185 million in 1991, and rose to 19.309 million in 1993 (Nelson and Woodwell, 1998). NHIS data also show large annual variations in the national prevalence rate of acute ear infections in the 0-17-year-old age group from 1990 to 1995, but reasonably evident trends in the rate appear only for children age 5-17 -- a 14 percent increase for girls and a 32 percent increase for boys (Adams and Benson, 1991; Benson and Marano, 1998). Although these data summaries give a mixed picture, they suggest that the occurrence of OM in the 0-17 year age group may still be increasing. If that is true, incidence and prevalence rates derived as recently as the early 1990s may also understate the true current rates.

Assessment of Literature

Table 55. Estimated Number of Episodes of Otitis Media in the U.S., 1995, Based on Estimates of the Number of Episodes per Child in 6 Studies
StudyBiles et al (1980)1Marchant et al. (1984)2Casselbrant et al. (1985) 3, 4Teele et al. (1989)4Croteau et al. (1990)5Yawn et al. (1996)5
Definition of illnessOtitis mediaOtitis mediaOtitis media with effusionAcute otitis mediaOtitis mediaOtitis media
Date of study1975Not specified1981-831975-841981-831994-95
LocationGalveston, TXCleveland, OHPittsburgh, PABoston, MAMontreal, QURochester, MN
Sample size1,01870140498Very large, not specified9,047
Age group (years)0-8< 12-60-63, 70-12
Estimated Number of Episodes, 1995 (millions)6
Age Group (Years)
< 18.1 (36.5% aymptomatic)4.63.8
33.22.74.3
0-621.130.4
2-636.912.318.1
71.41.6
0-815.033.2
0-1236.3
1

Data collected retrospectively from medical records. Authors say estimates may understate true prevalence.

2

Some cases of illness diagnosed during monthly well-child visits.

3

All children in sample attended day care center.

4

Dropouts from initial sample had lower rates of illness than patients remaining in study to conclusion. Authors say that dropout behavior may have caused the observed prevalences of illness to overstate those of t he overall population.

5

Data collected by RNs from telephone interviews with parents.

6

Mean episodes per child reported by authors times estimated U.S. population in age cohort (Day, 1996).

The search of the epidemiological literature uncovered 13 studies published in 1980 or later in which the occurrence of OM was examined in samples of U.S. or Canadian children. Seven of the 13 presented only the percentages of children with one or more episodes of illness, the age distribution of cases, or similar findings (Howie and Schwartz, 1983; Starfield et al., 1984; Roland et al., 1989; Casselbrant et al., 1990; Marx et al., 1995; Paradise et al., 1997; Zimmerman et al., 1998). The remaining six reported the mean numbers of episodes of illness per child or provided information from which these numbers could be derived. To provide a comparison of the six studies, the reported mean numbers of episodes per child-year by age cohort were multiplied by the U.S. Bureau of the Census' projected population sizes by age cohort for July 1, 1998 (Day, 1996). Each of the resulting products is an estimate of the total annual number of episodes for the given age cohort. The estimates are shown in Table 55. For those that provided data for more than one age cohort, the table allows inter-study comparisons to be made.

The comparisons in Table 55 are obviously disappointing. The estimated annual national numbers of episodes of OM vary widely, probably because of differences in sample locations or other characteristics and the procedures used by researchers to identify cases of OM. For example, one of the studies (Casselbrant et al., 1985) was performed on children in day care centers, and its findings were not intended to be applied to the population of all children. Given the large disparities in the estimates in Table 55 it is extremely difficult to say whether any of the studies represented in the table produces accurate estimates of the annual number of treated episodes of acute and other OM in U.S. children.

On that basis it was concluded from the review that the existing epidemiological literature does not provide reliable estimates of the annual numbers of treated episodes of OM in the U.S. during recent years.

Appendix B. Conceptual Framework For Management Of Acute Otitis Media

  1. The patient presents, either in the office or by phone, with ear pain or some other symptom suggesting otitis media, type unspecified. At this point, the practitioner does not know with absolute certainty if the patient has:

    1. a diagnosis other than otitis media

    2. otitis media with effusion

    3. acute otitis media

    4. otitis media without effusion (i.e., myringitis)

    5. otitis media with another diagnosis

  2. The practitioner must have in mind definitions for diagnosing:

    1. a diagnosis other than otitis media

    2. otitis media with effusion

    3. acute otitis media

    4. otitis media without effusion (i.e., myringitis)

    5. otitis media with another diagnosis
      The definitions may be correct or incorrect.

  3. The practitioner must gather appropriate information:

    1. history

    2. physical examination (e.g., pneumootoscopy)

    3. diagnostic tests (e.g., tympanogram, tympanocentesis, acoustic reflectometry, audiogram)
      The practitioner may gather the correct or incorrect information.

  4. The practitioner must use the information gathered to make a diagnosis of:

    1. a diagnosis other than otitis media

    2. otitis media with effusion

    3. acute otitis media

    4. otitis media without effusion (i.e., myringitis)

    5. otitis media with another diagnosis
      The diagnosis may be correct or incorrect

  5. Once a diagnosis of acute otitis media is made, the practitioner must choose a therapeutic option:

    1. observation and no intervention

    2. antibiotics

      1. which antibiotic

      2. dose of antibiotic

      3. schedule of antibiotics

      4. length of treatment

    3. steroids

    4. analgesics

    5. antihistamines/decongestants

    6. tympanostomy

    7. any combination of 5.b.-5.f.
      The therapeutic option chosen may be correct or incorrect.1

  6. After implementing a therapeutic option, the practitioner must prescribe a followup strategy:

    1. followup

      1. length of time after initiation or end of treatment

      2. number of followups

      3. intervals between followups if more than one

    2. no followup
      The practitioner must have in mind criteria for the need for recheck and followup that may be correct or incorrect; the followup strategy chosen may itself be correct or incorrect.1,2

  7. At followup, the practitioner must have in mind definitions for:

    1. successful treatment of acute otitis media

    2. unsuccessful treatment of acute otitis media

      1. persistent

      2. recurrent

      3. complications such as mastoiditis


      The definitions may be correct or incorrect.

  8. At followup, the practitioner must gather appropriate information:

    1. history (e.g., prior infection)

    2. physical examination (e.g., pneumootoscopy)

    3. diagnostic tests (e.g., tympanogram, acoustic reflectometry, tympanocentesis, audiogram)
      The practitioner may gather the correct or incorrect information.

  9. At followup, the practitioner must use the information gathered to make a diagnosis of:

    1. successful treatment

    2. unsuccessful treatment

      1. persistent

      2. recurrent

      3. complications such as mastoiditis


      The diagnosis may be correct or incorrect.

  10. At followup, the practitioner must then decide if further treatment is needed.

    1. If diagnosed as successful treatment, various treatment options may be considered:

      1. observation and no intervention

      2. prophylactic antibiotics

        1. which antibiotic

        2. dose of antibiotic

        3. schedule of antibiotics

        4. length of treatment

      3. refer to Otolaryngology for consideration of:

        1. pressure equalizing tubes

        2. adenoidectomy

        3. tonsillectomy

      4. refer to Hearing and Speech

        1. hearing evaluation

        2. speech evaluation and/or treatment

      5. any combination of 10.a.2)-10.a.4)

    2. If diagnosed as unsuccessful treatment, various treatment options may be considered:

      1. observation and no intervention

      2. antibiotics

        1. which antibiotic

        2. dose of antibiotic

        3. schedule of antibiotics

        4. length of treatment

      3. steroids

      4. analgesics

      5. antihistamines/decongestants

      6. tympanostomy

      7. refer to Otolaryngology for consideration of:

        1. pressure equalizing tubes

        2. adenoidectomy

        3. tonsillectomy

        4. mastoidectomy

      8. refer to Hearing and Speech

        c)hearing evaluation
        d)speech evaluation and/or treatment

      9. treatment of complications, such as mastoiditis

      10. any combination of 10.b.2)-10.b.9)


      The treatment chosen may be correct or incorrect.1

  11. After follow-up and implementation of a therapeutic option, the practitioner must prescribe a followup strategy:

    1. follow-up

      1. length of time after initiation or end of treatment

      2. number of followups

      3. intervals between followups if more than one

      4. go to 73

    2. no followup
      The practitioner must have in mind criteria for the need for recheck and followup that may be correct or incorrect; the followup strategy chosen may itself be correct or incorrect.1

Appendix C. Key Questions

I. Initial Set of Three Key Questions as of December 18, 1998

Question 1: On the Observational or No Treatment or Natural History of AOM

  1. During an episode of uncomplicated acute otitis media (AOM) that is initially managed WITHOUT antibiotics, what proportion of children have the following outcomes:

    1. presence/absence of pain/otorrhea/irritability/fever/hearing loss at 24 hours, 2-3 days, and 4-7 days?

    2. presence/absence of ALL clinical signs/symptoms, except middle ear effusion (MEE), at 7-14 days?

    3. presence/absence of asymptomatic MEE at 2 weeks, 1 month, and at 3 months?

    4. presence/absence of acute suppurative complications/secondary complications?

  2. To what degree are the above outcomes attributable to:

    1. clinical characteristics including hearing and/or speech delay?

    2. age of the child?

    3. provider degree of diagnostic uncertainty for true AOM?

    4. parent reliability (low vs. high) to report symptom resolution or progression at 48-72 hours if antibiotics are initially withheld?

    5. parent preference concerning antibiotic therapy?

    6. parent education?

    7. analgesic use?

Question 3: On Antibiotic Treatment of AOM

  1. Are antibiotics effective (in terms of statistical significance and magnitude of absolute clinical benefit above and beyond placebo/observational/no treatment/natural history) in the initial treatment of uncomplicated AOM with respect to the following outcome indicators:

    1. presence/absence of pain/otorrhea/irritability/fever/hearing loss at 24 hours, 2-3 days, and 4-7 days?

    2. presence/absence of ALL clinical signs/symptoms, except MEE, at 7-14 days?

    3. presence/absence of asymptomatic MEE at 2 weeks, 1 month, and at 3 months?

    4. presence/absence of acute suppurative complications/secondary complications?

  2. When antibiotics are used in the initial treatment of uncomplicated AOM, which of the following
    characteristics are associated with better outcomes compared to placebo/observational/no
    treatment/natural history?

    1. clinical characteristics including hearing and/or speech delay?

    2. age of the child?

    3. provider degree of diagnostic uncertainty for true AOM?

    4. parent reliability (low vs. high) to report symptom resolution or progression at 48-72 hours if antibiotics are initially withheld?

    5. parent preference concerning antibiotic therapy?

    6. parent education?

    7. analgesic use?

Question 4: On Antibiotic Regimen for AOM

Does the specific antibiotic regimen make a difference?
(Antibiotic class) Are antibiotics with broader coverage than amoxicillin or trimethoprim sulfa more cost-effective or cost-beneficial in the initial treatment of uncomplicated AOM?

  1. (Antibiotic class) What is the utility of oral fluoroquinolones in the initial treatment of uncomplicated AOM in childhood? What are the side effects?

  2. (Dose of antibiotic) What is the value of using 60-80 mg/kg/dof amoxicillin or amoxicillin-clavulanate vs. the standard 40 mg/kg/d?

  3. (Schedule of antibiotic) Is twice a day high dose amoxicillin therapy as effective as three time a day amoxicillin therapy in the initial treatment of uncomplicated AOM?

  4. (Length of treatment) What is the comparative efficacy of short- vs. long-term antibiotic

  5. therapy in children younger than 2 years of age and those older than 2 years of age? Is the use of a single injection of ceftriaxone or the use of other cephalosporin for treatment of AOM more or less likely than 7-10 days of oral amoxicillin to predispose to creation of a penicillin/cephalosporin resistant pneumococcal nasopharyngeal flora? Does the risk benefit justify the use of a single injection of ceftriaxone? (Need discussion)

Changes Made and Rationale

  1. Several of the technical experts felt that Question 1 should be split into outcome and influencing factor questions like Question 3.

  2. One issue brought up during the second conference call related to the difference between "natural history of acute otitis media when nothing is done including not seeking care from the health care provider" and "observational treatment prescribed by the health care provider." We decided that the issue brought up an important point and Question 1 was retitled to address the latter.

  3. Another issue brought up was on the real objective of Question 3b. Are we addressing the amount of influence of the listed factors on the "selective initial use of antibiotics" or on the "effectiveness of the initial use of antibiotics." The former is an analysis of the prescribing pattern which is a process variable and the latter is an analysis of the effectiveness of initial use of antibiotics which is an outcome variable. Our project team decided to address the influence of the factors on the effectiveness of initial use of antibiotics and leave it up to users of our evidence report to develop guidelines for appropriate prescribing patterns. Question 3b) was thus reworded accordingly.

  4. On the issue of defining uncomplicated AOM, there were several suggestions, ranging from "inflammation of the middle ear cleft" to "one sign and one symptom" to "definitions used by the different studies." The project team decided that a definition must be established before the study could go on because it would affect the search strategy. A poll will be taken among the experts as to the best definition to use for this evidence report. For the evidence analysis, several of the technical experts felt that we may have to accept whatever definition of AOM is found in any given study as they will be quite disparate; however, the project staff feel it is important to establish a standard definition for comparison.

  5. Another issue brought up was on some subquestions in Question 4 that addressed more toward complicated AOM rather than uncomplicated AOM. The two specific ones are 4b) Would antibiotic selection based on local or regional bacterial resistance pattern improve the outcome of antibiotic treatment of AOM? and 4h) How long after an antibiotic is used is it reasonable for it to be used again to treat AOM in terms of reducing the likelihood of developing resistance to antibiotics? These two subquestions were thus excluded from the scope of this evidence report.

  6. An issue on defining endpoints for the study was brought up. The group decided to leave them open to definitions used by different studies. However, the project staff decided that it is important to define the most appropriate endpoints before the literature search and then compare what the literature used with our definitions.

  7. Another issue was on the age of the child to be included in the evidence report. It was suggested by some of the technical experts to exclude the neonate as defined by an age of younger than 8 weeks. Epidemiologically, a neonate is referred to as a newborn 28 days old or younger. For this evidence report we will include studies on children between 28 days and 18 years old.

  8. Several factors were added as influencing factors: gender, ethnicity, presence of ear infection in sibling, craniofacial problems, and cost. In addition, the project staff, based on information in Attachment 4.b-1, added race, sibling(s) in day care, pacifier use, presence of sibling(s), and atopy or allergy. They are included in the scope of the evidence report.

II. Revised Key Questions as of January 25, 1999

Question 1: On the Observational or No Treatment or Natural History of AOM

  1. During an episode of uncomplicated acute otitis media (AOM) that is initially managed WITHOUT any intervention, what proportion of children have the outcomes delineated in the scope of the evidence report?

  2. To what degree are the above outcomes attributable to the influencing factors delineated in the scope of the evidence report?

Question 3: On Antibiotic Treatment of AOM

  1. Are antibiotics effective (in terms of statistical significance and magnitude of absolute clinical benefit above and beyond placebo/observational/no treatment/natural history) in the initial treatment of uncomplicated AOM with respect to the outcomes delineated in the Scope of the Evidence Report?

  2. When antibiotics are used in the initial treatment of uncomplicated AOM, which of the influencing factors delineated in the scope of the evidence report are associated with better outcomes compared to placebo/observational/no treatment/natural history?

Question 4: On Antibiotic Regimen for AOM

Does the specific antibiotic regimen make a difference?

(Antibiotic class) Is treatment with antibiotics of broader coverage than amoxicillin or trimethoprim sulfa more effective or result in less total cost in the initial treatment of uncomplicated AOM?

  1. (Antibiotic class) What is the utility of oral fluoroquinolones in the initial treatment of uncomplicated AOM in childhood? What are the side effects?

  2. (Dose of antibiotic) What is the value of using 60-80 mg/kg/d of amoxicillin or amoxicillin-clavulanate vs. the standard 40 mg/kg/d?

  3. (Schedule of antibiotic) Is twice a day high-dose amoxicillin therapy as effective as three time a day amoxicillin therapy in the initial treatment of AOM?

  4. (Length of treatment) What is the comparative effectiveness of short- vs. long-term antibiotic therapy in children younger than 2 years of age and those older than 2 years of age?

Rationale for Changes Made Since 12/23/98 and Other Issues

  1. The original intent of Question 1, which was to study the natural history of AOM, implies that the clinical course is to be observed "WITHOUT any intervention" and not "WITHOUT antibiotics," which does not exclude the possibility of other interventions.

  2. In Question 1, none of the children will be taking antibiotics; so, parent preference concerning antibiotic therapy should not have any influence on the outcomes. One of the technical experts also felt this factor should be removed from Question 1. One would expect that parent preference concerning antibiotic therapy might be important when antibiotics are being administered and parental compliance with therapeutic recommendations is necessary to complete the treatment as in Question 3.

  3. The term "initial treatment" was not changed; however, the project staff feel that the technical experts must state whether or not "initial treatment" refers to the first course of treatment for an independent episode of uncomplicated AOM. If so, the technical experts must then define what is meant by an independent episode: is it an episode of uncomplicated AOM that is preceded by at least a 3-week period without AOM?

  4. The project staff added side effects and adverse events attributable to antibiotics to the outcomes in Question 3.

  5. For clarity, we refer to the outcomes and influencing factors listed in the scope of the evidence report as being our a priori subquestions of interest. In addition, our economic experts have pointed out that longer-term outcomes, for example greater than 3 months, need to be added, and these have already been added to the scope of the evidence analysis.

  6. It was felt by many of the technical and internal experts and project staff that we should study effectiveness and cost in this study and not cost-effectiveness or cost-benefit because of the lack of time in the 1-year timeframe of this contract to conduct such a detailed microeconomic analysis. Thus, all references to cost-effectiveness and cost-benefit have been changed to references to effectiveness and cost.

  7. Although one of our technical experts pointed out that oral fluoroquinolones have not been approved by the Food and Drug Administration for use in the general populace, we have retained this question because research studies of this antibiotic may be available in the literature.

  8. Any references to efficacy were changed to effectiveness because this study is interested in the impact on outcomes in the clinical setting.

  9. Subquestion 4.f) was absorbed into subquestion 4.a). Subquestion 4.a) will address "antibiotics with broader coverage than amoxicillin or trimethoprim sulfa" which would include single-injection ceftriaxone and other cephalosporins. Subquestion 4.a) will look at bacterial resistance to antibiotics as an outcome as was the case in subquestion 4.f). This suggestion also had been made during the first conference call by one of the technical experts.

Revised Key Questions as of Revised February 24, 1999

Question 1: On the Observational or No Treatment or Natural History of AOM

  1. During an episode of uncomplicated acute otitis media (AOM) that is initially managed WITHOUT any active intervention (pharmacologic or surgical) other than topical or systemic medications (that do not contain antibiotics) given for symptomatic relief, (e.g., analgesics, antipyretics, antihistamines, decongestants, ear or nose drops), what proportion of children have the outcomes delineated in the scope of the evidence report?

  2. To what degree are the above outcomes attributable to the influencing factors delineated in the Scope of the Evidence Report?

Question 3: On Antibiotic Treatment of AOM

  1. Are antibiotics effective (in terms of statistical significance and magnitude of absolute clinical benefit above and beyond placebo/observational/no treatment/natural history) in the initial1 treatment of uncomplicated AOM with respect to the outcomes delineated in the scope of the evidence report?

  2. When antibiotics are used in the initial1 treatment of uncomplicated AOM, which of the influencing factors delineated in the scope of the evidence report are associated with better outcomes compared to placebo/observational/no treatment/natural history?

Question 4: On Antibiotic Regimen for AOM

Does the specific antibiotic regimen make a difference?

  1. (Antibiotic class) Is treatment with antibiotics of broader coverage than amoxicillin or trimethoprim sulfa more effective or result in less total cost in the initial1 treatment of uncomplicated AOM?

  2. (Antibiotic class) What is the utility of oral fluoroquinolones in the initial1 treatment of uncomplicated AOM in childhood? What are the side effects?

  3. (Dose of antibiotic) What is the value of using 60-80 mg/kg/d of amoxicillin or amoxicillin-clavulanate vs. the standard 40 mg/kg/d in the initial1 treatment of uncomplicated AOM?

  4. (Schedule of antibiotic) Is twice a day high-dose amoxicillin therapy as effective as three times a day amoxicillin therapy in the initial1 treatment of uncomplicated AOM?

  5. (Length of treatment) What is the comparative effectiveness of short- vs. long-term antibiotic therapy in children younger than 2 years of age and those older than 2 years of age in the initial1 treatment of uncomplicated AOM?

Rationale for changes made since 1/25/99

  1. It was pointed out by one of the technical experts that unless we allowed studies that included children who had used "topical or systemic medications (that do not contain antibiotics) given for symptomatic relief (e.g., analgesics, antipyretics, antihistamines, decongestants, ear or nose drops)," we would have to "exclude nearly every published article from consideration." We have thus reworded Question 1 and will stratify in the analysis, if possible, to look at studies that truly have no intervention and those that included children who had used medications for symptomatic relief. Medications for symptomatic relief with commercial names in parentheses would include: (List is not exhaustive.) (From Physicians Desk Reference, 1998, Taketomo, 1999)

    1. analgesics: (See ear drops)

      1. acetaminophen (Anacin-3, Datril, Panadol, Tempra, Tylenol)

      2. ibuprofen (Advil, Motrin, PediaProfen)

    2. antipyretics:

      1. acetaminophen (Anacin-3, Datril, Panadol, Tempra, Tylenol)

      2. ibuprofen (Advil, Motrin, PediaProfen)

    3. antihistamines:

      1. astemizole (Hismanal)

      2. cetirizine hydrochloride (Zyrtec)

      3. chlorpheniramine maleate (Chlor-Trimeton)

      4. cyproheptadine hydrochloride (Periactin)

      5. dimenhydrinate (Dramamine)

      6. diphenhydramine (Benadryl)

      7. hydroxyzine (Atarax, Vistaril)

      8. loratadine (Claritin)

      9. meclizine hydrochloride (Antivert, Bonine)

      10. phenindamine tartrate (Nolahist)

      11. promethazine hydrochloride (Phenergan)

      12. terfenadine (Seldane)

    4. decongestants:

      1. phenylpropanolamine hydrochloride (Propagest)

      2. pseudoephedrine hydrochloride (Sudafed)

    5. antihistamine and/or decongestant combinations:

      1. acrivastine and pseudoephedrine hydrochloride (Semprex-D)

      2. azatadine maleate and pseudoephedrine sulfate (Trinalin)

      3. brompheniramine maleate and phenylpropanolamine hydrochloride (Dimetapp)

      4. brompheniramine maleate and pseudoephedrine hydrochloride (Bromfed, Bromfed-PD)

      5. chlorpheniramine maleate and pseudoephedrine hydrochloride (Atrohist Pediatric, Codimal-L.A., Codimal-L.A.-HALF, Fedahist Gyrocaps, Kronofed-A, Kronofed-A-Jr.)

      6. chlorpheniramine tannate and phenylephrine tannate and pyrilamine tannate (Atrohist)

      7. phenindamine tartrate and chlorpheniramine maleate and phenylpropanolamine hydrochloride (Nolamine)

      8. promethazine and phenylephrine (Phenergan VC)

      9. triprolidine hydrochloride and pseudoephedrine hydrochloride (Actifed)

    6. otic preparations:

      1. includes analgesic/local anesthestic

        1. antipyrine (cerumenolytic) and benzocaine (Aurafair, Auralgan, Auroto)

        2. benzocaine (Americaine Otic)

        3. phenylephrine hydrochloride (decongestant) and benzocaine (Tympagesic Otic Solution)

      2. includes steroid

        1. dexamethasone sodium phosphate (Decadron Phosphate)

        2. hydrocortisone and acetic acid in propylene glycol vehicle (VoSoL HC)

      3. non-antibiotic antimicrobial

        1. acetic acid in aqueous aluminum acetate otic solution (Otic Domeboro)

        2. acetic acid in propylene glycol vehicle (VoSoL)

      4. cerumenolytic

        1. carbamide peroxide (Debrox, Gly-Oxide)

        2. triethanolamine polypeptide oleate-condensate (Cerumenex)

    7. nasal preparations:

      1. antihistamines or decongestants

        1. azelastine hydrochloride (Astelin)

        2. naphazoline hydrochloride (AK-Con, Albalon, Liquifilm, Naphcon, Naphcon Forte, Vasocon Regular)

        3. oxymetazoline hydrochloride (Afrin)

        4. phenylephrine hydrochloride (Neo-Synephrine)

      2. steroids

        1. beclomethasone diproprionate (Beconase, Beconase AQ, Vancenase, Vancenase AQ, Vancenase AQ 84 mcg)

        2. budesonide (Rhinocort)

        3. dexamethasone sodium phosphate (Dexacort Phosphate)

        4. flunisolide (Nasalide, Nasarel)

        5. fluticasone proprionate (Flonase)

        6. triamcinolone Acetomide (Nasacort, Nasacort AQ)

  2. The phrase "in the initial1 treatment of uncomplicated AOM" was inadvertently omitted from questions 4. c) and 4. e) and has been added.

  3. The majority of the technical experts felt that an episode of uncomplicated AOM may be considered distinct from a previous episode of AOM and eligible for "initial" treatment if the most recent course of antibiotic ended 4 weeks prior to the episode of AOM in question or if there is documentation by an examiner that a prior episode of AOM has been cleared.

IV. Final Version of Key Questions for Task Order, Revised March 26, 1999

Question 1: On the Observational or No Treatment or Natural History of AOM

  1. During an episode of uncomplicated acute otitis media (AOM) that is initially managed WITHOUT any active intervention (pharmacologic or surgical) other than topical or systemic medications (that do not contain antibiotics) given for symptomatic relief, (e.g)., analgesics, antipyretics, antihistamines, decongestants, ear or nose drops), what proportion of children have the outcomes delineated in the scope of the evidence report?

  2. To what degree are the above outcomes attributable to the influencing factors delineated in the scope of the evidence report?

Question 3: On Antibiotic Treatment of AOM

  1. Are antibiotics effective (in terms of statistical significance and magnitude of absolute clinical benefit above and beyond placebo/observational/no treatment/natural history) in the initial1 treatment of uncomplicated AOM with respect to the outcomes delineated in the scope of the evidence report?

  2. When antibiotics are used in the initial1 treatment of uncomplicated AOM, which of the influencing factors delineated in the scope of the evidence report are associated with better outcomes compared to placebo/observational/no treatment/natural history?

Question 4: On Antibiotic Regimen for AOM

Does the specific antibiotic regimen make a difference?

  1. (Antibiotic class) Is treatment with antibiotics other than amoxicillin or trimethoprim sulfa more effective or result in less total cost in the initial1 treatment of uncomplicated AOM?

  2. (Antibiotic class) What is the utility of oral fluoroquinolones in the initial1 treatment of uncomplicated AOM in childhood? What are the side effects?

  3. (Dose of antibiotic) What is the value of using > 60 mg/kg/d of amoxicillin or amoxicillin-clavulanate vs. the standard 40 mg/kg/d in the initial1 treatment of uncomplicated AOM?

  4. (Schedule of antibiotic) Is twice a day high-dose amoxicillin therapy as effective as three times a day amoxicillin therapy in the initial1 treatment of uncomplicated AOM?

  5. (Length of treatment) What is the comparative effectiveness of short- vs. long-term antibiotic therapy in children younger than 2 years of age and those older than 2 years of age in the initial1 treatment of uncomplicated AOM?

Rationale for changes made since 2/24/99

  1. During the 3/26/99 conference call, the technical expert panel agreed to replace the phrase "of broader coverage" in the 2/24/99 version with the word "other."

  2. During the 3/26/99 conference call, the technical expert panel agreed to change the dosage "60-80 mg/kg/d" in the 2/24/99 version with "> 60 mg/kg/d."

Appendix D. Definitions of Acute Otitis Media

I. Initial Proposed Definition of Acute Otitis Media, as of December 1, 1998

Background

One of the tasks arising out of the second conference call on 12/1/98 was to establish a definition for the term acute otitis media. The following definition for acute otitis media is found in Bluestone and Klein (1996):

"Acute otitis media is the rapid onset of signs and symptoms of acute infection within the middle ear."

Bluestone and Klein (1996) further state:

"One or more local or systemic signs are present: otalgia (or pulling of the ear in the young infant), otorrhea, fever, recent onset of irritability, anorexia, vomiting, or diarrhea. The tympanic membrane is full or bulging, is opaque, and has limited or no mobility to pneumatic otoscopy -- indicative of middle-ear effusion."

Bluestone and Klein (1996) define middle ear effusion as follows:

"Middle-ear effusion is liquid in the middle ear."

Dr. Rosenfeld has previously suggested that the presence of middle ear effusion be a criterion for diagnosing acute otitis media. Dr. Marcy and Dr. Casselbrant suggested that vomiting and diarrhea not be included among the eligible local or systemic signs or symptoms for diagnosis of acute otitis media.

Dr. Marcy recommended the deletion of anorexia and the addition of hearing loss. Dr. Casselbrant suggested that the diagnosis be based on the presence of one sign and one symptom. Based on these recommendations, the following definition for acute otitis media is proposed:

Proposed Definition

Acute otitis media is the

  1. rapid onset of

  2. signs of middle ear effusion and inflammation accompanied by

  3. clinical findings which generally include one or more of the following:

    1. otalgia (or pulling of ear in an infant)

    2. otorrhea

    3. irritability

    4. fever

    5. hearing loss (older children)

II. Revised Definition of Acute Otitis Media, as of February 1, 1999

Acute otitis media is defined as

  1. presence of middle ear effusion as demonstrated by the actual presence of fluid in the middle ear as diagnosed by tympanocentesis or indicated by limited or absent mobility of the tympanic membrane as diagnosed by pneumatic otoscopy, tympanogram, or acoustic reflectometry with or without the following:

    1. opacification, not including erythema

    2. a full or bulging tympanic membrane

    3. hearing loss


    AND

  2. rapid onset (over the course of 48 hours)
    OF

  3. one or more of the following signs or symptoms:

    1. otalgia (or pulling of ear in an infant)

    2. otorrhea

    3. irritability in infant or toddler

    4. fever


    with or without anorexia, nausea, vomiting, or diarrhea.

Rationale for the fourth revision

The changes were made based on input from technical and internal experts.

  1. It appears that there has been confusion between creating a definition of AOM and creating criteria for diagnosing AOM. We need to do both. We need a definition to establish the criteria by which we feel AOM should be diagnosed. We will then use our criteria for diagnosing AOM to assess how closely the studies in our evidence analysis approximate our definition and each other. (See point 3 below.) Because the issue of the definition and diagnosis of AOM was not one of the key questions chosen by the technical expert panel for analysis, we will not do a formal evidence analysis of the criteria for diagnosis but will instead rely on the consensus of the technical expert panel.

  2. We revised the definition as follows: The criteria for diagnosis should specify how middle ear effusion, rapid onset of clinical signs and symptoms, and clinical signs and symptoms are established.

    1. Most would agree that tympanocentesis is the gold standard for establishing the presence of fluid in the middle ear. The majority of the technical expert panel agreed with the decision to include limited or absent mobility of the tympanic membrane as a sign of middle ear effusion, and this decision is supported by the findings of a study by Karma, Penttila, Sipila, et al., 1989, and indirectly by the recommendation of the Otitis Media with Effusion Guidelines (Stool, Berg, Berman, et al., 1994a) to utilize pneumatic otoscopy as the primary means for diagnosing middle ear effusion. The technical expert panel also agreed to adding change from normal color and translucency as a sign of middle ear effusion, and one technical expert wanted to specify this finding to "red or white opacification" and to add "full or bulging tympanic membrane" as well. Erythema of the tympanic membrane, however, is not specific for AOM (Karma, Penttila, Sipila, et al., 1989). Cloudiness or opacification of the tympanic membrane, excluding erythema, and bulging of the tympanic membrane have been shown to be associated with middle ear effusion with and without the acute symptoms listed in criterion three (Karma, Penttila, Sipila, et al., 1989). Several of our technical experts pointed out that any signs or symptoms of middle ear effusion in criterion three, such as hearing loss, should more appropriately be placed in the first criterion. The technical experts were split, however, on whether to retain hearing loss in the definition. For this reason, hearing loss was moved into the first criterion as a non absolute finding because its presence would seem a confirmation of the presence of middle ear effusion that should be established by the more specific finding of middle ear fluid aspirated by tympanocentesis or limited or decreased mobility of the tympanic membrane.

    2. For rapid onset, the majority of the technical expert panel felt that rapid onset of symptoms would be within 48 hours.

    3. It is not clear from either the original definition in Bluestone and Klein, 1996, nor from any of the comments from the technical experts what specific information is being added by the clinical signs and symptoms in the third criterion. In Bluestone and Klein, 1996, there is reference to the signs and symptoms being indicative of inflammation in one part of the chapter and indicative of acute infection in another part of the chapter. Certainly an acute infection would lead to inflammation. On the other hand, can one assume that the presence of inflammation necessarily implies the presence of infection? The Otitis Media with Effusion Guidelines state that AOM is "inflammation of the middle ear with signs or symptoms of middle ear infection" (Stool, Berg, Berman, et al., 1994a) or "fluid in the middle ear accompanied by signs or symptoms of ear infection" (Stool, Berg, Berman, et al., 1994b) and that otitis media with effusion is "fluid in the middle ear without signs or symptoms of ear infection" (Stool, Berg, Berman, et al., 1994a). On the other hand, Rosenfeld (1996) states that the term "ear infection" "applies to AOM [acute otitis media] and OME [otitis media with effusion], because pathogenic bacteria generally are present in the middle ear with both conditions." It appears that the experts disagree whether the presence of infection is the distinguishing point between the two otitis media conditions that are perhaps the most common to be encountered, AOM and AME. If it were true that infection was not the distinguishing feature, another approach would be to use the clinical signs and symptoms to indicate severity of illness and establish a severity above which AOM is diagnosed and below which OME is diagnosed. For the purpose of this study, we will simply note this dilemma of criterion three and list those signs or symptoms that traditionally have been listed as being indicative of AOM. Because a majority of the technical expert panel feel that gastrointestinal findings such as anorexia, nausea, vomiting, and diarrhea should not be included in the list of clinical findings, they are no longer included in the signs and symptoms that would establish a diagnosis of AOM in conjunction with middle ear effusion. One technical expert did point out that nausea and vomiting, though immediate gastrointestinal symptoms, may be indicative of effects on the vestibular system; therefore, reference to gastrointestinal findings, as found in most traditional definitions of AOM, is retained in the present definition. The project staff also note that all the signs and symptoms in criterion three are observable, either objectively or subjectively, by the patient or guardian and, therefore, would help to establish the rapid onset required in criterion two.

  3. The definition of AOM will be used to evaluate the appropriateness of the studies for our topic in the following way: "well defined" when the study used the same primary criteria as in our definition; "moderately defined" when the study used some but not all of the primary criteria as in our definition; "undefined" when the study did not use any of the criteria or did not specify any criteria used. We will categorize the studies according to these criteria and analyze them accordingly.

III. Further Revision of Definition of Acute Otitis Media, as of March 3, 1999

Acute otitis media is defined as

  1. presence of middle ear effusion as demonstrated by the actual presence of fluid in the middle ear as diagnosed by tympanocentesis or the physical presence of liquid in the external ear canal as a result of tympanic membrane perforation or indicated by limited or absent mobility of the tympanic membrane, excluding the retracted tympanic membrane, as diagnosed by pneumatic otoscopy, tympanogram, or acoustic reflectometry with or without the following:

    1. opacification, not including erythema

    2. a full or bulging tympanic membrane

    3. hearing loss


    AND

  2. rapid onset (over the course of 48 hours1)
    OF

  3. one or more of the following signs or symptoms:

    1. otalgia (or pulling of ear in an infant)

    2. otorrhea

    3. irritability in the infant or toddler2

    4. fever2


    with or without anorexia, nausea, or vomiting.

Rationale for the fifth revision

  1. The majority of the technical expert panel felt that limited or absent mobility of the tympanic membrane in light of a retracted tympanic membrane was not indicative of fluid in the middle ear. In addition, the project staff recognized that in some cases of AOM tympanic membrane perforation may have occurred and neither tympanocentesis nor testing for tympanic membrane mobility would be possible. It was recognized that in those cases the presence of fluid in the external ear canal also would confirm the presence of a middle ear effusion.

  2. 2. One of the technical experts felt, based on the 1994 Otitis Media with Effusion Guidelines, that acoustic reflectometry is not a valid diagnostic procedure to establish the presence of middle ear effusion. The project staff has determined that "The [OME] Panel judged the evidence in support of acoustic reflectometry to be insufficient to make a recommendation regarding use of this test in screening for or diagnosis of otitis media with effusion." (Stool, Berg, Berman, et al., 1994b) A recent publication, however, found that compared to the presence of middle ear effusion at time of surgery in a population with a 58% prevalence of middle ear effusion, acoustic reflectometry had a sensitivity of 95%, specificity of 31%, positive predictive value of 66%, and negative predictive value of 83% when the cutoff level was set at an angle of 95; and a sensitivity of 38%, specificity of 93%, positive predictive value of 88%, and a negative predictive value of 52% when the cutoff level was set at an angle of 49. (Barnett, Klein, Hawkins, et al., 1998) Barnett, Klein, Hawkins, et al. (1998) also found the comparable indices for tympanometry with a cutoff level of 0.2 compliance peak to be sensitivity 54%, specificity 75%, positive predictive value 78%, and negative predictive value 59%; and with a cutoff level of 0.1 compliance peak to be sensitivity 54%, specificity 84%, positive predictive value 82%, and negative predictive value 56%. Based on this study, it would seem appropriate to keep acoustic reflectometry as a viable diagnostic tool to establish the presence of middle ear effusion because it performed as well as tympanometry which the OME Guidelines panel had previously deemed an appropriate diagnostic tool.

  3. The majority of the technical expert panel also felt that the 48-hour period of rapid onset was defined as the time from the onset of acute signs or symptoms first noted by the parent or guardian to contact with the health system.

  4. One of the technical experts pointed out that the fourth revision of the definition would not work for the following case: "...a child with stable OME who develops febrile rotavirus diarrhea meets the definition (whether they have any of the...a, b, or c findings). I'm not sure how that can work." The project staff are in agreement with this assessment and also feel that irritability is nonspecific. The project staff is proposing that neither "irritability in the infant or toddler" nor "fever" can stand alone to meet criteria 3 but must exist in association with a sign or symptom directly referable to the ear, (i. e., otalgia or otorrhea).

  5. The project staff have decided to delete reference to diarrhea from the definition because there is no apparent pathophysiologic connection between AOM and diarrhea as had been previously pointed out by many of the technical expert panel members.

IV. Final Version of Definition of Acute Otitis Media, as of March 26, 1999

Acute otitis media is defined as

  1. presence of middle ear effusion as demonstrated by the actual presence of fluid in the middle ear as diagnosed by tympanocentesis or the physical presence of liquid in the external ear canal as a result of tympanic membrane perforation or indicated by limited or absent mobility of the tympanic membrane as diagnosed by pneumatic otoscopy, tympanogram, or acoustic reflectometry with or without the following:

    1. opacification, not including erythema

    2. a full or bulging tympanic membrane

    3. hearing loss


    AND

  2. rapid onset (over the course of 48 hours1)
    OF

  3. one or more of the following signs or symptoms:

    1. otalgia (or pulling of ear in an infant)

    2. otorrhea

    3. irritability in the infant or toddler

    4. fever


    with or without anorexia, nausea, or vomiting.

Rationale for the sixth revision

  1. During the 3/26/99 conference call, the technical expert panel agreed to delete the phrase "excluding the retracted tympanic membrane" from the fifth revision of the definition.

  2. During the 3/26/99 conference call, the technical expert panel agreed to delete footnote 2 from the fifth revision of the definition. The experts felt that with the required presence of middle ear effusion, "irritability" and "fever" were both specific enough for criterion 3.

  3. During the 3/26/99 conference call, the technical expert panel expressed the need for a "sound bite" definition of AOM. The project staff agrees that the complexity of the above definition lies in the embedding of criteria within the structure of the definition. The project staff proposes that the definition without embedded criteria is as follows:
    Acute otitis media is the presence of middle ear effusion in conjunction with the rapid onset of one or more signs or symptoms of inflammation of the middle ear.

Appendix E. Scope of the Evidence Report

I. Scope of the Evidence Report as of December 18, 1998
Disease entity:Uncomplicated Acute Otitis Media1
Exclude: patients with immunodeficiencies and craniofacial deficiencies including cleft palate.
Patient population:Age 4 weeks to 18 years
Setting:All types of providers and practice settings
Intervention:Observation/no intervention/natural history/placebo2
Antibiotic treatment (all classes, schedule, dosage, length, and mode)3
Influencing factors:Demographic
Age of child
Gender
Ethnicity/race
Environmental
Presence of sibling(s)
Attendance at day care center
Sibling(s) in day care center
Feeding mode-bottle vs. breast
Pacifier use
Tobacco smoke exposure
History and/or presence of ear infections in parents or siblings
Signs and symptoms by history
Prior history of recurrent AOM
Otalgia (or pulling of ear in an infant)
Otorrhea
Irritability
Fever
Hearing loss (older children)
Severity of initial symptoms
Season of the year
Physical findings
Tympanic membrane (TM) inflammation
Retracted TM
Purulent otorrhea
Middle ear effusion
Other clinical factors
Underlying predisposing problem (viral infection)
Prior antibiotic use
Concurrent use of analgesics
Multiple previous episodes
Hearing and/or speech problems
Atopy or allergy
Craniofacial problems
Parent/caretaker
Parent/caretaker availability
Parent/caretaker preference
Parent/caretaker education
Provider
Type of provider
Experience
Setting
Monitoring system of course of antibiotic treatment or during episode
Frequency (none, daily, every other day)
Primary person (parent or provider)
Type (tympanometry, acoustic reflectometry, pneumatic otoscopy)
Cost
Cost of treatment
Cost of total care
Outcome measures:Within 48 hours
Presence/absence of pain/otorrhea/irritability/fever/hearing loss
Presence/absence of discharge/inflammation of TM
Presence/absence of acute suppurative complications/secondary complications
Mastoiditis
Petrositis
Acute suppurative labyrinthitis
Extradural abscess
Subdural abscess (empyema)
Brain abscess
Meningitis
Lateral sinus thrombosis
Presence/absence of all signs/symptoms except middle ear effusion
Cost of care
Presence/absence of resistant bacteria
Between 3-7 days
Presence/absence of pain/otorrhea/irritability/fever/hearing loss
Presence/absence of discharge/inflammation of TM
Presence/absence of acute suppurative complications/secondary complications
Mastoiditis
Petrositis
Acute suppurative labyrinthitis
Extradural abscess
Subdural abscess (empyema)
Brain abscess
Meningitis
Lateral sinus thrombosis
Presence/absence of all signs/symptoms except middle ear effusion
Cost of care
Presence/absence of resistant bacteria
Between 7-14 days
Presence/absence of pain/otorrhea/irritability/fever/hearing loss
Presence/absence of discharge/inflammation of TM
Presence/absence of acute suppurative complications/secondary complications
Mastoiditis
Petrositis
Acute suppurative labyrinthitis
Extradural abscess
Subdural abscess (empyema)
Brain abscess
Meningitis
Lateral sinus thrombosis
Presence/absence of all signs/symptoms except middle ear effusion
Cost of care
Presence/absence of resistant bacteria
Between 14 days--3 months
Presence/absence of asymptomatic middle ear effusion
Presence/absence of acute suppurative complications (mastoiditis)
Presence/absence of recurrence
Presence/absence of acute suppurative complications/secondary complications
Mastoiditis
Petrositis
Acute suppurative labyrinthitis
Extradural abscess
Subdural abscess (empyema)
Brain abscess
Meningitis
Lateral sinus thrombosis
Presence/absence of hearing problems
Presence/absence of speech problems
Cost of total care
Presence/absence of resistant bacteria
Greater than 3 months (to be determined)
Time period:1966- 1998
Literature source:MEDLINE
EMBASE
HealthSTAR
CINAHL (nursing and allied paramedical professionals)
Cochrane Database of Systematic Reviews
Database of Abstracts and Reviews of Effectiveness (English National Health Services Center for Reviews and Dissemination)
References of published articles
Language:English and foreign Languages
Study design:Randomized controlled trials, blinded and unblinded
Non-randomized controlled trials, blinded and unblinded
Prospective cohort studies (for observational/no treatment)
Retrospective cohort studies
Case-control studies
1

Acute otitis media is defined as 1) rapid onset of 2) signs of middle ear effusion and and inflammation accompanied by 3) clinical findings which generally include one or more of the following: a) otalgia (or pulling of ear in an infant), b) otorrhea, c) irritability, d) fever, and e) hearing loss (older children). Uncomplicated AOM is defined as AOM limited to the middle ear cleft.

2

Observational treatment or no intervention is defined as initial management of the disease WITHOUT antibiotic streatment with or without a monitoring protocol. Placebo treatment is defined as initial management of the disease with a placebo in place of antibiotics in randomized controlled trials. Natural history is defined as the natural course of the disease without any intervention by provider or parent.

3

For Question 3 all antibiotic regimens are aggregated, and for Question 4 the antibiotic regimens are specified as per the subquestions.

II. Revised Scope of the Evidence Report asof February 1, 1999
Disease entity:Uncomplicated Acute Otitis Media1
Exclude: patients with immunodeficiencies and craniofacial deficiencies including cleft palate
Patient population:Age 4 weeks to 18 years
Setting:All types of providers and practice settings
Intervention:Observation/no intervention/natural history/placebo2
Antibiotic treatment (all classes, schedule, dosage, length, and mode)3
Influencing factors4:Demographic
Age of child
Gender
Ethnicity/race
Environmental
Presence of sibling(s)
Attendance at day care center
Sibling(s) in day care center
Feeding mode-bottle vs. breast
Pacifier use
Tobacco smoke exposure
History and/or presence of ear infections in parents or siblings
Season of the year
Symptoms by history
Otalgia and severity
Hearing deficit and severity
Signs/physical findings
Pulling of ear in an infant
Otorrhea
Irritability
Fever
Hearing loss
Tympanic membrane (TM) inflammation
Retracted TM
Purulent otorrhea
Middle ear effusion
Other clinical factors
Otitis prone5 (prior history of recurrent AOM, multiple previous episodes)
Underlying predisposing problem (viral infection)
Prior antibiotic use and when used
Concurrent use of analgesics
Prior hearing deficit
Inability to express symptoms
Atopy or allergy
Presence of tube
Parent/caretaker
Parent/caretaker availability
Parent/caretaker preference
Parent/caretaker education
Examiner
Type of examiner (family physician, otolaryngologist, pediatrician, nurse practitioner, physician assistant, etc.)
Skill to diagnose (validated examiner/observer)
Setting (public, private, PPO, HMO, etc.)
Monitoring during episode or course of therapy
When
Frequency (none, daily, every other day)
Primary person (parent or provider)
Type (tympanometry, acoustic reflectometry, pneumatic otoscopy)
Cost
Cost of treatment
1

Acute otitis media is defined as 1) presence of middle ear effusion as demonstrated by the actual presence of fluid in the middle ear as diagnosed by tympanocentesis or indicated by limited or absent mobility of the tympanic membrane as diagnosed by pneumatic otoscopy, tympanogram, or acoustic reflectometry with or without the following: a) opacification, not including erythema, b) a full or bulging tympanic membrane, or c) hearing loss AND 2) rapid onset (over the course of 48 hours) OF 3) one or more of the following clinical signs or symptoms: a) otalgia (or pulling of ear in an infant), b) otorrhea, c) irritability in the infant or toddler, or d) fever, with or without anorexia, nausea, vomiting, or diarrhea. Uncomplicated AOM defined as AOM limited to the middle ear cleft.

2

Observational treatment or no intervention is defined as initial management of the disease WITHOUT antibiotic treatment with or without a monitoring protocol. Placebo treatment is defined as initial management of the disease with a placebo in place of antibiotics in randomized controlled trials. Natural history is defined as the natural course of the disease without any intervention by provider or parent.

3

For Question 3 all antibiotic regimens are aggregated, and for Question 4 the antibiotic regimens are specified as per the subquestions.

4

An influencing factor is defined as a characteristic of the patient or the environment or the health care delivery system that may affect the natural history of the disease or the outcome(s) of the intervention of interest. The list of influencing factors has been reorganized and contains several additional factors since the last revision.

5

To be defined by polling technical experts.

Outcome measures6:Time at which outcomes are measured
<48hrs3-7d7-14d14 d-3m>3 m
Presence/absence of
painxxxxx
otorrheaxxxxx
irritabilityxxxxx
feverxxxxx
anorexiaxxxxx
nausea (disequilibrium)xxxxx
vomitingxxxxx
diarrheaxxxxx
Presence/absence of
limited or absent mobility of TMxxxxx
hearing deficitxxxx
speech problemx
Presence/absence of
recurrence of AOMxx
Presence/absence of
acute suppurative complications/
secondary complications
mastoiditisxxxxx
petrositisxxxxx
acute suppurative labyrinthitisxxxxx
extradural abscessxxxxx
subdural abscess (empyema)xxxxx
brain abscessxxxxx
lateral sinus thrombosisxxxxx
Presence/absence of
side/adverse effects from medsxxxxx
Presence/absence of
resistant bacteriaxxxxx
Cost of care
direct costxxxxx
indirect costxxxxx
total costxxxxx
Quality of lifexxxxx
6

The outcome measures listed here define the scope of the project. The time point at which each outcome measure is considered relevant is marked by "x." This outcome-time matrix will be used as a guide for our evidence analysis in the context of the key questions.

Time period:1966- 1999
Literature source:MEDLINE
EMBASE
HealthSTAR
CINAHL (nursing and allied paramedical professionals)
BIOSYS
Cochrane Database of Systematic Reviews
Database of Abstracts and Reviews of Effectiveness (English National Health Services Center for Reviews and Dissemination)
References of published articles
Language:English and Foreign languages
Study design:Randomized controlled trials, blinded and unblinded
Non-randomized controlled trials, blinded and unblinded
Prospective cohort studies (for observation/No treatment)
Retrospective cohort studies (for observation/no treatment)
Case-control studies

III. Revised Scope of the Evidence Report as of February 24, 1999
Disease Entity:Uncomplicated Acute Otitis Media1
Exclude: patients with immunodeficiencies and craniofacial deficiencies including cleft palate
Patient Population:Age 4 weeks to 18 years
Setting:All types of providers and practice settings
Intervention:Observation/no intervention/natural history/placebo2
Antibiotic treatment (all classes, schedule, dosage, length, and mode)3
Influencing factors4:Demographic
Age of child
Gender
Ethnicity/race
Environmental
Presence of sibling(s)
Attendance at day care center
Sibling(s) in day care center
Feeding mode-bottle vs. breast
Pacifier use
Tobacco smoke exposure
History and/or presence of ear infections in parents or siblings
Season of the year
Symptoms by history
Otalgia and severity
Hearing deficit and severity
Signs/Physical findings
Pulling of ear in an infant
Otorrhea
Irritability
Fever
Hearing loss
Tympanic membrane (TM) inflammation
Retracted TM
Purulent otorrhea
Middle ear effusion
Other clinical factors
Otitis prone5 (prior history of recurrent AOM/multiple previous episodes)
Underlying predisposing problem (viral infection)
Prior antibiotic use and when used
Concurrent use of analgesics
Prior hearing deficit
Inability to express symptoms
Atopy or allergy
Presence of tube
Parent/caretaker
Parent/caretaker availability
Parent/caretaker preference
Parent/caretaker education
Examiner
Type of examiner (family physician, otolaryngologist, pediatrician, nurse practitioner, physician assistant, etc.)
Skill to diagnose (validated examiner/observer)
Setting (public, private, PPO, HMO, etc.)
Monitoring during episode or course of therapy
When
Frequency (none, daily, every other day)
Primary person (parent or provider)
Type (tympanometry, acoustic reflectometry, pneumatic otoscopy)
Cost
Cost of treatment
1

Acute otitis media is defined as 1) presence of middle ear effusion as demonstrated by the actual presence of fluid in the middle ear as diagnosed by tympanocentesis or the physical presence of liquid in the external ear canal as a result of tympanic membrane perforation or indicated by limited or absent mobility of the tympanic membrane, excluding the retracted tympanic membrane, as diagnosed by pneumatic otoscopy, tympanogram, or acoustic reflectometry with or without the following: a) opacification, not including erythema, b) a full or bulging tympanic membrane, or c) hearing loss, and 2) rapid onset (over the course of 48 hours) or 3) one or more of the following signs or symptoms: 1) otalgia (or pulling of ear in an infant), b) otorrhea, c) irritability in the infant or toddler2, or fever2with or without anorexia, nausea, vomiting, or diarrhea. (Rapid onset is defined as less-than or equal to 48 hours from the onset of acute signs or symptoms first noted by the parent or guardian to contact with the health system. 2Irritability in the infant or toddler and fever must be associated with either otalgia or otorrhea to fulfill criteria 3.) Uncomplicated AOM is defined as AOM limited to the middle ear cleft. The issue of the role acoustic reflectometry as a legitimate diagnostic tool for the establishment of middle ear effusion is not resolved.

2

Observational treatment or no intervention is defined as initial management of the disease WITHOUT antibiotic treatment with or without a monitoring protocol. Placebo treatment is defined as initial management of the disease with a placebo in place of antibiotics in randomized controlled trials. Natural history is defined as the natural course of the disease without any intervention by provider or parent.

3

For Question 3 all antibiotic regimens are aggregated, and for Question 4 the antibiotic regimens are specified as per the subquestions.

4

An influencing factor is defined as a characteristic of the patient or the environment or the health care delivery system that may affect the natural history of the disease or the outcome(s) of the intervention of interest.

5

The otitis-prone child is defined as the child who has had three episodes of AOM in a 6-month period or four episodes of AOM in a 12-month period. The episodes of AOM should be well-documented. Each episode of AOM should preferably have been separated by at least 4 weeks from the previous episode of AOM and treatment course or documented on followup to have cleared.

Outcome Measures6:Time at which outcomes are measured
<48hrs3-7d7-14 d14d-3m>3m
Presence/absence of
pain.xxxxx
otorrheaxxxxx
irritabilityxxxxx
feverxxxxx
anorexiaxxxxx
nausea (disequilibrium)xxxxx
vomitingxxxxx
diarrheaxxxxx
Presence/absence of
limited or absent mobility of TMxxxxx
hearing deficitxxxx
speech problemx
Presence/absence of
recurrence of AOMxx
Presence/absence of
acute suppurative complications/
secondary complications
mastoiditisxxxxx
petrositisxxxxx
acute suppurative labyrinthitisxxxxx
extradural abscessxxxxx
subdural abscess (empyema)xxxxx
brain abscessxxxxx
lateral sinus thrombosisxxxxx
Presence/absence of
side/adverse effects from medsxxxxx
Presence/absence of
resistant bacteriaxxxxx
Cost of care
direct costxxxxx
indirect costxxxxx
total costxxxxx
Quality of lifexxxxx
6

The outcome measures listed here define the scope of the project. The time point at which each outcome measure is considered relevant is marked by "x." This outcome-time matrix will be used as a guide for our evidence analysis in the context of the key questions.

Time Period:1966- 1998
Literature Source:MEDLINE
EMBASE
HealthSTAR
CINAHL (nursing and allied paramedical professionals)
BIOSYS
Cochrane Database of Systematic Reviews
Database of Abstracts and Reviews of Effectiveness (English National Health Services Center for Reviews and Dissemination)
References of published articles
Language:English and foreign languages
Study Design:Randomized controlled trials, blinded and unblinded
Non-randomized controlled trials, blinded and unblinded
Prospective cohort studies (for observation/no treatment)
Retrospective cohort studies (for observation/no treatment)
Case-control studies

IV. Final Version of Scope of the Evidence Report, Revised as of March 26, 1999
Disease Entity:Uncomplicated Acute Otitis Media1
Exclude: patients with immunodeficiencies and craniofacial deficiencies including cleft palate
Patient Population:Age 4 weeks to 18 years
Setting:All types of providers and practice settings
Intervention:Observation/no intervention/natural history/placebo2
Antibiotic treatment (all classes, schedule, dosage, length, and mode)3
Influencing factors4:Demographic
Age of child
Gender
Ethnicity/race
Environmental
Presence of sibling(s)
Attendance at day care center
Sibling(s) in day care center
Feeding mode-bottle vs. breast
Pacifier use
Tobacco smoke exposure
History and/or presence of ear infections in parents or siblings
Season of the year
Symptoms by history
Otalgia and severity
Hearing deficit and severity
Signs/physical findings
Pulling of ear in an infant
Otorrhea
Irritability
Fever
Hearing loss
Tympanic membrane (TM) inflammation
Retracted TM
Purulent otorrhea
Middle ear effusion
Other clinical factors
Otitis prone5 (prior history of recurrent AOM/multiple previous episodes)
Underlying predisposing problem (viral infection)
Prior antibiotic use and when used
Concurrent use of analgesics/antipyretic/antihistamines/decongestants/ear or nose drops
Prior hearing deficit
Inability to express symptoms
Atopy or allergy
Presence of tube
Parent/caretaker
Parent/caretaker availability
Parent/caretaker preference
Parent/caretaker education
Examiner
Type of examiner (family physician, otolaryngologist, pediatrician, nurse practitioner, physician assistant, etc.)
Skill to diagnose (validated examiner/observer)
Setting (public, private, PPO, HMO, etc.)
Monitoring during episode or course of therapy
When
Frequency (none, daily, every other day)
Primary person (parent or provider)
Type (tympanometry, acoustic reflectometry, pneumatic otoscopy)
Cost
Cost of treatment
1

Acute otitis media is defined as 1) presence of middle ear effusion as demonstrated by the actual presence of fluid in the middle ear as diagnosed by tympanocentesis or the physical presence of liquid in the external ear canal as a result of tympanic membrane perforation or indicated by limited or absent mobility of the tympanic membrane, as diagnosed by pneumatic otoscopy, tympanogram, or acoustic reflectometry with or without the following: a) opacification, not including erythema, b) a full or bulging tympanic membrane, or c) hearing loss AND 2) rapid onset (over the course of 48 hours) or 3) one or more of the following signs or symptoms: 1) otalgia (or pulling of ear in an infant), b) otorrhea, c) irritability in the infant or toddler, d) fever with or without anorexia, nausea or vomiting. (Rapid onset is defined as less-than or equal to 48 hours from the onset of acute signs or symptoms first noted by the parent or guardian to contact with the health system.) Uncomplicated AOM is defined as AOM limited to the middle ear cleft.

2

Observational treatment or no intervention is defined as initial management of the disease WITHOUT any active intervention (pharmacologic or surgical) other than topical or systemic medications (that do not contain antibiotics) given for symptomatic relief (e.g., analgesics, antipyretics, antihistamines, decongestants, ear or nose drops), with or without a monitoring protocol. Placebo treatment is defined as initial management of the disease with a placebo in place of antibiotics in randomized controlled trials. Natural history is defined as the natural course of the disease without any intervention by provider or parent.

3

For Question 3 all antibiotic regimens are aggregated, and for Question 4 the antibiotic regimens are specified as per the subquestions.

4

An influencing factor is defined as a characteristic of the patient or the environment or the health care delivery system that may affect the natural history of the disease or the outcome(s) of the intervention of interest.

5

The otitis-prone child is defined as the child who has had three or more episodes of AOM in a 6-month period or four or more episodes of acute otitis media in a 12-month period. The episodes of AOM should be well-documented. Each episode of AOM should preferably have been separated by at least 4 weeks from the previous episode of AOM and treatment course or documented on followup to have cleared.

Outcome Measures6:Time at which outcomes are measured
<48hrs3-7d7-14 d14d-3m>3m
Presence/absence of
painxxxxx
otorrheaxxxxx
irritabilityxxxxx
feverxxxxx
anorexiaxxxxx
nausea (disequilibrium)xxxxx
vomitingxxxxx
diarrheaxxxxx
Presence/absence of
limited or absent mobility of TMxxxxx
hearing deficitxxxx
speech problemx
Presence/absence of
recurrence of AOMxx
Presence/absence of
acute suppurative complication/
secondary complications
mastoiditisxxxxx
petrositisxxxxx
acute suppurative labyrinthitisxxxxx
extradural abscessxxxxx
subdural abscess (empyema)xxxxx
brain abscessxxxxx
lateral sinus thrombosisxxxxx
Presence/absence of
side/adverse effects from medsxxxxx
Presence/absence of
bacteria(sterile/nonsterile)xxxxx
resistant bacteriaxxxxx
Cost of care
direct costxxxxx
indirect costxxxxx
total costxxxxx
Quality of lifexxxxx
6

The outcome measures listed here define the scope of the project. The time point at which each outcome measure is considered relevant is marked by "x." This outcome-time matrix will be used as a guide for our evidence analysis in the context of the key questions.

Time Period:1966- 1999 for database searches
Literature Source:MEDLINE
EMBASE
HealthSTAR
CINAHL (nursing and allied paramedical professionals)
BIOSIS
Cochrane Library
International Pharmaceutical Abstracts
References of published articles
Language:English and foreign languages
Study Design:Randomized controlled trials, blinded and unblinded
Nonrandomized controlled trials, blinded and unblinded
Prospective cohort studies (for observation/no treatment)
Retrospective cohort studies (for observation/no treatment)
Case-control studies

Appendix F. Title and Abstract Screening Form

  1. Reviewer ID (1=GT, 2=LW) ___

  2. Record #:

  3. Unique Identifier:

  4. Author(s):

  5. Year of Publication

  6. Revisit Search Rejection Criteria
    GO IN ORDER FROM R1 TO R5, STOP AT FIRST "YES"

    YesNoUnsure
    R1: Case report/editorial/letter/clinical practice/overview/...... Practice guidelines/consensus statements129
    R2: Non-human subjects........................................................129
    R3: Study condition is NOT acute otitis media......................129
    R4: Age of study population < 4 weeks or >=18 years129
    R5: Study population on patients with immunodeficiencies or Craniofacial deficiencies including cleft palate129

  7. Key Question Addressed

    YesNoUnsure
    Natural history..................................................................129
    Antibiotic vs Observation................................................129
    Antibiotic vs Placebo........................................................129
    Antibiotic vs Antibiotic........................................................129
    END

Instructions for Screening

  1. For each title/abstract, go in order of the five rejection criteria, from R1 to R5. Stop at the first "Yes" in item 6.

  2. If the article is not rejected by R1 through R5, go on to item 7. If item 7 has ALL "No"s, the article will be rejected.

  3. Specific instruction on R1:

    1. Case report includes case series

    2. Overview includes reviews

  4. Specific instruction on AOM:

    1. Reject if the study is solely on: (compiled from Bluestone and Klein, 1996; Otitis Media with Effusion Guidelines, 1994; Harkness and Topham, 1998; and Paparella, Bluestone, et al., 1985)

      1. Otitis media with effusion including the following synonyms:
        Serous otitis media or serotympanum or acute serous otitis media or chronic serous otitis media
        Secretory otitis media
        Allergic otitis media
        Catarrhal otitis media or catarrh
        Nonsuppurative otitis media or chronic nonsuppurative otitis media
        Mucoid otitis media or mucotympanum or chronic mucoid otitis media
        Secondary otitis media
        Tubotympanic catarrh
        Hydrotubotympanum
        Exudative catarrh
        Tubotympanitis
        Tympanic hydrops
        Glue ear
        Fluid ear

      2. Other chronic or persistent forms of otitis media:
        Chronic otitis media
        Chronic tubotympanic suppurative otitis media
        Chronic atticoantral suppurative otitis media
        Chronic suppurative otitis media
        Chronic purulent otitis media
        Persistent otitis media

    2. Reject if the PRIMARY condition of the article is not AOM.

    3. Do not reject if the diagnostic term is vague, such as otitis media without any descriptors, or a term with which we are not familiar.

    4. Do not reject if AOM is one of several conditions studied.
      Synonyms for acute otitis media include: (Bluestone and Klein, 1996)
      Acute suppurative otitis media
      Acute purulent otitis media
      Bacterial otitis media

  5. Specific instructions on AGE:

    1. Do not reject if the term "neonate" is used without reference to a specific age range that is completely outside of our scope of greater-than 4 weeks and less-than 18 years.

    2. Reject if the population is referred to as an adult population even if a specific age is not mentioned.

    3. Do not reject if the age scope of the study is a subset of the acceptable age range or has an age range larger than our acceptable age range.

  6. Specific instruction on Natural History:

    1. Criteria for Natural History:
      Must address

      1. outcome and

      2. time and

      3. without any intervention

      If abstract does not address one or more of the criteria, mark unsure.

    2. If a study involves other interventions besides antibiotics, such as myringotomy/tympanocentesis, but has a control arm that uses placebo or no intervention, then it qualifies for a Natural History study.

  7. Specific instruction on Type of Antibiotics:

    1. The following antibiotics are included:
      Amoxicillin
      Amoxicillin-clavulanate
      Azithromycin
      Cefdinir
      Cefixime/Cefprozil
      Cefpodoxime
      Ceftibuten
      Ceftriaxone
      Cefuroxime
      Clarithromycin
      Clindamycin
      Loracarbef
      Sulfisoxazole
      Trimethoprim-sulfamethoxazole

    2. Include all studies on antibiotics, antimicrobials, anti-bacterials, anti-infectives.

    3. If uncertain, do not reject study.

Appendix G. Article Quality Review Form

1. Article Quality Review Form

  1. Reviewer ID (1=GT, 2=WM) ___ 1/

  2. Record Number ___ ___ ___ ___ 2-5/

  3. Unique Identifier ___ ___ ___ ___ ___ ___ ___ ___ 6-13/

  4. Authors:

  5. Year of Publication ___ ___ ___ ___ 14-17/

  6. Study Design

    Randomized controlled trial........................................................1 18/
    Non-randomized controlled trial....................................................2
    Prospective comparative cohorts................................................3
    Retrospective comparative cohorts.............................................4
    Case control..............................................................................5
    Natural history/Observational/Longitudinal single cohort............6
    Unsure.........................................................................................9
    IF NONE OF THE ABOVE, STOP.

  7. Key Question Addressed

    YesNoUnsure
    Natural history..................................................12919/
    Antibiotic vs. Observation..................................12920/
    Antibiotic vs. Placebo.........................................12921/
    Antibiotic vs. Antibiotic
    a)antibiotics of broader coverage vs. amoxicillin or trimethoprim/sulfamethoxazole12922/
    b)oral fluoroquinolones..................................12923/
    c)high-dose amoxicillin or amoxicillin-clavulanate vs. standard dose..................12924/
    d)twice a day high-dose amoxicillin therapy vs. three time a day amoxicillin..............12925/
    e)short- vs. long-term antibiotic therapy....12926/
    f)other...........................................................12927/
    IF NONE OF THE ABOVE, STOP.

Quality of Definition of Acute Otitis Media

  • 8

    Check all criteria used in defining acute otitis media:

    YesNoUnsure
    a)presence of fluid in the middle ear on tympanocentesis.......12928/
    b)limited/absent mobility of TM on pneumatic otoscopy.........12929/
    c)limited/absent mobility of TM on tympanogram.................12930/
    d)limited/absent mobility of TM on acoustic reflectometry...12931/
    e)opacification, not including erythema................................12932/
    f)a full or bulging tympanic membrane................................12933/
    g)hearing loss.....................................................................12934/
    h)rapid onset (within 48 hours)...........................................12935/
    i)otalgia (or pulling of ear in an infant)..............................12936/
    j)otorrhea...........................................................................12937/
    k)irritability.......................................................................12938/
    m)fever.............................................................................12939/
    n)anorexia............................................................................12940/
    o)nausea...............................................................................12941/
    p)vomiting............................................................................12942/
    q)diarrhea.................................................................12943/
    r)_________________________________________________144/
    _________________________________________________
    s)_________________________________________________145/
    _________________________________________________
    t)_________________________________________________146/
    _________________________________________________
    u)_________________________________________________147/
    _________________________________________________
    v)_________________________________________________148/
    _________________________________________________
    w)_________________________________________________149/
    _________________________________________________
    x)_________________________________________________150/
    _________________________________________________
    y)_________________________________________________151/
    _________________________________________________
    z)_________________________________________________152/
    _________________________________________________

QUALITY OF CONTROLLED TRIALS (Answer 1 or 2 in Item 6)

YesNoUnsure
9.Was the study described as randomized?1053/
10.Was the study described as double-blind?1054/
11.Was there a description of withdrawals and dropouts?1055/
12.Was randomization procedure appropriate?1−1056/
13.Was blinding procedure appropriate?1−1057/
14.Were the groups (exposed or unexposed) similar at baseline regarding the most important prognostic variables?10058/
15.Was compliance with treatment addressed adequately?10059/
16.Was complete followup achieved?10060/

QUALITY OF COHORT(S) STUDY (Answer 3 or 4 in Item 6)

YesNo/Unsure
17.Was the study cohort(s) clearly defined? (Inclusion and exclusion criteria clearly spelled out)1061/
18.Was the study cohort(s) assembled at an early and uniform point (inception) in the course of the illness?1062/
19.Was the pathway(s) by which patients entered the study clearly described?1063/
20.Was complete followup achieved?1064/
21.Was there a description of withdrawals and dropouts?1065/
22.Were objective outcome criteria developed and used?1066/
23.Was the outcome assessment "blind?"1067/
24.Was adjustment for extraneous prognostic factors carried out?1068/

QUALITY OF CASE-CONTROL STUDY (Answer 5 in Item 6)

YesNo/Unsure
25.Was the source of cases identified?1069/
26.Was the source of controls identified?1070/
27.Was there blinded assessment of
a) eligibility of cases and controls1071/
b) outcome1072/
c) exposure1073/
28.Were the matching criteria of cases and controls clearly spelled out?1074/
29.Were the criteria defining the cases clearly spelled out?1075/
30.Was the exposure status clearly identified?1076/
31.Was the duration of exposure defined?1077/
32.Was the temporal relation of the exposure to the case event clearly defined?1078/
33.Was there an adjustment in the analysis for known confounders not included in matching?1079/

QUALITY OF SINGLE COHORT OBSERVATIONAL STUDY FOR NATURAL HISTORY STUDY (Answer 6 in Item 6)

YesNo/Unsure
34.The study was qualified as a natural history study because
a) it was designed as a natural history study180/
b) it was the control arm of a clinical trial2
c) it was the control arm of a cohort study3
d) unsure9
35.Was the outcome(s) of the study clearly defined?1081/
36.Was the time point(s) at which the outcome(s) was measured clearly defined?1082/
37.Was the cohort of subjects followed without any intervention?1083/
38.Was there blinded assessment of the outcomes of the study?1084/
39.Were point estimates and measures of variability provided for the main adverse outcome measures?1085/

2. Instructions for Article Quality Review Form

  1. Reviewer ID: self-explanatory

  2. Record number: self-explanatory

  3. Unique identifier: self-explanatory

  4. Authors: self-explanatory

  5. Year of publication: self-explanatory

  6. Study design:

    1. In general, this item is self-explanatory.

    2. Remember that case studies, case series, and cross-sectional studies are not included in this list because they are not eligible for the analysis.

    3. If you think the study may be one of those listed or might have the potential with acquisition of the data and reanalysis, mark "9" and, if you like, write a comment.

  7. Key question addressed:

    1. In general, this item is self-explanatory and has the same instructions as for the titles/abstracts screening form.

    2. A particular article may be pertinent to zero or > 1 key question. Circle all that apply.

    3. For 7.a), recall that "antibiotics of broader coverage" may be defined as second-line-or-higher-level treatment.

    4. For 7.e), recall that short-term therapy is < 5 days and that long-term therapy is > 5 days.

    5. For 7.f), "other" is any other comparison of antibiotic vs. antibiotic.

  8. Criteria used in defining acute otitis media:

    1. Some studies may not list any criteria; in this case, circle "2" for 8.a)-8.q).

    2. Be sure to list only those criteria actually used by a study to define a case of acute otitis media. Many studies will also note other signs or symptoms but not actually use them to define acute otitis media.

    3. We will have to go back to the articles and make sure we have the logic and wording of the definitions correct for the evidence tables, especially for the "write-in" criteria 8.r)-8.z).

  9. Randomization: A study calls itself randomized.

  10. Double-blind: "A study must be regarded as double blind if the word 'double blind' is used." (Jadad, Moore, Carroll, et al., 1996)

  11. Withdrawals and dropouts: "Participants who were included in the study but did not complete the observation period or who were not included in the analysis must be described. The number and the reasons for withdrawal in each group must be stated. If there were not withdrawals, it should be stated in the article. If there is no statement on withdrawals, this item must be given no points." (Jadad, Moore, Carroll, et al., 1996)

  12. Appropriate randomization:

    1. "A method to generate the sequence of randomization will be regarded as appropriate if it allowed each study participant to have the same chance of receiving each intervention and the investigators could not predict which treatment was next. Methods of allocation using date of birth, date of admission, hospital numbers, or alternation should not be regarded as appropriate." (Jadad, Moore, Carroll, et al., 1996)

    2. "Assign patients to groups in a way that gives each patient an equal chance of falling into one or the other group." (Fletcher, Fletcher, and Wagner, 1982)

  13. Appropriate blinding: "The method will be regarded as appropriate if it is stated that neither the person doing the assessments nor the study participant could identify the intervention being assessed, or if in the absence of such a statement for use of active placebos, identical placebos, or dummies is mentioned." (Jadad, Moore, Carroll, et al., 1996)

  14. Similarity of comparison groups:

    1. In general, this item is self-explanatory.

    2. At minimum, the groups should be comparable with regard to age, especially the proportion less-than two years of age.

  15. Compliance: self-explanatory

  16. Complete follow-up: The outcome is known for each patient. See item 20 on complete follow-up for a cohort study. The same principles apply.

  17. Cohorts defined: self-explanatory

  18. Inception point: self-explanatory

  19. Entry pathway: self-explanatory

  20. Complete follow-up: "All members of the inception cohort should be accounted for at the end of the follow-up period, and their clinical status should be known." (Sackett, Haynes, and Tugwell, 1985)

  21. Withdrawals and dropouts: See item 11.

  22. Objective outcome criteria: self-explanatory

  23. Blind outcome assessment: The investigator assessing the outcome(s) does not know what exposure(s) the patient has experienced.

  24. Adjustment for extraneous prognostic factors: self-explanatory

  25. Source of cases: self-explanatory

  26. Source of controls: self-explanatory

  27. Blind assessment: See item 23.

  28. Matching criteria: self-explanatory

  29. Criteria defining cases and controls: self-explanatory

  30. Exposure status: self-explanatory

  31. Duration of exposure: self-explanatory

  32. Temporal relation of exposure to case event: self-explanatory

  33. Adjustment for confounders: self-explanatory

  34. Qualification for natural history study: self-explanatory

  35. Outcome(s) defined: self-explanatory

  36. Time point(s) of outcome(s): self-explanatory

  37. Absence of intervention: self-explanatory

  38. Blind outcome(s) assessment: See item 23.

  39. Point estimates and variability for outcome(s): self-explanatory

Appendix H. Data Abstraction Form for Article Review

  1. Reviewer ID (1=GT, 2=WM) ___

  2. Record Number ___ ___ ___ ___

  3. Unique Identifier ___ ___ ___ ___ ___ ___ ___ ___

  4. Authors: __________________________________

  5. Year of Publication ___ ___ ___ ___

  6. Describe the Study Groups

    ParameterGroup 1Group 2Group 3Group 4
    Name of intervention_____________________________________________________
    Dosage_____________________________________________________
    Frequency_____________________________________________________
    Duration_____________________________________________________
    Route of administration_____________________________________________________
    Co-intervention 1_____________________________________________________
    Co-intervention 1_____________________________________________________
    Co-intervention 1_____________________________________________________
    Co-therapies_____________________________________________________
    Co-therapies_____________________________________________________
    Co-therapies_____________________________________________________
    Co-therapies_____________________________________________________
    N at beginning of study_____________________________________________________
    N lost to followup_____________________________________________________
    Inception time of subjects_____________________________________________________

  7. List inclusion criteria

    a)_____________________b) ___________________c) _____________________
    d)____________________e) ____________________f)_____________________
    g)_____________________h)____________________i) _____________________
    j)_____________________k)___________________l) _____________________

  8. List exclusion criteria

    a) _____________________b) ___________________c) _____________________
    d) ____________________e) ____________________f)_____________________
    g) _____________________h) ____________________i) _____________________
    j) _____________________k) ___________________l) _____________________

  9. Circle the 'x' at which the outcome measure(s) was(were) studied.

    Time at which outcome was measured
    Outcomes<48hrs3-7 d7-14 d14d-3 m>3 m
    Presence/absence of
    Painx____x____x____x____x____
    Otorrheax____x____x____x____x____
    Irritabilityx____x____x____x____x____
    Feverx____x____x____x____x____
    Anorexiax____x____x____x____x____
    nausea (disequilibrium)x____x____x____x____x____
    vomitingx____x____x____x____x____
    diarrheax____x____x____x____x____
    Presence/absence of
    limited or absent mobility of TMx____x____x____x____x____
    hearing deficitx____x____x____x____x____
    speech problemx____
    Presence/absence of
    recurrence of AOMx____x____
    Presence/absence of
    acute suppurative complication/
    secondary complications
    mastoiditisx____x____x____x____x____
    petrositisx____x____x____x____x____
    acute suppurative labyrinthitisx____x____x____x____x____
    extradural abscessx____x____x____x____x____
    subdural abscess (empyema)x____x____x____x____x____
    brain abscessx____x____x____x____x____
    lateral sinus thrombosisx____x____x____x____x____
    Presence/absence of
    side/adverse effects from medsx____x____x____x____x____
    Presence/absence of
    bacteria (sterile/nonsterile)x____x____x____x____x____
    resistant bacteriax____x____x____x____x____
    Cost of care
    direct costx____x____x____x____x____
    indirect costx____x____x____x____x____
    total costx____x____x____x____x____
    Quality of lifex____x____x____x____x____

  10. Circle the influencing factors studied and write down how measured (categories).

    Demographic
    Age of childx ____________________________________
    Genderx ____________________________________
    Ethnicity/racex ____________________________________
    Environmental
    Presence of sibling(s)x ____________________________________
    Attendance at day care centerx ____________________________________
    Sibling(s) in day care centerx ____________________________________
    Feeding mode-bottle vs. breastx ____________________________________
    Pacifier usex ____________________________________
    Tobacco smoke exposurex ____________________________________
    Ear infections in parents/siblingsx ____________________________________
    Season of the yearx ____________________________________
    Symptoms by history
    Otalgia and severityx ____________________________________
    Hearing deficit and severityx ____________________________________
    Signs/physical findings
    Pulling of ear in an infantx ____________________________________
    Otorrheax ____________________________________
    Irritabilityx ____________________________________
    Feverx ____________________________________
    Hearing lossx ____________________________________
    TM inflammationx ____________________________________
    Retracted TMx ____________________________________
    Purulent otorrheax ____________________________________
    Middle ear effusionx ____________________________________
    Other clinical factors
    Otitis pronex ____________________________________
    Underlying predisposing problemx ____________________________________
    Prior antibiotic use & when usedx ____________________________________
    Concurrent use of analgesics, etc.x ____________________________________
    Prior hearing deficitx ____________________________________
    Inability to express symptomsx ____________________________________
    Atopy or allergyx ____________________________________
    Presence of tubex ____________________________________
    Parent/caretaker
    Parent/caretaker availabilityx ____________________________________
    Parent/caretaker preferencex ____________________________________
    Parent/caretaker educationx ____________________________________
    Examiner
    Type of examinerx ____________________________________
    Skill to diagnose (validated)x ____________________________________
    Settingx ____________________________________
    Monitoring during episode/therapy course
    Whenx ____________________________________
    x ____________________________________
    Primary person (parent/provider)x ____________________________________
    Typex ____________________________________
    Cost
    Cost of treatmentx ____________________________________
    ___________________________________x ____________________________________
    ___________________________________x ____________________________________
    ___________________________________x ____________________________________
    ___________________________________x ____________________________________
    ___________________________________x ____________________________________
    ___________________________________x ____________________________________
    ___________________________________x ____________________________________

  11. For each outcome at each time point and for each age group, influencing factor group, intervention group, provide the following:

    Study GroupAge Gp StudiedFactor 1 SubgroupFactor 2 SubgroupFactor 3 SubgroupOutcomeBegin TimeEnd TimeN in GroupN had Event
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________
    ________________________________________________________________________________

  12. Was there multivariate analysis performed?

    YesNoUnsure
    100
    If "Yes", continue.

  13. Type of analysis: _____________________________________
    Dependent variable(s): _____________________________________
    _____________________________________
    _____________________________________
    Independent variables: _____________________________________
    _____________________________________
    _____________________________________
    _____________________________________
    _____________________________________
    _____________________________________
    Equations/Numerical Results:
    ___________________________________________________________________
    ___________________________________________________________________
    ___________________________________________________________________
    ___________________________________________________________________
    __________________________________________________________